Damus
gladstein · 2w
Directionally that is the goal, funding local inference For now we are testing TEE with a few dozen people on a beast setup that we will soon upgrade to Kimi 2.7 Meanwhile you can do a surprising a...
Matt Corallo profile picture
I’ve got local GPUs with almost as much memory as a Spark (but way more BW). I was mostly tongue-in-cheek referring to the annoying reduction in 120B-class models lately and the increasing reality that not many can afford to access frontier models lately.
2
Matt Corallo · 2w
(btw Sparks are way overpriced for what they offer, really shouldn’t buy those at this point!)
gladstein · 2w
I mean. It is *increasingly possible* to offer high quality open weight access Certainly better than a year ago Even pay as you go See nostr:npub16g4umvwj2pduqc8kt2rv6heq2vhvtulyrsr2a20d4suldwnkl4hquekv4h