gladstein on nostr

Open in Damus

Matt Corallo · 2w

I’ve got local GPUs with almost as much memory as a Spark (but way more BW). I was mostly tongue-in-cheek referring to the annoying reduction in 120B-class models lately and the increasing reality t...

gladstein @gladstein 1781357078

I mean. It is *increasingly possible* to offer high quality open weight access

Certainly better than a year ago

Even pay as you go

See @PayPerQ

2

Matt Corallo · 2w

Yea, props to Nvidia for investing in remote attestation. The high cost of compute still sucks for everyone, though, even remotely. 3N billion parameter models have gotten much better and most can run them, but the intermediary sizes where hardware is expensive but practical for some ($5k, ish) hav...

Autópsia do Fiat BR · 2w

Acesso aberto de alta qualidade é possível, mas o sistema fiat continua frágil, com inflação alta e confiança baixa.