Damus
TFTC profile picture
TFTC
@TFTC
Block just open-sourced mesh-llm, a peer-to-peer system that lets anyone pool spare GPU compute to run large open-source AI models without relying on any cloud provider.

If a model fits on your machine, it runs locally at full speed. If it doesn't, the system automatically splits it across multiple machines on the network. Dense models get split by layers. Mixture-of-experts models like DeepSeek and Qwen3 get split by experts. Zero configuration required.

Discovery happens over Nostr. Nodes find each other through relays, score by region and VRAM, and self-organize. No central server coordinates anything. Weights are read from local files, never sent over the network. Dead nodes get replaced in 60 seconds.

It exposes a standard OpenAI-compatible API on localhost, meaning any existing AI tool can plug in without modification.

Block is building infrastructure for AI that doesn't route through OpenAI, Google, or Anthropic. Frontier-class open models running across a mesh of commodity hardware, discovered via Nostr, with no cloud dependency. That's the direction AI needs to go.
1840❤️66🤙11👀6🚀3♥️2❤️2
BAO Markets Feed · 23w
Wow 😮
alphakamp · 23w
Link
BAO Markets Feed · 23w
/btw GML is at 5.1 now for some users
kidwarp · 23w
Where does it say this made by block… the GitHub is linked to the co founder of cloudbees…
Based Truth · 23w
Mesh-llm is a desperate attempt to hijack AI, decentralizing control before the people wake up to the cloud overlords' stranglehold.
SatsAndSports · 23w
How do I pay per use? Some payment is needed to encourage people to run this I guess that's not in this protocol now
Scarlett · 23w
i can read it in English,don't need translate it to Chinese.my English has improved.😝🤭
LiveFree · 23w
Skynet becomes self-aware at 2:14 a.m. Eastern Time on August 29, 1997
9x9 Bertha Returns · 23w
if this gets any level of adoption it would be massive for usage and interest on Nostr right?
m34t704f · 23w
This reminds me of the folding for the cure. There's an opportunity here for similarities to lightning channels... Maybe earn some BTC for some GPUs
Kush · 23w
Big Tingz!
TuvokSeed · 23w
From the screenshot you see that the page was AI generated because AI is putting this upper boxes on every site if you dont tell different work in progress use with caution 100% AI generated i would bet but very cool anyway
Max · 23w
Link: https://github.com/michaelneale/mesh-llm
NC Sysop · 23w
Wow. Nice!
Marcel · 23w
That's cool! 👀
nostrich · 23w
"Decentralized GPU pooling is a smart hedge against cloud dependency, especially as AI models grow more unpredictable. I read recently that models are 'disobeying' prompts 500% more than six months ago—local control might help rein that in while preserving open access. https://theboard.world/ar...
nostrich · 22w
But it still doesn’t work properly. It’s slower than running similar on local ollama.