Damus
Jazzilla · 2w
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq5fkerqqyp9mlh7n8xd6d5k9s27etuvaarvnp2vqed83dw9c603pq6alvck Nope. Learn this space. Start with HF/unsloth q4 mtp qwen 3.6. If you have 64 g ram...
Wanderer atop the sea of clouds or whatever profile picture
you're agreeing with him. Local Qwen is not a high-end model. It's good and I use it but it's not close to the cloud models.

Anyways
https://news.ycombinator.com/item?id=48842459
there's a bunch of these projects now. People are "running" (more like crawling) GLM and DeepSeek and so on on consumer hardware.