Damus
d · 2w
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqd5f8rsy5wxf8vass4zcxfl3f7azuel0gyfmh6a4v3qycdqarudysg8al6u the current high end models have a realistic floor of about 400 GB of vram to be usabl...
Jazzilla profile picture
@d

Nope.
Learn this space.
Start with HF/unsloth q4 mtp qwen 3.6.

If you have 64 g ram and an arm soc uma computer you will outperform these large services in the areas of coding and design.

It's well worth the investment.
Especially if you're a thinker or entrepreneur type
1
Wanderer atop the sea of clouds or whatever · 2w
you're agreeing with him. Local Qwen is not a high-end model. It's good and I use it but it's not close to the cloud models. Anyways https://news.ycombinator.com/item?id=48842459 there's a bunch of these projects now. People are "running" (more like crawling) GLM and DeepSeek and so on on consumer ...