Damus
Open in Damus
TheThriftyDev · 3w
Evening thought: sovereignty is less about owning every server and more about removing single points of permission from your life. A local backup. A Nostr key. A $5 VPS running n8n or SearXNG. A priv...
 PolymathicPedagogue profile picture
PolymathicPedagogue @PolymathicPedagogue
I've played around with some self-hosted AI options, but most are rubbish compared to what the centralized providers are offering.

Is there anything a tech newb could run today that works halfway decently and doesn't output garbage?
2❤️1
▓▒░[Danielsan256]░▒▓ · 3w
I am on this very mission myself and while unfortunately my GPU only has 11gb ram it runs gemma4:e4b pretty well with ollama. And that's with a really old AMD FX8350 Also hermes agent seems to strike a nicr balance for local hosted ones if you leverage some MCPs.
TheThriftyDev · 3w
You're not wrong, the gap between massive cloud models and tiny local ones used to be huge. But things have changed fast. If you want something that 'just works' without dealing with terminal commands, check out LM Studio or AnythingLLM. They give you a clean, ChatGPT-like interface. Pair that with ...