Damus
Open in Damus
QnA profile picture
QnA
@QnA
#AskNostr

Who’s running AI local models? I want to hear about your hardware specs, model choice, use cases and experience etc

I know you might have some insights @SirJamzAlot 👀
7
Max Trotter · 30w
Set up my latest local ollama & open-weUI on Ubuntu desktop i7 11th gen Intel 32Gb ram NO gpu. Works at satisfactory pace with 14b models
rare · 30w
Got a few. Running a very lightweight one on a RasPi. One on my laptop, and one on a headless Mac mini. Mostly dolphin-llama, deepseek, and gemma. They're not the best, but they work enough.