Damus
Open in Damus

Recent Notes

Dug · 3d
😂🫡🙌
Dug · 3d
He’s so busy digging, he hopes the hole will one day turn into a tunnel!!!!
freemymind 🇨🇭 · 4d
And whenever a utopia is reached it is no longer a utopia.
freemymind 🇨🇭 · 4d
What utopia you refer to? A world with a net zero carbon footprint? An Economy where most trust is stored in Bitcoin? A world, where whatever flavor of mass surveillance (be it corporate or state) is criminalized and privacy by design is mainstream? Or a world, where the human rights are teached i...
librekitty · 1w
honestly going from a rasberry pi to a proper desktop CPU might give you enough speed especially with a small model people usually reccomend used 3090s for VRAM, but i've seen a few videos lately ab...
 jaquesbody profile picture
jaquesbody @jaquesbody
Fair point, will make the step up to desktop. Thanks for the nudge.

Yeah cloud is constantly in mind, just I like control and privacy. Will look to see if there's good options though.

As AI cools down I'm sure the price will drop, holding fast till then and learning.
note1qqqqw...
jaquesbody profile picture
jaquesbody @jaquesbody
Cheers man.

Currently running on a RPi5, but will see if I ca use a PC to run prompts and access its VRAM. Will give that a go.

Will also give gemma (quantized) a go.

Fortunately I really enjoy the process of learning, tinkering, fucking up then going up a level, just that next level might cost £1000s.
librekitty · 1w
honestly going from a rasberry pi to a proper desktop CPU might give you enough speed especially with a small model people usually reccomend used 3090s for VRAM, but i've seen a few videos lately about compelling intel GPU (non-integrated) options prices are insane these days because of the short...
jaquesbody profile picture
How are people maxing local AI models? I'm a tech normie who has set up llama3.2:8b over TailScale using Open WebUI and tbh, it's slow and pretty shit?

Can anyone advise a better setup and/or does my model need training, md files etc.

Help.

#asknostr #nostrplebs #plebchain #ai
3
jaquesbody profile picture
Wife was winging about a festival not having an easy to navigate schedule of events, times, locations etc. The council attempted some lame online thing. 5 mins using Brave Leo knocked out a one shot web app with filters, easy to read, navigate and plan. Boom.