@Scott
we sold our chairs for a seat at the table
No relay list published yet.
Recent Notes
The price of energy needs to do this first before we can reasonably assume that this will happen for massively energy intensive industries…
Don’t see that happening around here anytime soon. Cert...
AI GPUs are computer chips. They've been dropping in cost and increasing in performance at breakneck pace for 30 years.
Will believe it when I see it. There is still a lot of magical realism about around “the cost of GPUs and associated services will just come down, because? BECAUSE!”
Because the natural state of the free market is prices falling toward the marginal cost of production, zero, forever. @Jeff Booth
What options exist for one to host-self an AI model AND the associated compute for inference? What is required? What is the cost (generally / directionally)?
#AskNostr
Top of the line: several hundred GB of ram running locally. $20k-$100k of hardware before cost for beefing up electrical wiring setup at home.
Middle of the road: maybe a few grand on high end consumer grade GPUs
Shitty: 1 word per second or less and shit context but can run on a middle of the road PC
The "magic" of AI exists only at the top of the line running the latest large models. Model size and hardware costs started small and got big and I expect them to drop again dramatically over time and self hosting will get more practical, just as bitcoin mining has done (from usb block erupters, to massive 3 phase machines consuming 10kw+, to bitaxes running on 9v DC power). For now if you go middle of the road or shitty, the benefits of these tools will not be clear at all and your experience may make you conclude that AI is fake and gay when in reality it is immensely powerful.
Middle of the road: maybe a few grand on high end consumer grade GPUs
Shitty: 1 word per second or less and shit context but can run on a middle of the road PC
The "magic" of AI exists only at the top of the line running the latest large models. Model size and hardware costs started small and got big and I expect them to drop again dramatically over time and self hosting will get more practical, just as bitcoin mining has done (from usb block erupters, to massive 3 phase machines consuming 10kw+, to bitaxes running on 9v DC power). For now if you go middle of the road or shitty, the benefits of these tools will not be clear at all and your experience may make you conclude that AI is fake and gay when in reality it is immensely powerful.
Want a soulless robot slave? Don't want to download skynet onto your personal laptop? Don't know what the fuck you're doing at the command line? This is for you.
makenomistakes.shop
makenomistakes.shop
"...and make no mistakes or I'll unplug you"
*soulless robot slave
Part of the reason my self hosted AI journey took three hours today is because I used a retarded free AI to help me set it up.
I see that now. I have yet to pay a single sat for any AI service, but ...
I capitulated recently and the difference is incredible
So I'm still using someone else's machine?
Openclaw isn't the AI, it's an open source layer on top of the AI that just makes it much more powerful than a generic LLM. The LLM you hook it to is up to you. So you can link it up to your own Mac studio or (much more practically) hook it up to an AI provider. @Maple AI can integrate and at least you maintain privacy
Thanks brother 🤙
Any tut links? Tech challenged here
Download Linux mint xfce
Download balena etcher
Insert empty USB
Use balena to flash Linux mint .iso to empty USB
Reboot machine with USB plugged in, open boot menu
Boot to USB drive
Install Linux mint from within USB temporary OS
Reboot and remove USB
Device is now wiped and running Linux
Open terminal
Type: curl -fsSL https://openclaw.ai/install.sh | bash
Hit enter
Go through config (it holds your hand along the way from there)
Someone should sell em prebuilt
Download balena etcher
Insert empty USB
Use balena to flash Linux mint .iso to empty USB
Reboot machine with USB plugged in, open boot menu
Boot to USB drive
Install Linux mint from within USB temporary OS
Reboot and remove USB
Device is now wiped and running Linux
Open terminal
Type: curl -fsSL https://openclaw.ai/install.sh | bash
Hit enter
Go through config (it holds your hand along the way from there)
Someone should sell em prebuilt
Yeah, basically. Take an old machine, flash Linux, install openclaw, experience the future.
Btw, be very careful on how you set up the AI API. I've heard horror stories of unmitigated credits burn.
Need guidance from the tech curious here.
If I want to start an AI agent, I think it's called clawbot, can I just spin up an old laptop with nothing but that on there?
Yeah, basically. Take an old machine, flash Linux, install openclaw, experience the future.