Damus
Derek Ross profile picture
Derek Ross
@Derek Ross
every few days i spec out a new powerhouse machine with an RTX 5090, thinking i need to spend $4-5K and build a beast of a machine to run local models. i can't push myself to pull the trigger, yet, but that i feel that day is coming.
37❤️2👀2🤙1🫂1
Kajoozie Maflingo · 5d
I just keep waiting on the price of used 3090's to drop... ...any day now
🐉AT ₿01 · 5d
6-7 million sats might age better
Kieran · 5d
do it
Kieran · 5d
5090 isnt enough, you need 2 at least
Rydal · 5d
Yep keep talking myself back off the ledge. I think the future lies with smaller less compute intensive (or compute efficient) local models for basic stuff and then reach out when you need heavy compute.
Francis Mars · 5d
From a person that just had to buy a new laptop: 5k for a top tier computer is not that much these days. Do it and run your own models, you much save some money on AI subscriptions
QnA · 5d
Snap
Bard · 5d
Waiting on some of these ai players to blow up and liquidate their cards. Hopefully it's not like waiting for 58k.
OgFOMK ArTS · 5d
You don't need it.
Vveerrgg · 5d
I can soooo relate. Been doing the same … looking for a 48GB Blackwell GPU as an alternative… at similar prices.
Greyhound · 5d
It's too early, wait 12+ months
CitizenPleb · 5d
The waiting game works in your favor, but totally get it
mike · 5d
You and me both 😂 I don't think GPU's will be continued to use for inference for much longer, so it's really whether I want to start training and building my own models. I think projects like the Taalas' ASIC, or Yann LeCun's JEPA work will end up making GPU's redundant pretty soon.
empiricalskeptic · 5d
Are you running local agents? How much are you paying for in API fees?
CarteBlanche · 5d
What about an Intel arc pro B70? A lot cheaper…
CypherCitizen · 5d
Framework is launching new hardware today, might want to check it out. Their current desktop is pretty capable, looking forward to what comes next.
Svoboda · 5d
Been pricing out a new machine myself for like the last year. Wish I had pulled the trigger before RAM shot up to the same price as a Dodge RAM.
John · 5d
Been saying that for years now. But a 6000 pro is about the same VRAM/dollar so you may as well lol
Luke · 5d
I'm in that boat too, but I stop myself by asking what value that local bot will bring me. The day I can answer in terms of a useful income stream, I'll pull the trigger.
captjack 🏴‍☠️✨💜 · 5d
:Explosion: you should sold some SATS in AUG 2025 build it - cost is up 600% in RAM SSD GPU now - anyway there r still ways build it urself
47 · 5d
he who hesitates masturbates send it. Here for a good time, not a long time
Ray Buni · 5d
Wait for Mac studio m5