Buy a used nvidia rtx titan v (24 GB).

https://www.nvidia.com/en-us/products/workstations/dgx-spark/ If you got the bread

https://open.spotify.com/episode/3bEF157FM2F0O3kCJ9zYBF?si=NcPJfFsGQieY9Pqrn17ucw Somewhere in this episode Alex Finn describes his 24/7 coding OpenClaws with opensource models. Of course the latency for conversations will be terrible, but tasks without time pressure can be handled well by this setu...

macbook pro with as much ram as you can justify. if you're putting it on a desk / in a server room, mac studio with the same. it sounds like a fanboy take, but nvidia cards carry a stiff premium right now and are somewhat skimpy on memory, while people keep finding ways to get more out of mac hardwa...

r/LocalLlama is the best resource for this question tldr: For agentic-type tasks in the background, probably an apple M series with lots of VRAM. And Qwen 3.5 27b has reached a level of agentic effectiveness that can run on a single 3090 that is kinda staggering (something like opus 4.1) rough bre...

mac mini or ryzen ai mini pc. running local models is empowering. ben says he got this for gaming but i see a server nostr:nevent1qqspk8t26lr94j2y92unrxmryvlr6w4fx0q03uftxdtqf6ajuzfv6lgzyqvcjq6w26u0vpk8yn695ykwsjs3sstzr2hhrq4p7ety8q9ecsnkkqcyqqqqqqgpz3mhxue69uhhyetvv9ujuerpd46hxtnfdu5ehhn7

Good idea 🤝

Used server off eBay. Mini pc lot + rack mount

intel is seriously competitive for price-to-VRAM, but i don't know about compatibility NVIDIA is usually the clear winner for performance, 5xxx series/blackwell has support for NVFP4 quantized models https://developer.nvidia.com/blog/introducing-nvfp4-for-efficient-and-accurate-low-precision-infere...

Nvidia DGX Spark hardware or any OEM version with GB10 Blackwell superchip! The community is growing and every week a new LLM with a better recipe is topping the leaderboard in performance: https://spark-arena.com

A Time Machine !

A lot of Bitcoin people love Start9, I would personally recommend an Umbrel even though I don’t have one

Even old hardware would do. I’m using an MSI laptop from 2016 and it works really fine, although I’m running several containers on it, including Jellyfin which is for streaming. I haven’t got down to organizing my photos yet, but they require more processing power. So for something like Immich...

You'd think the industry got the message by now its worth it to re-architect their chips to optimize for large pools of RAM for single/small/personal systems. I think Apple stumbled into this corner semi by accident. Ive been digging into this from time to time, and there are plenty of things that ...

- Mac Pro M2 with a maximum 192GB of memory - Frame desktop with a maximum 128GB of memory

My goal is to run EVERYTHING locally on my GrapheneOS device ✌

canirun.ai here you can see what models you can run with different hardware, it's very useful

Shoes?

I run a Start9 node which I bought directly from Start9. I find the OS to restrictive so I will get a regular Linux distro on it and only run my own choice of open source [non Google, etc] software on it. I bought a Dell 5060 Micro i7 8th Gen Desktop refurbished with a couple of TB... cheap and fast...

Maybe check into system76.com if Linux is an option. I picked up a Thelio system with 98GB of memory after returning their MeerKat mini. The USB ports on the Mini after several days would just lose power and require a reboot. I spread various applications across different Virtual Machines. Lik...

just any x86 hardware maybe prefer AMD CPU before Intel, 64GB RAM Raid SSD or mirror boot SSD and for file storage lots of mechanical drives for non technical people #StartOS firmware would be best But you can also install everything on your own! you also need a Tunnel software on a decoy server so ...

https://www.youtube.com/watch?v=n43mPIT-7Co Here's a summary of the YouTube video comparing the performance of the DeepSeek R1 14B model on an Apple M4 Mac Mini versus a Dell R250 system: **Video Overview** The video compares the performance of the DeepSeek R1 14B model running on an Apple M4 Mac...

Raspberry pi5 ⚡️