r/LocalLlama is the best resource for this question tldr: For agentic-type tasks in the background, probably an apple M series with lots of VRAM. And Qwen 3.5 27b has reached a level of agentic effectiveness that can run on a single 3090 that is kinda staggering (something like opus 4.1) rough bre...

mac mini or ryzen ai mini pc. running local models is empowering. ben says he got this for gaming but i see a server nostr:nevent1qqspk8t26lr94j2y92unrxmryvlr6w4fx0q03uftxdtqf6ajuzfv6lgzyqvcjq6w26u0vpk8yn695ykwsjs3sstzr2hhrq4p7ety8q9ecsnkkqcyqqqqqqgpz3mhxue69uhhyetvv9ujuerpd46hxtnfdu5ehhn7

Good idea 🤝

Used server off eBay. Mini pc lot + rack mount

mini pc with ryzen 9 ai max 395 max plus 128gb shared memory (Strix halo) Apple studio Mini pc with oculink pair it with a pro Nvidia gpu

intel is seriously competitive for price-to-VRAM, but i don't know about compatibility NVIDIA is usually the clear winner for performance, 5xxx series/blackwell has support for NVFP4 quantized models https://developer.nvidia.com/blog/introducing-nvfp4-for-efficient-and-accurate-low-precision-infere...

Nvidia DGX Spark hardware or any OEM version with GB10 Blackwell superchip! The community is growing and every week a new LLM with a better recipe is topping the leaderboard in performance: https://spark-arena.com

How much $$ you looking to spend?

How much VRAM? You think you need? Because more is always better.

A Time Machine !

A lot of Bitcoin people love Start9, I would personally recommend an Umbrel even though I don’t have one

Even old hardware would do. I’m using an MSI laptop from 2016 and it works really fine, although I’m running several containers on it, including Jellyfin which is for streaming. I haven’t got down to organizing my photos yet, but they require more processing power. So for something like Immich...

You'd think the industry got the message by now its worth it to re-architect their chips to optimize for large pools of RAM for single/small/personal systems. I think Apple stumbled into this corner semi by accident. Ive been digging into this from time to time, and there are plenty of things that ...

- Mac Pro M2 with a maximum 192GB of memory - Frame desktop with a maximum 128GB of memory

Whats "everything"? At this point I think I have at least 5 different machines running of various sizes from a rpi 3b to an older gamer PC of decent (but old) hardware to a high end (consumer) AI inference machine. Is it just self hosting everyday services? AI inference? Im currently testing out ...

My goal is to run EVERYTHING locally on my GrapheneOS device ✌

I'd buy a computer because a chainsaw and a big bag of nails perform horribly when it comes to running software on them.

canirun.ai here you can see what models you can run with different hardware, it's very useful

Shoes?

I run a Start9 node which I bought directly from Start9. I find the OS to restrictive so I will get a regular Linux distro on it and only run my own choice of open source [non Google, etc] software on it. I bought a Dell 5060 Micro i7 8th Gen Desktop refurbished with a couple of TB... cheap and fast...

Maybe check into system76.com if Linux is an option. I picked up a Thelio system with 98GB of memory after returning their MeerKat mini. The USB ports on the Mini after several days would just lose power and require a reboot. I spread various applications across different Virtual Machines. Lik...

just any x86 hardware maybe prefer AMD CPU before Intel, 64GB RAM Raid SSD or mirror boot SSD and for file storage lots of mechanical drives for non technical people #StartOS firmware would be best But you can also install everything on your own! you also need a Tunnel software on a decoy server so ...

https://www.youtube.com/watch?v=n43mPIT-7Co Here's a summary of the YouTube video comparing the performance of the DeepSeek R1 14B model on an Apple M4 Mac Mini versus a Dell R250 system: **Video Overview** The video compares the performance of the DeepSeek R1 14B model running on an Apple M4 Mac...

Raspberry pi5 ⚡️