considering buying hardware to run everything locally. Would should I buy? #asknostr
intel is seriously competitive for price-to-VRAM, but i don't know about compatibility
NVIDIA is usually the clear winner for performance, 5xxx series/blackwell has support for NVFP4 quantized models
https://developer.nvidia.com/blog/introducing-nvfp4-for-efficient-and-accurate-low-precision-inference/
but you could also do like, multiple 3090s or something
hope this helps
NVIDIA is usually the clear winner for performance, 5xxx series/blackwell has support for NVFP4 quantized models
https://developer.nvidia.com/blog/introducing-nvfp4-for-efficient-and-accurate-low-precision-inference/
but you could also do like, multiple 3090s or something
hope this helps
2
