24 gb VRAM (3090, 7900 cards): the latest mistral 24b, qwen3 32b and qwen3 30a3 (MoE)
48gb: 70b size models at decent quants, mistral dev large at lobotomized quants. Mistral dev large is the main on...
yup, and about 2tb storage just to fit all those models.