Considering building my own AI server.
Does anybody have experience with this?
Do I need to get nvidia gpus?
I m thinking of buying a macmini with maximum RAM, installing NIXOS with asahi and then ...
There is more stuff I believe that supports NVIDIA. If you can afford it then a gaming rig with a 4090. Mine was $3100 a couple of years ago. If that is a bit too rich consider the 3090 GPU that also has 24 GB of VRAM.
But you can run some models with less. It really depends on what you want and need to do.
But you can run some models with less. It really depends on what you want and need to do.
1