AlexAnarcho on nostr

@AlexAnarcho 1769319387

Considering building my own AI server.

Does anybody have experience with this?

Do I need to get nvidia gpus?

I m thinking of buying a macmini with maximum RAM, installing NIXOS with asahi and then using it as a server in a private network.

Help is appreciated. #asknostr

4❤1

sister_sam · 3w

There is more stuff I believe that supports NVIDIA. If you can afford it then a gaming rig with a 4090. Mine was $3100 a couple of years ago. If that is a bit too rich consider the 3090 GPU that also has 24 GB of VRAM. But you can run some models with less. It really depends on what you want a...

Juraj · 3w

Asahi will not support apple silicon (mlx) inference, macos is not optional, but you can ssh into it and run it as a server. NVIDIA - the main parameter to look for is vram. 4090 with 24GB is not very useful for inference of the largest models. Look at amd with integrated ram and vram (that's wh...