Damus

Recent Notes

ly · 14w
NixOS is cool but Arch is fine too. I use both.
TheFuzzStone · 14w
Yeah, I know about NisOS and the new junkies/fans of that distro. I have: 1 Thinkpad + 1 GrapheneOS = I don't need to keep in sync multiple PCs/laptops. The second thing - my FrankenArch doesn't break. Don't the screenshot you can see the amount of days I use Arch, and nothing has broken since the...
AlexAnarcho profile picture
Considering building my own AI server.

Does anybody have experience with this?

Do I need to get nvidia gpus?

I m thinking of buying a macmini with maximum RAM, installing NIXOS with asahi and then using it as a server in a private network.

Help is appreciated. #asknostr
41
sister_sam · 14w
There is more stuff I believe that supports NVIDIA. If you can afford it then a gaming rig with a 4090. Mine was $3100 a couple of years ago. If that is a bit too rich consider the 3090 GPU that also has 24 GB of VRAM. But you can run some models with less. It really depends on what you want a...
Juraj · 14w
Asahi will not support apple silicon (mlx) inference, macos is not optional, but you can ssh into it and run it as a server. NVIDIA - the main parameter to look for is vram. 4090 with 24GB is not very useful for inference of the largest models. Look at amd with integrated ram and vram (that's wh...
TheFuzzStone · 14w
If I put everything I need into Hyprland, I simply get bad working Plasma. And KDE Connect... 😌 (you can't have it with Hyprland, except some basic functionality)
AlexAnarcho · 15w
I use NIXOS + Hyprland BTW
SpontaneousOrder · 15w
Konnte es mir nicht geben wegen Niki… Elias Gudwis argumentiert vielleicht noch schärfer (gegen veganismus)
Schroedinger · 19w
Frohe Weihnachten