Juraj
· 3w
Asahi will not support apple silicon (mlx) inference, macos is not optional, but you can ssh into it and run it as a server.
NVIDIA - the main parameter to look for is vram. 4090 with 24GB is not ve...
Thank you so so much for this detailed reply! Very insightful