⚡️💻️🤖 What is the best AI model to run on a standard PC (32 GB of RAM + 8 GB of VRAM)? And are there any alternatives to Ollama? https://blossom.primal.net/170cb93f5acfee3d8888767498f7d4b8...
Yes lama.cpp and 8gb pretty tight for anything good tbh, try bonsai 27b, maybe 2 or 4q
❤️2