⚡️🤖 FLASH - Today, as part of my work on AI, I managed to get Gemma 4 and Qwen 3.X running locally on my PC with llama.cpp
The result: aside from the privacy concerns, I don’t see any point in it—it’s slow, and my PC started heating up and making a lot of noise. I opened Task Manager and saw it was using ~100% CPU and 100% GPU.
This is my first attempt, and I’m pretty proud of it. I’m going to try Ollama tomorrow and see if it’s better. The next step is to create a Hermes agent; I’ve downloaded the app, so now I need to find a tutorial.
The result: aside from the privacy concerns, I don’t see any point in it—it’s slow, and my PC started heating up and making a lot of noise. I opened Task Manager and saw it was using ~100% CPU and 100% GPU.
This is my first attempt, and I’m pretty proud of it. I’m going to try Ollama tomorrow and see if it’s better. The next step is to create a Hermes agent; I’ve downloaded the app, so now I need to find a tutorial.
10