I looked for a non-janky sidebar/extension for Chromium to add LLM integration but came up short. So trying it out with Brave. It let's you add openai api-compatible endpoints, so I dropped in my loca...
Have you tried Ollama and Open-WebUI on NixOS yet? I just added it to my config a few days ago and some models work fine using CPU with no GPU.
1