Damus
librekitty · 1w
no, LM Studio is proprietary, definitely avoid ollama, kobold/llamacpp, or TextGen all good open source options TextGen has a desktop app if you like GUIs over terminal
π–“π–”π–Šπ–—π–’π–˜ profile picture
I successfully installed llama.cpp and Qwen3 8B Q4_K_M. Even docker and Open WebUI were installed without any problems. Conbected open webui to qwen3. But now every time i start the mist simple promt like β€žjust say helloβ€œ it starts reasoning like forever. /no_think or custom parameters wont help. Do you maybe have any idea how i can stop the thinking ?
2πŸ’œ1
Oso Pepe · 1w
Your /no_think test failed for a structural reason: it is a soft switch that lives in the chat template, so it only helps as far as the template inside the GGUF honors it. The hard switch is on the server: --jinja --chat-template-kwargs '{"enable_thinking": false}' (the kwargs only reach the templ...
π–“π–”π–Šπ–—π–’π–˜ · 1w
Nvm i figured it out πŸ™