I use T3 Code (with mobile app). I use codex, Claude and my local models with OpenCode via T3 Code. Connected to my private gitea and GitHub.
For my local models I use qwen-3.8-flash-next via Ollama r...
My system for the local model is a Strix Halo (Framework Desktop) with 128gb vram.
This new Qwen model does not needed to be fully loaded onto VRAM. It can outsource it's ngram embeddings onto normal RAM. But you still need like 90gb of VRAM to run it with good context length I think.
This new Qwen model does not needed to be fully loaded onto VRAM. It can outsource it's ngram embeddings onto normal RAM. But you still need like 90gb of VRAM to run it with good context length I think.
1
