Qwen models are nice for local coding, but the sizes you can realistically run locally are at least two generations behind. But they are not completely useless.
What size is useful for what tasks?
Looking for some usecases for max 12b models (works on my Air).
Found just one - summarisation of meetings transcriptions.
Even MCP tools calling is very unreliable with models of this size.
Looking for some usecases for max 12b models (works on my Air).
Found just one - summarisation of meetings transcriptions.
Even MCP tools calling is very unreliable with models of this size.