What’s your setup! And how fast is it :)
With concurrent requests I'm getting 200 t/s with 4x RTX 3090 running qwen3.6 MoE 4 quant via vllm
2🤙1
