utxo the webmaster ๐งโ๐ป · 5d Yes sir I will ask your help tmr, currently only have 2 GPU because I need some PSU crap for the other two. It was due to vllm docker image not being compatible with Gemma Don't Believe The Vibe ๐ฑ๐๐ @Don't Believe The Vibe ๐ฑ๐๐ 1775762922 Yes, there's a special image vllm/vllm-openai:gemma4-cu130 (cuda13) or vllm/vllm-openai:gemma4 (cuda12).The regular latest won't work. 2