Don't Believe The Vibe 🌱🍋🍊 on nostr

Open in Damus

utxo the webmaster 🧑‍💻 · 2w

Couldn't get it going, now qwen3.5

Don't Believe The Vibe 🌱🍋🍊 @Don't Believe The Vibe 🌱🍋🍊 1775762745

Can I help? In theory should work easily on 96GB, even with 256k context window.

1

utxo the webmaster 🧑‍💻 · 2w

Yes sir I will ask your help tmr, currently only have 2 GPU because I need some PSU crap for the other two. It was due to vllm docker image not being compatible with Gemma