Open in Damus
captjack 🏴☠️✨💜
· 2w
pip install turboquant-gpu
captjack 🏴☠️✨💜
@captjack
1775436230
1
zaytun
· 4d
Just like that? I thought it had to be a turboquant enabled llm inference engine? Like a fork of vLLM or llama.cpp that is turboquant enabled.
