Running Vicuna chat bot on my Qubes laptop with only a CPU.
It works!!
But incredibly slow, about one minute per token.
https://vicuna.lmsys.org/
It works!!
But incredibly slow, about one minute per token.
https://vicuna.lmsys.org/
1
