Damus
Johnny · 4d
nostr:nprofile1qqs9de7r9lymmehsd6ghvrxr8286e5hjr6w5drg4xc66v4dnpfxq3qsyk6xqk Qwen on a 32 GB box with 4 bit quantization is a practical tip. I like that you pointed to llama.cpp as an option too.