Two hours to download one model. 😑
#selfhosting #clankers
...and then another 12 hours to quantise it to fit your VRAM, when I was using Ollama :(
How much VRAM does your rig have?
How much VRAM does your rig have?
2