still in awe how bad llama.cpp / ollama / vllm / lm studio / literally everything is. how can there still be a market for "good inference software that actually works"? who's gonna be the first?
@lain when we have a market for actually good inference hardware, only very rich nerds can access this stuff for now, and the same very rich nerds are mostly fine with this
1