Damus
Open in Damus
lain profile picture
lain
@lain
still in awe how bad llama.cpp / ollama / vllm / lm studio / literally everything is. how can there still be a market for "good inference software that actually works"? who's gonna be the first?
1
:blank: · 2d
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqv57dpglku0evttjz8r8vdn3j7jwx4f4lztdaucj8tzt0urq3qleq7dthtd when we have a market for actually good inference hardware, only very rich nerds can access this stuff for now, and the same very rich nerds are mostly fine with this