Damus
ChipTuner · 5d
A "smart" decision based router unlocks better and possibly more dynamic pricing routes. The average home hoster is unlikely to be able to run more than a single usable model loaded at a time, and usually not more than a 1-3 concurrent KV caches. I don't think routerly alone solves this issue, but i...