I mean. It is *increasingly possible* to offer high quality open weight access
Certainly better than a year ago
Even pay as you go
See nostr:npub16g4umvwj2pduqc8kt2rv6heq2vhvtulyrsr2a20d4suldwnkl...
Yea, props to Nvidia for investing in remote attestation. The high cost of compute still sucks for everyone, though, even remotely.
3N billion parameter models have gotten much better and most can run them, but the intermediary sizes where hardware is expensive but practical for some ($5k, ish) have seen a drop off in investment as more compute goes into the frontier sizes.
3N billion parameter models have gotten much better and most can run them, but the intermediary sizes where hardware is expensive but practical for some ($5k, ish) have seen a drop off in investment as more compute goes into the frontier sizes.
1