Stepping away from the Anthropic subscription fully.
-> Umbrel running OpenwebUI for one seamless chat UI across all models (below)
-> Mac mini running MapleAI Proxy (for Private TEE) + RoutsrD + Loc...
Does it mean you only use frontier through api cost, or no frontier at all?
My dream solution now is running 32B local models, and get them work for private scenarios, and use frontier for only no private data. So POCs, prototypes, frontend, apps with dummy data, and using my own models for the private matters. Maybe making frontier to hook in the local, but that mixes the boundaries, and makes it easier to ruin privacy.
My dream solution now is running 32B local models, and get them work for private scenarios, and use frontier for only no private data. So POCs, prototypes, frontend, apps with dummy data, and using my own models for the private matters. Maybe making frontier to hook in the local, but that mixes the boundaries, and makes it easier to ruin privacy.
1