What are the tradeoffs?

Sounds nice in theory to run it on a teeny system but that will require you to shift everything into the LLM. A good agent should have a lot of side processes for collecting and processing data for the LLM calls. Otherwise your token usage will be enormous. For sure the forks are on now that Sam Al...

It makes api calls how did they manage to fuck it up lmao