the weights you can verify if the env is fully reproducible
the local attack vectors are a problem, ideally you have a secure data center + tamper proof hardware.
its not a panacea but theres a huge difference between "i'm using random llm api provider (or a proxy to have even more hops that you ...