This repo: https://github.com/mudler/localai You can pick and install many backends and models, some of them very lightweight are prefixed vits piper, there are many languages