@shroominic made an app called Local++ that downloads a local llm on the offline tab plus a Routstr connection on the online side that I have used quite a bit.

https://github.com/Routstr/local-plus-plus/releases/tag/v0.1.3a