These guys are doing some really interesting research to losslessly compress larger models to work well on your phone.

I’ve played around with their models and they work quite well.

https://prismml.com