Would you download a 2 GB LLM model and keep it saved in the phone to use inside of Amethyst?
Possibly! To what end? Is it strictly for text generation, or is it for categorizing and surfacing content?