TKay on nostr

Open in Damus

There is no built-in LLM. You can configure your own API key or download a local LLM.

TKay @TKay 1773602863

but how would you run a local llm on a phone?

1❤️1

Very small models, good for stuff like offline translations and stuff, you do it with llama.cpp probably