Mayank ☂️ on nostr

Recent Notes

The performance depends on the hardware you use. If you have access to more powerful hardware, you can run 13B and 70B models by following the instructions here: https://github.com/getumbrel/llama-gpt

blank · 131w

Can it run any llama2 fine tuned model?

Mayank ☂️ @mayank 1692211268

Currently it uses the Nous Hermes Llama 2 (7B). If you’re technical, you can customize the Dockerfile to run a different Llama model: https://github.com/getumbrel/llama-gpt/blob/c76225a6fc26a000fc07b074223a69b0d65b7bcf/api/Dockerfile#L6

blank · 131w

That is pretty cool but will wait for it to be fleshed out a bit more. Would be interesting to see how this eventually combines with home assistant and whisper. Can steal some good ideas from in regards to models and characters etc. https://github.com/oobabooga/text-generation-webui

note1u627l...

Mayank ☂️ @mayank 1692211141

It may just be taking a long while to download (since the app’s ~5.5GB). Also, can you confirm if you have at least 6GB of total RAM on your system?

sudocarlos · 131w

going to start fresh and try again

note1ja5fl...

Mayank ☂️ @mayank 1685459436

Ah sadly we weren't able to set up Bitcoin payments with our current payment processor (Stripe) for the initial launch, but there will be a custom checkout experience for Bitcoin/LN payments down the line. We'll announce it as soon as it's available!