Piriya ⚡🟧 on nostr

Open in Damus

@Piriya ⚡🟧 1713759278

I really need to get started on running LLMs and training my personal LLMs.
Where do I start? (aside from huggingface)
What hardware should I use?
What books should I read?

63❤️5🤙4

Piriya ⚡🟧 · 98w

nostr:npub1h8nk2346qezka5cpm8jjh3yl5j88pf4ly2ptu7s6uu55wcfqy0wq36rpev

Account deleted · 98w

You might want to check out Orca 2.

For running, I’m a big fan of ollama. https://ollama.com

You can use Ollama for inferring some playground models. It can run on both CPU and GPU. Python is required. Learn how to create the dataset (in ChatML format or completion format, for example). For fine tuning, if you have Nvidia GPU(s), try using Unsloth. As for me, I'm using my MacBook with t...

For running you want to use LM Studio. Open-source, Super easy, Supports all the main models...