Run your own private Local AI at home with no drivers, no configuration, and no command line.

Watch @Nathan Fretz ☂️ run a local AI model on an AI PC and a mini PC running umbrelOS, then plug in an eGPU and go from 7 to 70 tokens/sec instantly.

https://www.youtube.com/watch?v=yVF1oSQKk-A