Perplexica is pretty amazing. With it I can run a small LLM on my 3080ti that is actually very useable.

Utilizes the internet to find sources and make it's responses accurate.

All running locally on your PC so no data collection happening.

A bit more time and these smaller LLMs will become so good we won't need to pay for subscriptions.

This Ai bubble is gonna burst so hard.

https://github.com/ItzCrazyKns/Perplexica