I added support for Ollama to the demo Inference Provider API chrome ext, so now you can try out the demo ext and web app using local models on your machine.




If you are interested in this proposed browser standard, please try it out and let me know if you have any feedback. This makes building web apps powered by LLMs so much easier. If you take a look at the web app code, it's a single HTML file with no dependencies and the code is pretty simple while allowing users to use OpenAI or Ollama to power the app.

https://github.com/SamSamskies/inference-provider-api