Folks what questions do you have for this week’s #FreedomTechFriday?
Want nostr:nprofile1qqs936kc97s4k4gqjnmltljgqns0uadh08d77t5mypg3anxkneks37gpzemhxue69uhhsmtj9e6hxetwdaehgu3wdaexwqguwaehxw309ah...
I like the idea of using a local 8B LLM on my laptop.
What’s the best way to add a web search layer on top of a model running f.e. in Ollama? Are there any standard good solutions?
I tried using RAG (Retrieval-Augmented Generation) myself, but it didn’t work as expected. Even using a separate embedded context LLM beforehand didn’t have the desired effect.
What’s the best way to add a web search layer on top of a model running f.e. in Ollama? Are there any standard good solutions?
I tried using RAG (Retrieval-Augmented Generation) myself, but it didn’t work as expected. Even using a separate embedded context LLM beforehand didn’t have the desired effect.
❤️2🤙1
