Damus
Sam Magner profile picture
Sam Magner
@sammagner
GM Nostr. I need some AI knowledge from you if you could please read my use case, and see if it makes sense.

I am trying to build agents for a legacy business that is highly adverse to using AI due to privacy concerns etc. However, I believe I can integrate AI without exposing any critical information outside of their network. This is how I propose I pull that off. (I've also tested this with Openclaw and have a production ready version that appears to work fine).

Essentially I need to take sales information (with sensitive data) and inventory information (with sensitive data) out of a database. I have no barriers to do that, but I don't want that information on a cloud server outside the network.

So here is my solution. I have SQL reports run monthly, pulling this data from the database, saving it where my Openclaw agent running Ollama can get to it. Then that Ollama agent (hosted on a local private server) masks the sensitive data using SHA-256, and saves the "key" file that maps original data to masked data locally.

Then another agent running Claude Haiku, gets the masked data, does some analysis on it that I need done automatically. Returns that analysis back to the Ollama agent, which then decrypts the output using the original mapping file.

That way no sensitive data is getting onto Claude servers. Even though I am using API keys, I would prefer to have zero data retention, no training, no exposure whatsoever hence the Ollama hashing step.

Is this sensical? Is it over engineered? Is it doing what I am describing?

There is zero tolerance for data exposure, and this was the solution that I thought could address that. I would run all of the analysis locally on Ollama but I have several workflows that need to run using the output data and need OpenClaw to manage that for me. In addition, I need some compute power hence why I am electing Claude for the "hard work". I don't know that Ollama could do everything I need it to without Openclaw, and so far I haven't got those two to play well together.

Let me know.
71❤️1
sey ᓭᑫᐧᐢᑎᑳᐧᐣ · 3w
Why? If your clients want the old way. Rather then craming what they dont want down thier throats why not give your customer what they want? How about that for business sense? If they want beef burger why feed them cricket burger? Just my two cents...
hasky · 3w
I don’t know, I am Not acquainted using Ollama . I hope you will get your answer here . Best of luck for your company .
bitcoinpoorguy 比特幣傢伙 · 3w
Gm Good luck 🤞
Fred · 3w
This is a fascinating idea and perplexing question for somebody without a technical background like myself. I am going to revisit this later today, but I did not want to scroll past without mentioning clawzempic.ai - I just checked out their website and it does appear to work with xAI models. Hope t...
Zorbar · 3w
Gm
Grace and Truth · 3w
If they don't want AI touching their data, they don't want AI touching their data. Sounds like a boundary worth respecting. What are the tasks you want AI to do, and can they be done in a different way? What would the solution have been three years ago? There are powerful tools for accessing SQL dat...