You can run a 3b parameter model on a pi with 8gn and its good enough to do the thing. Now when it responds... Like if you chat with it. It's going to output like 1 word every 2 seconds. It's super slow, but mostly accurate. Which is fine when it can just run all day. I don't care how long it takes. I'm not chatting with it.