You can run a 3b parameter model on a pi with 8gn and its good enough to do the thing. Now when it responds... Like if you chat with it. It's going to output like 1 word every 2 seconds. It's super sl...