Local AI on a PS5
A jailbroken PlayStation 5 is now running llama.cpp as a native app that uses the GPU. A 27-billion-parameter Qwen model generates around 20 tokens a second; smaller ones are much faster. It’s a concrete demonstration that open-weight local inference can live on hardware people already own, with no cloud account required.
https://github.com/cobanov/PS5LM #opensourceAI
A jailbroken PlayStation 5 is now running llama.cpp as a native app that uses the GPU. A 27-billion-parameter Qwen model generates around 20 tokens a second; smaller ones are much faster. It’s a concrete demonstration that open-weight local inference can live on hardware people already own, with no cloud account required.
https://github.com/cobanov/PS5LM #opensourceAI