Been playing around with this model locally on my phone. So far I’m impressed with how well it works. #ai #llm

8 billion parameters in just 1.2 GB of space. For comparison Qwen 3.5 takes up just over 3 GB for 4 billion parameters.

It will be interesting to see where these new 1bit models lead.

https://www.prnewswire.com/news-releases/prismml-launches-worlds-first-1-bit-ai-model-to-redefine-intelligence-at-the-edge-302730568.html