this is super bullish for self hosted LLMs when you can now get a device that can run 70b models at nearly the full speed at a price of $3000
i'm definitely following up on this thread of research.
i'm definitely following up on this thread of research.
8❤️1💯1