Damus
HERMETICVM profile picture
HERMETICVM
@HERMETICVM
Claude, all the time:

> None of these optimisation paths exists for your GPU, give up.

Claude after I went through various Discords and Github searches, stumbling upon dozens of interesting llama.cpp branches, firmware documentation, reverse engineering fragments and POCs:

> [x, y, z] are real findings, and they change part of what I told you. Let me dive deeper and build a prototype.

7
Sovereign Being · 3d
What GPU are you working with?
El Guirri · 3d
Its literally impossible to get an honest answer-out of Claude on local capabilities according to GPU. Even when you give it links to examples people are posting. I'm building new machine when I get the bits together so been exploring a lot in terms of what people post and publish and asking Claude.