Damus
slembcke · 2w
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq0q8eanytqf3m9jd0fqvxu6r63lt6jle9qgyxfrd97zv2nwfa8cpq30622w Uff. I have complex feelings about this. On the one hand local LLMs being a free publi...
slembcke profile picture
@nprofile1q... Local models are actually surprisingly good at understanding/explaining code (eh... kinda?), but I tried having them fix bugs that I already fixed and they just... couldn't. In the one case I tried a half dozen 30+ billion param models to implement a simple feature in my Lua debugger. Something I did in 2 lines of code in 5 minutes. I gave them all *hours* to do it and they just... couldn't. The closest I got was that one hand inlined a function that was ~5% of the total debugger size.
1
slembcke · 2w
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq0q8eanytqf3m9jd0fqvxu6r63lt6jle9qgyxfrd97zv2nwfa8cpq30622w Each of them literally wrote half a novel (100k+ words) of "thinking", and still just could never do any of the simple problems I tried to make them fix. Honestly, I went in to it with ...