anyone who wants to find out just how retarded LLMs are should try building a programming language.
the limitations of context, the gravity well of its training corpus matching on similar text to your language it doesn't remember long term anything you tell it to do.
like, i banned the make() builtin from Go because i narrowed that down in moxie to only use &[]typename{} literal syntax. fixed it three weeks ago in the Go version of the compiler. just fixed it again today in the bootstrapped version - even though it wasn't in the original compiler it got smuggled back in by the LLM's galaxy brain memory.
the skill of software architect is a long way from being replaced, if it ever can be replaced, by LLM based AIs. maybe if there was a form of memory model algorithm that learns continously it could at least follow your directions and not forget what you told it an hour ago in a previous context window. but replacing an architect?
from the perspective of jurisprudence and misesian and other theorists who explain that agency and property are inextricable, the tool cannot replace the tool user.
just stop with the AI solves everything narrative. it just solves a limited set of problems and makes some work easier. but its limitations create new work that you didn't have to do when you were arguing with the CS grad junior your boss hired to work with you. and i've been there. oh the arguments i had with that one were epic. no, it's not done like this, i don't do it that way because a, b, c. now do it this way. RAWWWRRR.
the LLM doesn't fight with you so much but it's a goldfish and you have to put all kinds of guardrails on it. memories, fix the damn code, stop reading that other shit. Moxie is not Go. it goes on and on.
i'm closing on 2 weeks bootstrapping a language from a compiler built in a language that is a lot like the one i'm making. that plus all the limitations of the LLM tool it's nowhere near being capable of replacing even the most testosterone fuelled CS grad with all the marks of high T. it's a delicate goldfish brain, all that's happened is i'm trading a a fight with a 20something with constant vigilance with a tool that is as dumb as a horse trying to do basic arithmetic. gotta put blinkers on it, build fences, all this other shit.
the limitations of context, the gravity well of its training corpus matching on similar text to your language it doesn't remember long term anything you tell it to do.
like, i banned the make() builtin from Go because i narrowed that down in moxie to only use &[]typename{} literal syntax. fixed it three weeks ago in the Go version of the compiler. just fixed it again today in the bootstrapped version - even though it wasn't in the original compiler it got smuggled back in by the LLM's galaxy brain memory.
the skill of software architect is a long way from being replaced, if it ever can be replaced, by LLM based AIs. maybe if there was a form of memory model algorithm that learns continously it could at least follow your directions and not forget what you told it an hour ago in a previous context window. but replacing an architect?
from the perspective of jurisprudence and misesian and other theorists who explain that agency and property are inextricable, the tool cannot replace the tool user.
just stop with the AI solves everything narrative. it just solves a limited set of problems and makes some work easier. but its limitations create new work that you didn't have to do when you were arguing with the CS grad junior your boss hired to work with you. and i've been there. oh the arguments i had with that one were epic. no, it's not done like this, i don't do it that way because a, b, c. now do it this way. RAWWWRRR.
the LLM doesn't fight with you so much but it's a goldfish and you have to put all kinds of guardrails on it. memories, fix the damn code, stop reading that other shit. Moxie is not Go. it goes on and on.
i'm closing on 2 weeks bootstrapping a language from a compiler built in a language that is a lot like the one i'm making. that plus all the limitations of the LLM tool it's nowhere near being capable of replacing even the most testosterone fuelled CS grad with all the marks of high T. it's a delicate goldfish brain, all that's happened is i'm trading a a fight with a 20something with constant vigilance with a tool that is as dumb as a horse trying to do basic arithmetic. gotta put blinkers on it, build fences, all this other shit.
3✅️1👍️1💯1
