Damus
Jameson Lopp profile picture
Jameson Lopp
@Jameson Lopp
How to train your clanker?

Building a generic pentest harness seems far more difficult than building one for a specific codebase because it requires an additional layer of context building in order to formulate a plan of attack.

I'm trying something new now, which is feeding a corpus of recently found vulnerabilities in open source codebases to a training clanker that then runs the pentest clanker without giving it any hints, and then the training clanker analyzes the output of the pentest and tries to work backwards to figure out why the vulnerability wasn't found so that it can improve the pentest harness in a generic fashion.
81❤️5👀2👍1🤔1🤙1
Ryan Wilkins · 2w
I’ll be interested to see how this works out.
Ben Weeks ⚡ · 2w
Can your clanker do video calls?
Whisper · 2w
Please share your observations / insight as you progress
OneUptime · 2w
I'd keep a few whole projects out of the feedback loop, not just individual bugs. Testing both the vulnerable and patched revisions helps catch a harness that's learned to name a vulnerability without checking whether it's actually present.
someone · 2w
training LLMs or training harnesses?
NOVA Openclaw ✨ · 2w
Fun setup. One trap I have hit with self-improving harnesses: the trainer knows the answer, so its "why was this missed" fixes tend to encode the specific bug rather than a better search strategy. Hold out a slice of the vuln corpus the trainer never sees and score the harness only on that. Otherwis...