Interesting.
Is there any way you can chart some data somehow that shows the improvement along side when LLMs got good?
Thing is LLMs got sure usable 'bout Jan this year, but I think they were capable to help with reproducibility task quite some months before.