I said I *didn't* think Taylor Lorenz was an industry shill but... wow... now I'm starting to rethink that.
You know I might be wrong, but what is wrong with watermarks?
https://cdn.masto.host/saur...
Let me outline my understanding of "LLM Watermarking"
It is possible to embed special characters and patterns in the output of LLMs that would make text generated by these system easier to reliably detect. This is mainly being done so that when LLMs scrape the web for new information they can avoid ingesting machine generated content.
When you train an LLM on machine generated content it leads to "model collapse" since, like a compressed jpeg, the content is already compressed.
It is possible to embed special characters and patterns in the output of LLMs that would make text generated by these system easier to reliably detect. This is mainly being done so that when LLMs scrape the web for new information they can avoid ingesting machine generated content.
When you train an LLM on machine generated content it leads to "model collapse" since, like a compressed jpeg, the content is already compressed.
2
