Ch(e)at GPT? - Computerphile

What Hacker News said

Recommends kimburgess · 2023-02 · on “ShareGPT: Share your ChatGPT conversations with one click”

Watermarking. From an outsiders perspective, the issue appears to reaching consensus on how this can be implemented (but not in the technical sense). There's a game theoretic challenge in that if models define and publish detection mechanisms, this creates a motivation for people to use other systems that don't include this. On the technical front there's a good paper here: [LINK] , and a nice very approachable video explaining it here: [this video] .

Cites piersj225 · 2023-02 · on “CheatGPT”

I've heard one idea of adding weights to words. The idea being if I someone hands in a essay with a higher frequency of certain words, there is a very good chance its come from a language model. [this video] I'm not sure this helps with coding though, maybe variable names?

Cites stcg · 2023-03 · on “Research shows we can only accurately identify AI writers about 50% of the time”

I think watermarking is a better solution. There is a paper on it: Kirchenbauer, J., Geiping, J., Wen, Y., Katz, J., Miers, I., & Goldstein, T. (2023). A watermark for large language models. arXiv preprint arXiv:2301.10226. ( [LINK] ) Also, Computerphile did a video on it: [this video] But of course, watermarking or your proposed solution (checksums) only work while the general public cannot run a tool like ChatGPT locally on personal computers. And it's only a matter of time before that happens. So in the long run, we need to either: 1. take away control from the users over their personal computers, in the form of what I would call 'AI DRM' (I strongly oppose this option), or 2. legislate: enfor

Cites rjmunro · 2023-05 · on “GPT detectors are biased against non-native English writers”

There's an interesting scheme described here: [this video] Essentially by biasing the LLM's token choices slightly you can infer with high probability later that the text was generated by it.

Cites Zambyte · 2024-07 · on “Meta Launches AI Studio in US”

I wonder if they have a watermark built in that allows them to detect text generated by Llama easily. [this video] [LINK]

Cites m-chrzan · 2026-08 · on “How Claude marks AI-generated content”

There's a computerphile video ( [this video] ) with Dr. Mark Pound explaining a paper by John Kirchenbauer, Jonas Geiping et al. ( [LINK] ) that described a method for watermarking LLM output like this. It's not directly stated anywhere in the Claude support article that this is what they're using, but the properties of the watermark described seem to point to this method.