5 ms·
I'm waiting for a Firefox / chrome extension that will auto-mark and optionally adblock GPT-generated content. Would even be willing to pay for it.
by dbgev 3y ago
I'm waiting for a Firefox / chrome extension that will auto-mark and optionally adblock GPT-generated content.
Would even be willing to pay for it.
- smoldesu 3y agoWhat would you consider an acceptable false positive rate?
- dbgev 3y agoI'd say low false positive + high false negative would be a good starting point.
- chaxor 3y agoThe only real way to block specifically openAI generated content (or some other online generated LLM content) is for the company itself to store all of its outputs and compare to that database, like shingling / LSH for plagiarism detection. Other LLMs (local) are completely impossible to block, as it's a constant chase. Any system that tries to estimate the distribution of e.g. a specific LLM that performs beam search with certain parameters, can be easily adjusted to use typical decoding or something else, so it simply will never be possible, hence useless to try to stop.
- dbgev 3y agoIt doesn't need to stop the determined users, thete's value in just filtering out articles that are not even proofread by humans. It's going to be a constant cat and mouse game, I agree, but for now it just need to catch the dead mice.
- ademarre 3y agoShazam-like fingerprinting for text. The complete LLM outputs wouldn't need to be stored, just the fingerprints along with some mechanism for trusted timestamping (could be Blockchain).
- chaxor 3y agoThis has been done for a very long time. Blockchains are definitely not required (this isn't just the usual hate from HN of Blockchain, it just actually doesn't make sense here). Fingerprinting by shingling (windows of text) with some normalization steps is pretty typical in plagiarism or similarity detection. A big database of docid-shingleid pairs along with weights for their frequency is often a very simple and fast way to do this analysis. The big part is getting OpenAI/anthropic/etc to do it on their data and provide a service for that, but there's obviously a lot of unwanted consequences - specifically storing of all user data (even if the shingled and docids are hashes, it's still info).
- tyingq 3y agoCouldn't I then bulk submit a lot of original human generated content with prompts like "reproduce this block of text verbatim" or similar?
- NoMoreNicksLeft 3y agoGiven Mozilla's recent behavior, I think you should more likely expect the built-in GPT-generated ads that you can't disable in browser settings.