4 ms·
Maybe the problem are said Markov chains? It's possible the phrase "in her anus" occurs more frequently on the internet than "in her arms".
by jakobegger 8y ago
Maybe the problem are said Markov chains? It's possible the phrase "in her anus" occurs more frequently on the internet than "in her arms".
- dmichulke 8y agoIn other words: Just because 50% of the internet are porn, you shouldn't use a 50% porn corpus to train your Markov chains.
- qwerty456127 8y agoAn important idea. Obviously you should use a corpus made from books (of a relevant genre and/or time period preferably) not from the whole Internet.
- robin_reala 8y agoIf you build that corpus from your OCRed text that has a consistent misinterpretation then that misinterpretation will be amplified as the correct answer.
- qwerty456127 8y agoObviously you are to build it from known-valid texts that are already proof-read.
- DenisM 8y agoAnd this would be a linguistic "prion" - systemic defect that replicate itself, yet does not rise up to the level of complexity we require of a life-form.
- deleted 8y ago[deleted]