4 ms·
Yes, a fun fact about slop text is that it's very low perplexity text (basically: it's statistically likely text from an LLM's point of view) so most algorithms
by VHRanger 11mo ago
Yes, a fun fact about slop text is that it's very low perplexity text (basically: it's statistically likely text from an LLM's point of view) so most algorithms that rank will tend to have a bias towards preferring this text.
Since even classical machine learning uses BERT based embeddings on the backend this problem is likely wider scale than it seems if a search engine isn't proactively filtering it out
- JumpCrisscross 11mo ago> low perplexity text Is this a term of art? (How is perplexity different from complexity, colloquially, or entropy, particularly?)
- VHRanger 11mo agoPerplexity is a term of art in LLM training, yes. A naive way of scoring how AI laden text is would be to run n-1 layers of a model and compare the text to the probability space of tokens from the model. It works somewhat to detect obvious text but is not strong enough a method by itself.