2 ms·
> low perplexity text Is this a term of art? (How is perplexity different from complexity, colloquially, or entropy, particularly?)
by JumpCrisscross 1y ago
> low perplexity text
Is this a term of art? (How is perplexity different from complexity, colloquially, or entropy, particularly?)
- VHRanger 1y agoPerplexity is a term of art in LLM training, yes. A naive way of scoring how AI laden text is would be to run n-1 layers of a model and compare the text to the probability space of tokens from the model. It works somewhat to detect obvious text but is not strong enough a method by itself.