3 ms·
They actually run 2^30-way tournament (they derive an equivalent form that doesn't requires 2B operations). You do not need to run the LLM, it only depends on t
by mmoskal 2y ago
They actually run 2^30-way tournament (they derive an equivalent form that doesn't requires 2B operations). You do not need to run the LLM, it only depends on the tokenizer.
- espadrine 2y agoYou’re right. I understood it to require taking the top 2^30 tokens, but instead they sample 2^30 times with replacement. Too bad they only formulate the detection positive rate empirically. I am curious what the exact probability would be mathematically.