4 ms·
"they are non-deterministic/non-heuristic systems based on probability" is a fundamental flaw for a deterministic task. You seem to be confusing "fundamental"
by BoorishBears 2y ago
"they are non-deterministic/non-heuristic systems based on probability" is a fundamental flaw for a deterministic task.
You seem to be confusing "fundamental" with "terminal".
> all of these have mitigations somewhere which either stop or reduce the impact of these thing occurring for the end user.
You missed their comment is talking about what could be implemented, not what is implemented.
> that’s quite a big claim with no real evidence.
A zero-shot single pass of summarization with a model like Gemini 2.0 Flash benchmarks at around 99.3% accuracy.
Gemini Flash slots in below their 120B Pro model and the 8B Flash model, and is generally estimated to be <70B parameters: https://x.com/ArtificialAnlys/status/1867292015181942970 https://x.com/ArtificialAnlys/status/1867292015181942970
So we could give Gemini multiple passes with multiple prompts, multiple shots of each prompt, time for thinking, self-verification, and have plenty of room left over.
I wrote the comment in a way that assumes that the reader understands just how much compute 1 Trillion parameters represents for current models.
That's an insane amount of compute for each email, so it's not a big claim at all.
But I tend to write assuming people actually know the topics they're commenting on, so please forgive the lack of evidence.