3 ms·
LLMs are pessimisticly constrained to being equivalent to TC0 or more specifically are uniform consent depth threshold circuits. Circuits and TMs are very diff
by nyrikki 3y ago
LLMs are pessimisticly constrained to being equivalent to TC0 or more specifically are uniform consent depth threshold circuits.
Circuits and TMs are very different, but while LLMs can use threshold circuits, they do not have access to finite size input parity circuits, nor can they do operations like xor in a single layer.
It is the cost of high parallelism.
For those who are trying to figure out real world applications, it is worth the effort to learn circuit complexity, as it will be far more realistic than TM.
https://complexityzoo.net/Complexity_Zoo:T#tc0 https://complexityzoo.net/Complexity_Zoo:T#tc0