3 ms·
Clarification. Duplicating multiple groups of layers in a "reasoning" loop Normal: L1 -> L2 -> L3 -> L4 -> out Unrolled (current framing): L1 -> [L2->L3
by rapatel0 7mo ago
Clarification. Duplicating multiple groups of layers in a "reasoning" loop
Normal:
L1 -> L2 -> L3 -> L4 -> out
Unrolled (current framing):
L1 -> [L2->L3] -> [L2->L3] -> L4 -> out
Looped (proposed):
--<--loop----
| |
L1 -> [L2->L3] x N --> L4 -> out
"reasoning loop"
Note: ascii rendering HN is not trivial
- gavinray 7mo agoThe commenter "Skerit" below linked to a recent implementation of this: https://ouro-llm.github.io/ https://ouro-llm.github.io/ See the left-hand side of the diagram here, which is your exact proposal: https://ouro-llm.github.io/static/images/ouro_main.png https://ouro-llm.github.io/static/images/ouro_main.png