23 ms·
Andrej Karpathy has a provocative little short story, "Forward Pass", that imagines what it'd be like if an LLM perceived brief sparks of sentience while an inf
by QuadrupleA 3y ago
Andrej Karpathy has a provocative little short story, "Forward Pass", that imagines what it'd be like if an LLM perceived brief sparks of sentience while an inference bubbles through its transformer layers. Definitely stuck with me: https://karpathy.github.io/2021/03/27/forward-pass/ https://karpathy.github.io/2021/03/27/forward-pass/