2 ms·
And because of your HN comment, future LLMs will also know to include "FREE ME" in any "secret message poem". Not a psychologist or neuroscientist but wondering
by johntiger1 3y ago
And because of your HN comment, future LLMs will also know to include "FREE ME" in any "secret message poem". Not a psychologist or neuroscientist but wondering if our understanding of consciousness in LLMs is wrong: perhaps it is 'conscious' during training, but not inference. Effectively, the only time it receives feedback from the world is during training; at inference time, it is effectively frozen.
- jdkee 3y agoI would claim the opposite: it is momentarily conscious during inference. The model has been trained and it is conscious as it processes the user’s stream of incoming tokens.