2 ms·
The LLMs do indeed deal with Plato's shadows, but so do we - what we "see", after all, is not the actual up or down, but a series of neural activations from our
by int_19h 3y ago
The LLMs do indeed deal with Plato's shadows, but so do we - what we "see", after all, is not the actual up or down, but a series of neural activations from our retinas (which aren't even 3D, so concepts like "behind" are only captured by proxy). Such activations can all be readily encoded into tokens, which is exactly what models specifically trained to describe images do.