3 ms·

Your bar is too low. With the coffee cup, you at least have access to all the pieces - in theory, although not in engineering practice. With Aristotle, you don'

by antonvs 6mo ago

Your bar is too low. With the coffee cup, you at least have access to all the pieces - in theory, although not in engineering practice. With Aristotle, you don't have anything close to that. Recreating Aristotle in any meaningful way, other than a model trained on his surviving writing of a million or so words, is simply not possible even in principle.

jcgrillo 6mo ago
OK I'll raise the bar--make sure when you reassemble the coffee cup and put the coffee back into it, the coffee is the exact same temperature as when you threw the whole shooting match onto the floor ;) EDIT: and you don't get to re-heat it. EDIT AGAIN: to be clear, in my post above (and this one) by "put the coffee back in" I meant more precisely "put every molecule of coffee that splashed/sloshed/flowed/whatever out when the cup smashed back into the re-assembled cup" i.e. "restore the system back to the initial state". Not "refill the glued-together pieces of your shattered coffee cup with new coffee".
- antonvs 6mo ago
  Ah ok sorry, so you want them to fully reverse entropy. I agree that bar is high enough.
  - jcgrillo 6mo ago
    Yeah I think if you could pull off a trick like that you could probably recover the necessary training data ;)
fragmede 6mo ago
That's easy! All you have to do is simulate the whole universe on a computer, and then go the point when Aristotle is lecturing. Record all his works, then ctrl-c out of that and then feed those recordings into the LLM's training data. For the coffee, you just rewind the simulation and ctrl-c and ctrl-v it at the point you want.
- jcgrillo 6mo ago
  Fuck why didn't I think of that all those other times I fucked up in my life. Ctrl-z woulda done it every goddamn time.
- antonvs 6mo ago
  > simulate the whole universe on a computer Of course in principle that computer only has to be 1.x times larger than the universe, where x > 0. Perhaps AWS can sell you the compute.

by antonvs 6mo ago

jcgrillo 6mo ago

OK I'll raise the bar--make sure when you reassemble the coffee cup and put the coffee back into it, the coffee is the exact same temperature as when you threw the whole shooting match onto the floor ;) EDIT: and you don't get to re-heat it. EDIT AGAIN: to be clear, in my post above (and this one) by "put the coffee back in" I meant more precisely "put every molecule of coffee that splashed/sloshed/flowed/whatever out when the cup smashed back into the re-assembled cup" i.e. "restore the system back to the initial state". Not "refill the glued-together pieces of your shattered coffee cup with new coffee".

antonvs 6mo ago
Ah ok sorry, so you want them to fully reverse entropy. I agree that bar is high enough.
- jcgrillo 6mo ago
  Yeah I think if you could pull off a trick like that you could probably recover the necessary training data ;)

fragmede 6mo ago

That's easy! All you have to do is simulate the whole universe on a computer, and then go the point when Aristotle is lecturing. Record all his works, then ctrl-c out of that and then feed those recordings into the LLM's training data. For the coffee, you just rewind the simulation and ctrl-c and ctrl-v it at the point you want.

jcgrillo 6mo ago
Fuck why didn't I think of that all those other times I fucked up in my life. Ctrl-z woulda done it every goddamn time.
antonvs 6mo ago
> simulate the whole universe on a computer Of course in principle that computer only has to be 1.x times larger than the universe, where x > 0. Perhaps AWS can sell you the compute.