3 ms·
It was an "Oh" moment, but on the other hand, it'd be like laughing at text-davinci-003 when you realised how basic it really was, and yet, it has led us to GPT
by imdsm 3y ago
It was an "Oh" moment, but on the other hand, it'd be like laughing at text-davinci-003 when you realised how basic it really was, and yet, it has led us to GPT-4 and, much as Windows 3.1 was amazing back in the day, now it's a distant memory as we carry around little glass tablets that can play 3D games and do UHD global video calls.
If Q* is the basic algorithm that is as transformative as, well, transformers/attention, then developing it to be more than just children's math could be the key to thinking - and not just latent space token generation.