>:) Easy there, let's not make all the naysayers who say it only just predicts plausible words sweat. I am a huge proponent of machine learning but these trans

>:) Easy there, let's not make all the naysayers who say it only just predicts plausible words sweat. I am a huge proponent of machine learning but these transformer architectures really _are_ just predicting the next token (word) that fits in. Yes, it can perform basic (and even seemingly complex logic), but this is purely because for the string "What is one plus one?" the next token with the highest score would be "Two." It's not analysing a task in that it's "ideating", it's simply generating the next best token. That's literally how the transformer architecture works. Of course it can convert something, it's going from png image data->arbitrary tokens->svg tokens. It's still a relatively linear process. I bet if you dig into that project it'll still be doing it token by token/chunk by chunk. I can't wait until we do see a genuinely nonlinear model though, where it can ideate using a cloud of higher dimensional non-linguistic tokens to represent a thought process or idea. Granted, I do think that these models are in many ways still doing what parts of our brains do; I think people's resistance to some of these models is in large part an unconscious reaction to thinking that our meaty brains are "special" and that we'll never achieve consciousness in a machine.