>I'm attributing the start of the current AI hype cycle to the resurgence of CNNs using GPUs, roughly around the time of AlexNet and AlphaGo, not to LLMs and th

>I'm attributing the start of the current AI hype cycle to the resurgence of CNNs using GPUs, roughly around the time of AlexNet and AlphaGo, not to LLMs and the Transformer architecture. The current hype cycle, the one fueling hundreds of billions in investment by multiple of the biggest tech companies in the world has little to do with Alex Net and AlphaGo and everything to do with LLMs and generative AI in general. >Though if we're being really pedantic, the original Transformer paper is from 2017, so almost a decade ago. But this is beside my point. The transformer paper did not start the generative AI craze. GPT-3 in 2020 did it for the research world, and the release of ChatGPT in Nov 22 did it for the general public. >The machine has no concept of a "domain". Whether it's outputting code, poetry, images, or video, it's all data generated by probabilistic pattern matching and pseudo-randomness. The structure and accuracy of the generated data is meaningful only to humans, and it's the most important factor that is measured in all these benchmarks. What are you on about? Of course it does. This conversations are getting tiring. Yes, LLMs model concepts directly independent of the text it is trained on. This has been demonstrated multiple times including very recently again by anthropic. There is nothing random about the predictions they make. And even if the machine didn't model these things directly, the concept of domains would still be relevant to the humans testing it as 'data' is not equal. SOTA LLMs are good for diagnosis. That was evident even before this benchmark. I'm not talking about some imagined future. I'm talking about right now. Sticking your head in the sand because of your 'experience' with coding is nonsensical. The benchmarks aren't arbitrary - In some cases they are directly testing the ability in question. I'm not advocating for removing doctors from the picture entirely. It wouldn't even be possible even if I was, at least at the moment.