4 ms·
The vast majority of human progress is not revolutionary, but incremental. Even ChatGPT was an incremental improvement on GPT 3, which was an incremental improv
by janalsncm 3y ago
The vast majority of human progress is not revolutionary, but incremental. Even ChatGPT was an incremental improvement on GPT 3, which was an incremental improvement on GPT 2, which was an incremental improvement on decoder-only transformers.
Still, if you stack enough small changes together it becomes a difference in kind. A tsunami is “just” a bunch of water but it’s a lot different than a splash of water.
- joshspankit 3y agoFair and I agree. I guess it raised flags for me that shouldn’t have: why is is a blog post at all (it’s a new thing) and why is it gaining traction on HN (it’s an OpenAI thing)