4 ms·
> Software 2.0 is happening right now. GTP-3 and Tesla FSD are examples of this. I agree with this. As an anecdote, I've spent the past decade explaining to cl
by sbrother 6y ago
> Software 2.0 is happening right now. GTP-3 and Tesla FSD are examples of this.
I agree with this. As an anecdote, I've spent the past decade explaining to clients that things like natural language question answering and abstractive summarization are impossible, and now we have OpenAI and others dropping pretrained models like https://github.com/openai/summarize-from-feedback https://github.com/openai/summarize-from-feedback that turn all those assumptions on their head. There are caveats, of course, but I've gone from a deep learning skeptic (I started my career with "traditional" ML and NLP) to believing that these sorts of techniques are truly revolutionary and we are only yet scratching the surface of what's possible with them.