3 ms·
One really exciting place things might improve is in data cleaning. Right now preprocessing your data and putting it in a format that can be learned efficiently
by hiddencost 4y ago
One really exciting place things might improve is in data cleaning. Right now preprocessing your data and putting it in a format that can be learned efficiently and without bias is a huge pain // risk. This next generation is allowing us to largely ignore a lot of that work.
Similarly, transfer learning is finally good.
And the models are generalist, few shot learners.
As a consequence, individuals with minimal expertise can set up a world class system to solve niche problems. That's really exciting and it's going to get easier.
- hiddencost 4y agoCross-language learning (what was referred to as an "interlingua" in the 90s) means we're seeing some stunning advances in low resource languages. It used to be that everyone ignored languages other than English, and then provides them with mediocre support. I think we're at a point where there's very little excuse not to launch in many languages at once.