3 ms·
I guess the next step is democratizing ML. Right now we seem to be into a kind of "mainframe phase", where running big models is super expensive. I wonder wha
by oblio 5y ago
I guess the next step is democratizing ML.
Right now we seem to be into a kind of "mainframe phase", where running big models is super expensive.
I wonder what kind of speedup we need for ML to be truly accessible for the average developer. 50x? 100x?
- hervature 5y agoDefine "accessible". Very modest hardware (sub $100 and certainly sub $1000) can train random forests very quickly. This is going to be close to SOTA on basically any classification task.
- ska 5y ago> speedup we need for ML to be truly accessible for the average developer. 50x? 100x? The data scale (and access) is often more important than the modelling, and that doesn't have a technological fix, or at least not a purely technological fix.
- fumar 5y agoSo Moore's Law is a constraint for average people as hardware costs a key factor in performance, is that right?
- ska 5y agoWhat I'm saying is the hardware is less of a problem than access to data, for most problems that would get you out of what you can reasonably do on a consumer accessible (cost) machine.
- jsharf 5y agoUnless we have widely available pre-trained models with generic knowledge that is easily transferable. Such a thing is obviously difficult, but it isn't impossible if we're talking about the future.
- minimaxir 5y agoThe trick for ML accessibility is minor finetuning the existing models that have been trained on these super training models so that users can get similar performance, and lately companies have been more open about releasing models open source.
- deleted 5y ago[deleted]
- mistrial9 5y agoGoogle is all over this -- there are at least two science-fiction level videos on YouTube of actual field experiments using ML, each with a very non-USA/third world person narrating.. the view count is in the low four digits both times one of them is related to a paper in Nature this year on "democratizing ML" .. the MOSAIK project iir edit- hilariously, Google Search wont let me look for MOSAIK instead correcting the spelling.. and when forced, many similarly named projects that are not it, are ahead.. the one referenced here is A generalizable and accessible approach to machine learning with global satellite imagery