3 ms·
Well... we're not really an ML ops startup haha. I am ALSO pessimistic about ML Ops startups. But calling Grid an ML Ops startup is like calling Lightning Kera
by wfalcon 6y ago
Well... we're not really an ML ops startup haha. I am ALSO pessimistic about ML Ops startups.
But calling Grid an ML Ops startup is like calling Lightning Keras... maybe at a quick blink it looks like that, but that's where the similarities end.
For what it's worth, a lot of what we're building comes from my experience at FAIR.
- andrewmutz 6y agoIf it is not ML Ops, how would you describe it?
- wfalcon 6y agoit's honestly just a different approach. ML ops is adjusting your code to work with the cloud and managing all that. For us is basically integrating clouds directly into your code so the barrier disappears and the cloud providers become an extension of your laptop.
- orbifold 6y agoMight not be your target audience, but high energy physics has been operating an infrastructure like that for years: https://www.etp.physik.uni-muenchen.de/research/grid-computing/index.html https://www.etp.physik.uni-muenchen.de/research/grid-computi... You can basically use these frameworks to run your analysis jobs on any of the connected HPC centers and interactively move workloads around. The data never has to touch your hard drive either but gets moved to the compute on demand. This is how thousands of physicists do statistical analysis on petabytes of data.
- wfalcon 6y agosuper cool! One of the professors at my lab at NYU CILVR (Kyle Cranmer) i believed was super involved with this. Will definitely sync up with him! Thanks for the heads up!