4 ms·
I built something similar 2.5 years ago in case you're interested: https://github.com/tobilg/lsh https://github.com/tobilg/lsh
by tobilg 5y ago
I built something similar 2.5 years ago in case you're interested: https://github.com/tobilg/lsh https://github.com/tobilg/lsh
- ignoramous 5y ago+ dgsh [0], I wonder if one could build a serverless sh map-reduce? [0] https://news.ycombinator.com/item?id=21700014 https://news.ycombinator.com/item?id=21700014
- tobilg 5y agoYeah, that should be possible I guess. I slightly had another idea in the back of my head with LSH. E.g. see https://davidwells.io/blog/rise-of-embarrassingly-parallel-serverless-compute https://davidwells.io/blog/rise-of-embarrassingly-parallel-s...
- alexpotato 5y agoIf you count someone else's server as "serverless", then yes: https://adamdrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html https://adamdrake.com/command-line-tools-can-be-235x-faster-...
- JasonCannon 5y ago>If you count someone else's server as "serverless" That's literally what serverless is. Serverless doesn't mean there are no servers. It is simply the ability to run your code without having to think about the server it is running on. More server agnostic than serverless.
- otrack 5y agoVery interesting work, thanks for the link! We actually missed it among the references in our paper [1] and will correct this in the journal version. Regarding the differences, lsh has an interactive mode but not sshell. On the other hand, sshell compile to native (to support massively parallel calls), and IPCs between such calls (thanks to the DSO layer). [1] https://drive.google.com/file/d/1D7h0hoMep0W73XV_EdXPSEWUxpToTtfG/view https://drive.google.com/file/d/1D7h0hoMep0W73XV_EdXPSEWUxpT...