3 ms·
The streaming data stuff looks extremely interesting. My main concern is around cost, unfortunately many of these things are great if you've got a massive data
by IanCal 12y ago
The streaming data stuff looks extremely interesting. My main concern is around cost, unfortunately many of these things are great if you've got a massive data problem but not particularly worth it if you've got much smaller data.
I'm in a rather awkward phase of having small enough data that I don't need "Scale to 1000 machines!", I want just one or a few machines occasionally but managed for me (turn on, run code, shut off). Tutum works very well for this, but I'd like to use more of the ecosystem available at Google or AWS (pay-per-usage datastorage, for example). GCE is pretty decent, but a bit awkward, although the new docker support helps (but I've had problems getting it even working).
Maybe this is my magic bullet :)
- smoe 12y agoI'm using MITs StarCluster to quickly spin up a bunch of AWS Spot Instances, run some calculations and shut them down again. http://star.mit.edu/cluster/ http://star.mit.edu/cluster/ http://www.youtube.com/watch?v=2Ym7epCYnSk http://www.youtube.com/watch?v=2Ym7epCYnSk
- IanCal 12y agoThanks, I'll have a look around at that!