3 ms·
I tend to subscribe to the ideas that Joyent has around their manta product -- it's about "data gravity" and "data velocity". There was an article submitted ear
by e12e 13y ago
I tend to subscribe to the ideas that Joyent has around their manta product -- it's about "data gravity" and "data velocity". There was an article submitted earlier to hn that didn't get many votes -- and no comments -- but is well worth a read:
"Building a Black Swan: Disrupting NetApp, EMC, Amazon’s S3 … maybe all BigData":
https://medium.com/money-banking/b8427c23bf0f https://medium.com/money-banking/b8427c23bf0f
https://news.ycombinator.com/item?id=6028334 https://news.ycombinator.com/item?id=6028334
Also worth skimming is the blog post introducing Manta:
"Hello, Manta: Bringing Unix to Big Data":
http://www.joyent.com/blog/hello-manta-bringing-unix-to-big-data http://www.joyent.com/blog/hello-manta-bringing-unix-to-big-...
And, (more closely) related to the "you don't have big data", I found this little post about Manta also interesting:
http://building.wanelo.com/post/54110156963/a-cost-effective-approach-to-scaling-event-based-data http://building.wanelo.com/post/54110156963/a-cost-effective...
(as an example of how keeping things simple (here: simple log files) can combine to provide the scalability needed to collect "BigData" -- and then the Manta architecture can help with turning that data into information)
(No affiliation with Joyent/Manta -- but it does seem like they have a pretty good product concept/idea -- and even if not using Manta or Joyent -- building on their ideas and architecture -- seems like something that might be useful also for smaller installations).