3 ms·
I think MogileFS is closest to being what most people need. I'd love to see a Go version with all the lessons learned from that project. https://code.google.co
by staunch 12y ago
I think MogileFS is closest to being what most people need. I'd love to see a Go version with all the lessons learned from that project.
https://code.google.com/p/mogilefs/ https://code.google.com/p/mogilefs/
- deleted 12y ago[deleted]
- qohen 12y agoWhat about Nokia's Disco project, which uses Erlang and Python? http://discoproject.org/ http://discoproject.org/ From http://disco.readthedocs.org/en/develop/intro.html http://disco.readthedocs.org/en/develop/intro.html What is Disco? Disco is an implementation of mapreduce for distributed computing. Disco supports parallel computations over large data sets, stored on an unreliable cluster of computers, as in the original framework created by Google. This makes it a perfect tool for analyzing and processing large data sets, without having to worry about difficult technicalities related to distribution such as communication protocols, load balancing, locking, job scheduling, and fault tolerance, which are handled by Disco. Disco can be used for a variety data mining tasks: large-scale analytics, building probabilistic models, and full-text indexing the Web, just to name a few examples. Batteries included The Disco core is written in Erlang, a functional language that is designed for building robust fault-tolerant distributed applications. Users of Disco typically write jobs in Python, which makes it possible to express even complex algorithms with very little code.
- deleted 12y ago[deleted]
- rdtsc 12y agoI am more exited about a newer one -- LeoFS http://leo-project.net/leofs/ http://leo-project.net/leofs/ all open source. They started with S3 compatible API and are adding multi-data-center replication and NFS support.