I'd been a fan of Sector/Sphere and Dr. Gu for a while. But here is the biggest problem of the benchmark: "replication is disabled" for maximum performance, whi

I'd been a fan of Sector/Sphere and Dr. Gu for a while. But here is the biggest problem of the benchmark: "replication is disabled" for maximum performance, which means these are not realistic benchmarks for large scale clusters (> 200 nodes), where node failure is the norm. I suspect that Sector's replication algorithm is not up to par with HDFS', which uses fairly sophisticated replication pipelining for maximum throughput. The most interesting thing about Sector/Sphere is that it doesn't use TCP/IP for transport but their own UDT stuff, which has its own pluses (more efficient on high latency links) and minuses (stability issues due to lack of wide usage/testing)