2 ms·

Is a "file system" the best design for this? Not sure of a better general solution, but approaches like BigTable/GFS and SimpleDB come to mind. Conversely if

by mey 17y ago

Is a "file system" the best design for this? Not sure of a better general solution, but approaches like BigTable/GFS and SimpleDB come to mind. Conversely if ZFS is supposed to scale to petabyte loads, what configuration do they expect that data to be in?

liuliu 17y ago
BigTable is for structure data. I think the best open-source software for this problem is Haystack from Facebook. It solves the problem by creating really big file (1G size), in that case, you don't have to bother with filesystem.
- pvg 17y ago
  Haystack is not open-source software.