3 ms·
Interesting is that much of this is externalized through Google Cloud in one way or another: - GFS/Colossus = GCS - Borg = Kubernetes - Dremel = BigQuery -
by vgt 11y ago
Interesting is that much of this is externalized through Google Cloud in one way or another:
- GFS/Colossus = GCS
- Borg = Kubernetes
- Dremel = BigQuery
- BigTable = BigTable (naturally)
- FlumeJava,MapReduce,MillWheel = Dataflow
- skj 11y agoKubernetes is not an externalized borg. They are completely separate products that do more-or-less similar things. Similarly, dataflow is completely new code that does similar things. As far as I know, GCS, bigquery, and bigtable actually are externalized offerings of their internal equivalents.
- vgt 11y agoRight, there are clearly levels of differences between Google-internal and external. Some more than others.
- exacube 11y agoGFS/Colossues are distributed file systems, which GCS doesn't really address (I think GCS is akin to AWS' S3?)
- ecnahc515 11y agoYep, but GCS is probably powered by GFS
- jrv 11y agoGFS was phased out many years ago - it has been replaced by Colossus.
- thrownaway2424 11y agoGFS is so dead few people even remember using it. But to say that something is "based on GFS" or "based on Colossus" is to say very little. If it stores data it is eventually "based on Colossus". You could say just as much if you said it was "based on ext4".
- timdierks 11y agoIn what fashion is GCS not a distributed file system?