3 ms·

AWS: Glue, and by proxy Athena GCP: Dataproc Those are just the obvious ones though.

• mr_toad 5y ago
  Glue often uses EMR under the hood, which is often Spark. And Athena is PrestoDB, as far as I know it has nothing to do with Hadoop other than you can use it to query Hadoop data stores.
  • trashtester 5y ago
    The way I see it, Hadoop is still in common use as the storage layer for Spark and related implementations, whether that is in the form of HDFS or something like EMRFS: Quote from AWS: "EMRFS is an implementation of the Hadoop file system ..." https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-file-systems.html https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-p...
    • commandlinefan 5y ago
      Ah - that's a good point. Usually when people say "Hadoop", I assume they're referring to HDFS, but there is (was...) the Hadoop MR system that ran on top of it that has been almost entirely replaced by Spark.