Databricks was founded by the creators of Apache Spark, and their platform is a fully hosted spark solution. Spark is a flexible distributed computing framework

Databricks was founded by the creators of Apache Spark, and their platform is a fully hosted spark solution. Spark is a flexible distributed computing framework which came as a successor to Hadoop and map/reduce. Spark processes big data at scale on clusters, this includes ML training and inference pipelines. Now though, their value prop is less clear since you can implement these pipelines (for example using AWS sagemaker) without having to learn spark.