4 ms·

Imagine if data bricks switched and just started to contribute to this. I live in a dream world :)

• nevi-me 2y ago
  They have their own implementation that is closed source (last time I checked), Photon [1], which is written with a C++ engine. Databricks' terms prevent(ed?) publishing benchmarks, it would be interesting to see how Comet performs relative to it over time. Photon comes at a higher cost, so one big advantage of Comet is being able to deploy it on a standard Databricks cluster that doesn't have Photon, at a lower running cost. [1] https://www.databricks.com/product/photon https://www.databricks.com/product/photon
  • slt2021 2y ago
    nice word play for two competing spark execution engines: Photon and Comet. C++ vs Rust, closed-source vs open-source