4 ms·
Open-source Rust database tops JSONBench using DataFusion
- deleted 2y ago[deleted]
- killme2008 2y agoIn the past, I also had doubts about whether a Rust database built on open-source components would be performance-limited, but this evaluation has dispelled our concerns. Apache DataFusion + Arrow + Parquet + OpenDAL, as a new data stack, have proven their potential.
- kuailefeiba1991 2y ago[flagged]
- k_bx 2y agoBig question I have is: should I invest in DeltaLake/Iceberg based solution, or something like this?
- killme2008 2y agoDelta Lake and Iceberg are great for managing offline, big data workloads like batch analytics and ETL on data lakes. They're not built for real-time queries or high-throughput writes. GreptimeDB, on the other hand, is optimized for real-time, time-series data like IoT and observability metrics, but it's not suited for offline batch processing. Choose Delta Lake or Iceberg for offline analytics at scale. Use GreptimeDB for fast, real-time data ingestion and queries. Together, they can complement each other: GreptimeDB handles real-time data, while Delta Lake/Iceberg manages offline analytics.
- k_bx 2y agoThank you. I've previously tried Databend but it was very slow at multiple individual inserts. Will try GreptimeDB next time I have a chance!
- killme2008 2y agoThank you for considering GreptimeDB! Feel free to give it a try next time, and we warmly welcome you to join our Slack community: https://greptime.com/slack https://greptime.com/slack