2 ms·
Microsoft Open-Sources Haystack - An Indexing Subsystem for Apache Spark
- tannerbrockwell 6y agoMore descriptive title: "Hyperspace, an indexing subsystem for Apache Spark™, is now open source"
- yarapavan 6y agoAt a high-level, Hyperspace offers users the ability to: - Build indexes on your data (e.g., CSV, JSON, Parquet). - Maintain the indexes through a multi-user concurrency model. - Leverage these indexes automatically, within your Spark workloads, without any changes to your application code for query/workload acceleration. GitHub: https://github.com/microsoft/hyperspace https://github.com/microsoft/hyperspace Spark + AI Summit 2020 presentation: https://databricks.com/session_na20/hyperspace-an-indexing-subsystem-for-apache-spark https://databricks.com/session_na20/hyperspace-an-indexing-s...