3 ms·
Ask HN: Apache Ignite vs. Apache Spark?
Hi all,
I know Apache Ignite quiet a bit, at least worked with the data grid API. I'm currently thinking about how to best distribute a temporal open source storage system, that is maybe in the first step simply replicate the data through a single master, which may distribute writes both asynchronous and synchronous to its followers/slaves. I want to preserve ACID transactional semantics through some kind of consensus protocol and the single master. I don't think that a two phase protocol is the best, though.
But I'm tempted to use Apache Ignite for distributing a transaction log from a single master, though I haven't used Apache Spark (which I probably can use afterwards for the query part!?). Or maybe I should use another system like Zookeeper!?
Any kind of recommendations would be great -- oh and the system I'm developing is mostly written in Java (and lately some Kotlin) :-)
Kind regards
Johannes
- diehunde 8y agoTake a look at this: https://delta.io/ https://delta.io/