4 ms·
"Beam is designed to store large graphs that cannot fit on a single server. " What would be a good alternative for less huge datasets?
by fulafel 8y ago
"Beam is designed to store large graphs that cannot fit on a single server. "
What would be a good alternative for less huge datasets?
- manigandham 8y agoA single-node graph database? Neo4j is probably the most well-supported and standardized option: https://neo4j.com/ https://neo4j.com/
- snaky 8y agoAllegroGraph https://franz.com/agraph/allegrograph/ https://franz.com/agraph/allegrograph/
- hu3 8y agohttps://github.com/dgraph-io/dgraph https://github.com/dgraph-io/dgraph is worth a look. Although it can be distributed, setting it up is trivial enough to be appealing in single machine configurations.
- fouc 8y agoI'm curious how Erlang's BEAM/OTP would handle storing large graphs across servers. (My understanding is that it can probably support that?)
- RobertKerans 8y agoOut of the box, imo it'll be faffy and probably not worth it vs just using an existing solution. :digraph is great, having a graph structure available out of the box in the standard library is super nice for certain things, but it's 3 ETS tables, and ETS tables can't be replicated across nodes. MNesia tables can (that's the point), so replicating how :digraph works using MNesia is probably fairly doable (I assume this has been tried but I haven't investigated it)
- dvirsky 8y agoThe fastest one would probably be RedisGraph. https://oss.redislabs.com/redisgraph/ https://oss.redislabs.com/redisgraph/
- marknadal 8y agohttps://github.com/amark/gun https://github.com/amark/gun Altho it can sync across machines and backup to S3, so only a subset of your data needs to be loaded on the machine at any given time. The Internet Archive and others use it in production.
- mindcrime 8y agoJena TDB --> https://jena.apache.org/documentation/tdb/index.html https://jena.apache.org/documentation/tdb/index.html
- mtrn 8y agoWe used Jena for a project with 500M triples, the uncompressed file was about 80G. It mostly works fine.