4 ms·
Cool! Can this be used for graphs far larger than core memory? If not what would you suggest for that case?
by mooneater 7y ago
Cool!
Can this be used for graphs far larger than core memory?
If not what would you suggest for that case?
- StellarGraph 7y agoHi @mooneater. At the moment, the library is focused on graphs that fit in memory. Managing out-of-core data brings a whole extra layer of caching, data transfer and data management complexity; we prefer to focus on extending and increasing the algorithms we support. We think this is the appropriate trade-off because many problems involve relatively small graphs, and, even for larger ones, it’s getting easier and cheaper to rent machines with hundreds of gigabytes or even terabytes of RAM. That said, we do have experimental support for running GraphSAGE against a graph stored in Neo4j, and we’re working towards better support for Neo4j in general, e.g. https://github.com/stellargraph/stellargraph/issues/1034 https://github.com/stellargraph/stellargraph/issues/1034.