4 ms·
This is really well executed. I am always surprised that more graph engines are not designed using the internal architecture here. Similar designs actually work
by jandrewrogers 9y ago
This is really well executed. I am always surprised that more graph engines are not designed using the internal architecture here. Similar designs actually work well in more distributed environments. The design is close to a graph engine I wrote for a supercomputer in 2009, particularly how the parallelization and scale-out work, which performed well. The overhead of networking is significant but can be partially mitigated with aggressive latency hiding techniques.
The article demonstrates how efficiently a very large graph can be processed on a single machine but the architecture has analogues that work nicely on large compute clusters too. It is just a good way to process graphs.
- jacquesm 9y agoDo you have any papers about your work online? That sounds super interesting.
- sologoub 9y agoNot the OP, but googled and this was the second after LinkedIn: http://www.jandrewrogers.com/2015/10/08/spacecurve/ http://www.jandrewrogers.com/2015/10/08/spacecurve/
- jandrewrogers 9y agoUnfortunately not. I've recently started working on a series of articles and papers to close that gap though.