3 ms·

Titan Distributed Graph Database 0.5.0

54 points by okram 12y ago

sixwing 12y ago
Some nice changes in this release. Having built-in TTL on edges and vertices would have simplified several different system's I've worked on.
ddorian43 12y ago
http://s3.thinkaurelius.com/docs/titan/0.5.0/changelog.html http://s3.thinkaurelius.com/docs/titan/0.5.0/changelog.html
blutoot 12y ago
This might a stupid question but is this competing with Neo4j or Giraph? I didn't see a mention of comparison with either in the docs. I believe graph data storage and graph processing are two different things - is TItan doing both?
- okram 12y ago
  Titan provides both graph analytic (OLAP) and graph database capabilities (OLTP). For more information, please read: http://thinkaurelius.com/2013/05/13/educating-the-planet-with-pearson/ http://thinkaurelius.com/2013/05/13/educating-the-planet-wit... (cluster-sized graphs OLTP) http://thinkaurelius.com/2012/11/11/faunus-provides-big-graph-data-analytics/ http://thinkaurelius.com/2012/11/11/faunus-provides-big-grap... (OLAP engine) http://thinkaurelius.com/2013/11/24/boutique-graph-data-with-titan/ http://thinkaurelius.com/2013/11/24/boutique-graph-data-with... (single-machine sized graphs OLTP)
- mooneater 12y ago
  Might find this interestign: http://euranova.eu/upl_docs/publications/an-empirical-comparison-of-graph-databases.pdf http://euranova.eu/upl_docs/publications/an-empirical-compar...
  - okram 12y ago
    That is an old version of Titan. Please see 0.4.1+ and Titan's caching model: http://thinkaurelius.com/2013/11/24/boutique-graph-data-with-titan/ http://thinkaurelius.com/2013/11/24/boutique-graph-data-with...
mooneater 12y ago
Some benchmarks against other graphdbs (but it was with Titan 0.3): http://euranova.eu/upl_docs/publications/an-empirical-comparison-of-graph-databases.pdf http://euranova.eu/upl_docs/publications/an-empirical-compar...
- bobbriody 12y ago
  If you're looking for more up-to-date information about Titan's capabilities then check out these posts. Titan underwent major changes to optimize in-memory operations. Here is some up-to-date info on that: http://thinkaurelius.com/2013/11/24/boutique-graph-data-with-titan/ http://thinkaurelius.com/2013/11/24/boutique-graph-data-with... IIRC, the euranova benchmark doesn't discuss scalability. This post does: http://thinkaurelius.com/2013/05/13/educating-the-planet-with-pearson/ http://thinkaurelius.com/2013/05/13/educating-the-planet-wit...
okram 12y ago
For those interested in Titan 1.0 roadmap and the evolution of the Titan OLTP/OLAP story. Titan will be implementing TinkerPop3 API http://www.tinkerpop.com/docs/current/ http://www.tinkerpop.com/docs/current/ ... Currently, Titan 0.5.0 leverages the Faunus Gremlin compiler (http://faunus.thinkaurelius.com http://faunus.thinkaurelius.com), but with TinkerPop3, TinkerPop3 provides an OLAP compiler for Gremlin that will make things easier for Titan as well as other graph computing engines implementing the stack http://www.tinkerpop.com/docs/current/#traversalvertexprogram http://www.tinkerpop.com/docs/current/#traversalvertexprogra...
- emehrkay 12y ago
  We are getting a bunch of exceptions because of the Gremlin complier, I hope that TinkerPop complier performs better.
  - okram 12y ago
    ?. Perhaps you might want to ask questions on the public mailing list. https://groups.google.com/forum/#!forum/aureliusgraphs https://groups.google.com/forum/#!forum/aureliusgraphs
vosper 12y ago
I would love to hear about peoples experiences working with Titan (or other graph dbs, for that matter) - I've been following the project with interest for some time now. If you don't want to comment on HN I'd really appreciate an email to craig dot glennie gmail
- emehrkay 12y ago
  We are using titan at my job and we will be releasing an open source library for interacting with the graph in PHP via Gremlin call Mogwai (there seems to be a few libs with the same name and purpose, so we might change it). We like it so far, but are having some issues with the server crashing. I'll update to this release and see if it fixes our issues.
grizzles 12y ago
Does this one work? I spent a bit of time playing with Titan earlier this year before passing and moving on. IMHO the project made a critical design error by trying to be backend agnostic. From a technical perspective, that gives the worst of all worlds for everyone involved.
- mbroecheler 12y ago
  Yes, it works :-) Support for multiple storage backends gives Titan a lot of deployment flexibility and allows it to inherit some great features like multi DC support. Software component reuse is pretty standard these days. What lead you to the conclusion that it is the worst of all worlds?
  - grizzles 12y ago
    I think you've documented some of the issues on the Titan Limitations page. For us, we couldn't get Titan to work properly, which we documented in the Issue Tracker. That lead me to the conclusion that Titan was just too complex because from my perspective it's obvious that you guys are spreading yourselves too thin with the 7 different backends. Why do you need both a BerkeleyDB and PersistIt backend? At the absolute most you should have 2 or 3. Single Machine, AP Cluster, ACID Cluster. 7 backends means 7 different database products, with the same API facade. Duh right? Well the problem is that constrains your API to a least common denominator feature set, limiting access to the unique attributes and capabilites of the underlying backend. Not to mention completely abstracting away memory/disk issues. This is a really big issue with your approach. You have some sunken costs here but I think eventually you will see the value in tightening up your focus.
espeed 12y ago
Here's Matthias' talk on Titan at StrangeLoop 2013... Graph Computing at Scale http://www.infoq.com/presentations/scaling-graphs http://www.infoq.com/presentations/scaling-graphs
lobster_johnson 12y ago
How does Titan compare to OrientDB?

54 points by okram 12y ago

Some nice changes in this release. Having built-in TTL on edges and vertices would have simplified several different system's I've worked on.

ddorian43 12y ago

http://s3.thinkaurelius.com/docs/titan/0.5.0/changelog.html http://s3.thinkaurelius.com/docs/titan/0.5.0/changelog.html

blutoot 12y ago

This might a stupid question but is this competing with Neo4j or Giraph? I didn't see a mention of comparison with either in the docs. I believe graph data storage and graph processing are two different things - is TItan doing both?

okram 12y ago
Titan provides both graph analytic (OLAP) and graph database capabilities (OLTP). For more information, please read: http://thinkaurelius.com/2013/05/13/educating-the-planet-with-pearson/ http://thinkaurelius.com/2013/05/13/educating-the-planet-wit... (cluster-sized graphs OLTP) http://thinkaurelius.com/2012/11/11/faunus-provides-big-graph-data-analytics/ http://thinkaurelius.com/2012/11/11/faunus-provides-big-grap... (OLAP engine) http://thinkaurelius.com/2013/11/24/boutique-graph-data-with-titan/ http://thinkaurelius.com/2013/11/24/boutique-graph-data-with... (single-machine sized graphs OLTP)
mooneater 12y ago
Might find this interestign: http://euranova.eu/upl_docs/publications/an-empirical-comparison-of-graph-databases.pdf http://euranova.eu/upl_docs/publications/an-empirical-compar...
- okram 12y ago
  That is an old version of Titan. Please see 0.4.1+ and Titan's caching model: http://thinkaurelius.com/2013/11/24/boutique-graph-data-with-titan/ http://thinkaurelius.com/2013/11/24/boutique-graph-data-with...

mooneater 12y ago

Some benchmarks against other graphdbs (but it was with Titan 0.3): http://euranova.eu/upl_docs/publications/an-empirical-comparison-of-graph-databases.pdf http://euranova.eu/upl_docs/publications/an-empirical-compar...

bobbriody 12y ago
If you're looking for more up-to-date information about Titan's capabilities then check out these posts. Titan underwent major changes to optimize in-memory operations. Here is some up-to-date info on that: http://thinkaurelius.com/2013/11/24/boutique-graph-data-with-titan/ http://thinkaurelius.com/2013/11/24/boutique-graph-data-with... IIRC, the euranova benchmark doesn't discuss scalability. This post does: http://thinkaurelius.com/2013/05/13/educating-the-planet-with-pearson/ http://thinkaurelius.com/2013/05/13/educating-the-planet-wit...

okram 12y ago

For those interested in Titan 1.0 roadmap and the evolution of the Titan OLTP/OLAP story. Titan will be implementing TinkerPop3 API http://www.tinkerpop.com/docs/current/ http://www.tinkerpop.com/docs/current/ ... Currently, Titan 0.5.0 leverages the Faunus Gremlin compiler (http://faunus.thinkaurelius.com http://faunus.thinkaurelius.com), but with TinkerPop3, TinkerPop3 provides an OLAP compiler for Gremlin that will make things easier for Titan as well as other graph computing engines implementing the stack http://www.tinkerpop.com/docs/current/#traversalvertexprogram http://www.tinkerpop.com/docs/current/#traversalvertexprogra...

emehrkay 12y ago
We are getting a bunch of exceptions because of the Gremlin complier, I hope that TinkerPop complier performs better.
- okram 12y ago
  ?. Perhaps you might want to ask questions on the public mailing list. https://groups.google.com/forum/#!forum/aureliusgraphs https://groups.google.com/forum/#!forum/aureliusgraphs

vosper 12y ago

I would love to hear about peoples experiences working with Titan (or other graph dbs, for that matter) - I've been following the project with interest for some time now. If you don't want to comment on HN I'd really appreciate an email to craig dot glennie gmail

emehrkay 12y ago
We are using titan at my job and we will be releasing an open source library for interacting with the graph in PHP via Gremlin call Mogwai (there seems to be a few libs with the same name and purpose, so we might change it). We like it so far, but are having some issues with the server crashing. I'll update to this release and see if it fixes our issues.

grizzles 12y ago

Does this one work? I spent a bit of time playing with Titan earlier this year before passing and moving on. IMHO the project made a critical design error by trying to be backend agnostic. From a technical perspective, that gives the worst of all worlds for everyone involved.

mbroecheler 12y ago
Yes, it works :-) Support for multiple storage backends gives Titan a lot of deployment flexibility and allows it to inherit some great features like multi DC support. Software component reuse is pretty standard these days. What lead you to the conclusion that it is the worst of all worlds?
- grizzles 12y ago
  I think you've documented some of the issues on the Titan Limitations page. For us, we couldn't get Titan to work properly, which we documented in the Issue Tracker. That lead me to the conclusion that Titan was just too complex because from my perspective it's obvious that you guys are spreading yourselves too thin with the 7 different backends. Why do you need both a BerkeleyDB and PersistIt backend? At the absolute most you should have 2 or 3. Single Machine, AP Cluster, ACID Cluster. 7 backends means 7 different database products, with the same API facade. Duh right? Well the problem is that constrains your API to a least common denominator feature set, limiting access to the unique attributes and capabilites of the underlying backend. Not to mention completely abstracting away memory/disk issues. This is a really big issue with your approach. You have some sunken costs here but I think eventually you will see the value in tightening up your focus.

espeed 12y ago

Here's Matthias' talk on Titan at StrangeLoop 2013... Graph Computing at Scale http://www.infoq.com/presentations/scaling-graphs http://www.infoq.com/presentations/scaling-graphs

lobster_johnson 12y ago

How does Titan compare to OrientDB?