4 ms·
> Freebase is an online collection of structured data which includes contributions from many sources including individual and user-generated contributions. Curr
by mikkom 10y ago
> Freebase is an online collection of structured data which includes contributions from many sources including individual and user-generated contributions. Currently, it has 1.9 Billion RDF N-Triples worth 250GB of uncompressed data. On top of that, this dataset is over 95% accurate with a complex and rich real world schema. It is an ideal data set to test the performance of Dgraph. We decided not to use the entire data set as it wasn’t necessary for our goal here.
I don't follow. Wasn't using as much data as possible exactly what scaling is about?
- mrjn 10y agoNot exactly. Given enough time and a lot of hard disk, you can put the entire 1.9B triples into any database -- that doesn't prove that it scales. Also, if the database uses a single global mutex lock for all reads and writes, again it's not a scalable architecture. Scaling is about throughput and latency. This post is trying to determine whether adding more machine power actually lets the db perform better.
- LoSboccacc 10y ago> Scaling is about throughput and latency. under reasonable constraint. throughput and latency from a cacheable dataset is moot for big data.