4 ms·
A plug: if you are looking for TPC-style application-level benchmarks for database systems, check out the LDBC Social Network Benchmark [1]. It has workloads fo
by szarnyasg 4y ago
A plug: if you are looking for TPC-style application-level benchmarks for database systems, check out the LDBC Social Network Benchmark [1]. It has workloads for both OLTP and OLAP systems. We designed both of these to prevent many of the common benchmarking mistakes. To ensure that implementations follow the specification and their results are reproducible, we have a rigorous auditing process (similarly to TPC's benchmarks) [2].
[1] https://ldbcouncil.org/docs/presentations/ldbc-snb-2022-11.pdf https://ldbcouncil.org/docs/presentations/ldbc-snb-2022-11.p...
[2] https://ldbcouncil.org/benchmarks/snb/ https://ldbcouncil.org/benchmarks/snb/
- mapleeman 4y agoThis is indeed a good industry leading benchmark.
- mbuda 4y agoLDBC is really great, it is and it should be the standard non-biased benchmark to look at. The point with https://memgraph.com/benchgraph https://memgraph.com/benchgraph is to be more tilted towards some specific workloads, easy to extend and run, etc. Time will tell to which extend that could be achieved, but definitely a place to look for some interesting workloads and results. + the whole thing is super early and it's going to evolve! Again, definitely take a look at LDBC benchmarks they are in general the most relevant.