3 ms·

A theme of the comments so far has been around the fact that the benchmark is created in a manner that feels biased. QUICK STRAW POLL: What is the right way fo

A theme of the comments so far has been around the fact that the benchmark is created in a manner that feels biased. QUICK STRAW POLL: What is the right way for that information to be gathered and presented? a. There is no bias. Companies can and should present research that may favor them, as long as they cite good sources. b. An industry analyst, paid to research multiple companies and options and present that information to their respective (most likely paying) customers. c. A journalist, presenting research in public, funded by advertising for unrelated interests. d. Reporting by peers/actual users of the system on how the products compare, and possibly about how it aligns with their technical and business goals. e. Trust no one. Conduct your own research, and publish it if you see fit to so do, or keep it to yourself. I see potential "disinformation vulnerability" with each approach. How ought we get the best info on how to align our organizations with technologies?

RobLach 8y ago
The best benchmarks I’ve witnessed come out of academia.
thekozmo 8y ago
The benchmark was done as fair as possible but I'm the vendor, yes, don't take my word (despite good background in OSS and earlier achievements). Listen to our users: - Here's a webinar by one of our customers explaining how they migrated from Mongo+Hive, received better consistency and simplicity while saving 5X: https://www.youtube.com/watch?v=1hXKd_rNyuE https://www.youtube.com/watch?v=1hXKd_rNyuE - See how kiwi.com got a CRAZY gain with Scylla vs Cassandra: https://youtu.be/Bqh09LG_QDE?t=833 https://youtu.be/Bqh09LG_QDE?t=833 - See Grab (South east Asia Uber) about Dynamo vs Scylladb: https://www.scylladb.com/users/case-study-grab-hails-scylla-for-performance-and-ease-of-use/ https://www.scylladb.com/users/case-study-grab-hails-scylla-... Go ahead and give it a try and see for yourself

RobLach 8y ago

The best benchmarks I’ve witnessed come out of academia.

thekozmo 8y ago

The benchmark was done as fair as possible but I'm the vendor, yes, don't take my word (despite good background in OSS and earlier achievements). Listen to our users: - Here's a webinar by one of our customers explaining how they migrated from Mongo+Hive, received better consistency and simplicity while saving 5X: https://www.youtube.com/watch?v=1hXKd_rNyuE https://www.youtube.com/watch?v=1hXKd_rNyuE - See how kiwi.com got a CRAZY gain with Scylla vs Cassandra: https://youtu.be/Bqh09LG_QDE?t=833 https://youtu.be/Bqh09LG_QDE?t=833 - See Grab (South east Asia Uber) about Dynamo vs Scylladb: https://www.scylladb.com/users/case-study-grab-hails-scylla-for-performance-and-ease-of-use/ https://www.scylladb.com/users/case-study-grab-hails-scylla-... Go ahead and give it a try and see for yourself