3 ms·
Have you noticed the curious absence of independent commercial database or cloud platform benchmarks? If you publicly post benchmarks of most commercial databas
by jiggawatts 5y ago
Have you noticed the curious absence of independent commercial database or cloud platform benchmarks? If you publicly post benchmarks of most commercial database products or public cloud services, you'll get a scary letter from some expensive lawyers threatening to end your career, bankrupt you, and ruin your life.
They're not secret police because they're not secret, and they're not police. But in the same way, even if you broke no laws, they will punish you all the same. Small people punishing other small people for angering their "betters".
Explain to me how this is better.
- rank0 5y agoThis can’t be true. Where are you getting this info?
- jiggawatts 5y agohttps://www.brentozar.com/archive/2018/05/the-dewitt-clause-why-you-rarely-see-database-benchmarks/ https://www.brentozar.com/archive/2018/05/the-dewitt-clause-... https://dwheeler.com/essays/dewitt-clause.html https://dwheeler.com/essays/dewitt-clause.html
- tomrod 5y agoIt would seem this should be easy to work around. Simply assign the worst possible benchmark value since test cannot be conducted and make annotation as to why. Infinite time to run a query since benchmarking requires sneakernet approval from commercial provider, or some such. Put open source in the best possible light and highlight the DeWitt clause at the same time.
- pepperberg 5y agoHave a look at Google Cloud Platform's ToS: "Benchmarking. Customer may conduct benchmark tests of the Services (each a "Test"). Customer may only publicly disclose the results of such Tests if it (a) obtains Google's prior written consent, (b) provides Google all necessary information to replicate the Tests, and (c) allows Google to conduct benchmark tests of Customer's publicly available products or services and publicly disclose the results of such tests." https://cloud.google.com/terms/service-terms https://cloud.google.com/terms/service-terms
- wayneftw 5y agoI thought that people regularly ignored things like EULAs without running into legal problems. Who even reads them? I guess you'd get in trouble when you go to publish the results, but we probably would have heard about that by now if it ever happened with Google.
- deleted 5y ago[deleted]
- t8sr 5y agoAre you suggesting that if you post a performance benchmark about a commercial database that you’ll get threatened with legal action? Do you have anything to back that up? It sounds far fetched, and a cursory search finds many such benchmarks on random people’s blogs.
- spijdar 5y agoIt's present in the EULA for many databases, etc in http://download.microsoft.com/documents/useterms/SQL%20Server%20Standard_2000_English_330ff319-b1fc-47d1-862e-53a64ca2a568.pdf http://download.microsoft.com/documents/useterms/SQL%20Serve... "e.Benchmark Testing. You may not disclose the results of any benchmark test of either the Server Software or Client Software to any third party without Microsoft’s prior written approval." Hasty addition: I doubt random benchmarks would be threatened with legal action -- but the key is you are technically breaking your license agreement by posting a benchmark. I'm sure the likelihood of whatever DB company pursuing action depends on both the company, who you are, and in what avenue you posted your benchmark. If you're well known, have a large audience, and publish a bad benchmark of Oracle DB, I would be very surprised if Oracle didn't contact you directly and demand some action.
- Semaphor 5y agoThey’d be hard-pressed to make that case in Germany (or the EU actually, as they took our laws in that regard), the EULA has to follow the pretty strict regulations for AGBs which also can’t contain surprising clauses. This is only for B2C though.
- BiteCode_dev 5y agoDoesn't matter if that doesn't hold in court. The whole problem is that loosing in court has no cost for them, but just going to court is a net loss for you.
- gsnedders 5y agoThat depends on the country; losing in court could have the cost of your legal fees for them in some countries.
- deleted 5y ago[deleted]
- conradfr 5y agoIn the audio world people release plugins named "American Amp" or "Famous British Console". I wonder if you could post benchmarks of a "Big American Database" and get away with it.
- schmorptron 5y agoI've also heard this exact same thing from my Databases professor about Oracle and their products.
- redis_mlc 5y agoThe original reason for the ban on benchmarks is that it's difficult to do a rigorous and fair comparison between two databases. Even if you're an expert on one, it's unlikely you're an expert on two. However, everybody publishes TPCC results. http://www.tpc.org/tpcc/ http://www.tpc.org/tpcc/ The results of a stress test utility by MySQL AB were published, which encouraged various vendors to fix crash problems, thus preparing them for Internet-scale loads. Source: DBA.