3 ms·
As an admin of the elixir slack, i have to handle that one a lot. It is not really realistic at all no. But mostly because the benchmark is not realistic of a
by di4na 7y ago
As an admin of the elixir slack, i have to handle that one a lot.
It is not really realistic at all no. But mostly because the benchmark is not realistic of a production load. That said we should do better.
The main reason it is not fixed is that the few members of the community that tried to fix it had a really bad experience interacting with the repo and getting feedback of impact and simply lost interest. And we have not have people motivated enough so far because they do not really care about the benchmark.
Ofc it matters to people that are not in the community but well...
That said, yes we would never be close to Rust anyway (probably) but we could probably have a far better standard deviation than Rust. Something that tend to matter in production a lot but people forget reading benchmark is the spread of the response time vs the average one.
We should also perform better in a noisy environment like the "cloud" one.
There are hopes that the recent EEF marketing group could help find volunteers or finance someone to fix it.
- steveklabnik 7y agoYep, that makes perfect sense. I've had good experiences contributing, but it can be tough... It's also 100% true that benchmarks are not representative of production loads. Sadly, it's also 100% true that programmers make decisions based on benchmarks that aren't representative of production loads. It's a real catch-22 situation.