3 ms·
That's why I was so unsure. I think though, that it is generally better to have the input generator seeded and do not disclose the chosen seed in advance, which
by lifthrasiir 3y ago
That's why I was so unsure. I think though, that it is generally better to have the input generator seeded and do not disclose the chosen seed in advance, which prevents overfitting to a single input and yet encourages overfitting to a much bigger class of inputs.
- rocqua 3y agoThat invites probing submissions to figure out a good hash for all names from that one seed. I think having the names for performance tests public is fine. But there should be correctness tests on sets with random names.
- lifthrasiir 3y agoOf course, I assume names are also randomly generated. But it might be the case that they are all ASCII-only, which can be exploited.