4 ms·
Those rankings based on countries don't say much IMHO. It depends on : - the score. If the top 5 achieves 85/100 and the the rest of the top 20 achieves 83/100
by antpls 8y ago
Those rankings based on countries don't say much IMHO.
It depends on :
- the score. If the top 5 achieves 85/100 and the the rest of the top 20 achieves 83/100, they are all on par.
- the field. If it's academic with open source code and scientific results shared with everyone on Earth, who cares who is in the top 5?
It's a global effort
- nopinsight 8y agoActual figures for CoQA from the link above: No.1 is 86.8%; no.5, 81.4%; no.20, 66.5%. No.5, though quite impressive (humans are at 88.8%), still give about two-fifth more errors than no.1. These technologies tend toward natural monopolies as users tend to choose among the top 3-4 providers which allow them to spread costs, lower prices, and acquire yet more data. The winners at the right time tend to hold long-term monopolistic/oligopolistic power, until a major breakthrough happens. Also, all results in the top 20 from the same link are from either the US or China (except for a couple of anonymous results). At least in this subfield, there could be only two national contenders, despite many key papers being open. Exact algorithms, implementation details, and system engineering and integration count.