3 ms·

There's also a big implicit bias towards the concept that research is done in universities - in some places there's a distinction of institutions where universi

There's also a big implicit bias towards the concept that research is done in universities - in some places there's a distinction of institutions where universities focus on teaching and most of academic research is done outside of universities in separate research institutes (e.g. the Fraunhofer institute chain in Germany which employs many thousands of researchers and has resulted in a lot of high-impact science); a professor might be involved in both, but his research work wouldn't count for the university's rating (because it's not affiliated with the university) and the institutes are excluded from that rating because they don't teach undergrads.

nextos 5y ago
That's true. Some rankings like the one from Nature I mentioned do include institutes. As a result, places like Wellcome Sanger in Cambridge or Helmholtz in Germany rank really well and above most leading universities in their field. As you say, these are not universities, but research institutes and therefore ignored by ARWU, US News and others.
IanCal 5y ago
Rankings can also be affected depending on how the identification of the university in the affiliation is done. Automated matches are often lower for languages that have different ways of writing things (often when there are different characters, or it's written in different languages), changes to location/name/structure, and how long it's been around. Based on a quick look at wikipedia: For Szeged, the university is kind of old but also only appeared in it's current form in 2000. It's also called Szegedi Tudományegyetem. It has multiple colleges inside it, so it may depend on how well those are represented in the data. Authors using acronyms more makes identification less likely, each of the colleges have acronyms. Finally, where authors publish makes a big difference - not all publishers open their data up and even those that allow access to some raw data it can be less reliable to extract. So if you publish in places where the publisher does not make the affiliations easily machine readable your work may be counted less in many of these automated rankings. Pubmed (not a publisher but a key way a lot of people get some of this data) didn't have affiliations for anyone but the first author until some fairly late date. Either automated mappings are used for a lot of work (since there are tens of millions of unique affiliation strings), or the source material is heavily curated (so for example only the "top" N journals are looked at). source: worked on affiliation mapping at Dimensions in a previous life

nextos 5y ago

That's true. Some rankings like the one from Nature I mentioned do include institutes. As a result, places like Wellcome Sanger in Cambridge or Helmholtz in Germany rank really well and above most leading universities in their field. As you say, these are not universities, but research institutes and therefore ignored by ARWU, US News and others.

IanCal 5y ago

Rankings can also be affected depending on how the identification of the university in the affiliation is done. Automated matches are often lower for languages that have different ways of writing things (often when there are different characters, or it's written in different languages), changes to location/name/structure, and how long it's been around. Based on a quick look at wikipedia: For Szeged, the university is kind of old but also only appeared in it's current form in 2000. It's also called Szegedi Tudományegyetem. It has multiple colleges inside it, so it may depend on how well those are represented in the data. Authors using acronyms more makes identification less likely, each of the colleges have acronyms. Finally, where authors publish makes a big difference - not all publishers open their data up and even those that allow access to some raw data it can be less reliable to extract. So if you publish in places where the publisher does not make the affiliations easily machine readable your work may be counted less in many of these automated rankings. Pubmed (not a publisher but a key way a lot of people get some of this data) didn't have affiliations for anyone but the first author until some fairly late date. Either automated mappings are used for a lot of work (since there are tens of millions of unique affiliation strings), or the source material is heavily curated (so for example only the "top" N journals are looked at). source: worked on affiliation mapping at Dimensions in a previous life