Search

Despite growing demand for practicable methods of research evaluation, the use of bibliometric indicators remains controversial. This paper examines performance assessment practice in Europe—first, identifying the most commonly used bibliometric methods and, second, identifying the actors who have defined wide-spread practices. The framework of this investigation is Abbott's theory of professions, and I argue that indicator-based research assessment constitutes a potential jurisdiction for both individual experts and expert organizations. This investigation was conducted using a search methodology that yielded 138 evaluation studies from 21 EU countries, covering the period 2005 to 2019. Structured content analysis revealed the following findings: (1) Bibliometric research assessment is most frequently performed in the Nordic countries, the Netherlands, Italy, and the United Kingdom. (2) The Web of Science (WoS) is the dominant database used for public research assessment in Europe. (3) Expert organizations invest in the improvement of WoS citation data, and set technical standards with regards to data quality. (4) Citation impact is most frequently assessed with reference to international scientific fields. (5) The WoS classification of science fields retained its function as a de facto reference standard for research performance assessment. A detailed comparison of assessment practices between five dedicated organizations and other individual bibliometric experts suggests that corporate ownership and limited access to the most widely used citation databases have had a restraining effect on the development and diffusion of professional bibliometric methods during this period. [ABSTRACT FROM AUTHOR]

Based on the entire population of Nobel laureates in science from 1901 to 2017, we show that North America’s rise as global power in science started in the 1920s. Following a transition period (1940s to 1960s), its scientific hegemony was consolidated in the 1970s. Yet since the 2000s, North America’s global leadership in science has come under pressure. In that time, its share of laureates across disciplines dropped, although it has retained its attractiveness as a destination for future laureates from Europe and the Asia-Pacific region. In addition, we find that North America has become apparently less effective since 2010 in transferring capacities for conducting ground-breaking research from one generation of scientists to another. Furthermore, both Europe and the Asia-Pacific region have similarly high shares of newcomer organizations with regard to where prize-winning work is conducted, indicating that these two regions are very active in the inter-organizational competition for scientific talent. Despite this competition, however, we find no support for the rise of a new global center of science. [ABSTRACT FROM AUTHOR]

The use of bibliometric measures in the evaluation of research has increased considerably based on expertise from the growing research field of evaluative citation analysis (ECA). However, mounting criticism of such metrics suggests that the professionalization of bibliometric expertise remains contested. This paper investigates why impact metrics, such as the journal impact factor and the h-index, proliferate even though their legitimacy as a means of professional research assessment is questioned. Our analysis is informed by two relevant sociological theories: Andrew Abbott’s theory of professions and Richard Whitley’s theory of scientific work. These complementary concepts are connected in order to demonstrate that ECA has failed so far to provide scientific authority for professional research assessment. This argument is based on an empirical investigation of the extent of reputational control in the relevant research area. Using three measures of reputational control that are computed from longitudinal inter-organizational networks in ECA (1972–2016), we show that peripheral and isolated actors contribute the same number of novel bibliometric indicators as central actors. In addition, the share of newcomers to the academic sector has remained high. These findings demonstrate that recent methodological debates in ECA have not been accompanied by the formation of an intellectual field in the sociological sense of a reputational organization. Therefore, we conclude that a growing gap exists between an academic sector with little capacity for collective action and increasing demand for routine performance assessment by research organizations and funding agencies. This gap has been filled by database providers. By selecting and distributing research metrics, these commercial providers have gained a powerful role in defining de-facto standards of research excellence without being challenged by expert authority. [ABSTRACT FROM AUTHOR]

This paper investigates the factors that support building capacity in global environmental change research. We compare two major international collaboration programs in Earth and environmental sciences, the International Geosphere Biosphere Program (IGBP) and the International Hydrological Program (IHP). High mutual dependence, a positive international scientific reputation, and bottom-up funding structure explain the IGBP's capability to effectively organize international collaboration; low mutual dependence, intergovernmental decision structures, and organizational barriers to growth hinder effective capacity building by the IHP. We conclude that future collaboration programs focusing on cumulative global change research should consider the relative strengths of both collaboration models. [ABSTRACT FROM AUTHOR]

The paper examines the characteristics and performance of regional innovation systems in 12 new member states of the European Union. More specifically, it develops a typology that differentiates their various potentials as innovative regions. Based on a principal component analysis, five different groups of regions are identified. The characteristic profile of each group is detailed and exploration of possible paths of innovation-based regional development is presented for each type of region. The paper concludes with an examination of policy implications emerging from the analysis. [ABSTRACT FROM AUTHOR]