Search

Loet Leydesdorff (mentioned as Loet in the following) passed away in March 2023. Our paper is dedicated to the important contributions of this exceptional researcher (in scientometrics). We investigated which studies, theories, methods, and ideas have influenced Loet's scientific work. The method reference publication year spectroscopy (RPYS) can be used to answer this and related questions. Many RPYS studies have been published regarding the historical roots of research fields, journals, and scientists. The program CRExplorer was specifically developed for RPYS. In this study, we used CRExplorer to investigate the historical roots and influential publications of Loet's oeuvre. The results demonstrate the wide range of topics in Loet's research and their fundamental meaning for the scientometric field. [ABSTRACT FROM AUTHOR]

In recent years, high-growth entrepreneurship (HGE) research has gained increasing importance. For this reason, it is considered necessary to analyze papers that have had the most significant impact on the development of the discipline and that should be familiar to all researchers. Building new knowledge on these works is important because it provides legitimacy and coherence to the future development of this research field. Thus, this paper aims to identify and characterize the classic articles in the field of HGE, a line of research that has seen significant growth in the last 30 years. The H-Classics method is used to identify these papers. Subsequently, several bibliometric aspects of this collection are analyzed, such as the forums of journals where they have been published, the most productive authors, the patterns of collaboration, and an analysis of the conceptual structure through co-word analysis. Exhaustive content analysis is carried out to complement this vision, identifying the proposed objectives, methodologies, types of data, analysis techniques used, and their main contributions in three consecutive periods. The results are of value to researchers interested in high-growth firms because they allow us to understand the foundations on which this discipline has been built through its classics and to determine its main challenges for the future. [ABSTRACT FROM AUTHOR]

The purpose of this paper is to commemorate the late scholar Loet Leydesdorff for his great academic contribution on the basis of data from Web of Science. In the span of more than 40 years, he had 526 publications, with the years 2004-2021 being the most productive (394 publications). His international collaborations spread widely across 36 countries, with Germany, the USA, the UK, China, Russia, and South Korea being the most significant. His most frequent collaboration partners included Lutz Bornmann (Germany), Staša Milojević (USA), Caroline Wagner (USA), Henry Etzkowitz (USA), Jonathan Adams (UK), Ronald Rousseau (Belgium), and Ping Zhou (China). With a broad and deep knowledge background, Leydesdorff's research extended across multiple disciplines and fields, but he was most active in library and information science and computer science. He made profound contributions to the study of bibliometrics, innovation systems (the Triple Helix model), and communications. Leydesdorff had a remarkable and extensive citation impact, with citations in 221 WoS subject categories from 120 countries. His publications in 1996, 1998, 2000, 2005, 2006, and 2012 are highly cited, and those on university-industry-government relations (the Triple Helix model) are the most cited. [ABSTRACT FROM AUTHOR]

With the announcement of the retirement of Microsoft Academic Graph (MAG), the non-profit organization OurResearch announced that they would provide a similar resource under the name OpenAlex. Thus, we compare the metadata with relevance to bibliometric analyses of the latest MAG snapshot with an early OpenAlex snapshot. Practically all works from MAG were transferred to OpenAlex preserving their bibliographic data publication year, volume, first and last page, DOI as well as the number of references that are important ingredients of citation analysis. More than 90% of the MAG documents have equivalent document types in OpenAlex. Of the remaining ones, especially reclassifications to the OpenAlex document types journal-article and book-chapter seem to be correct and amount to more than 7%, so that the document type specifications have improved significantly from MAG to OpenAlex. As another item of bibliometric relevant metadata, we looked at the paper-based subject classification in MAG and in OpenAlex. We found significantly more documents with a subject classification assignment in OpenAlex than in MAG. On the first and second level, the classification structure is nearly identical. We present data on the subject reclassifications on both levels in tabular and graphical form. The assessment of the consequences of the abundant subject reclassifications on field-normalized bibliometric evaluations is not in the scope of the present paper. Apart from this open question, OpenAlex seems to be overall at least as suited for bibliometric analyses as MAG for publication years before 2021 or maybe even better because of the broader coverage of document type assignments. [ABSTRACT FROM AUTHOR]

This study analyses the thematic and conceptual structure of the Spanish scientific production published in Emerging Sources Citation Index (Web of Science) journals. In this way, the aim is to identify the closest links between concepts and terms based on the co-occurrence of keywords used by the authors of the papers analysed, and also to point out the theoretical foundations that exist in the discipline through the co-citation relationships of articles in the bibliography of the documents in the sample. Finally, these results were compared with those obtained from the analysis of Spanish scientific production in Social Sciences Citation Index (SSCI). To achieve these objectives, a network analysis of the co-occurrence of keywords and co-citation of references in articles published in Communication journals between 2015 and 2021 in ESCI (N = 3,559) and SSCI (N = 1,738) with at least one author linked to a Spanish institution was carried out. The results point to similar structural cohesion values and to a thematic and methodological similarity between both sets observed. There is a marked tendency towards quantitative studies on new technologies. While in SSCI there is an almost absolute dominance of Journalism studies, in ESCI there is a greater diversity of other disciplines such as Audiovisual Communication or Advertising. However, the intellectual structure of the production in SSCI reflects a more specialised character than in ESCI. [ABSTRACT FROM AUTHOR]

The field of Communication in Spain is analyzed, contextualizing Spanish output at a global and local level between the years 2000 and 2020. Based on a descriptive bibliometric analysis of the Communication category of the Social Sciences Citation Index database, part of Web of Science, the impact of the main countries is identified. The weight of the output in the Emerging Sources Citation Index (ESCI) database between 2015 and 2020 is also studied. An analysis of the output by universities in Spain for the period 2010–2020 is also carried out, comparing it with the impact and the works in the first quartile. The results reveal that Spain has been the fourth country in terms of output in Communication in the last decade and that Austria stands out as the country whose works have the greatest impact. It is also observed that 67% of Spain’s works in Communication are published in journals that are indexed in ESCI. The impact of Spanish universities is very close to the world average. The Universitat Pompeu Fabra stands out, publishing the most articles and, furthermore, being the Spanish university with most papers in the first quartile of the JCR in Communication between 2010 and 2020. The study of the Shanghai Ranking by area includes eight Spanish universities, only three of which have output in Communication that comes mainly from professors in this area. The role of the Spanish journals Comunicar and Profesional de la información is notable, as they publish a large fraction of the output by Spanish universities in the Communication field. Finally, this paper presents the challenges of research in Communication, as well as those related to its bibliometric analysis, and a reflection on the problems that affect scientific production and research in this subject area. [ABSTRACT FROM AUTHOR]

COVID-19 has greatly impacted science. It has become a global research front that constitutes a unique phenomenon of interest for the scientometric community. Accordingly, there has been a proliferation of descriptive studies on COVID-19 papers using altmetrics. Social media metrics serve to elucidate how research is shared and discussed, and one of the key points is to determine which factors are well-conditioned altmetric values. The main objective of this study is to analyze whether the altmetric mentions of COVID-19 medical studies are associated with the type of study and its level of evidence. Data were collected from the PubMed and Altmetric.com databases. A total of 16,672 publications by study types (e.g., case reports, clinical trials, or meta-analyses) that were published in the year 2021 and that had at least one altmetric mention were retrieved. The altmetric indicators considered were Altmetric Attention Score (AAS), news mentions, Twitter mentions, and Mendeley readers. Once the dataset of COVID-19 had been created, the first step was to carry out a descriptive study. Then, a normality hypothesis was evaluated by means of the Kolmogorov–Smirnov test, and since this was significant in all cases, the overall comparison of groups was performed using the nonparametric Kruskal–Wallis test. When this test rejected the null hypothesis, pairwise comparisons were performed with the Mann–Whitney U test, and the intensity of the possible association was measured using Cramer’s V coefficient. The results suggest that the data do not fit a normal distribution. The Mann–Whitney U test revealed coincidences in five groups of study types: The altmetric indicator with most coincidences was news mentions, and the study types with the most coincidences were the systematic reviews together with the meta-analyses, which coincided with four altmetric indicators. Likewise, between the study types and the altmetric indicators, a weak but significant association was observed through the chi-square and Cramer’s V. It can thus be concluded that the positive association between altmetrics and study types in medicine could reflect the level of the “pyramid” of scientific evidence. [ABSTRACT FROM AUTHOR]

The aim of this article is to explore the editorial response of journals to research articles that may contain methodological errors or misconduct. A total of 17,244 articles commented on in PubPeer, a post-publication peer review site, were processed and classified according to several error and fraud categories. Then, the editorial response (i.e., editorial notices) to these papers were retrieved from PubPeer, Retraction Watch, and PubMed to obtain the most comprehensive picture. The results show that only 21.5% of the articles that deserve an editorial notice (i.e., honest errors, methodological flaws, publishing fraud, manipulation) were corrected by the journal. This percentage would climb to 34% for 2019 publications. This response is different between journals, but cross-sectional across all disciplines. Another interesting result is that high-impact journals suffer more from image manipulations, while plagiarism is more frequent in low-impact journals. The study concludes with the observation that the journals have to improve their response to problematic articles. [ABSTRACT FROM AUTHOR]

A new indicator of technological impact of a scientific journal is presented, based on citations in patent applications to papers published in that journal. Key characteristics are that patent citations are aggregated by patent family, and that not all citations are considered equal. To each family citation a weight is assigned that is proportional to the Gross Domestic Product (GDP) of the countries in which protection is requested, to take into account the costs and expected benefits of patenting, and inversely proportional to the number of cited references in a patent family, as a way to correct for differences in citation frequencies in patent applications among technological fields. Around one third of journals indexed in Scopus have at least one citation from patent applications in a 5-year citation window. The distribution of the technological impact scores among journals can be modelled as a power law distribution, with the slope being a little smoother than that of common scientific impact indicators SJR and JIF. However, the correlations between technological and scientific impact indicators are mostly low or moderate, which shows that they measure quite different aspects of journal or research performance. [ABSTRACT FROM AUTHOR]

Within the current panorama of science evaluation, the limitations of citation indexes to study the social sciences and humanities have been the subject of wide debate. To resolve this situation, different products have been created for use in national contexts, since they cover certain aspects not contained in more international indices. An example is the In-RECS family, where an indicator such as the impact factor of Eugene Garfield is defined, but its contribution lies in the ability to evaluate research in Spain by obtaining citation indicators. This paper thus highlights the need to create new products for research evaluation in general, but particularly in the social sciences and humanities. The context in which different alternatives arise and are developed to evaluate existing journals is presented, along with Dialnet Metrics, a citation index developed by the Dialnet Foundation in collaboration with the EC3 Group and dozens of Spanish universities. Based on an analysis of the citations of source journals from different subject areas, Dialnet Metrics provides indicators to evaluate the research impact at different levels. This bibliometric product enables contextualized analysis at the micro (researchers), meso (journals), and macro (areas and universities) levels. Finally, the content, data volumes, and structure of this citation index are described quantitatively. [ABSTRACT FROM AUTHOR]

The news media's citations of journals, authors, and papers have been used avant la letre to study the impact of science in the lay press and some characteristics of scientific journalism. In this paper, the concepts of press citation and media impact are outlined by analogy to those of scientific citation and scientific impact, establishing their similarities and differences. Some possibilities of study using press citations counts are also outlined, as well as the development of new bibliometric indicators to measure the media impact of science. The analysis of press citations has advantages over alternative metrics (altmetrics) because the press is the main news producer and offers a more consolidated product with a professional filter. However, press citations also have some limitations, mainly the lack of a database of press citations from scientific journals in the international lay press. [ABSTRACT FROM AUTHOR]

The evaluation of scientific journals with bibliometric indicators has been dominated by the Impact factor since the 70s. However Thomson has recently included in the Journal Citation Reports the Eigen factor and the Article influence score. On the other hand Elsevier has included in Scopus the Source normalized impact per paper (SNIP) and the SCImago journal rank (SJR). In this paper we introduce and describe these indicators. Secondly, to study the similarities we analyze correlations of the traditional indicators and the new ones, detailing the results across 27 scientific fields. It was noted that some couples of indicators such as Eigen- Citations, Impact factor-ArticleScore, Impact factor-SJR and SJR-ArticleScore do correlate in many areas. Correlations showed different trends in Science and Social science; therefore, in the last section we discuss the need to take into account the scientific area when selecting an indicator. [ABSTRACT FROM AUTHOR]

Patents include citations, both to other patents and to documents that are not patents (NPL, Non-patent literature). Non-patent literature (NPL) includes articles published in scientific journals. The technological impact of scientific works can be studied through the citations they receive from patents, just like the scientific impact of articles can be analyzed through the citations. The NPL references included in patents are far from being standardized, so determining which scientific article they refer to is not a trivial task. This paper presents a procedure for linking the NPL references of the patents collected in the Patstat database and the scientific works indexed in the Scopus bibliographic database. This procedure consists of two phases: a broad generation of candidate couples and another phase of validation of couples, and it has been implemented with reasonably good results at a low cost. [ABSTRACT FROM AUTHOR]

A bibliometric analysis of research production in scientific journals, of the Scopus subject category Food Science, between 2003 and 2013, from seventy-one Spanish institutions with at least fifty works published, is presented. Statistical z tests are used for an evaluation of the degree to which an observed number of top-cited papers (top-10%) for an institution differs from the number expected, on the basis of randomness in the selection of papers. A map has been generated that displays inter-institutional collaboration networks; activity and impact values are displayed. The results show the most active institutions, located primarily in Madrid, Cataluña, Valencia, and Murcia, belong to the Spanish National Research Council (CSIC) and Catalonian research institutions. [ABSTRACT FROM AUTHOR]

In this paper, we will be carrying out an in-depth analysis of a series of investigations involving concept maps used in eye tracking methodology. First, the background to this kind of research is analyzed: on the one hand we will focus on generic scientific literature about those concept maps with theoretical foundations in the psychology of learning, and second the literature of eye tracking in teaching and learning will be reviewed. Finally, we will center our attention on the way in which the literature for these two areas overlaps. A total of 15 published works on concept maps using eye tracking were located and subsequently the quality of these papers, their visibility, topics, and results were analyzed. The findings show there are very few published works on this subject, all originated from dispersed sources which proved difficult to locate, despite the fact that eye tracking methodology lends itself perfectly to the study of concept maps. We predict that in coming years there will be many more publications in this field. [ABSTRACT FROM AUTHOR]

Since the end of the 1980s, citation impact values -especially for evaluative purposes- are increasingly presented as fieldnormalized citation scores than as bare citation counts or citation rates. In rather popular variants of the scores, the average score over a publication year is not exactly one due to multiple Web of Science subject categories per paper. We propose a scaling method which introduces slight changes in the field-normalized scores of each paper that ensures that the average value of all scores equals one. [ABSTRACT FROM AUTHOR]

This bibliometric study analyzes the research output produced by Spain during the 2005-2014 time period in Open Access (OA) journals indexed in Web of Science. The aim of the paper is to determine if papers published in Open Access journals contribute to the improvement of citation impact and collaboration indicators in Spanish research. The results are shown by scientific areas and compared with 17 European countries. Spain is the second highest ranking European country with gold OA publication output and the fourth highest in Open Access output (9%). In Spain OA output is especially high in the fields of Arts and Humanities (28%). Spain's normalized citation impact in Open access (0.72) is lower than the world average and that of the main European countries. Finally, we discuss how these results differ from the so-called Open Access citation advantage. [ABSTRACT FROM AUTHOR]

Over the recent years, the subject of university rankings has attracted a significant amount of attention and sparked a scientific debate. However, few studies on this topic focus on elaborating the scientific performance of universities' institutions, such as institutes, schools, and faculties. For this reason, the aim of this study is to design an appropriate framework for evaluating and ranking institutions within a university. The devised methodology ranks institutions based on the number of published papers, mean normalized citation score (MNCS), and four percentile-based indicators using the I-distance method. We applied the proposed framework and scrutinized the University of Belgrade (UB) as the biggest and the best-ranked university in Serbia. Thus, 31 faculties and 11 institutes were compared. Namely, an in-depth percentile-based analysis of the UB papers indexed in the Science Citation Index Expanded (SCIe) and the Social Science Citation Index (SSCI) for the period 2008-2011 is provided. The results clearly show considerable discrepancies in two occasions: first, when it comes to the question of leading author, and second, when it comes to analyzing the percentile rank classes (PRs) of groups of faculties. [ABSTRACT FROM AUTHOR]

paper presents and describes the methodological opportunities offered by bibliometric data to produce indicators of scientific mobility. Large bibliographic datasets of disambiguated authors and their affiliations allow for the possibility of tracking the affiliation changes of scientists. Using the Web of Science as data source, we analyze the distribution of types of mobile scientists for a selection of countries. We explore the possibility of creating profiles of international mobility at the country level, and discuss potential interpretations and caveats. Five countries -Canada, The Netherlands, South Africa, Spain, and the United States- are used as examples. These profiles enable us to characterize these countries in terms of their strongest links with other countries. This type of analysis reveals circulation among and between countries with strong policy implications. [ABSTRACT FROM AUTHOR]

Although there are many models for ranking higher education institutions, the SCImago Institutions Rankings methodology stands out for its ability to present quantitative and qualitative indicators of scientific output. Besides Total number of published papers, several indicators are concerned with quality dimensions of published papers, such as International collaboration, Scientific leadership or High quality publications. However, official rankings are provided solely on the basis of one indicator: Output (total number of published papers). This paper presents a statistical I-distance method that integrates all the indicators into one value, which therefore represent a rank and show which of the input indicators is the most important for the process of ranking. Our results clearly showed that Excellence with Leadership occupies the most significant spot. [ABSTRACT FROM AUTHOR]

This paper shows how bibliometric assessment can be implemented at individual level. This has been successfully done at the University of Vienna carried out by the Department for Bibliometrics and Publication Strategies of the Vienna University Library. According to the department's philosophy, bibliometrics is not only a helpful evaluation instrument in order to complement the peer review system. It is also meant as a compass for researchers in the 'publish or perish' dilemma in order to increase general visibility and to optimize publication strategies. The individual assessment comprises of an interview with the researcher under evaluation, the elaboration of a bibliometric report of the researcher's publication output, the discussion and validation of the obtained results with the researcher under evaluation as well as further optional analyses. The produced bibliometric reports are provided to the researchers themselves and inform them about the quantitative aspects of their research output. They also serve as a basis for further discussion concerning their publication strategies. These reports are eventually intended for informed peer review practices, and are therefore forwarded to the quality assurance and the Rector's office and finally sent to the peers. The most important feature of the generated bibliometric report is its multidimensional and individual character. It relies on a variety of basic indicators and further control parameters in order to foster comprehensibility. Researchers, administrative staff and peers alike have confirmed the usefulness of this bibliometric approach. An increasing demand is noticeable. In total, 33 bibliometric reports have been delivered so far. Moreover, similar reports have also been produced for the bibliometric assessment of two faculties with great success. [ABSTRACT FROM AUTHOR]

This paper analyzes the Web applications to manage literature in Biomedical Sciences. We identified, examined and described 28 academic utilities that perform automated analysis. They are user-friendly, and altogether provide better search, retrieval, management and metaanalysis (bibliometrics, network analyses and text mining) of PubMed literature in an efficient, automated, updated and systematized manner that facilitates the simultaneous handling of large quantities of paper records, making it possible for the user to choose the most relevant. All of these initiatives address the needs and challenges of biomedical research in our time. [ABSTRACT FROM AUTHOR]

Zipf's law is a theory based on mathematics and linguistics that analyzes and quantifies how words are distributed within a text. It is possible to represent by graphs and statistical analyzes which are the terms that are repeated over so that a ranking of keywords is created. This research found, through the Zipf's law, variations and uniformities of written academic papers and they presented orally. The oral presentations were inserted in video form on YouTube, it was possible to recover automatically the transcript of the audio. Using a Bash script, texts and transcribed presentations were quantified and organized, thereby creating tag clouds and tables with rankings, facilitating the analysis of the contents. It was possible to identify the spheres of content, identifying common words or not and, mathematically, analyze and compare what was written with what was presented in oral discourse. [ABSTRACT FROM AUTHOR]

This paper proposes the application of the three main Bibliometrics laws -Lotka, Zipf, and Bradford- to address the following questions: (i) How to be sure of the quality of publishers and contents in scholarly publishing, and (ii) How to determine content reliability. Our main goal is to evaluate the visibility of Transinformação, a Brazilian scholarly journal in the information science area, according to its productivity, citation counts, and performance indicators. This study focusses on the concepts of Bibliometrics and Scholarly Journals, presenting a brief history of scholarly publishing and its accessibility in Brazil, as well as the software tools used in this work. This is an exploratory documentary study, based on descriptive mixed methods (i.e., both qualitative and quantitative), that analyzes 24 years of Transinformação issues, from its first edition in 1989 to 2011. Descriptive statistics tables are used to show the results obtained from analyses carried out with Publish or perish, Microsoft Excel, and Web of science Citespace tools. [ABSTRACT FROM AUTHOR]

Google Scholar is a search engine that specializes in scientific information and in the identification of the citations that academic papers receive, making it a strong competitor for other citations indexes. For this reason, several studies have attempted to evaluate its capacity as a bibliometric tool. Due to this interest, we present an introduction to its use and the advantages and disadvantages versus Scopus and Web of Science. First, its way of collecting information and features of its interface are analyzed. The following section describes the results that Google Scholar generates. Thirdly, we analyze the coverage of information sources and the different document types to be found, showing how this coverage universe offers different citations versus other products. Finally, we specify the standardization problems of Google Scholar and offer a number of precautions that must be taken into account when using Google Scholar as an evaluation tool. [ABSTRACT FROM AUTHOR]

In the context of recent developments in scientometrics to measure novelty or creative potential, Wu, Wang, and Evans (2019) propose a new disruption index that measures the extent to which a publication disrupts the field of science. We calculated the disruption index for some example papers. The analyses of the index values (using our Web of Science in-house database) show that they depend on the citation window (the period of time over which citations are collected). [ABSTRACT FROM AUTHOR]

In this paper we show that the aggregation of bibliometric indices is an appropriate way to evaluate scientific production of researchers because it allows us to develop much more precise new bibliometric indices that combine the advantages of each index that is aggregated. [ABSTRACT FROM AUTHOR]