83 results
Search Results
2. How and why eLife selects papers for peer review
- Author
-
eLife Editorial Leadership, eLife Senior Editors, and eLife Early Career Advisory Group
- Subjects
scientific publishing ,peer review ,preprints ,research assessment ,research communication ,Medicine ,Science ,Biology (General) ,QH301-705.5 - Abstract
When deciding which submissions should be peer reviewed, eLife editors consider whether they will be able to find high-quality reviewers, and whether the reviews will be valuable to the scientific community.
- Published
- 2024
- Full Text
- View/download PDF
3. Scientometrics Study of Research Output on Sheep and Goats from Greece.
- Author
-
Lianou, Daphne T. and Fthenakis, George C.
- Subjects
GOATS ,RUMINANTS ,SHEEP ,ANIMAL products ,SCIENTOMETRICS ,MILK yield ,DOMESTIC animals - Abstract
Simple Summary: The article studies the research output on sheep and goats from Greece; a country where small ruminant farming is the most important terrestrial animal farming business. Milk production from sheep and goats exceeds that from cattle and over 90% of total milk produced from sheep and goats is used for dairy products. Research output on sheep and goats have increased significantly from 1997 to 2022. The bulk of publications, 87.5% of relevant papers, has originated from four establishments: Aristotle University of Thessaloniki; University of Thessaly; Agricultural University of Athens and Hellenic Agricultural Organization—Dimitra. Papers were published most frequently in the journals Small Ruminant Research and Journal of the Hellenic Veterinary Medical Society. The most frequent general topics of study were animal health-welfare and animal products. The findings have indicated that research has focused on milk production and diseases of the udder of small ruminants; moreover, there was accumulation of relevant research in Greece in some establishments only. The findings of the study can be used by researchers; stakeholders and Government entities to improve relevant research and to better allocate resources in the country. The study is a scientometrics evaluation of published articles performed in Greece on sheep and goats during the last 25 years, a period coinciding with implementation of reforms to shape and consolidate tertiary education and research establishments in the country. Objectives were: evaluation of the relevant publications and presentation of quantitative characteristics regarding scientific content and bibliometric details. The Web of Science platform was used (search terms: [[sheep OR goat*] OR [Ovis aries OR Capra hircus]] (1997–2022)) and 1080 papers were considered in detail. Throughout the study period, there was a clear progressive increase in numbers of papers published. The papers originated from 39 different entities, most from Aristotle University of Thessaloniki (34.0%), University of Thessaly (28.0%), Agricultural University of Athens (21.2%) and Hellenic Agricultural Organization—Dimitra (13.6%). Papers were published in 318 different journals. Journals with more published papers were Small Ruminant Research and Journal of the Hellenic Veterinary Medical Society. The most frequent general topic of study in the papers was health and welfare (46.7% of papers); second most frequent topic was animal products (18.6%). The papers have received 16,558 citations, i.e., οn average 15.4 citations per paper; the h-index was 56, the i
10 -index was 518 and the yearly citations per paper were 1.71. Papers on goats had higher impact than papers on sheep. There were 1711 individual authors, of which 728 were first or last authors. In total, 24 authors have each co-authored ≥2.5% of all papers; five authors were each first or last in that proportion of all papers. The findings have indicated that relevant research has focused on milk production and diseases of the udder of small ruminants; moreover, there was accumulation of relevant research in Greece in some establishments only. The findings of the study can be employed to initiate improved relevant research approaches in the country. [ABSTRACT FROM AUTHOR]- Published
- 2022
- Full Text
- View/download PDF
4. Arqus Openness Position Paper
- Author
-
Kaier, Christian, Walter, Hildrun, Bela��n, Florence, Boukacem-Zeghmouri, Ch��rifa, D��az Urrutia, Mar��a, Garc��a Gil, Mar��a Angeles, Garc��a S��nchez, Pablo, Herbet, Marie-Emilia, Medzvieckait��, Gint��, Ostrop, Jenny, Str��mme, Tormod Eismann, Voigt, Pia, Weiner, Barbara, Zorzi, Michela, Apostolico, Mauro, Aubert, Yves, Juod��, Egl��, Le Bahers, Tangui, Mantelli, Barbara, and Romero-Fr��as, Esteban
- Subjects
Open Access ,Open Science ,Citizen Science ,Open Data ,European University Alliance ,Open Research ,open science ,Open data ,Arqus European University Alliance ,Research Assessment ,Open Scholarship - Abstract
The Openness Position Paper published by the Arqus European University Alliance emphasises that Arqus institutions, in line with the policies, roadmaps and strategies of the EU and a wide range of stakeholders, are striving jointly to make further progress towards realising Open Science. The Position Paper identifies and acknowledges aims and values of Open Science and relates them to values, principles, and standards shared by the Arqus Alliance, followed by a vision for a future with Open Science. In the interest of a nuanced picture, the Position Paper discusses not only desired effects, but also possible areas of tension related to Open Science. It presents a wide range of specific aims and recommendations for each of the eleven elements of Open Science defined by the Arqus Openness Task Force: Governance Publications (including Open Access) Data (including research data management, FAIR and Open Data) Infrastructures (including support staff, Open Science software and tools, repositories, Open Labs) Methods (including source code, preregistration, materials, workflows, protocols, lab notes) Awareness and training (including education of early-stage researchers) Evaluation (including Open Metrics, research assessment, Open Peer Review, rewards and incentives) Communication (including multilingualism) Citizen Science Open Education Open Innovation The Position Paper concludes with an annex that highlights the progress already made in the implementation and support of Open Science practices at Arqus institutions., Cofunded by the Erasmus+Programme of the European Union
- Published
- 2022
- Full Text
- View/download PDF
5. Review of guidance papers on regression modeling in statistical series of medical journals
- Author
-
Wallisch, C., Bach, P., Hafermann, L., Klein, N., Sauerbrei, W., Steyerberg, E.W., Heinze, G., Rauch, G., and Topic Grp 2 STRATOS Initiative
- Subjects
Computer and Information Sciences ,Medical Journals ,Epidemiology ,Science ,Research and Analysis Methods ,Computer Software ,Mathematical and Statistical Techniques ,Epidemiological Statistics ,Medicine and Health Sciences ,Humans ,Statistical Methods ,Multidisciplinary ,Models, Statistical ,Statistics ,Software Engineering ,Research Assessment ,Medical Writing ,Medical Risk Factors ,Physical Sciences ,Research Reporting Guidelines ,Regression Analysis ,Engineering and Technology ,Epidemiological Methods and Statistics ,Medicine ,Periodicals as Topic ,Medical Humanities ,Mathematics ,Research Article ,Forecasting - Abstract
Although regression models play a central role in the analysis of medical research projects, there still exist many misconceptions on various aspects of modeling leading to faulty analyses. Indeed, the rapidly developing statistical methodology and its recent advances in regression modeling do not seem to be adequately reflected in many medical publications. This problem of knowledge transfer from statistical research to application was identified by some medical journals, which have published series of statistical tutorials and (shorter) papers mainly addressing medical researchers. The aim of this review was to assess the current level of knowledge with regard to regression modeling contained in such statistical papers. We searched for target series by a request to international statistical experts. We identified 23 series including 57 topic-relevant articles. Within each article, two independent raters analyzed the content by investigating 44 predefined aspects on regression modeling. We assessed to what extent the aspects were explained and if examples, software advices, and recommendations for or against specific methods were given. Most series (21/23) included at least one article on multivariable regression. Logistic regression was the most frequently described regression type (19/23), followed by linear regression (18/23), Cox regression and survival models (12/23) and Poisson regression (3/23). Most general aspects on regression modeling, e.g. model assumptions, reporting and interpretation of regression results, were covered. We did not find many misconceptions or misleading recommendations, but we identified relevant gaps, in particular with respect to addressing nonlinear effects of continuous predictors, model specification and variable selection. Specific recommendations on software were rarely given. Statistical guidance should be developed for nonlinear effects, model specification and variable selection to better support medical researchers who perform or interpret regression analyses.
- Published
- 2022
6. Anchoring effects in the assessment of papers: The proposal for an empirical survey of citing authors
- Author
-
Alexander Tekles, Christian Ganser, and Lutz Bornmann
- Subjects
Databases, Factual ,Research Quality Assessment ,Social Sciences ,Surveys ,Treatment and control groups ,Cognition ,Email address ,Citation analysis ,Surveys and Questionnaires ,Psychology ,GeneralLiterature_REFERENCE(e.g.,dictionaries,encyclopedias,glossaries) ,Problem Solving ,Data Management ,media_common ,Multidisciplinary ,Impact factor ,Publications ,Cognitive Heuristics ,Research Assessment ,Research Personnel ,Research Design ,Publishing ,Citation Analysis ,Medicine ,Journal Impact Factor ,Science ,media_common.quotation_subject ,Decision Making ,Bibliometrics ,Research and Analysis Methods ,Registered Report Protocol ,Humans ,Quality (business) ,Scientific Publishing ,Internet ,Survey Research ,Actuarial science ,business.industry ,Cognitive Psychology ,Biology and Life Sciences ,Cognitive Science ,Citation ,business ,Neuroscience - Abstract
In our planned study, we shall empirically study the assessment of cited papers within the framework of the anchoring-and-adjustment heuristic. We are interested in the question whether citation decisions are (mainly) driven by the quality of cited references. The design of our study is oriented towards the study by Teplitskiy, Duede [10]. We shall undertake a survey of corresponding authors with an available email address in the Web of Science database. The authors are asked to assess the quality of papers that they cited in previous papers. Some authors will be assigned to three treatment groups that receive further information alongside the cited paper: citation information, information on the publishing journal (journal impact factor), or a numerical access code to enter the survey. The control group will not receive any further numerical information. In the statistical analyses, we estimate how (strongly) the quality assessments of the cited papers are adjusted by the respondents to the anchor value (citation, journal, or access code). Thus, we are interested in whether possible adjustments in the assessments can not only be produced by quality-related information (citation or journal), but also by numbers that are not related to quality, i.e. the access code. The results of the study may have important implications for quality assessments of papers by researchers and the role of numbers, citations, and journal metrics in assessment processes.
- Published
- 2021
7. Using single impact metrics to assess research in business and economics: why institutions should use multi-criteria systems for assessing research
- Author
-
Olavarrieta, Sergio
- Published
- 2022
- Full Text
- View/download PDF
8. Analysis of publications by authors of Ukrainian institutes in Scopus‐delisted titles.
- Subjects
SCHOLARLY publishing ,RESEARCH evaluation - Abstract
In Ukraine, Scopus data are used to evaluate academics. Existing shortcomings in the Ukrainian evaluation system allow them to publish in titles that have been delisted from Scopus, and continue to use those papers as credible research output for evaluation. The purpose of this study was to analyse the publishing activity of Ukrainian institutions in Scopus‐delisted titles (as of September 2021) in different fields between 2011 and 2020 and to attempt to appreciate how common this practice is among Ukrainian authors. Scopus was sourced to collect bibliographic and citations‐related data, while SciVal was used to analyse these data. The findings suggest that for 17 Ukrainian institutions, papers from titles that have been delisted from Scopus still play an important part of the publication achievement of their employees. In particular, in the field of economics, econometrics and finance, 46.92% of Ukrainian papers were published in a title that was excluded from Scopus. Moreover, the analysis indicated that in two Ukrainian institutions, the level of citation of such papers significantly exceeds the average number of citations to Scopus‐indexed papers in the same year and in the same field. Given that bibliometric indicators are also used for research assessment in other Eastern European countries, the results of this paper are applicable to a wider geographic context. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
9. Recognition & Rewards in the Netherlands
- Author
-
Kim Huijpen and Per Pippin Aspaas
- Subjects
Video recording ,Research assessment ,business.industry ,Podcast ,Stakeholder ,Library science ,Diversification (marketing strategy) ,Open Science ,Publishing ,Political science ,Position paper ,Evaluation ,business ,ComputingMilieux_MISCELLANEOUS ,Netherlands - Abstract
In this episode, Kim Huijpen from the Association of Universities in the Netherlands (VSNU) tells about the programme following the publication of Room for Everyone's Talent, a position paper aiming for a wholescale overhaul of the practices of research assessment in the Netherlands. The podcast interview was made in conjunction with the 16th Munin Conference on Scholarly publishing in November 2021 (see abstract and video recording of Kim Huijpen's conference paper). The nation-wide follow-up programme, named Recognition & Rewards, is coordinated by Kim Huijpen. In her dialogue with stakeholder at Dutch institutions, she often meets dilemmas and concerns that are familiar from similar debates in other countries. Nevertheless, more and more institutions are now implementing the the principles and guidelines laid out in the 2019 position paper, thereby stimulating the growth of open science practices and the diversification of career paths in Dutch academia. The on-going process can be followed on several platforms, including: Twitter: https://twitter.com/recogrewards?lang=en LinkedIn: https://www.linkedin.com/company/recognition-rewards/Youtube: Recognition & Rewards playlist Newsletter: https://recognitionrewards.nl/blog/newsletter-recognition-rewards/DORA Repository: Updated information on the Dutch Recognition & Rewards Programme See also a recap of the Recognition & Rewards Festival (January 2021) and recorded webinars on rewarding teaching (November 2020). A summary of The Dutch Recognition & Rewards Programme can also be found in the DORA Repository
- Published
- 2021
10. Can ChatGPT evaluate research quality?
- Author
-
Thelwall, Mike
- Subjects
CHATGPT ,CONVENIENCE sampling (Statistics) ,LANGUAGE models ,TASK analysis - Abstract
Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task. Test the extent to which ChatGPT-4 can assess the quality of journal articles using a case study of the published scoring guidelines of the UK Research Excellence Framework (REF) 2021 to create a research evaluation ChatGPT. This was applied to 51 of my own articles and compared against my own quality judgements. ChatGPT-4 can produce plausible document summaries and quality evaluation rationales that match the REF criteria. Its overall scores have weak correlations with my self-evaluation scores of the same documents (averaging r=0.281 over 15 iterations, with 8 being statistically significantly different from 0). In contrast, the average scores from the 15 iterations produced a statistically significant positive correlation of 0.509. Thus, averaging scores from multiple ChatGPT-4 rounds seems more effective than individual scores. The positive correlation may be due to ChatGPT being able to extract the author's significance, rigour, and originality claims from inside each paper. If my weakest articles are removed, then the correlation with average scores (r=0.200) falls below statistical significance, suggesting that ChatGPT struggles to make fine-grained evaluations. The data is self-evaluations of a convenience sample of articles from one academic in one field. Overall, ChatGPT does not yet seem to be accurate enough to be trusted for any formal or informal research quality evaluation tasks. Research evaluators, including journal editors, should therefore take steps to control its use. This is the first published attempt at post-publication expert review accuracy testing for ChatGPT. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
11. A multi-scale perspective for assessing publishing circuits in non-hegemonic countries.
- Author
-
Beigel, Fernanda
- Subjects
WORLD class companies ,UNIVERSITY rankings - Abstract
Copyright of Tapuya: Latin American Science, Technology & Society is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2021
- Full Text
- View/download PDF
12. Liposomes, The Attractive Vehicles for Drug Delivery: A Scientometric Mapping of Web of Science Indexed Literature.
- Author
-
Dandoti, Sayequa Shujauddin, Ansari, Khadeeja M. N., and Rahaman, Md Safiqur
- Subjects
- *
SCIENCE in literature , *SCIENTIFIC literature , *BILAYER lipid membranes , *DRUG carriers , *CATIONIC lipids , *PRODUCTIVITY accounting , *MEDICATION therapy management - Abstract
The Liposome is a spherical-shaped vesicle composed of one or more phospholipid bilayers, closely resembling cell membranes' structure. It has a novel drug delivery system (NDDS); the lipid bilayer can fuse with other bilayers, such as the cell membrane, thus delivering the liposome contents. The present study has been conducted to map the research productivity of 'liposomes as drug delivery' between 1980 and 2021. This study employed the scientometric method to analyze 629 research papers indexed in the Web of Science database. Different bibliometrics indicators were used to assess the annual research growth, prolific authors, authorship pattern, funding agencies, productive source, organization, country, author keywords, cited paper and cited references, etc. Biblioshiny, Bibexcel, VOSviewer, and MS Office were used to analyze the 629 published papers. The findings show that 629 publications were published between 1980 and 2001, with 24674 citations. 2018 and 2019 recorded the highest research with 49 publications and 758 and 471 citations, respectively. Journal of Controlled Release was the most relevant source in the field, with 45 publications and 3063 citations. LIU Y was the most productive author, with 15 publications and 342 citations. Northwestern University USA has the highest record with 11 publications, and the USA was the most productive country with 181 publications, while China emerged as a leading collaborator with the USA (19 publications). Liposomes and cationic liposomes were identified as the most important research themes. Permeability, ocular drug delivery, Chemotherapy, Cancer therapy, Hypoxia, Combination therapy, and hyaluronic acid were research topics that have gained recent popularity. At the same time, Vesicles targeted drug delivery, cellular uptake, ultrasound, Chitosan, and Pegylation were identified as the research areas that require further attention in the field of liposomes as drug delivery research. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
13. Authorship and citation patterns of highly cited biomedical researchers: a cross-sectional study.
- Author
-
Perneger, Thomas
- Subjects
AUTHORSHIP ,CROSS-sectional method ,DATABASES - Abstract
Background: Scientific productivity is often evaluated by means of cumulative citation metrics. Different metrics produce different incentives. The H-index assigns full credit from a citation to each coauthor, and thus may encourage multiple collaborations in mid-list author roles. In contrast, the Hm-index assigns only a fraction 1/k of citation credit to each of k coauthors of an article, and thus may encourage research done by smaller teams, and in first or last author roles. Whether H and Hm indices are influenced by different authorship patterns has not been examined. Methods: Using a publicly available Scopus database, I examined associations between the numbers of research articles published as single, first, mid-list, or last author between 1990 and 2019, and the H-index and the Hm-index, among 18,231 leading researchers in the health sciences. Results: Adjusting for career duration and other article types, the H-index was negatively associated with the number of single author articles (partial Pearson r -0.06) and first author articles (-0.08), but positively associated with the number of mid-list (0.64) and last author articles (0.21). In contrast, all associations were positive for the Hm-index (0.04 for single author articles, 0.18 for first author articles, 0.24 for mid-list articles, and 0.46 for last author articles). Conclusion: The H-index and the Hm-index do not reflect the same authorship patterns: the full-credit H-index is predominantly associated with mid-list authorship, whereas the partial-credit Hm-index is driven by more balanced publication patterns, and is most strongly associated with last-author articles. Since performance metrics may act as incentives, the selection of a citation metric should receive careful consideration. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
14. Liposomes, The Attractive Vehicles for Drug Delivery: A Scientometric Mapping of Web of Science Indexed Literature
- Author
-
Sayequa Shujauddin Dandoti, Khadeeja MN Ansari, and Md Safiqur Rahaman
- Subjects
liposomes ,science mapping ,scientometric ,research assessment ,Information resources (General) ,ZA3040-5185 ,Transportation and communications ,HE1-9990 - Abstract
The Liposome is a spherical-shaped vesicle composed of one or more phospholipid bilayers, closely resembling cell membranes' structure. It has a novel drug delivery system (NDDS); the lipid bilayer can fuse with other bilayers, such as the cell membrane, thus delivering the liposome contents. The present study has been conducted to map the research productivity of 'liposomes as drug delivery' between 1980 and 2021. This study employed the scientometric method to analyze 629 research papers indexed in the Web of Science database. Different bibliometrics indicators were used to assess the annual research growth, prolific authors, authorship pattern, funding agencies, productive source, organization, country, author keywords, cited paper and cited references, etc. Biblioshiny, Bibexcel, VOSviewer, and MS Office were used to analyze the 629 published papers. The findings show that 629 publications were published between 1980 and 2001, with 24674 citations. 2018 and 2019 recorded the highest research with 49 publications and 758 and 471 citations, respectively. Journal of Controlled Release was the most relevant source in the field, with 45 publications and 3063 citations. LIU Y was the most productive author, with 15 publications and 342 citations. Northwestern University USA has the highest record with 11 publications, and the USA was the most productive country with 181 publications, while China emerged as a leading collaborator with the USA (19 publications). Liposomes and cationic liposomes were identified as the most important research themes. Permeability, ocular drug delivery, Chemotherapy, Cancer therapy, Hypoxia, Combination therapy, and hyaluronic acid were research topics that had gained recent popularity. At the same time, Vesicles targeted drug delivery, cellular uptake, ultrasound, Chitosan, and Pegylation were identified as the research areas that require further attention in the field of liposomes as drug delivery research.
- Published
- 2023
- Full Text
- View/download PDF
15. NEW APPROACHES IN RESEARCH ASSESSMENT - FROM BIBLIOMETRICS TO GOALS-ORIENTED APPROACHES. THE CASE OF RESEARCHERS' ASSESSMENT FOR HIRING AND CAREER DEVELOPMENT IN ROMANIA.
- Author
-
SPANACHE, Ioana, IRIMIA, Alina, and CURAJ, Adrian
- Subjects
BIBLIOMETRICS ,ORGANIZATIONAL research - Abstract
In recent years, there has been increased attention given to how research assessment is conducted at different levels - research proposals, individual researchers, research organizations. In this context, the current paper explores existing literature regarding current research assessment approaches, and especially recommendations provided through four reference documents on the topic: the San Francisco Declaration on Research Assessment (2013), the Leiden Manifesto (Hicks et al. 2015), Science Europe's Position Statement and Recommendations on Research Assessment Processes (2020), and the Hong Kong Principles for assessing researchers (Moher et al. 2020). The aim is to provide a basis for analysing the legislative and normative framework regulating how researchers are being evaluated in Romania for hiring and career development, and then apply it to identify recommendations regarding how the latter can be improved. Some of the recommendations identified refer to aspects such as: the need to explore evaluation arrangements which incorporate research activity related practices, and that measure performance against research units' research goals; increased focus on qualitative approaches, and on scientific content, as opposed to performance in publication metrics; developing a broader list with indicators, including Open Science and societal relevance related; introducing the principle of transparency; developing a monitoring and evaluation framework. [ABSTRACT FROM AUTHOR]
- Published
- 2022
16. Statistical model and method for analyzing AI conference rankings: China vs USA
- Author
-
Anna Ermolayeva, Aliaksandr Birukou, Sergey Matyushenko, and Dmitry Kochetkov
- Subjects
Conference proceedings ,Scientometrics ,Research evaluation ,Research assessment ,Artificial intelligence ,Science (General) ,Q1-390 ,Social sciences (General) ,H1-99 - Abstract
Artificial Intelligence (AI) is a rapidly developing field of research that attracts significant funding from both the state and industry players. Such interest is driven by a wide range of AI technology applications in many fields. Since many AI research topics relate to computer science, where a significant share of research results are published in conference proceedings, the same applies to AI. The world leaders in artificial intelligence research are China and the United States. The authors conducted a comparative analysis of the bibliometric indicators of AI conference papers from these two countries based on Scopus data. The analysis aimed to identify conferences that receive above-average citation rates and suggest publication strategies for authors from these countries to participate in conferences that are likely to provide better dissemination of their research results. The results showed that, although Chinese researchers publish more AI papers than those from the United States, US conference papers are cited more frequently. The authors also conducted a correlation analysis of the MNCS index, which revealed no high correlation between MNCS USA vs. MNCS China, MNCS China/MNCS USA vs. MSAR, and MNCS China/MNCS USA vs. CORE ranking indicators.
- Published
- 2023
- Full Text
- View/download PDF
17. Rethinking success, integrity, and culture in research (part 2) — a multi-actor qualitative study on problems of science
- Author
-
Aubert Bonn, Noémie and Pinxten, Wim
- Published
- 2021
- Full Text
- View/download PDF
18. Rethinking success, integrity, and culture in research (part 1) — a multi-actor qualitative study on success in science
- Author
-
Aubert Bonn, Noémie and Pinxten, Wim
- Published
- 2021
- Full Text
- View/download PDF
19. Is big team research fair in national research assessments? The case of the UK Research Excellence Framework 2021.
- Author
-
Thelwall, Mike, Kousha, Kayvan, Makita, Meiko, Abdoli, Mahshid, Stuart, Emma, Wilson, Paul, and Levitt, Jonathan
- Subjects
RESEARCH teams ,PEARSON correlation (Statistics) ,GRADE point average - Abstract
Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors. Whilst splitting the rewards for an article amongst its authors has the greatest surface-level fairness, many important evaluations assign full credit to each author, irrespective of team size. The underlying rationales for this are labour reduction and the need to incentivise collaborative work because it is necessary to solve many important societal problems. This article assesses whether full counting changes results compared to fractional counting in the case of the UK's Research Excellence Framework (REF) 2021. For this assessment, fractional counting reduces the number of journal articles to as little as 10% of the full counting value, depending on the Unit of Assessment (UoA). Despite this large difference, allocating an overall grade point average (GPA) based on full counting or fractional counting gives results with a median Pearson correlation within UoAs of 0.98. The largest changes are for Archaeology (r=0.84) and Physics (r=0.88). There is a weak tendency for higher scoring institutions to lose from fractional counting, with the loss being statistically significant in 5 of the 34 UoAs. Thus, whilst the apparent over-weighting of contributions to collaboratively authored outputs does not seem too problematic from a fairness perspective overall, it may be worth examining in the few UoAs in which it makes the most difference. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
20. The failure of success: four lessons learned in five years of research on research integrity and research assessments.
- Author
-
Aubert Bonn, Noémie, De Vries, Raymond G., and Pinxten, Wim
- Subjects
RESEARCH integrity ,SUCCESS - Abstract
In the past 5 years, we captured the perspectives from a broad array of research stakeholders to better understand the impact that current approaches to success and research assessment may have on the integrity and the quality of research. Here, we translate our findings in four actions that are urgently needed to foster better research. First, we need to address core research structures to overcome systemic problems of the research enterprise; second, we must realign research assessments to value elements that advance and strengthen science; third, we need to remodel, diversify, and secure research careers; and finally, we need to unite and coordinate efforts for change. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
21. Sustainable Professional Development of German Language Teachers in China: Research Assessment and External Research Funding.
- Author
-
Liu, Siqi, Chen, Yu, Shen, Qi, and Gao, Xuesong
- Abstract
The academic evaluation of teachers of languages other than English (LOTEs) has been extensively researched, especially from the perspective of academic publications. However, little attention has been paid to another key performance indicator in teacher assessment, namely, external research funding. Focusing on German language teachers (GLTs), this paper adopts a mixed methods approach to investigate the assessment requirements for LOTE teachers in terms of external research funding and the factors that may impact their accomplishments. Based on Bronfenbrenner's ecological systems theory and conservation of resources theory, we analyzed policy documents from the universities under investigation, examined "German or Germany-related" funding approvals, and conducted semi-structured interviews with eight GLTs to explore the environmental factors (individual context, institutional context, social context, chronological context) that may influence the survival of GLTs in terms of the requirements for external research funding. The findings indicate that factors from each ecological context interact with one another and have a combined influence on GLTs' external research funding application activity. Moreover, there is an imbalance between the academic demands faced by GLTs and the resource support that is available to them. This imbalance may affect the survival and development of GLTs and is likely to have a continuing influence throughout their career. The study concludes by offering some suggestions at different levels to facilitate the sustainable professional development of GLTs. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
22. Responsible Research Assessment and Research Information Management Systems.
- Author
-
Schöpfel, Joachim and Azeroual, Otmane
- Subjects
INFORMATION storage & retrieval systems ,OPEN scholarship ,INFORMATION resources management ,INFORMATION superhighway ,CULTURAL pluralism ,DATA modeling ,METADATA - Abstract
Definition: In the context of open science, universities, research-performing and funding organizations and authorities worldwide are moving towards more responsible research assessment (RRA). In 2022, the European Coalition for Advancing Research Assessment (CoARA) published an agreement with ten commitments, including the recognition of the "diversity of contributions to, and careers in, research", the "focus on qualitative evaluation for which peer review is central, supported by responsible use of quantitative indicators", and the "abandon (of) inappropriate uses in research assessment of journal- and publication-based metrics". Research assessment (RA) is essential for research of the highest quality. The transformation of assessment indicators and procedures directly affects the underlying research information management infrastructures (also called current research information systems) which collect and store metadata on research activities and outputs. This entry investigates the impact of RRA on these systems, on their development and implementation, their data model and governance, including digital ethics. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
23. Scientometrics Study of Research Output on Sheep and Goats from Greece
- Author
-
Daphne T. Lianou and George C. Fthenakis
- Subjects
goat ,mastitis ,meta-research ,milk production ,research analysis ,research assessment ,Veterinary medicine ,SF600-1100 ,Zoology ,QL1-991 - Abstract
The study is a scientometrics evaluation of published articles performed in Greece on sheep and goats during the last 25 years, a period coinciding with implementation of reforms to shape and consolidate tertiary education and research establishments in the country. Objectives were: evaluation of the relevant publications and presentation of quantitative characteristics regarding scientific content and bibliometric details. The Web of Science platform was used (search terms: [[sheep OR goat*] OR [Ovis aries OR Capra hircus]] (1997–2022)) and 1080 papers were considered in detail. Throughout the study period, there was a clear progressive increase in numbers of papers published. The papers originated from 39 different entities, most from Aristotle University of Thessaloniki (34.0%), University of Thessaly (28.0%), Agricultural University of Athens (21.2%) and Hellenic Agricultural Organization—Dimitra (13.6%). Papers were published in 318 different journals. Journals with more published papers were Small Ruminant Research and Journal of the Hellenic Veterinary Medical Society. The most frequent general topic of study in the papers was health and welfare (46.7% of papers); second most frequent topic was animal products (18.6%). The papers have received 16,558 citations, i.e., οn average 15.4 citations per paper; the h-index was 56, the i10-index was 518 and the yearly citations per paper were 1.71. Papers on goats had higher impact than papers on sheep. There were 1711 individual authors, of which 728 were first or last authors. In total, 24 authors have each co-authored ≥2.5% of all papers; five authors were each first or last in that proportion of all papers. The findings have indicated that relevant research has focused on milk production and diseases of the udder of small ruminants; moreover, there was accumulation of relevant research in Greece in some establishments only. The findings of the study can be employed to initiate improved relevant research approaches in the country.
- Published
- 2022
- Full Text
- View/download PDF
24. Prioritising and incentivising productivity within indicator-based approaches to Research Impact Assessment: a commentary.
- Author
-
Deeming, Simon, Hure, Alexis, Attia, John, Nilsson, Michael, and Searles, Andrew
- Subjects
PROJECT finance ,RESEARCH personnel ,MEDICAL research ,PUBLIC health research ,RESEARCH funding - Abstract
Research Impact Assessment (RIA) represents one of a suite of policies intended to improve the impact generated from investment in health and medical research (HMR). Positivist indicator-based approaches to RIA are widely implemented but increasingly criticised as theoretically problematic, unfair, and burdensome. This commentary proposes there are useful outcomes that emerge from the process of applying an indicator-based RIA framework, separate from those encapsulated in the metrics themselves. The aim for this commentary is to demonstrate how the act of conducting an indicator-based approach to RIA can serve to optimise the productive gains from the investment in HMR. Prior research found that the issues regarding RIA are less about the choice of indicators/metrics, and more about the discussions prompted and activities incentivised by the process. This insight provides an opportunity to utilise indicator-based methods to purposely optimise the research impact. An indicator-based RIA framework specifically designed to optimise research impacts should: focus on researchers and the research process, rather than institution-level measures; utilise a project level unit of analysis that provides control to researchers and supports collaboration and accountability; provide for prospective implementation of RIA and the prospective orientation of research; establish a line of sight to the ultimate anticipated beneficiaries and impacts; Include process metrics/indicators to acknowledge interim steps on the pathway to final impacts; integrate 'next' users and prioritise the utilisation of research outputs as a critical measure; Integrate and align the incentives for researchers/research projects arising from RIA, with those existing within the prevailing research system; integrate with existing peer-review processes; and, adopt a system-wide approach where incremental improvements in the probability of translation from individual research projects, yields higher impact across the whole funding portfolio. Optimisation of the impacts from HMR investment represents the primary purpose of Research Impact policy. The process of conducting an indicator-based approach to RIA, which engages the researcher during the inception and planning phase, can directly contribute to this goal through improvements in the probability that an individual project will generate interim impacts. The research project funding process represents a promising forum to integrate this approach within the existing research system. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
25. Peer review e scienza aperta nelle discipline umanistiche: esperienze a confronto.
- Author
-
Ballerio, Stefano, Scarabelli, Laura, Guglielmi, Marina, Rebecchini, Damiano, Pievatolo, Maria Chiara, Mecella, Laura, Guardo, Andrea, and Galimberti, Paola
- Subjects
OPEN scholarship ,SHARING - Abstract
What is open peer review? Could we use it in the humanities, in one form or another? More generally, how can the principles of open science interact with research assessment practices in the humanities? These issues were discussed in a round table that was held at the University of Milan on October 25, 2023. The notes included in this section present some of the reflections that were shared on that occasion. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
26. Engaging learned societies in promotion of open science and responsible research
- Author
-
Pölönen, Janne and Late, Elina
- Subjects
Research ethics ,Open Science ,Learned societies ,Research integrity ,Research assessment - Abstract
Since the 17th century, learned societies - voluntary non-profit organizations involving academics - have existed for the advancement of scholarship, research, disciplines, publishing and public understanding of science. Publishing scientific journals and books has traditionally been an important part of the activities of learned societies but they also take other various activities including arranging conferences, supporting research, and popularizing knowledge. The most well-known learned societies are the national science academies, in which membership is typically based on invitation and merit. However, there also exists a much broader archipelago of local, national and international societies, whose membership is open to all academics, and often also to interested professionals and citizens. In English-language literature, a learned society can also be referred to as a learned/scholarly/scientific association or scholarly society. Occasionally, the term professional society is also used. We have estimated in a working-paper that there are around 9000 learned societies in Europe (https://doi.org/10.5281/zenodo.5513560). In historical perspective, learned societies constitute, along with universities and other kinds of research performing organizations, the foundation of contemporary academia. International Survey on Research Integrity (IRIS: https://doi.org/10.17605/OSF.IO/XB9RK) provides the broadest available indication of the continued relevance of learned societies. Over 82% of 60,885 active researchers from Europe, United States and other countries, who in 2021 answered the IRIS survey question concerning professional societies, identified at least “a little bit” with the societies, and 62% identified “moderately”, “a lot” or “a great deal”. Yet, surprisingly little information and research exists on their current number, forms of organizations and operation, or contributions to scientific and societal impact of research in specific countries, regions or globally. While more attention has been paid to the obstacles and challenges for promoting open access in the landscape of learned society journals, next to nothing is known or said about the (potential) role of learned societies in the area of responsible research, including research integrity and research assessment. However, we argue that these societies create networks of scholars and professionals and have discipline specific expertise on scholarly activities that should be exploited more. In this paper we address the following questions: 1. What role does open science and responsible research play in societies’ activities? 2. Do the members expect open science and responsible research to be part of the societies’ activities? To answer these questions, we would need a global review of learned societies, their activities and membership. The scope of our present study is mainly focused on Finland, from which we have a comprehensive report in 2019 (https://doi.org/10.23847/isbn.9789525995190). Besides Finland, one survey study has covered learned societies in Portugal, and another one social science societies in the UK. Methods and data We provide data from Finland and from Finnish societies. Currently, almost 300 societies are members of the Federation of Finnish Learned Societies (TSV), and they have more than 250,000 individual members (Finland has a population of 5,5 million). Recently TSV collected two broad datasets from its member societies and the individual members of these societies.The first dataset (N=114 unique societies) concerns the actions related with responsible research of learned societies. The second dataset (N=1540 individual members of learned societies) concern the membership of the societies. By integrating these two datasets we are able to provide insight about the open science and responsible research activities from the viewpoint of the societies and their membership. Results Over 94% of 114 learned societies in Finland, who answered the survey in 2021, indicated that the promotion of scientific activities is a major part of their activities, followed by the promotion of general understanding of science and societal impact. Generally speaking, the promotion of responsible research and open science has not yet become a key part of learned societies’ operations. Yet around 70 per cent of the societies participate in developing open science, 60 per cent publish immediately openly available publications. However, activities linked to research integrity, open data, open education and citizen science are rarer. Nevertheless, the majority of societies were interested in developing their activities in one or more areas of responsible research: identifying and proposing experts to working groups, committees or as evaluators (65 % of societies), promoting open science and organizing events (more than 50 %), evaluating the quality of research (more than 40 %), assessment of social impact, science education and research ethics (approx. 30 %). The membership of the learned societies regards traditional forms of operation, such as networking, publications, events and the popularization of science as the most important parts of the societies’ operations. Over 90 per cent of the respondents agreed at least partially with the statement that the promotion of the openness of research-based knowledge is important, and more than 80 per cent agreed that this should be free of charge to the readers. Almost 90 percent of the respondents agreed at least partially with the statement that the promotion of research integrity should be an important task of societies, and almost 80% agreed also on the importance of responsible assessment of researchers and research quality. Almost 60% agreed on the promotion of citizen science, while 45% agreed that producing open learning materials is an important task of societies. Significance Our case study in Finland shows that societies are active in the most traditional forms of open science, such as open access publishing. Publication activities are indeed one of the learned societies’ key forms of operation, and a significant proportion of learned societies’ publications already complies with the principles of open science. The societies have been important enablers and promoters of open, non-profit and scientific publication activities without author fees (so called Diamond OA) in Finland. Other forms of open science and responsible research are not yet established but highly supported by the members of the societies. The perceptions from the membership should guide the future development of the societies. Data on society memberships shows that learned societies represent the science community on a broad scale in terms of age, field of education, work organization and place of residence. The networks created by the societies are cross-organizational and often international and provide a unique resource for identifying experts of different domains and creating collaboration between the domains. Thus, societies have a great potential in implementing and developing field-specific open science practices through engagement of researchers at the grass-root level towards a more responsible direction. Policy makers, research performing and funding organizations could develop more strategic collaboration with learned societies as a valued intermediary between science and society.
- Published
- 2023
- Full Text
- View/download PDF
27. Anatomy of Research Performance from a Bottom-Up Approach: Examination of Researchers' Perspective.
- Author
-
Manasia, Loredana, Popa, Diana, and Ianos, Gratiela
- Abstract
Performance-based research policies and programmes have fundamentally altered both organisational and individual behaviours and expectations, putting immense pressure on researchers. The soundness of research, originality, valorisation potential, and societal and economic impacts are highly valued and expected characteristics of research. Yet, our understanding of the effects of various systemic and organisational factors on research performance is limited. In an exploratory, single-country case, this paper aimed to develop and examine different models of research performance as perceived by researchers themselves using a large cross-disciplinary sample of 553 researchers from 72 public research organisations in Romania. A pre-tested questionnaire was self-administered online, comprising seven scales: (1) recruitment and selection, (2) research recognition and value, (3) participation in research projects and teams, (4) work incentives, (5) job payment and salary, (6) career development opportunities, and (7) leadership effectiveness. Maximum likelihood and Bayesian estimators were used to test three structural models: (M1) mono-factor; (M2) intercorrelated dimensions, and (M3) the dimensions are indicators of a general construct. Additionally, a path analysis was carried out to study the relationships among the dimensions. We found that M2 and M3 fit the empirical data better. The results showed that career development programmes and opportunities gain centrality in achieving research performance by directly influencing participation and research projects and teams and mediating the effect of job payment. Revealingly, powerful work incentives within research organisations are international mobilities or appreciation awards. When informing evidence-based policies, the models we propose could serve the goal of improving research performance through talent development as the main proxy. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
28. Assessing Discussions of Related Work through Citation-based Recommendations and Network Visualization
- Author
-
Beck, Fabian
- Subjects
open citations ,citation network ,literature search ,research assessment - Abstract
A discussion of related work is part of every research paper and grant proposal submission, and as such is evaluated in the reviewing process. If a reviewer is an expert in all covered areas, a qualified judgement of the section can be expected. However, in many cases, especially when the discussion touches on different research areas and application domains, most reviewers will only have a partial understanding of the related research. Hence, they face a difficult challenge in assessing the quality and completeness of the discussion of related work. Starting an own full-fledged literature search with traditional academic search tools poses an unrealistically high effort for the reviewers. Facilitated by an increased availability of open citation data, a new group of tools has recently been published that support users in tracking the citation links of multiple researcher papers. For instance, “Citation Gecko” and “PURE suggest” visualize the surrounding citation network and suggest related papers that are linked through citations to the selected ones. Other tools, like “ResearchRabbit” and “Inciteful”, embed similar features with a broader range of analysis and recommendation options. Loading the list of references of a paper under review, these tools hence allow inspecting the citation network and suggest related, non-listed publications. This can be the starting point for an efficient check of the character and completeness of a related work discussion. In this talk, I specifically explore the capabilities of our tool “PURE suggest” (https://fabian-beck.github.io/pure-suggest/) for assessing a list of references. The top-ranked suggestions can be quickly checked for relevancy. If the scores of these suggestions are comparable to the scores of already included papers, this might already hint at a gapped discussion. Boost keywords help the reviewer to investigate specific directions more closely. Filtering by year allows checking whether the newest publications have already been considered. Similarly, filtering for underrepresented works might point out relevant, but somewhat unknown works that have been overlooked. The cluster-oriented visualization of the citation network reveals whether expected clusters of works show in the network, are missing, or disconnected. This demonstrates that these tools, although targeted primarily on literature search, can be also leveraged for assessing lists of related work in the sense of a sanity check. It does not replace the expertise of the reviewers but complements it with a data-driven approach. The reviewers work with the tool and use it as an aid to reflect on various aspects of the related work. Of course, a similar approach can be used by the authors of the submission already to prevent gaps in their discussion of related work. Although it might sound like a threat to the suggested assessment, on the contrary, it would be a desirable effect as it will, already in the first place, likely improve the quality of the submitted work.
- Published
- 2022
- Full Text
- View/download PDF
29. The Transformation of the Green Road to Open Access
- Author
-
Joachim Schöpfel, Stéphane Chaudiron, Bernard Jacquemin, Eric Kergosien, Hélène Prost, Florence Thiault, Groupe d'Études et de Recherche Interdisciplinaire en Information et COmmunication - ULR 4073 (GERIICO ), Université de Lille, Pôle de Recherche Francophonies, Interculturel, Communication, Sociolinguistique (PREFICS EA 7469), Université de Bretagne Sud (UBS)-Université de Rennes 2 (UR2), Projet HAL/LO GIS 'Réseau Urfist', Groupe d'Études et de Recherche Interdisciplinaire en Information et COmmunication - ULR 4073 [GERIICO ], and Pôle de Recherche Francophonies, Interculturel, Communication, Sociolinguistique [PREFICS EA 7469]
- Subjects
open access ,[SHS.INFO]Humanities and Social Sciences/Library and information sciences ,Communication ,Library and Information Sciences ,contributor ,research assessment ,Current research information system ,Computer Science Applications ,monitoring ,library_information_science ,open science ,open repositories ,green road ,self-archiving ,Media Technology ,Business and International Management - Abstract
(1) Background: The 2002 Budapest Open Access Initiative recommended the self-archiving of scientific articles in open repositories, which has been described as the “green road” to open access. Twenty years later, only one part of the researchers deposits their publications in open repositories; moreover, one part of the repositories’ content is not based on self-archived deposits but on mediated nonfaculty contributions. The purpose of the paper is to provide more empirical evidence on this situation and to assess the impact on the future of the green road. (2) Methods: We analyzed the contributions to the French national HAL repository from more than 1000 laboratories affiliated with the ten most important French research universities, with a focus on 2020, representing 14,023 contributor accounts and 164,070 deposits. (3) Results: We identified seven different types of contributor accounts, including deposits from nonfaculty staff and import flows from other platforms. Mediated nonfaculty contributions (deposits by libraries, import of bibliographic records, migration from other platforms, etc.) account for at least 48% of the 2020 deposits. We also identified differences between institutions and disciplines. (4) Conclusions: Our empirical results reveal a transformation of open repositories from self-archiving and direct scientific communication towards research information management. Repositories like HAL are somewhere in the middle of the process. The paper describes data quality as the main issue and major challenge of this transformation.
- Published
- 2023
30. The positive impact on translational research of Fondazione italiana di ricerca per la Sclerosi Laterale Amiotrofica (AriSLA), a non-profit foundation focused on amyotrophic lateral sclerosis. Convergence of ex-ante evaluation and ex-post outcomes when goals are set upfront
- Author
-
Stefania Guareschi, Maddalena Ravasi, Danila Baldessari, Silvia Pozzi, Tiziana Zaffino, Mario Melazzini, and Anna Ambrosini
- Subjects
amyotrophic lateral sclerosis ,ALS research ,relative citation ratio ,RCR ,research assessment ,Bibliography. Library science. Information resources - Abstract
Charities investing on rare disease research greatly contribute to generate ground-breaking knowledge with the clear goal of finding a cure for their condition of interest. Although the amount of their investments may be relatively small compared to major funders, the advocacy groups' clear mission promotes innovative research and aggregates highly motivated and mission-oriented scientists. Here, we illustrate the case of Fondazione italiana di ricerca per la Sclerosi Laterale Amiotrofica (AriSLA), the main Italian funding agency entirely dedicated to amyotrophic lateral sclerosis research. An international benchmark analysis of publications derived from AriSLA-funded projects indicated that their mean relative citation ratio values (iCite dashboard, National Institutes of Health, U.S.) were very high, suggesting a strong influence on the referring international scientific community. An interesting trend of research toward translation based on the “triangle of biomedicine” and paper citations (iCite) was also observed. Qualitative analysis on researchers' accomplishments was convergent with the bibliometric data, indicating a high level of performance of several working groups, lines of research that speak of progression toward clinical translation, and one study that has progressed from the investigation of cellular mechanisms to a Phase 2 international clinical trial. The key elements of the success of the AriSLA investment lie in: (i) the clear definition of the objectives (research with potential impact on patients, no matter how far), (ii) a rigorous peer-review process entrusted to an international panel of experts, (iii) diversification of the portfolio with ad hoc selection criteria, which also contributed to bringing new experts and younger scientists to the field, and (iv) a close interaction of AriSLA stakeholders with scientists, who developed a strong sense of belonging. Periodic review of the portfolio of investments is a vital practice for funding agencies. Sharing information between funding agencies about their own policies and research assessment methods and outcomes help guide the international debate on funding strategies and research directions to be undertaken, particularly in the field of rare diseases, where synergy is a relevant enabling factor.
- Published
- 2023
- Full Text
- View/download PDF
31. Examining linguistic shifts between preprints and publications
- Author
-
Nicholson, David N., Rubinetti, Vincent, Hu, Dongbo, Thielk, Marvin, Hunter, Lawrence E., and Greene, Casey S.
- Subjects
Science and Technology Workforce ,Computer and Information Sciences ,Viral Diseases ,Biomedical Research ,Science Policy ,Bioinformatics ,Social Sciences ,Research and Analysis Methods ,Careers in Research ,Database and Informatics Methods ,Mathematical and Statistical Techniques ,Medical Conditions ,Terminology as Topic ,Medicine and Health Sciences ,Statistical Methods ,Scientific Publishing ,Data Management ,Language ,Metadata ,Principal Component Analysis ,Grammar ,Statistics ,Publications ,Linguistics ,Covid 19 ,Research Assessment ,Professions ,Infectious Diseases ,Preprints as Topic ,People and Places ,Multivariate Analysis ,Physical Sciences ,Meta-Research Article ,Scientists ,Population Groupings ,Mathematics - Abstract
Preprints allow researchers to make their findings available to the scientific community before they have undergone peer review. Studies on preprints within bioRxiv have been largely focused on article metadata and how often these preprints are downloaded, cited, published, and discussed online. A missing element that has yet to be examined is the language contained within the bioRxiv preprint repository. We sought to compare and contrast linguistic features within bioRxiv preprints to published biomedical text as a whole as this is an excellent opportunity to examine how peer review changes these documents. The most prevalent features that changed appear to be associated with typesetting and mentions of supporting information sections or additional files. In addition to text comparison, we created document embeddings derived from a preprint-trained word2vec model. We found that these embeddings are able to parse out different scientific approaches and concepts, link unannotated preprint–peer-reviewed article pairs, and identify journals that publish linguistically similar papers to a given preprint. We also used these embeddings to examine factors associated with the time elapsed between the posting of a first preprint and the appearance of a peer-reviewed publication. We found that preprints with more versions posted and more textual changes took longer to publish. Lastly, we constructed a web application (https://greenelab.github.io/preprint-similarity-search/) that allows users to identify which journals and articles that are most linguistically similar to a bioRxiv or medRxiv preprint as well as observe where the preprint would be positioned within a published article landscape., Preprints allow researchers to make their findings available to the scientific community before they have undergone peer review This study analyzes the full text content of the bioRxiv preprint repository, identifying field-specific patterns and changes that occur during publication, and providing a search tool that can identify the published papers that are most similar to a given bioRxiv or medRxiv preprint.
- Published
- 2022
32. Internet-based supply chain financing-oriented risk assessment using BP neural network and SVM
- Author
-
Weiqiong Fu, Hanxiao Zhang, and Fu Huang
- Subjects
Optimization ,Computer and Information Sciences ,China ,Asia ,Support Vector Machine ,Neural Networks ,Economics ,Science ,Social Sciences ,Research and Analysis Methods ,Risk Assessment ,Machine Learning ,Geographical Locations ,Artificial Intelligence ,Support Vector Machines ,Computer Networks ,Research Errors ,Internet ,Multidisciplinary ,Commerce ,Biology and Life Sciences ,Research Assessment ,Public Finance ,Physical Sciences ,People and Places ,Money Supply and Banking ,Medicine ,Neural Networks, Computer ,Finance ,Mathematics ,Algorithms ,Research Article ,Neuroscience - Abstract
To better prevent the potential risks in Internet-based Supply Chain Financing (SCF) products, this paper optimizes and evaluates the Internet-based SCF-oriented Credit Risk Evaluation (CRE) method. Firstly, this paper summarizes 12 risk factors of SCF business, establishes a Risk Assessment Index System (RAIS) with good consistency and stability; then, the principles of Backpropagation (BP) Neural Network (NN) is expounded together with Support Vector Machines (SVM) and Genetic Algorithm (GA) model. Consequently, a CRE model is implemented by the NN tools in MATLAB based on the collection of multiple groups of SCF-oriented risk assessment samples. Subsequently, the assessment samples are trained and tested. Finally, the SCF-oriented CRE model is proposed and verified. The results show that the BP-GA model has presented high prediction consistency with the actual classification. According to the comparison of classification results of SVM, BP model, and BP-GA model, the classification accuracy of test samples of the proposed Internet-based SCF-oriented CRE system using BP-GA model reaches 97.19%; the Type I and Type II error rate of the CRE system based on BP-GA model is 7.2% and 14.21%, respectively. Therefore, a suitable SCF-oriented CRE method is put forward for China’s commercial banks along with scientific and feasible suggestions to manage SCF-oriented credit risks more reasonably and effectively.
- Published
- 2022
33. INFLUENCE OF CITATION PRACTICES ON ACADEMIC ASSESSMENT
- Author
-
Horacio Rivera
- Subjects
citations ,referencing ,citation biases ,research assessment ,altmetrics ,Medical philosophy. Medical ethics ,R723-726 - Abstract
In writing scientific papers, proper citation and referencing are crucial and thereby should be taught to graduate students and novice researchers as tools for counteracting the pervasive errors in citing, quoting, and referencing. Although the relevance of citation counts and derived indicators such as the h-index in assessing research performance is out of question, this emphasis has resulted in an “impact or perish” culture featuring post-production misrepresentation and related misbehaviors. Herein, I appraise the use of citations in academic assessment, citations in original vs. review articles, convenience and country of origin biases, and some related issues. The current landscape highlights that formal instruction on citation practices and their implications should be included in graduate programs and enduringly reinforced by mentors in laboratories.
- Published
- 2022
- Full Text
- View/download PDF
34. The Platformisation of Scholarly Information and how to Fight It.
- Author
-
Lai Ma
- Abstract
The commercial control of academic publishing and research infrastructure by a few oligopolistic companies has crippled the development of the open access movement and interfered with the ethical principles of informa)tion access and privacy. In recent years, vertical integration of publishers and other service providers throughout the research cycle has led to plat)formisation, characterised by datafication and commodification similar to the practices on social media platforms. Scholarly publications are treated as user-generated contents for data tracking and surveillance, resulting in profitable data products and services for research assessment, benchmark)ing and reporting. Meanwhile, the bibliodiversity and equal open access are denied by the dominant gold open access model and the privacy of researchers is being compromised by spyware embedded in research infra)structure. This article proposes four actions to challenge the platformisation of scholarly information after a brief overview of the market of academic journals and research assessments and their implications for bibliodiversity, information access, and privacy: (1) Educate researchers about commercial publishers and APCs; (2) Allocate library budget to support scholar-led and library publishing; (3) Engage in the development of public research infra)structures and copyright reform; and (4) Advocate for research assessment reforms. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
35. Evaluating research excellence in architecture: A view from German technical universities towards a European perspective.
- Author
-
Luce, Martin, Pfarr-Harfst, Mieke, Reeh, Judith, Schröder, Jörg, and Tessmann, Oliver
- Subjects
EUROPEAN communities ,EXCELLENCE ,RESEARCH personnel - Abstract
From the perspective of the architecture departments in nine German technical universities, this essay argues that the positioning of architecture as a research discipline requires adapted evaluation standards to fulfil its promise of generating new knowledge. Evaluation processes depend on and also influence their funding context, plus they are strongly linked to a categorisation of research practices and topics. The essay argues for widespread recognition of discipline-specific research methods, as well as specific outputs and publication practices. It provides empirical evidence of new European standards for peer-reviewed assessment of architectural research in line with subject-specific approaches. Suggestions are made for opening up excellence funding lines to design-oriented and practice-based research. The essay thus calls for researchers, universities, and associations to work together to improve evaluation and funding frameworks. It proposes that measures to strengthen the quality of architectural research in Germany can thus be of interest to a wider European academic community. The essay's conclusions support the goal of the Coalition for Advancing Research Assessment (COARA) to maximise the excellence and impact of research by reforming assessment practices across all disciplines. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
36. La peer review nella valutazione della ricerca e data analysis sulle pubblicazioni del SSD M-STO/08 (Archivistica, bibliografia e biblioteconomia).
- Author
-
Morriello, Rossana
- Subjects
QUALITATIVE research ,BIBLIOGRAPHY ,LIBRARY science ,HABIT ,BIBLIOMETRICS ,DATA analysis - Abstract
Copyright of JLIS.it: Italian Journal of Library, Archives & Information Science is the property of Firenze University Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2023
- Full Text
- View/download PDF
37. Are female scientists underrepresented in self-retractions for honest error?
- Author
-
Mariana D. Ribeiro, Jesus Mena-Chalco, Karina de Albuquerque Rocha, Marlise Pedrotti, Patrick Menezes, and Sonia M. R. Vasconcelos
- Subjects
gender ,self-correction of science ,retractions ,research integrity ,research assessment ,science policy ,Bibliography. Library science. Information resources - Abstract
Retractions are among the effective measures to strengthen the self-correction of science and the quality of the literature. When it comes to self-retractions for honest errors, exposing one's own failures is not a trivial matter for researchers. However, self-correcting data, results and/or conclusions has increasingly been perceived as a good research practice, although rewarding such practice challenges traditional models of research assessment. In this context, it is timely to investigate who have self-retracted for honest error in terms of country, field, and gender. We show results on these three factors, focusing on gender, as data are scarce on the representation of female scientists in efforts to set the research record straight. We collected 3,822 retraction records, including research articles, review papers, meta-analyses, and letters under the category “error” from the Retraction Watch Database for the 2010–2021 period. We screened the dataset collected for research articles (2,906) and then excluded retractions by publishers, editors, or third parties, and those mentioning any investigation issues. We analyzed the content of each retraction manually to include only those indicating that they were requested by authors and attributed solely to unintended mistakes. We categorized the records according to country, field, and gender, after selecting research articles with a sole corresponding author. Gender was predicted using Genderize, at a 90% probability threshold for the final sample (n = 281). Our results show that female scientists account for 25% of self-retractions for honest error, with the highest share for women affiliated with US institutions.
- Published
- 2023
- Full Text
- View/download PDF
38. Can co-authorship networks be used to predict author research impact? A machine-learning based analysis within the field of degenerative cervical myelopathy research
- Author
-
Noah Grodzinski, Benjamin Davies, Ben Grodzinski, Grodzinski, Ben [0000-0001-8839-4718], and Apollo - University of Cambridge Repository
- Subjects
FOS: Computer and information sciences ,Biomedical Research ,Social connectedness ,Computer science ,International Cooperation ,Field (computer science) ,Machine Learning ,Mathematical and Statistical Techniques ,Knowledge extraction ,Japan ,Medical Laboratory Personnel ,Musculoskeletal System ,Multidisciplinary ,Computer and information sciences ,Artificial neural network ,Applied Mathematics ,Simulation and Modeling ,Statistics ,Opinion leadership ,Neurodegenerative Diseases ,Research Assessment ,Research Personnel ,Physical sciences ,Medicine ,Anatomy ,Network Analysis ,Algorithms ,Network analysis ,Research Article ,Neural Networks ,Science ,FOS: Physical sciences ,Bibliometrics ,Spinal Cord Diseases ,Machine Learning Algorithms ,Artificial Intelligence ,Humans ,Statistical Methods ,Set (psychology) ,Skeleton ,Artificial Neural Networks ,Retrospective Studies ,Computational Neuroscience ,Medicine and health sciences ,Biology and life sciences ,Computational Biology ,Data science ,Spine ,Authorship ,Research and analysis methods ,North America ,Neural Networks, Computer ,Mathematics ,Neck ,Neuroscience ,Forecasting - Abstract
Introduction Degenerative Cervical Myelopathy (DCM) is a common and disabling condition, with a relatively modest research capacity. In order to accelerate knowledge discovery, the AO Spine RECODE-DCM project has recently established the top priorities for DCM research. Uptake of these priorities within the research community will require their effective dissemination, which can be supported by identifying key opinion leaders (KOLs). In this paper, we aim to identify KOLs using artificial intelligence. We produce and explore a DCM co-authorship network, to characterise researchers’ impact within the research field. Methods Through a bibliometric analysis of 1674 scientific papers in the DCM field, a co-authorship network was created. For each author, statistics about their connections to the co-authorship network (and so the nature of their collaboration) were generated. Using these connectedness statistics, a neural network was used to predict H-Index for each author (as a proxy for research impact). The neural network was retrospectively validated on an unseen author set. Results DCM research is regionally clustered, with strong collaboration across some international borders (e.g., North America) but not others (e.g., Western Europe). In retrospective validation, the neural network achieves a correlation coefficient of 0.86 (p Discussion Analysis of the neural network shows that the nature of collaboration strongly impacts an author’s research visibility, and therefore suitability as a KOL. This also suggests greater collaboration within the DCM field could help to improve both individual research visibility and global synergy.
- Published
- 2021
39. Using single impact metrics to assess research in business and economics: why institutions should use multi-criteria systems for assessing research
- Author
-
Sergio Olavarrieta
- Subjects
impact factor ,article influence ,business journals ,research assessment ,faculty promotion ,tenure ,Business ,HF5001-6182 - Abstract
Purpose – Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is generating an emerging trend in Business Schools to use single journal impact factors (IFs) as key (unique) drivers for those relevant school decisions. This paper aims to investigate the effects of using single Web of Science (WoS)-based journal impact metrics when assessing research from two related disciplines: Business and Economics, and its potential impact for the strategic sustainability of a Business School. Design/methodology/approach – This study collected impact indicators data for Business and Economics journals from the Clarivate Web of Science database. We concentrated on the IF indicators, the Eigenfactor and the article influence score (AIS). This study examined the correlations between these indicators and then ranked disciplines and journals using these different impact metrics. Findings – Consistent with previous findings, this study finds positive correlations among these metrics. Then this study ranks the disciplines and journals using each impact metric, finding relevant and substantial differences, depending on the metric used. It is found that using AIS instead of the IF raises the relative ranking of Economics, while Business remains basically with the same rank. Research limitations/implications – This study contributes to the research assessment literature by adding substantial evidence that given the sensitivity of journal rankings to particular indicators, the selection of a single impact metric for assessing research and hiring/promotion and tenure decisions is risky and too simplistic. This research shows that biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and traditions. Practical implications – Consistent with the literature, given the sensibility of journal rankings to particular indicators, the selection of a single impact metric for assessing research, assigning research funds and hiring/promotion and tenure decisions is risky and simplistic. However, this research shows that risks and biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and trajectories. The use of multiple criteria is advised for such purposes. Originality/value – This is an applied work using real data from WoS that addresses a practical case of comparing the use of different journal IFs to rank-related disciplines like Business and Economics, with important implications for faculty tenure and promotion committees and for research funds granting institutions and decision-makers.
- Published
- 2022
- Full Text
- View/download PDF
40. The disconnect between researcher ambitions and reality in achieving impact in the Earth & Environmental Sciences – author survey [version 2; peer review: 1 approved, 1 approved with reservations, 1 not approved]
- Author
-
Andrew Kelly, Victoria Gardner, and Anna Gilbert
- Subjects
Research Article ,Articles ,academic publishing ,Earth Sciences ,Environmental Sciences ,research journals ,research assessment ,survey ,Sustainable Development Goals ,SDGs - Abstract
Background: There is an increasing desire for research to provide solutions to the grand challenges facing our global society, such as those expressed in the UN SDGs (“real-world impact”). Herein, we undertook an author survey to understand how this desire influenced the choice of research topic, choice of journal, and preferred type of impact. Methods: We conducted a survey of authors who had published in >100 of our Earth & Environmental Science journals. The survey was sent to just under 60,000 authors and we received 2,695 responses (4% response rate). Results: Respondents indicated that the majority of their research (74%) is currently concerned with addressing urgent global needs, whilst 90% of respondents indicated that their work either currently contributed to meeting real-world problems or that it would be a priority for them in the future; however, the impetus for this research focus seems to be altruistic researcher desire, rather than incentives or support from publishers, funders, or their institutions. Indeed, when contextualised within existing reward and incentive structures, respondents indicated that citations or downloads were more important to them than contributing to tackling real-world problems. Conclusions: At present, it seems that the laudable and necessary ambition of researchers in the Earth & Environmental Sciences to contribute to the tackling of real-world problems, such as those included in the UN SDGs, is seemingly being lost amidst the realities of being a researcher, owing to the prioritisation of other forms of impact, such as citations and downloads.
- Published
- 2022
- Full Text
- View/download PDF
41. A comparative analysis of the principal component analysis and entropy weight methods to establish the indexing measurement
- Author
-
Robert M. X. Wu, Zhongwu Zhang, Wanjun Yan, Jianfeng Fan, Jinwen Gou, Bao Liu, Ergun Gide, Jeffrey Soar, Bo Shen, Syed Fazal-e-Hasan, Zengquan Liu, Peng Zhang, Peilin Wang, Xinxin Cui, Zhanfei Peng, and Ya Wang
- Subjects
Fossil Fuels ,Computer and Information Sciences ,China ,Safety Management ,Epidemiology ,Entropy ,Science ,Materials Science ,Decision Making ,Social Sciences ,Fuels ,Research and Analysis Methods ,Mathematical and Statistical Techniques ,Cognition ,Medicine and Health Sciences ,Data Mining ,Psychology ,Accidents, Occupational ,Statistical Methods ,Materials ,Data Management ,Principal Component Analysis ,Multidisciplinary ,Physics ,Applied Mathematics ,Simulation and Modeling ,Statistics ,Cognitive Psychology ,Biology and Life Sciences ,Research Assessment ,Coal Mining ,Energy and Power ,Coal ,Evaluation Studies as Topic ,Medical Risk Factors ,Physical Sciences ,Multivariate Analysis ,Thermodynamics ,Engineering and Technology ,Cognitive Science ,Medicine ,Organic Materials ,Mathematics ,Algorithms ,Research Article ,Neuroscience - Abstract
Background As the world’s largest coal producer, China was accounted for about 46% of global coal production. Among present coal mining risks, methane gas (called gas in this paper) explosion or ignition in an underground mine remains ever-present. Although many techniques have been used, gas accidents associated with the complex elements of underground gassy mines need more robust monitoring or warning systems to identify risks. This paper aimed to determine which single method between the PCA and Entropy methods better establishes a responsive weighted indexing measurement to improve coal mining safety. Methods Qualitative and quantitative mixed research methodologies were adopted for this research, including analysis of two case studies, correlation analysis, and comparative analysis. The literature reviewed the most-used multi-criteria decision making (MCDM) methods, including subjective methods and objective methods. The advantages and disadvantages of each MCDM method were briefly discussed. One more round literature review was conducted to search publications between 2017 and 2019 in CNKI. Followed two case studies, correlation analysis and comparative analysis were then conducted. Research ethics was approved by the Shanxi Coking Coal Group Research Committee. Results The literature searched a total of 25,831publications and found that the PCA method was the predominant method adopted, and the Entropy method was the second most widely adopted method. Two weighting methods were compared using two case studies. For the comparative analysis of Case Study 1, the PCA method appeared to be more responsive than the Entropy. For Case Study 2, the Entropy method is more responsive than the PCA. As a result, both methods were adopted for different cases in the case study mine and finally deployed for user acceptance testing on 5 November 2020. Conclusions The findings and suggestions were provided as further scopes for further research. This research indicated that no single method could be adopted as the better option for establishing indexing measurement in all cases. The practical implication suggests that comparative analysis should always be conducted on each case and determine the appropriate weighting method to the relevant case. This research recommended that the PCA method was a dimension reduction technique that could be handy for identifying the critical variables or factors and effectively used in hazard, risk, and emergency assessment. The PCA method might also be well-applied for developing predicting and forecasting systems as it was sensitive to outliers. The Entropy method might be suitable for all the cases requiring the MCDM. There is also a need to conduct further research to probe the causal reasons why the PCA and Entropy methods were applied to each case and not the other way round. This research found that the Entropy method provides higher accuracy than the PCA method. This research also found that the Entropy method demonstrated to assess the weights of the higher dimension dataset was higher sensitivity than the lower dimensions. Finally, the comprehensive analysis indicates a need to explore a more responsive method for establishing a weighted indexing measurement for warning applications in hazard, risk, and emergency assessments.
- Published
- 2022
42. 'How and Why Do Researchers Reference Data'? A Study of Rhetorical Features and Functions of Data References in Academic Articles
- Author
-
Sara Lafia, Andrea Thomer, Elizabeth Moss, David Bleckley, and Libby Hemphill
- Subjects
citation analysis ,data reuse ,research assessment ,scholarly communication ,Science (General) ,Q1-390 - Abstract
Data reuse is a common practice in the social sciences. While published data play an essential role in the production of social science research, they are not consistently cited, which makes it difficult to assess their full scholarly impact and give credit to the original data producers. Furthermore, it can be challenging to understand researchers’ motivations for referencing data. Like references to academic literature, data references perform various rhetorical functions, such as paying homage, signaling disagreement, or drawing comparisons. This paper studies how and why researchers reference social science data in their academic writing. We develop a typology to model relationships between the entities that anchor data references, along with their features (access, actions, locations, styles, types) and functions (critique, describe, illustrate, interact, legitimize). We illustrate the use of the typology by coding multidisciplinary research articles (n = 30) referencing social science data archived at the Inter-university Consortium for Political and Social Research (ICPSR). We show how our typology captures researchers’ interactions with data and purposes for referencing data. Our typology provides a systematic way to document and analyze researchers’ narratives about data use, extending our ability to give credit to data that support research.
- Published
- 2023
- Full Text
- View/download PDF
43. Development of a self-management intervention for stroke survivors with aphasia using co-production and behaviour change theory: An outline of methods and processes
- Author
-
Madeline Cruice, Anne Forster, Faye Wray, and David Dave Clarke
- Subjects
Male ,Speech-Language Pathology ,Applied psychology ,Social Sciences ,Laryngology ,Sociology ,Behavior Therapy ,Medicine and Health Sciences ,Psychology ,Survivors ,Program Development ,Language ,Multidisciplinary ,Self-management ,Social Communication ,Middle Aged ,Research Assessment ,Test (assessment) ,Stroke ,Systematic review ,Caregivers ,Engineering and Technology ,Medicine ,Female ,Workshops ,medicine.symptom ,Research Article ,Adult ,Systematic Reviews ,Process (engineering) ,Science ,Speech Therapy ,Research and Analysis Methods ,Education ,Quality of life (healthcare) ,Intervention (counseling) ,Aphasia ,medicine ,Humans ,Prototypes ,Speech ,Behavior ,Self-Management ,Cognitive Psychology ,Biology and Life Sciences ,Linguistics ,R1 ,Focus group ,Communications ,Technology Development ,Otorhinolaryngology ,Cognitive Science ,Neuroscience - Abstract
Background Self-management is a promising approach to improve quality of life after stroke. However, evidence for the appropriateness and effectiveness of self-management for stroke survivors with aphasia is limited. This article reports on the process used to develop a supported self-management intervention for stroke survivors with aphasia (SSWA) using co-production and behaviour change theory. Preparatory research included systematic reviews, and qualitative interviews and focus groups with SSWA, family members and speech and language therapists (SLTs). Materials and methods We conducted six, 2 hour long intervention development workshops with key stakeholders. The workshops were informed by principles of co-production and the intervention development process outlined by the Behaviour Change Wheel (BCW). We also incorporated the findings of our preparatory research within workshops. Each workshop included an introduction, 1–2 co-production tasks and time for feedback at the end of the session. Data were analysed on an ongoing basis so that findings could be used to feed in to subsequent workshops and intervention development. Results Workshop participants (n = 12) included; SSWA (n = 5), family members (n = 3) and SLTs (n = 4). Together, participants engaged with accessible and participatory co-production tasks which aligned with the BCW framework. Participants engaged in discussion to define self-management in behavioural terms (behavioural diagnosis) and to identify what needed to change to support self-management. Participant’s co-produced solutions for supporting self-management and discussed options to implement these in practice. Prototype materials were generated by the research team and evaluated by participants. Intervention functions and behaviour change techniques (BCTs) were mapped to the solutions generated by participants by the research team, after the final workshop. A supported self-management intervention for SSWA was developed which will be delivered by SLTs through community stroke services. Conclusions This paper reports the process we used to integrate co-production work with behaviour change theory to develop a complex self-management intervention. This is of relevance for researchers looking to harness the strengths of co-production methods and theory in intervention design. Future research will feasibility test the supported self-management intervention developed. This paper provides transparency to our intervention development process which will help others to better interpret the findings of our feasibility work.
- Published
- 2021
44. Time to publish? Turnaround times, acceptance rates, and impact factors of journals in fisheries science
- Author
-
Brendan J. Runde
- Subjects
Viral Diseases ,Medical Journals ,Coronavirus disease 2019 (COVID-19) ,Epidemiology ,Science ,Acceptance rate ,Fisheries ,MEDLINE ,Marine and Aquatic Sciences ,Aquaculture ,Bibliometrics ,Research and Analysis Methods ,Turnaround time ,Medical Conditions ,Medicine and Health Sciences ,Humans ,Marketing ,Pandemics ,Publication ,Scientific Publishing ,Publishing ,Fisheries science ,Multidisciplinary ,Impact factor ,business.industry ,COVID-19 ,Biology and Life Sciences ,Agriculture ,Covid 19 ,Research Assessment ,Infectious Diseases ,Earth Sciences ,Medicine ,Journal Impact Factor ,Periodicals as Topic ,business ,Psychology ,Medical Humanities ,Research Article - Abstract
Selecting a target journal is a universal decision faced by authors of scientific papers. Components of the decision, including expected turnaround time, journal acceptance rate, and journal impact factor, vary in terms of accessibility. In this study, I collated recent turnaround times and impact factors for 82 journals that publish papers in the field of fisheries sciences. In addition, I gathered acceptance rates for the same journals when possible. Findings indicated clear among-journal differences in turnaround time, with median times-to-publication ranging from 79 to 323 days. There was no clear correlation between turnaround time and acceptance rate nor between turnaround time and impact factor; however, acceptance rate and impact factor were negatively correlated. I found no field-wide differences in turnaround time since the beginning of the COVID-19 pandemic, though some individual journals took significantly longer or significantly shorter to publish during the pandemic. Depending on their priorities, authors choosing a target journal should use the results of this study as guidance toward a more informed decision.
- Published
- 2021
45. Recognising supporting roles (Recognition & Rewards Festival 2023, Workshop 1.8)
- Author
-
Sander Bosch, Jeroen Bosman, Maria Cruz, Nicoleta Nastase, Shauna Ni Fhlaithearta, Esther Plomp, Dan Rudmann, Jeroen Sondervan, Marta Teperek, and Dieudonnée van de Willige
- Subjects
support staff ,Team Infrastructure Roles ,Third space ,Recognition & Rewards ,research assessment - Abstract
Slides used for the Recognition & Rewards Festival 2023, Workshop 1.8 - Recognising supporting roles on the 13th of April 2023. Session contributors listed in alphabetical order. Workshop abstract: The position paper ‘Room for everyone's talent’ focusses, amongst other things, on diversifying career paths and how to recognise team performances. This should be a key opportunity to involve staff at research institutions that have more specialised or supporting tasks in these teams. This workshop aims to increase awareness regarding supporting roles, what role they play in Team Science and how to recognise their expertise. During this interactive workshop we will exchange practices and start with setting up a survey and roadmap to ensure that supporting roles are involved in current and future Recognition and Rewards efforts. Please note that animations were used in the slides, which are properly displayed in the .pptx format.
- Published
- 2023
- Full Text
- View/download PDF
46. Recognising supporting roles (Recognition & Rewards Festival 2023, Workshop 1.8)
- Author
-
Bosch, Sander, Bosman, Jeroen, Cruz, Maria, Nastase, Nicoleta, Fhlaithearta, Shauna Ni, Plomp, Esther, Rudmann, Dan, Sondervan, Jeroen, Teperek, Marta, and Van De Willige, Dieudonnée
- Subjects
support staff ,Team Infrastructure Roles ,Third space ,Recognition & Rewards ,research assessment - Abstract
Slides used for the Recognition & Rewards Festival 2023, Workshop 1.8 - Recognising supporting roles on the 13th of April 2023. Session contributors listed in alphabetical order. Workshop abstract: The position paper ‘Room for everyone's talent’ focusses, amongst other things, on diversifying career paths and how to recognise team performances. This should be a key opportunity to involve staff at research institutions that have more specialised or supporting tasks in these teams. This workshop aims to increase awareness regarding supporting roles, what role they play in Team Science and how to recognise their expertise. During this interactive workshop we will exchange practices and start with setting up a survey and roadmap to ensure that supporting roles are involved in current and future Recognition and Rewards efforts. Please note that animations were used in the slides, which are properly displayed in the .pptx format.
- Published
- 2023
- Full Text
- View/download PDF
47. Measuring how motivation affects information quality assessment
- Author
-
Poženel, Marko, Zrnec, Aljaž, and Lavbič, Dejan
- Subjects
psychometrics ,strinjanje med ocenjevalci ,information quality ,video games ,kakovost informacij ,motivacija ,online encyclopedias ,research assessment ,ocena kakovosti informacij ,naloga ,motivation ,task-at-hand ,udc:004 ,information quality assessment ,gameful design ,inter-rater agreement ,measurement ,sports ,games - Abstract
Purpose Existing research on the measurability of information quality (IQ) has delivered poor results and demonstrated low inter-rater agreement measured by Intra-Class Correlation (ICC) in evaluating IQ dimensions. Low ICC could result in a questionable interpretation of IQ. The purpose of this paper is to analyse whether assessors’ motivation can facilitate ICC. Methodology To acquire the participants’ views of IQ, we designed a survey as a gamified process. Additionally, we selected Web study to reach a broader audience. We increased the validity of the research by including a diverse set of participants (i.e. individuals with different education, demographic and social backgrounds). Findings The study results indicate that motivation improved the ICC of IQ on average by 0.27, demonstrating an increase in measurability from poor (0.29) to moderate (0.56). The results reveal a positive correlation between motivation level and ICC, with a significant overall increase in ICC relative to previous studies. The research also identified trends in ICC for different dimensions of IQ with the best results achieved for completeness and accuracy. Practical implications The work has important practical implications for future IQ research and suggests valuable guidelines. The results of this study imply that considering raters’ motivation improves the measurability of IQ substantially. Originality Previous studies addressed ICC in IQ dimension evaluation. However, assessors’ motivation has been neglected. This study investigates the impact of assessors’ motivation on the measurability of IQ. Compared to the results in related work, the level of agreement achieved with the most motivated group of participants was superior.
- Published
- 2023
48. Measuring Back: Bibliodiversity and the Journal Impact Factor brand. A Case study of IF-journals included in the 2021 Journal Citations Report
- Author
-
Bardiau, Marjorie and Dony, Christophe
- Subjects
journal impact factor ,journal citation reports ,bibliometrics ,bibliodiversity ,responsible metrics ,impact factor ,open access models ,research assessment ,publishing models ,APC - Abstract
Little attention has been devoted to whether the Impact Factor (IF) can be considered a responsible metric in light of bibliodiversity. This paper critically engages with this question in measuring the following variables of IF journals included in the 2021 Journal CItation Reports and examining their distribution: publishing models (hybrid, Open Access with or without fees, subscription), world regions, language(s) of publication, subject categories, publishers, and the prices of article processing charges (APC) if any. Our results show that the quest for prestige or perceived quality through the IF brand poses serious threats to bibliodiversity. The IF brand can indeed hardly be considered a responsible metric insofar as it perpetuates publishing concentration, maintains a domination of the Global North and its attendant artificial image of mega producer of scholarly content, does not promote linguistic diversity, and de-incentivizes fair and equitable open access by entrenching fee-based OA delivery options with rather high APCs. Dataset The accompanying data to this study can be found here: 10.5281/zenodo.7683743
- Published
- 2023
- Full Text
- View/download PDF
49. Population prevalence and distribution of ankle pain and symptomatic radiographic ankle osteoarthritis in community dwelling older adults: a systematic review and cross-sectional study
- Author
-
Trishna Rathod, Hylton B. Menz, Michelle Marshall, Edward Roddy, Charlotte L. Murray, and Catherine Bowen
- Subjects
Male ,Cross-sectional study ,Knees ,lcsh:Medicine ,Osteoarthritis ,Logistic regression ,0302 clinical medicine ,Medicine and Health Sciences ,Prevalence ,Medicine ,030212 general & internal medicine ,Ankle pain ,lcsh:Science ,Musculoskeletal System ,Uncategorized ,Aged, 80 and over ,education.field_of_study ,Multidisciplinary ,Age Factors ,Research Assessment ,Middle Aged ,Ankle Joints ,Sports Science ,3. Good health ,medicine.anatomical_structure ,Systematic review ,Legs ,Female ,Anatomy ,Foot (unit) ,Research Article ,Sports ,medicine.medical_specialty ,Systematic Reviews ,Population ,Pain ,Research and Analysis Methods ,Pelvis ,03 medical and health sciences ,Sex Factors ,Rheumatology ,Humans ,education ,Aged ,030203 arthritis & rheumatology ,Behavior ,Hip ,business.industry ,Arthritis ,Limbs (Anatomy) ,lcsh:R ,Ankles ,Biology and Life Sciences ,medicine.disease ,Radiography ,Joints (Anatomy) ,Cross-Sectional Studies ,Physical therapy ,Recreation ,lcsh:Q ,Ankle ,business ,RA ,Ankle Joint - Abstract
Objectives\ud To identify by systematic review published prevalence estimates of radiographic ankle osteoarthritis (OA) and to subsequently estimate the prevalence of ankle pain and symptomatic, radiographic ankle OA within community-dwelling older adults from North Staffordshire, UK.\ud \ud Methods\ud Electronic databases were searched using terms for ankle, osteoarthritis and radiography. Data regarding population, radiographic methods, definitions and prevalence estimates of ankle OA were extracted from papers meeting predetermined selection criteria. Adults aged ≥50 years and registered with four general practices in North Staffordshire were mailed a health questionnaire. Ankle pain in the previous month was determined using a foot and ankle pain manikin. Respondents reporting pain in or around the foot in the last 12 months were invited to attend a research clinic where weight-bearing, antero-posterior and lateral ankle radiographs were obtained and scored for OA using a standardised atlas. Prevalence estimates for ankle pain and symptomatic, radiographic ankle OA were calculated using multiple imputation and weighted logistic regression, and stratified by age, gender and socioeconomic status.\ud \ud Results\ud Eighteen studies were included in the systematic review. The methods of radiographic classification of ankle OA were poorly reported and showed heterogeneity. No true general population prevalence estimates of radiographic ankle OA were found, estimates in select sporting and medical community-dwelling populations ranged from 0.0–97.1%. 5109 participants responded to the health survey questionnaire (adjusted response 56%). Radiographs were obtained in 557 participants. The prevalence of ankle pain was 11.7% (10.8,12.6) and symptomatic, radiographic ankle OA grade≥2 was 3.4% (2.3, 4.5) (grade≥1: 8.8% (7.9,9.8); grade = 3: 1.9% (1.0,2.7). Prevalence was higher in females, younger adults (50–64 years) and those with routine/manual occupations.\ud \ud Conclusion\ud No general population prevalence estimates of radiographic ankle OA were identified in the published literature. Our prevalence study found that ankle pain was common in community-dwelling older adults, whereas moderate to severe symptomatic, radiographic ankle OA occurred less frequently. Further investigations of the prevalence of ankle OA using more sensitive imaging modalities are warranted.
- Published
- 2023
- Full Text
- View/download PDF
50. What Does DORA Mean for CRIS?
- Author
-
Schöpfel, Joachim, Azeroual, Otmane, Groupe d'Études et de Recherche Interdisciplinaire en Information et COmmunication - ULR 4073 [GERIICO ], Groupe d'Études et de Recherche Interdisciplinaire en Information et COmmunication - ULR 4073 (GERIICO ), Université de Lille, German Center for Higher Education Research and Science Studies (DZHW), and euroCRIS
- Subjects
current research information systems ,Research assessment ,Current research information systems CRIS ,[SHS.INFO]Humanities and Social Sciences/Library and information sciences ,San Francisco Declaration on Research Assessment (DORA) ,research information management ,research assessment ,Coalition for Advancing Research Assessment (CoARA) - Abstract
International audience; In the context of the Open Science movement, metrics and procedures of research assessment are changing. What does this mean for current research information systems (CRIS)? From an analysis of a selection of official documents, our contribution describes the challenges and provides some ideas and perspectives for the further development of the CRIS.In 2012, DORA, the San Francisco Declaration on Research Assessment, invited funding agencies, institutions, publishers, and researchers to improve their practices in research assessment, without “journal-based metrics, such as Journal Impact Factors, as a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring, promotion, or funding decisions”. At the same time, DORA recommended more transparency (explicit criteria), more diversity (including datasets and software), quality instead of quantity assessment (content) and open metrics (licensing).Many institutions and organizations signed the DORA declaration. Also, since 2012, an increasing number of international and national organizations published their own declarations, manifestos, reports, and other recommendations in order to shape and to accelerate the transformation of the research assessment landscape; some of them are listed below. Yet, the debate on research assessment is open. While the European Coalition for Advancing Research Assessment (CoARA) published a couple of months ago an Agreement with ten commitments, including the recognition of the “diversity of contributions to, and careers in, research”, the “focus on qualitative evaluation for which peer review is central, supported by responsible use of quantitative indicators” and the “abandon (of) inappropriate uses in research assessment of journal- and publication-based metrics”, the German Research Foundation (DFG), in a recent paper, recalls that its purpose is to fund “research of the highest quality” and that it is “opposed towards transforming research assessment systems with the aim to impose open science as an end in itself”.What does this mean for the development and implementation of research information systems? What does this mean for the underlying data model? Based on our former research and on a review of recent declarations, our contribution will summarize the main issues and provide some ideas and recommendations for CRIS providers and managers.
- Published
- 2022
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.