Search

In Ukraine, Scopus data are used to evaluate academics. Existing shortcomings in the Ukrainian evaluation system allow them to publish in titles that have been delisted from Scopus, and continue to use those papers as credible research output for evaluation. The purpose of this study was to analyse the publishing activity of Ukrainian institutions in Scopus‐delisted titles (as of September 2021) in different fields between 2011 and 2020 and to attempt to appreciate how common this practice is among Ukrainian authors. Scopus was sourced to collect bibliographic and citations‐related data, while SciVal was used to analyse these data. The findings suggest that for 17 Ukrainian institutions, papers from titles that have been delisted from Scopus still play an important part of the publication achievement of their employees. In particular, in the field of economics, econometrics and finance, 46.92% of Ukrainian papers were published in a title that was excluded from Scopus. Moreover, the analysis indicated that in two Ukrainian institutions, the level of citation of such papers significantly exceeds the average number of citations to Scopus‐indexed papers in the same year and in the same field. Given that bibliometric indicators are also used for research assessment in other Eastern European countries, the results of this paper are applicable to a wider geographic context. [ABSTRACT FROM AUTHOR]

This study analyzes USPTO patents in the period 1998–2017. The number of science-related patents has increased twice as fast as the number of patents and scientific publications, and the number of cited papers per patent has almost doubled. These results vary substantially from one scientific and technological field to another. The proportion of the research papers cited by a patent has doubled. It refers to papers that are mostly published by the countries that have developed both scientific and technological capability and, surprisingly, are mainly used by inventors abroad. However, a weak relationship between the number of citations received from patents and papers reveals that the assessment of research performance needs some changes as the percentage of papers related to the innovations has grown over time. • Over time, the number of science-related patents has increased twice as fast as the number of patents and publications. • The percentage of technology-oriented research has doubled over time. • The countries that are capable both in science and technology produce the main part of technology-oriented research. • The relationship between the number of citations received from patents and papers is weak. • Except for the US, countries utilize foreign science more than domestic ones. [ABSTRACT FROM AUTHOR]

For several decades, a leading paradigm of how to quantitatively assess scientific research has been the analysis of the aggregated citation information in a set of scientific publications. Although the representation of this information as a citation network has already been coined in the 1960s, it needed the systematic indexing of scientific literature to allow for impact metrics that actually made use of this network as a whole, improving on the then prevailing metrics that were almost exclusively based on the number of direct citations. However, besides focusing on the assignment of credit, the paper citation network can also be studied in terms of the proliferation of scientific ideas. Here we introduce a simple measure based on the shortest-paths in the paper's in-component or, simply speaking, on the shape and size of the wake of a paper within the citation network. Applied to a citation network containing Physical Review publications from more than a century, our approach is able to detect seminal articles which have introduced concepts of obvious importance to the further development of physics. We observe a large fraction of papers co-authored by Nobel Prize laureates in physics among the top-ranked publications. [ABSTRACT FROM AUTHOR]

Aims: To evaluate the relative efficiencies of five Internet-based digital and three paper-based scientific surveys and to estimate the costs for different-sized cohorts. Methods: Invitations to participate in a survey were distributed via e-mail to employees of two university hospitals (E1 and E2) and to members of a medical association (E3), as a link placed in a special text on the municipal homepage regularly read by the administrative employees of two cities (H1 and H2), and paper-based to workers at an automobile enterprise (P1) and college (P2) and senior (P3) students. The main parameters analyzed included the numbers of invited and actual participants, and the time and cost to complete the survey. Statistical analysis was descriptive, except for the Kruskal-Wallis-H-test, which was used to compare the three recruitment methods. Cost efficiencies were compared and extrapolated to different-sized cohorts. Results: The ratios of completely answered questionnaires to distributed questionnaires were between 81.5% (E1) and 97.4% (P2). Between 6.4% (P1) and 57.0% (P2) of the invited participants completely answered the questionnaires. The costs per completely answered questionnaire were $0.57–$1.41 (E1–3), $1.70 and $0.80 for H1 and H2, respectively, and $3.36–$4.21 (P1–3). Based on our results, electronic surveys with 10, 20, 30, or 42 questions would be estimated to be most cost (and time) efficient if more than 101.6–225.9 (128.2–391.7), 139.8–229.2 (93.8–193.6), 165.8–230.6 (68.7–115.7), or 188.2–231.5 (44.4–72.7) participants were required, respectively. Conclusions: The study efficiency depended on the technical modalities of the survey methods and engagement of the participants. Depending on our study design, our results suggest that in similar projects that will certainly have more than two to three hundred required participants, the most efficient way of conducting a questionnaire-based survey is likely via the Internet with a digital questionnaire, specifically via a centralized e-mail. [ABSTRACT FROM AUTHOR]

Several network features and information retrieval methods have been proposed to elucidate the structure of citation networks and to detect important nodes. However, it is difficult to retrieve information related to trends in an academic field and to detect cutting-edge areas from the citation network. In this paper, we propose a novel framework that detects the trend as the growth direction of a citation network using network representation learning(NRL). We presume that the linear growth of citation network in latent space obtained by NRL is the result of the iterative edge additional process of a citation network. On APS datasets and papers of some domains of the Web of Science, we confirm the existence of trends by observing that an academic field grows in a specific direction linearly in latent space. Next, we calculate each node’s degree of trend-following as an indicator called the intrinsic publication year (IPY). As a result, there is a correlation between the indicator and the number of future citations. Furthermore, a word frequently used in the abstracts of cutting-edge papers (high-IPY paper) is likely to be used often in future publications. These results confirm the validity of the detected trend for predicting citation network growth. [ABSTRACT FROM AUTHOR]

Abstract: Background: There has been a rapid expansion in the number of research papers published on clinical epilepsy topics and the number of journals in the medical field. In this expanding publishing environment, the question arises as to how much of the published medical literature has ‘enduring value’ in terms of advancing knowledge in any significant way. Methods: We developed a methodology to assess the enduring value of papers published in the field of clinical epilepsy and established its internal validity. We studied 300 research papers published in 1981, 1991, and 2001 (100 in each year) and assessed their enduring value in four domains: citations in the last year, citations in the last 10years, citations in the standard epilepsy textbook, and a subjective assessment by an experienced epileptologist. Results: Of the 300 papers, 214 (71%) were categorized as having ‘no enduring value’, and only 11 (4%) were identified as having ‘high enduring value’. The ‘high enduring value’ papers could generally be identified immediately on publication, by high initial citation values, and were also more likely to be published in journals with a high impact factor. The commonest characteristics of a paper with no enduring value were that they reported research that was inherently unimportant (55.6%), not novel (38.8%), or had significant methodological flaws (22.0%). Conclusions: Although there are other reasons for publishing papers, the fact that the great majority of published papers lack enduring value in terms of advancing knowledge should be a concern to the medical and scientific community. [Copyright &y& Elsevier]

Open access publication rates have been steadily increasing over time. In spite of this growth, academics in low income settings struggle to gain access to the full canon of research literature. While the vast majority of open access repositories and funding organizations with open access policies are based in high income countries, the geographic patterns of open access publication itself are not well characterized. In this study, we developed a computational approach to better understand the topical and geographical landscape of open access publications in the biomedical research literature. Surprisingly, we found a strong negative correlation between country per capita income and the percentage of open access publication. Open access publication rates were particularly high in sub-Saharan Africa, but vastly lower in the Middle East and North Africa, South Asia, and East Asia and the Pacific. These effects persisted when considering papers only bearing authors from within each region and income group. However, papers resulting from international collaborations did have a higher percentage of OA than single-country papers, and inter-regional collaboration increased OA publication for all world regions. There was no clear relationship between the number of open access policies in a region and the percentage of open access publications in that region. To understand the distribution of open access across topics of biomedical research, we examined keywords that were most enriched and depleted in open access papers. Keywords related to genomics, computational biology, animal models, and infectious disease were enriched in open access publications, while keywords related to the environment, nursing, and surgery were depleted in open access publications. This work identifies geographic regions and fields of research that could be priority areas for open access advocacy. The finding that open access publication rates are highest in sub-Saharan Africa and low income countries suggests that factors other than open access policy strongly influence authors’ decisions to make their work openly accessible. The high proportion of OA resulting from international collaborations indicates yet another benefit of collaborative research. Certain applied fields of medical research, notably nursing, surgery, and environmental fields, appear to have a greater proportion of fee-for-access publications, which presumably creates barriers that prevent researchers and practitioners in low income settings from accessing the literature in those fields. [ABSTRACT FROM AUTHOR]

There is growing interest in assessing the societal impacts of research such as informing health policies and clinical practice, and contributing to improved health. Bibliometric approaches have long been used to assess knowledge outputs, but can they also help evaluate societal impacts? We aimed to see how far the societal impacts could be traced by identifying key research articles in the psychiatry/neuroscience area and exploring their societal impact through analysing several generations of citing papers. Informed by a literature review of citation categorisation, we developed a prototype template to qualitatively assess a reference's importance to the citing paper and tested it on 96 papers. We refined the template for a pilot study to assess the importance of citations, including self-cites, to four key research articles. We then similarly assessed citations to those citing papers for which the key article was Central i.e. it was very important to the message of the citing article. We applied a filter of three or more citation occasions in order to focus on the citing articles where the reference was most likely to be Central. We found the reference was Central for 4.4 % of citing research articles overall and ten times more frequently if the article contained three or more citation occasions. We created a citation stream of influence for each key paper across up to five generations of citations. We searched the Web of Science for citations to all Central papers and identified societal impacts, including international clinical guidelines citing papers across the generations. [ABSTRACT FROM AUTHOR]

Background: Sponsors that seek to commercialize new drugs apply to the Food and Drug Administration (FDA) which independently analyzes the raw data and reports the results on its website. Objectives: This study sought to determine if there are differences between the FDA assessments and journal reports on biologic agents developed for the treatment of rheumatoid arthritis. Methods: Available data on FDA-approved drugs were extracted from the website, and a systematic literature search was conducted to identify matching studies in peer-reviewed medical journals. Outcome measures were the American College of Rheumatology response criteria ACR20 (efficacy) and withdrawal due to adverse events (safety). As effect size odds ratios were estimated for each active trial arm vs. control arm (i.e. for both sources: FDA and journal report), followed by calculation of the ratios of the FDA and journal report odds ratios. A ratio of odds ratios not equal to 1 was categorized as a discrepancy. Results: FDA reports were available for 8 of 9 FDA-approved biologic agents for rheumatoid arthritis; all identified trials (34) except one were published in peer-reviewed journals. Overall, discrepancies were noted for 20 of the 33 evaluated trials. Differences in the apparent benefit reporting were found in 39% (24/61) pairwise comparisons and in 11 cases these were statistically significant; the FDA report showed greater benefit than the journal publication in 15 comparisons and lesser benefit in 9. Differences in the reported harms were found in 51% (28/55) pairwise comparisons and were statistically significant in 5. The “signal” in FDA reports showed a less harmful effect than the journal publication in 17 comparisons whereas a more harmful effect in 11. The differences were attributed to differences in analytic approach, patient inclusion, rounding effect, and counting discrepancies. However, no differences were categorized as critical. Conclusion: There was no empirical evidence to suggest biased estimates between the two sources. Increased and detailed transparency in publications would improve the understanding and credibility of published results. Further, the FDA report was found to be a useful source when data are missing in the published report (i.e. reporting bias). [ABSTRACT FROM AUTHOR]

Informed consent is the cornerstone of human research subject protection. Many subjects sign consent documents without understanding the study purpose, procedures, risks, benefits, and their rights. Proof of comprehension is not required and rarely obtained. Understanding might improve by using an interactive system with multiple options for hearing, viewing and reading about the study and the consent form at the subject’s own pace with testing and immediate feedback. This prospective randomized study compared the IRB-approved paper ICF for an actual clinical research study with an interactive presentation of the same study and its associated consent form using an iPad device in two populations: clinical research professionals, and patients drawn from a variety of outpatient practice settings. Of the 90 participants, 69 completed the online test and survey questions the day after the session (maximum 36 hours post-session). Among research professionals (n = 14), there was a trend (p  = .07) in the direction of iPad subjects testing better on the online test (mean correct  =  77%) compared with paper subjects (mean correct  =  57%). Among patients (n = 55), iPad subjects had significantly higher test scores than standard paper consent subjects (mean correct  =  75% vs 58%, p < .001). For all subjects, the total time spent reviewing the paper consent was 13.2 minutes, significantly less than the average of 22.7 minutes total on the three components to be reviewed using the iPad (introductory video, consent form, interactive quiz). Overall satisfaction and overall enjoyment slightly favored the interactive iPad presentation. This study demonstrates that combining an introductory video, standard consent language, and an interactive quiz on a tablet-based system improves comprehension of research study procedures and risks. [ABSTRACT FROM AUTHOR]

Some scholars add authors to their research papers or grant proposals even when those individuals contribute nothing to the research effort. Some journal editors coerce authors to add citations that are not pertinent to their work and some authors pad their reference lists with superfluous citations. How prevalent are these types of manipulation, why do scholars stoop to such practices, and who among us is most susceptible to such ethical lapses? This study builds a framework around how intense competition for limited journal space and research funding can encourage manipulation and then uses that framework to develop hypotheses about who manipulates and why they do so. We test those hypotheses using data from over 12,000 responses to a series of surveys sent to more than 110,000 scholars from eighteen different disciplines spread across science, engineering, social science, business, and health care. We find widespread misattribution in publications and in research proposals with significant variation by academic rank, discipline, sex, publication history, co-authors, etc. Even though the majority of scholars disapprove of such tactics, many feel pressured to make such additions while others suggest that it is just the way the game is played. The findings suggest that certain changes in the review process might help to stem this ethical decline, but progress could be slow. [ABSTRACT FROM AUTHOR]

Scientists often perceive a trade-off between quantity and quality in scientific publishing: finite amounts of time and effort can be spent to produce few high-quality papers or subdivided to produce many papers of lower quality. Despite this perception, previous studies have indicated the opposite relationship, in which productivity (publishing more papers) is associated with increased paper quality (usually measured by citation accumulation). We examine this question in a novel way, comparing members of the National Academy of Sciences with themselves across years, and using a much larger dataset than previously analyzed. We find that a member’s most highly cited paper in a given year has more citations in more productive years than in in less productive years. Their lowest cited paper each year, on the other hand, has fewer citations in more productive years. To disentangle the effect of the underlying distributions of citations and productivities, we repeat the analysis for hypothetical publication records generated by scrambling each author’s citation counts among their publications. Surprisingly, these artificial histories re-create the above trends almost exactly. Put another way, the observed positive relationship between quantity and quality can be interpreted as a consequence of randomly drawing citation counts for each publication: more productive years yield higher-cited papers because they have more chances to draw a large value. This suggests that citation counts, and the rewards that have come to be associated with them, may be more stochastic than previously appreciated. [ABSTRACT FROM AUTHOR]

Citation metrics are increasingly used to appraise published research. One challenge is whether and how to normalize these metrics to account for differences across scientific fields, age (year of publication), type of document, database coverage, and other factors. We discuss the pros and cons for normalizations using different approaches. Additional challenges emerge when citation metrics need to be combined across multiple papers to appraise the corpus of scientists, institutions, journals, or countries, as well as when trying to attribute credit in multiauthored papers. Different citation metrics may offer complementary insights, but one should carefully consider the assumptions that underlie their calculation. [ABSTRACT FROM AUTHOR]

We studied the research performance of 69 countries by considering two different types of new knowledge: incremental (normal) and fundamental (radical). In principle, these two types of new knowledge should be assessed at two very different levels of citations, but we demonstrate that a simpler assessment can be performed based on the total number of papers (P) and the ratio of the number of papers in the global top 10% of most cited papers divided to the total number of papers (Ptop 10%/P). P represents the quantity, whereas the Ptop 10%/P ratio represents the efficiency. In ideal countries, P and the Ptop 10%/P ratio are linked to the gross domestic product (GDP) and GDP the per capita, respectively. Only countries with high Ptop 10%/P ratios participate actively in the creation of fundamental new knowledge and have Noble laureates. In real countries, the link between economic and scientific wealth can be modified by the technological activity and the research policy. We discuss how technological activity may decrease the Ptop 10%/P ratio while only slightly affecting the capacity to create fundamental new knowledge; in such countries, many papers may report incremental innovations that do not drive the advancement of knowledge. Japan is the clearest example of this, although there are many less extreme examples. Independently of technological activity, research policy has a strong influence on the Ptop 10%/P ratio, which may be higher or lower than expected from the GDP per capita depending on the success of the research policy. [ABSTRACT FROM AUTHOR]

Fundamental scientific advances can take decades to translate into improvements in human health. Shortening this interval would increase the rate at which scientific discoveries lead to successful treatment of human disease. One way to accomplish this would be to identify which advances in knowledge are most likely to translate into clinical research. Toward that end, we built a machine learning system that detects whether a paper is likely to be cited by a future clinical trial or guideline. Despite the noisiness of citation dynamics, as little as 2 years of postpublication data yield accurate predictions about a paper's eventual citation by a clinical article (accuracy = 84%, F1 score = 0.56; compared to 19% accuracy by chance). We found that distinct knowledge flow trajectories are linked to papers that either succeed or fail to influence clinical research. Translational progress in biomedicine can therefore be assessed and predicted in real time based on information conveyed by the scientific community's early reaction to a paper. [ABSTRACT FROM AUTHOR]

This bibliometric study of a large publication set dealing with research on climate change aims at mapping the relevant literature from a bibliometric perspective and presents a multitude of quantitative data: (1) The growth of the overall publication output as well as (2) of some major subfields, (3) the contributing journals and countries as well as their citation impact, and (4) a title word analysis aiming to illustrate the time evolution and relative importance of specific research topics. The study is based on 222,060 papers (articles and reviews only) published between 1980 and 2014. The total number of papers shows a strong increase with a doubling every 5–6 years. Continental biomass related research is the major subfield, closely followed by climate modeling. Research dealing with adaptation, mitigation, risks, and vulnerability of global warming is comparatively small, but their share of papers increased exponentially since 2005. Research on vulnerability and on adaptation published the largest proportion of very important papers (in terms of citation impact). Climate change research has become an issue also for disciplines beyond the natural sciences. The categories Engineering and Social Sciences show the strongest field-specific relative increase. The Journal of Geophysical Research, the Journal of Climate, the Geophysical Research Letters, and Climatic Change appear at the top positions in terms of the total number of papers published. Research on climate change is quantitatively dominated by the USA, followed by the UK, Germany, and Canada. The citation-based indicators exhibit consistently that the UK has produced the largest proportion of high impact papers compared to the other countries (having published more than 10,000 papers). Also, Switzerland, Denmark and also The Netherlands (with a publication output between around 3,000 and 6,000 papers) perform top—the impact of their contributions is on a high level. The title word analysis shows that the term climate change comes forward with time. Furthermore, the term impact arises and points to research dealing with the various effects of climate change. The discussion of the question of human induced climate change towards a clear fact (for the majority of the scientific community) stimulated research on future pathways for adaptation and mitigation. Finally, the term model and related terms prominently appear independent of time, indicating the high relevance of climate modeling. [ABSTRACT FROM AUTHOR]

The Journal of Physiology and British Journal of Pharmacology jointly published an editorial series in 2011 to improve standards in statistical reporting and data analysis. It is not known whether reporting practices changed in response to the editorial advice. We conducted a cross-sectional analysis of reporting practices in a random sample of research papers published in these journals before (n = 202) and after (n = 199) publication of the editorial advice. Descriptive data are presented. There was no evidence that reporting practices improved following publication of the editorial advice. Overall, 76-84% of papers with written measures that summarized data variability used standard errors of the mean, and 90-96% of papers did not report exact p-values for primary analyses and post-hoc tests. 76-84% of papers that plotted measures to summarize data variability used standard errors of the mean, and only 2-4% of papers plotted raw data used to calculate variability. Of papers that reported p-values between 0.05 and 0.1, 56-63% interpreted these as trends or statistically significant. Implied or gross spin was noted incidentally in papers before (n = 10) and after (n = 9) the editorial advice was published. Overall, poor statistical reporting, inadequate data presentation and spin were present before and after the editorial advice was published. While the scientific community continues to implement strategies for improving reporting practices, our results indicate stronger incentives or enforcements are needed. [ABSTRACT FROM AUTHOR]

This paper summarizes the 18th Academic Publishing in Europe (APE) Conference: Berlin Re-Visited: Building Technological Support for Scholarship and Scientific Publishing, held as a hybrid event 10 and 11 January 2023, and organized by the Berlin Institute of Scholarly Publishing (BISP), a not-for-profit organization dedicated to bringing publishers, researchers, funders, and policymakers together. This year's conference theme "Out with the old, in with the new!" was discussed and presented in keynote speeches, the APE lecture, and several panel discussions. Current challenges within scholarly publishing, e.g., with research integrity, trust, and research assessment, have much to do with the old ways of doing things. To move science forward, new technologies and innovations, like the decentralized web, FAIR digital objects, and blockchain technology are needed to shape new paradigms. In many sessions it was stressed that not just new technologies are needed to move science forward, but human collaboration and partnerships as well. The changing role of the journal and the importance to recognize more diverse research outputs, beyond the journal article, was a topic of importance. Not only research assessment reforms and improved collaboration amongst different stakeholder groups are needed to address this, new publishing systems, better metadata, and open infrastructures as well. A session presenting different start-ups showcased how Artificial Intelligence, Natural Language Processing and software technology can be used to tackle problems in e.g., finding relevant funders and peer reviewers, and detecting image plagiarism. It was also discussed what publishers can do to help achieve the Sustainable Development Goals. Collaboration, data transparency and sharing best practices amongst researchers, funders, and policy makers are key. Another important topic during this year's APE was how publishers can support Early Career Researchers: establishing new workflows and infrastructures that enable publication of a wider range of research outputs, and broader recognition of these outputs, will incentivize ECRs. This year's APE was concluded with the APE Award Ceremony. The winner - Vsevolod Solovyov from Prophy - has used AI to enhance the current peer review system and made a very important contribution to improving the scholarly communication system. [ABSTRACT FROM AUTHOR]

Background: Mobile electronic devices are replacing paper-based instruments and questionnaires for epidemiological and public health research. The elimination of a data-entry step after an interview is a notable advantage over paper, saving investigator time, decreasing the time lags in managing and analyzing data, and potentially improving the data quality by removing the error-prone data-entry step. Research has not yet provided adequate evidence, however, to substantiate the claim of fewer errors for computerized interviews. Methodology: We developed an Android-based illness explanatory interview for influenza vaccine acceptance and tested the instrument in a field study in Pune, India, for feasibility and acceptability. Error rates for tablet and paper were compared with reference to the voice recording of the interview as gold standard to assess discrepancies. We also examined the preference of interviewers for the classical paper-based or the electronic version of the interview and compared the costs of research with both data collection devices. Results: In 95 interviews with household respondents, total error rates with paper and tablet devices were nearly the same (2.01% and 1.99% respectively). Most interviewers indicated no preference for a particular device; but those with a preference opted for tablets. The initial investment in tablet-based interviews was higher compared to paper, while the recurring costs per interview were lower with the use of tablets. Conclusion: An Android-based tablet version of a complex interview was developed and successfully validated. Advantages were not compromised by increased errors, and field research assistants with a preference preferred the Android device. Use of tablets may be more costly than paper for small samples and less costly for large studies. [ABSTRACT FROM AUTHOR]

The challenge of detecting research topics in a specific research field has attracted attention from researchers in the bibliometrics community. In this study, to solve two problems of clustering papers, i.e., the influence of different distributions of citation links and involved textual features on similarity computation, the authors propose a hybrid self-optimized clustering model to detect research topics by extending the hybrid clustering model to identify “core documents”. First, the Amsler network, consisting of bibliographic coupling and co-citation links, is created to calculate the citation-based similarity based on the cosine angle of papers. Second, the cosine similarity is also used to compute the text-based similarity, which consists of the textual statistical and topological features. Then, the cosine angle of the linear combination of citation- and text-based similarity is considered as the hybrid similarity. Finally, the Louvain method is applied to cluster papers, and the terms based on term frequency are used to label clusters. To test the performance of the proposed model, a dataset related to the data envelopment analysis field is used for comparison and analysis of clustering results. Based on the benchmark built, different clustering methods with different citation links or textual features are compared according to evaluation measures. The results show that the proposed model can obtain reasonable and effective clustering results, and the research topics of data envelopment analysis field are also analyzed based on the proposed model. As different features are considered in the proposed model compared with previous hybrid clustering models, the proposed clustering model can provide inspiration for further studies on topic identification by other researchers. [ABSTRACT FROM AUTHOR]

Evaluating the impact of a scholarly article is of great significance and has attracted great attentions. Although citation-based evaluation approaches have been widely used, these approaches face limitations e.g. in identifying anomalous citations patterns. This negligence would inevitably cause unfairness and inaccuracy to the article impact evaluation. In this study, in order to discover the anomalous citations and ensure the fairness and accuracy of research outcome evaluation, we investigate the citation relationships between articles using the following factors: collaboration times, the time span of collaboration, citing times and the time span of citing to weaken the relationship of Conflict of Interest (COI) in the citation network. Meanwhile, we study a special kind of COI, namely suspected COI relationship. Based on the COI relationship, we further bring forward the COIRank algorithm, an innovative scheme for accurately assessing the impact of an article. Our method distinguishes the citation strength, and utilizes PageRank and HITS algorithms to rank scholarly articles comprehensively. The experiments are conducted on the American Physical Society (APS) dataset. We find that about 80.88% articles contain contributed citations by co-authors in 26,366 articles and 75.55% articles among these articles are cited by the authors belonging to the same affiliation, indicating COI and suspected COI should not be ignored for evaluating impact of scientific papers objectively. Moreover, our experimental results demonstrate COIRank algorithm significantly outperforms the state-of-art solutions. The validity of our approach is verified by using the probability of Recommendation Intensity. [ABSTRACT FROM AUTHOR]

Articles from open access and local journals are important resources for research in Korea and the usage trends of these articles are important indicators for the assessment of the current research practice. We analyzed an institutional collection of published papers from 1998 to 2014 authored by researchers from Seoul National University, and their references from papers published between 1998 and 2011. The published papers were collected from Web of Science or Scopus and were analyzed according to the proportion of articles from open access journals. Their cited references from published papers in Web of Science were analyzed according to the proportion of local (South Korean) or open access journals. The proportion of open access papers was relatively stable until 2006 (2.5 ~ 5.2% in Web of Science and 2.7 ~ 4.2% in Scopus), but then increased to 15.9% (Web of Science) or 18.5% (Scopus) in 2014. We analyzed 2,750,485 cited references from 52,295 published papers. We found that the overall proportion of cited articles from local journals was 1.8% and that for open access journals was 3.0%. Citations of open access articles have increased since 2006 to 4.1% in 2011, although the increase in open access article citations was less than for open access publications. The proportion of citations from local journals was even lower. We think that the publishing / citing mismatch is a term to describe this difference, which is an issue at Seoul National University, where the number of published papers at open access or local journals is increasing but the number of citations is not. The cause of this discrepancy is multi-factorial but the governmental / institutional policies, social / cultural issues and authors' citing behaviors will explain the mismatch. However, additional measures are also necessary, such as the development of an institutional citation database and improved search capabilities with respect to local and open access documents. [ABSTRACT FROM AUTHOR]

Rationale, aims and objective: Substituting outpatient hospital care with primary care is seen as a solution to decrease unnecessary referrals to outpatient hospital care and decrease rising healthcare costs. This systematic review aimed to evaluate the effects on quality of care, health and costs outcomes of substituting outpatient hospital care with primary care-based interventions, which are performed by medical specialists in face-to-face consultations in a primary care setting. Method: The systematic review was performed using the PICO framework. Original papers in which the premise of the intervention was to substitute outpatient hospital care with primary care through the involvement of a medical specialist in a primary care setting were eligible. Results: A total of 14 papers were included. A substitution intervention in general practitioner (GP) practices was described in 11 papers, three described a joint consultation intervention in which GPs see patients together with a medical specialist. This study showed that substitution initiatives result mostly in favourable outcomes compared to outpatient hospital care. The initiatives resulted mostly in shorter waiting lists, shorter clinic waiting times and higher patient satisfaction. Costs for treating one extra patient seemed to be higher in the intervention settings. This was mainly caused by inefficient planning of consultation hours and lower patient numbers. Conclusions: Despite the fact that internationally a lot has been written about the importance of performing substitution interventions in which preventing unnecessary referrals to outpatient hospital care was the aim, only 14 papers were included. Future systematic reviews should focus on the effects on the Triple Aim of substitution initiatives in which other healthcare professions than medical specialists are involved along with new technologies, such as e-consults. Additionally, to gain more insight into the effects of substitution initiatives operating in a dynamic healthcare context, it is important to keep evaluating the interventions in a longitudinal study design. [ABSTRACT FROM AUTHOR]

The “publish or perish” incentive drives many researchers to increase the quantity of their papers at the cost of quality. Lowering quality increases the number of false positive errors which is a key cause of the reproducibility crisis. We adapted a previously published simulation of the research world where labs that produce many papers are more likely to have “child” labs that inherit their characteristics. This selection creates a competitive spiral that favours quantity over quality. To try to halt the competitive spiral we added random audits that could detect and remove labs with a high proportion of false positives, and also improved the behaviour of “child” and “parent” labs who increased their effort and so lowered their probability of making a false positive error. Without auditing, only 0.2% of simulations did not experience the competitive spiral, defined by a convergence to the highest possible false positive probability. Auditing 1.35% of papers avoided the competitive spiral in 71% of simulations, and auditing 1.94% of papers in 95% of simulations. Audits worked best when they were only applied to established labs with 50 or more papers compared with labs with 25 or more papers. Adding a ±20% random error to the number of false positives to simulate peer reviewer error did not reduce the audits’ efficacy. The main benefit of the audits was via the increase in effort in “child” and “parent” labs. Audits improved the literature by reducing the number of false positives from 30.2 per 100 papers to 12.3 per 100 papers. Auditing 1.94% of papers would cost an estimated $15.9 million per year if applied to papers produced by National Institutes of Health funding. Our simulation greatly simplifies the research world and there are many unanswered questions about if and how audits would work that can only be addressed by a trial of an audit. [ABSTRACT FROM AUTHOR]

Arabian Journal for Science and Engineering (AJSE) is a rapidly growing multidisciplinary academic journal that publishes original contributions in the Science disciplines of Biological sciences, Chemistry, Earth Sciences, and Physics, and in the Engineering disciplines of Civil, Chemical, Electrical, Mechanical, Petroleum Engineering, Computer Science and Engineering, Systems Engineering, and along with a Theme Issue on specific topic. This study uses bibliometric tools to present a retrospective analysis of research productivity during 1977–2021. The bibliometric method used to analyze AJSE's published papers based on annual growth, citation pattern, prolific authors, country, organization, funding agencies, author keyword, authorship patterns, theme analysis, most cited papers, cited references, and international collaborations. The result shows that AJSE has grown noticeably from 1977 to 2021 in total publications and citations, reaching 7658 papers and 33,846 citations. India (TP: 1324) is the country with the more number of papers contributed. King Fahd University of Petroleum and Minerals (TP: 838) found as the most contributing organization to the AJSE publications. Zhang L identified as the most prolific author with 28 publications. The most important author keywords are Optimization, Adsorption, Genetic algorithm, and Mechanical properties. Saudi Arabia and Egypt collaborated in the maximum number of AJSE research papers. This is the first bibliometric investigation of AJSE scientific literature since its establishment. Overall, the findings provide useful information to the AJSE editorial board. Its retrospective review will likely encourage readers of the journal and help the editorial team formulate research agendas and inform research strategies that will enable research scientists to contribute high-quality research papers to the AJSE. [ABSTRACT FROM AUTHOR]

There is an increasing need both to understand the translation of biomedical research into improved healthcare and to assess the range of wider impacts from health research such as improved health policies, health practices and healthcare. Conducting such assessments is complex and new methods are being sought. Our new approach involves several steps. First, we developed a qualitative citation analysis technique to apply to biomedical research in order to assess the contribution that individual papers made to further research. Second, using this method, we then proposed to trace the citations to the original research through a series of generations of citing papers. Third, we aimed eventually to assess the wider impacts of the various generations. This article describes our comprehensive literature search to inform the new technique. We searched various databases, specific bibliometrics journals and the bibliographies of key papers. After excluding irrelevant papers we reviewed those remaining for either general or specific details that could inform development of our new technique. Various characteristics of citations were identified that had been found to predict their importance to the citing paper including the citation's location; number of citation occasions and whether the author(s) of the cited paper were named within the citing paper. We combined these objective characteristics with subjective approaches also identified from the literature search to develop a citation categorisation technique that would allow us to achieve the first of the steps above, i.e., being able routinely to assess the contribution that individual papers make to further research. [ABSTRACT FROM AUTHOR]

This study investigates the effects of large-scale research funding from the Japanese government on the research outcomes of university researchers. To evaluate the effects, we use the difference-in-differences estimator and measure research outcomes in terms of number of papers and citation counts per paper. Our analysis shows that the funding program led to an increase in the number of papers in some fields and an increase in the citation counts in the other fields. A comparison of our estimation results with assessment data obtained from peer reviews showed important differences. Since the characteristics of research vary according to the field, bibliometrics analysis should be used along with the peer review method for a more accurate analysis of research impact. [ABSTRACT FROM AUTHOR]

The Euclidean length of a citation list is "depth relevant": the metric increases when citations are transferred from less to more cited papers. We introduce "breadth relevance," which favors consistent achievers over one‐hit wonders. The exponent of the CES aggregator then is less than unity rather than greater than unity, as for depth relevance. Using two datasets on citations of economists for the top 50 US and global universities, simply counting citations maximizes the correlation between the citation metrics of researchers and the peer‐reviewed rank of their department. However, citation depth may explain the allocation of researchers across lower‐ranked departments. [ABSTRACT FROM AUTHOR]

Although racism has been posited as driver of racial/ethnic inequities in healthcare, the relationship between racism and health service use and experience has yet to be systematically reviewed or meta-analysed. This paper presents a systematic review and meta-analysis of quantitative empirical studies that report associations between self-reported racism and various measures of healthcare service utilisation. Data were reviewed and extracted from 83 papers reporting 70 studies. Studies included 250,850 participants and were conducted predominately in the U.S. The meta-analysis included 59 papers reporting 52 studies, which were analysed using random effects models and mean weighted effect sizes. Racism was associated with more negative patient experiences of health services (HSU-E) (OR = 0.351 (95% CI [0.236,0.521], k = 19), including lower levels of healthcare-related trust, satisfaction, and communication. Racism was not associated with health service use (HSU-U) as an outcome group, and was not associated with most individual HSU-U outcomes, including having had examinations, health service visits and admissions to health professionals and services. Racism was associated with health service use outcomes such as delaying/not getting healthcare, and lack of adherence to treatment uptake, although these effects may be influenced by a small sample of studies, and publication bias, respectively. Limitations to the literature reviewed in terms of study designs, sampling methods and measurements are discussed along with suggested future directions in the field. [ABSTRACT FROM AUTHOR]

Although interdisciplinarity is often touted as a necessity for modern research, the evidence on the relative impact of sectorial versus to interdisciplinary science is qualitative at best. In this paper we leverage the bibliographic data set of the American Physical Society to quantify the role of interdisciplinarity in physics, and that of talent and luck in achieving success in scientific careers. We analyze a period of 30 years (1980-2009) tagging papers and their authors by means of the Physics and Astronomy Classification Scheme (PACS), to show that some degree of interdisciplinarity is quite helpful to reach success, measured as a proxy of either the number of articles or the citations score. We also propose an agent-based model of the publication-reputation-citation dynamics which reproduces the trends observed in the APS data set. On the one hand, the results highlight the crucial role of randomness and serendipity in real scientific research; on the other, they shed light on a counterintuitive effect indicating that the most talented authors are not necessarily the most successful ones. [ABSTRACT FROM AUTHOR]