Search

BackgroundLiterature reviews (LRs) identify, evaluate, and synthesize relevant papers to a particular research question to advance understanding and support decision-making. However, LRs, especially traditional systematic reviews, are slow, resource-intensive, and become outdated quickly. ObjectiveLiteRev is an advanced and enhanced version of an existing automation tool designed to assist researchers in conducting LRs through the implementation of cutting-edge technologies such as natural language processing and machine learning techniques. In this paper, we present a comprehensive explanation of LiteRev’s capabilities, its methodology, and an evaluation of its accuracy and efficiency to a manual LR, highlighting the benefits of using LiteRev. MethodsBased on the user’s query, LiteRev performs an automated search on a wide range of open-access databases and retrieves relevant metadata on the resulting papers, including abstracts or full texts when available. These abstracts (or full texts) are text processed and represented as a term frequency-inverse document frequency matrix. Using dimensionality reduction (pairwise controlled manifold approximation) and clustering (hierarchical density-based spatial clustering of applications with noise) techniques, the corpus is divided into different topics described by a list of the most important keywords. The user can then select one or several topics of interest, enter additional keywords to refine its search, or provide key papers to the research question. Based on these inputs, LiteRev performs a k-nearest neighbor (k-NN) search and suggests a list of potentially interesting papers. By tagging the relevant ones, the user triggers new k-NN searches until no additional paper is suggested for screening. To assess the performance of LiteRev, we ran it in parallel to a manual LR on the burden and care for acute and early HIV infection in sub-Saharan Africa. We assessed the performance of LiteRev using true and false predictive values, recall, and work saved over sampling. ResultsLiteRev extracted, processed, and transformed text into a term frequency-inverse document frequency matrix of 631 unique papers from PubMed. The topic modeling module identified 16 topics and highlighted 2 topics of interest to the research question. Based on 18 key papers, the k-NNs module suggested 193 papers for screening out of 613 papers in total (31.5% of the whole corpus) and correctly identified 64 relevant papers out of the 87 papers found by the manual abstract screening (recall rate of 73.6%). Compared to the manual full text screening, LiteRev identified 42 relevant papers out of the 48 papers found manually (recall rate of 87.5%). This represents a total work saved over sampling of 56%. ConclusionsWe presented the features and functionalities of LiteRev, an automation tool that uses natural language processing and machine learning methods to streamline and accelerate LRs and support researchers in getting quick and in-depth overviews on any topic of interest.

Abstract Emerging infectious diseases are a growing threat in sub-Saharan African countries, but the human and technical capacity to quickly respond to outbreaks remains limited. Here, we describe the experience and lessons learned from a joint project with the WHO Regional Office for Africa (WHO AFRO) to support the sub-Saharan African COVID-19 response. In June 2020, WHO AFRO contracted a number of consultants to reinforce the COVID-19 response in member states by providing actionable epidemiological analysis. Given the urgency of the situation and the magnitude of work required, we recruited a worldwide network of field experts, academics and students in the areas of public health, data science and social science to support the effort. Most analyses were performed on a merged line list of COVID-19 cases using a reverse engineering model (line listing built using data extracted from national situation reports shared by countries with the Regional Office for Africa as per the IHR (2005) obligations). The data analysis platform The Renku Project ( https://renkulab.io ) provided secure data storage and permitted collaborative coding. Over a period of 6 months, 63 contributors from 32 nations (including 17 African countries) participated in the project. A total of 45 in-depth country-specific epidemiological reports and data quality reports were prepared for 28 countries. Spatial transmission and mortality risk indices were developed for 23 countries. Text and video-based training modules were developed to integrate and mentor new members. The team also began to develop EpiGraph Hub, a web application that automates the generation of reports similar to those we created, and includes more advanced data analyses features (e.g. mathematical models, geospatial analyses) to deliver real-time, actionable results to decision-makers. Within a short period, we implemented a global collaborative approach to health data management and analyses to advance national responses to health emergencies and outbreaks. The interdisciplinary team, the hands-on training and mentoring, and the participation of local researchers were key to the success of this initiative.