Search

It is unclear how well self-rated oral health (SROH) reflects actual oral health status in the rural Australian population. Therefore, this study aimed to compare the clinically assessed oral health status and SROH of adults living in rural Australia. The data were from 574 participants who took part in the Crossroads II cross-sectional study. Three trained and calibrated dentists evaluated the oral health status of participants based on WHO criteria. SROH was assessed with the question 'Overall, how would you rate the health of your teeth and gums?', with a score ranging from excellent = 5 to poor = 1. A logistic regression analysis (LRA) was performed, allowing us to assess factors associated with SROH. The mean age of participants was 59.2 years (SD 16.3), and 55.3% were female. The key results from the LRA show poorer SROH in those with more missing teeth (OR = 1.05; 95% CI; 1.01-1.08), more decayed teeth (OR = 1.28; 95% CI: 1.11-1.46), and more significant clinical attachment loss of periodontal tissue (6mm or more) (OR = 2.63; 95% CI: 1.29-5.38). This study found an association between negative SROH and clinical indicators used to measure poor oral health status, suggesting that self-rated oral health is an indicator of oral health status. When planning dental healthcare programs, self-reported oral health should be considered a proxy measure for oral health status.

OBJECTIVE: With the increasing amount and growing variety of healthcare data, multimodal machine learning supporting integrated modeling of structured and unstructured data is an increasingly important tool for clinical machine learning tasks. However, it is non-trivial to manage the differences in dimensionality, volume, and temporal characteristics of data modalities in the context of a shared target task. Furthermore, patients can have substantial variations in the availability of data, while existing multimodal modeling methods typically assume data completeness and lack a mechanism to handle missing modalities. METHODS: We propose a Transformer-based fusion model with modality-specific tokens that summarize the corresponding modalities to achieve effective cross-modal interaction accommodating missing modalities in the clinical context. The model is further refined by inter-modal, inter-sample contrastive learning to improve the representations for better predictive performance. We denote the model as Attention-based cRoss-MOdal fUsion with contRast (ARMOUR). We evaluate ARMOUR using two input modalities (structured measurements and unstructured text), six clinical prediction tasks, and two evaluation regimes, either including or excluding samples with missing modalities. RESULTS: Our model shows improved performances over unimodal or multimodal baselines in both evaluation regimes, including or excluding patients with missing modalities in the input. The contrastive learning improves the representation power and is shown to be essential for better results. The simple setup of modality-specific tokens enables ARMOUR to handle patients with missing modalities and allows comparison with existing unimodal benchmark results. CONCLUSION: We propose a multimodal model for robust clinical prediction to achieve improved performance while accommodating patients with missing modalities. This work could inspire future research to study the effective incorporation of multi

INTRODUCTION: Adequate methods to promptly translate digital health innovations for improved patient care are essential. Advances in Artificial Intelligence (AI) and Machine Learning (ML) have been sources of digital innovation and hold the promise to revolutionize the way we treat, manage and diagnose patients. Understanding the benefits but also the potential adverse effects of digital health innovations, particularly when these are made available or applied on healthier segments of the population is essential. One of such adverse effects is overdiagnosis. OBJECTIVE: to comprehensively analyze quantification strategies and data-driven definitions for overdiagnosis reported in the literature. METHODS: we conducted a scoping systematic review of manuscripts describing quantitative methods to estimate the proportion of overdiagnosed patients. RESULTS: we identified 46 studies that met our inclusion criteria. They covered a variety of clinical conditions, primarily breast and prostate cancer. Methods to quantify overdiagnosis included both prospective and retrospective methods including randomized clinical trials, and simulations. CONCLUSION: a variety of methods to quantify overdiagnosis have been published, producing widely diverging results. A standard method to quantify overdiagnosis is needed to allow its mitigation during the rapidly increasing development of new digital diagnostic tools.

Process mining techniques can be used to analyse business processes using the data logged during their execution. These techniques are leveraged in a wide range of domains, including healthcare, where it focuses mainly on the analysis of diagnostic, treatment, and organisational processes. Despite the huge amount of data generated in hospitals by staff and machinery involved in healthcare processes, there is no evidence of a systematic uptake of process mining beyond targeted case studies in a research context. When developing and using process mining in healthcare, distinguishing characteristics of healthcare processes such as their variability and patient-centred focus require targeted attention. Against this background, the Process-Oriented Data Science in Healthcare Alliance has been established to propagate the research and application of techniques targeting the data-driven improvement of healthcare processes. This paper, an initiative of the alliance, presents the distinguishing characteristics of the healthcare domain that need to be considered to successfully use process mining, as well as open challenges that need to be addressed by the community in the future.

The accelerated adoption of digital technologies in people’s lives is creating unique opportunities to leverage routinely collected digital data and machine learning models to diagnose diseases before they become symptomatic. Like traditional tests, digital screening will likely generate cases of overdiagnosis and thereby harm some patients. Digital screening tests (such as detecting mood or sleep disorders from smartphone use patterns) are being developed faster than the ability to assess their value. The additional risks and benefits of these digital tests are not only a function of their accuracy; and it is important that such approaches be validated prospectively.

Health data captured in Electronic health records (EHRs) have enabled the development of computational approaches to improve patient management and treatment, including early diagnosis of severe conditions such as sepsis. The validity of these efforts, however, largely relies on which sepsis definition is used and the quality of the underlying data. Here we tested different sepsis definitions to better understand how phenotyping approaches may impact the classification accuracy of sepsis prediction algorithms. To assess the extent to which sepsis definitions (dis)agree with each other, we have analised a large cohort of patients admitted to the ICU (over 22,000) from MIMIC-IV. Cases were classified as septic and non-septic using the Sepsis-3 definition as a standard and compared with different ICD-10-based sepsis phenotyping criteria. Most of administrative sepsis definitions agreed with each other when identifying positive sepsis cases. At the same time, we identified considerable disagreement between Sepsis-3 and administrative definitions. This discrepancy affected machine learning algorithms’ predictive performance. Two algorithms out of three built on Sepsis-3 outperformed models based on other phenotypes. Experiments demonstrate that phenotype definitions can significantly influence a predictive model performance. This highlights the importance of consistent and validated digital phenotyping criteria.

Process mining is a discipline sitting between data mining and process science, whose goal is to provide theoretical methods and software tools to analyse process execution data, known as event logs. Although process mining was originally conceived to facilitate business process management activities, research studies have shown the benefit of leveraging process mining tools in different contexts, including healthcare. However, applying process mining tools to analyse healthcare process execution data is not straightforward. In this paper, we report the analysis of an event log recording more than 30 million events capturing the general practice healthcare processes of more than one million patients in Victoria–Australia–over five years. Our analysis allowed us to understand benefits and limitations of the state-of-the-art process mining techniques when dealing with highly variable processes and large data-sets. While we provide solutions to the identified limitations, the overarching goal of this study was to detect differences between the patients‘ health services utilization pattern observed in 2020– during the COVID-19 pandemic and mandatory lock-downs –and the one observed in the prior four years, 2016 to 2019. By using a combination of process mining techniques and traditional data mining, we were able to demonstrate that vaccinations in Victoria did not drop drastically–as other interactions did. On the contrary, we observed a surge of influenza and pneumococcus vaccinations in 2020, contradicting research findings of similar studies conducted in different geographical areas.

OBJECTIVE: Data quality (DQ) must be consistently defined in context. The attributes, metadata, and context of longitudinal real-world data (RWD) have not been formalized for quality improvement across the data production and curation life cycle. We sought to complete a literature review on DQ assessment frameworks, indicators and tools for research, public health, service, and quality improvement across the data life cycle. MATERIALS AND METHODS: The review followed PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Databases from health, physical and social sciences were used: Cinahl, Embase, Scopus, ProQuest, Emcare, PsycINFO, Compendex, and Inspec. Embase was used instead of PubMed (an interface to search MEDLINE) because it includes all MeSH (Medical Subject Headings) terms used and journals in MEDLINE as well as additional unique journals and conference abstracts. A combined data life cycle and quality framework guided the search of published and gray literature for DQ frameworks, indicators, and tools. At least 2 authors independently identified articles for inclusion and extracted and categorized DQ concepts and constructs. All authors discussed findings iteratively until consensus was reached. RESULTS: The 120 included articles yielded concepts related to contextual (data source, custodian, and user) and technical (interoperability) factors across the data life cycle. Contextual DQ subcategories included relevance, usability, accessibility, timeliness, and trust. Well-tested computable DQ indicators and assessment tools were also found. CONCLUSIONS: A DQ assessment framework that covers intrinsic, technical, and contextual categories across the data life cycle enables assessment and management of RWD repositories to ensure fitness for purpose. Balancing security, privacy, and FAIR principles requires trust and reciprocity, transparent governance, and organizational cultures that value good documentation.

As healthcare providers receive fixed amounts of reimbursement for given services under DRG (Diagnosis-Related Groups) payment, DRG codes are valuable for cost monitoring and resource allocation. However, coding is typically performed retrospectively post-discharge. We seek to predict DRGs and DRG-based case mix index (CMI) at early inpatient admission using routine clinical text to estimate hospital cost in an acute setting. We examined a deep learning-based natural language processing (NLP) model to automatically predict per-episode DRGs and corresponding cost-reflecting weights on two cohorts (paid under Medicare Severity (MS) DRG or All Patient Refined (APR) DRG), without human coding efforts. It achieved macro-averaged area under the receiver operating characteristic curve (AUC) scores of 0·871 (SD 0·011) on MS-DRG and 0·884 (0·003) on APR-DRG in fivefold cross-validation experiments on the first day of ICU admission. When extended to simulated patient populations to estimate average cost-reflecting weights, the model increased its accuracy over time and obtained absolute CMI error of 2·40 (1·07%) and 12·79% (2·31%), respectively on the first day. As the model could adapt to variations in admission time, cohort size, and requires no extra manual coding efforts, it shows potential to help estimating costs for active patients to support better operational decision-making in hospitals.

BACKGROUND: Systematic reviews allow health decisions to be informed by the best available research evidence. However, their number is proliferating quickly, and many skills are required to identify all the relevant reviews for a specific question. METHODS AND FINDINGS: We screen 10 bibliographic databases on a daily or weekly basis, to identify systematic reviews relevant for health decision-making. Using a machine-based approach developed for this project we select reviews, which are then validated by a network of more than 1000 collaborators. After screening over 1,400,000 records we have identified more than 300,000 systematic reviews, which are now stored in a single place and accessible through an easy-to-use search engine. This makes Epistemonikos the largest database of its kind. CONCLUSIONS: Using a systematic approach, recruiting a broad network of collaborators and implementing automated methods, we developed a one-stop shop for systematic reviews relevant for health decision making.

Nowadays, assessing and improving customer experience has become a priority, and has emerged as a key differentiator for business and organizations worldwide. A customer journey (CJ) is a strategic tool, a map of the steps customers follow when engaging with a company or organization to obtain a product or service. The increase of the need to obtain knowledge about customers' perceptions and feelings when interacting with participants, touchpoints, and channels through different stages of the customer life cycle. This study aims to describe the application of process mining techniques in healthcare as a tool to asses customer journeys. The appropriateness of the approach presented is illustrated through a case study of a key healthcare process. Results depict how a healthcare process can be mapped through the CJ components, and its analysis can serve to understand and improve the patient's experience.

Background: The use of location-based data in clinical settings is often limited to real-time monitoring. Here we develop a proximity-based localisation system, and show how its longitudinal analysis can provide operational insights relating to mobility and occupancy in clinical settings. Objective: We measure the accuracy of the system, and algorithmically calculate measures of mobility and occupancy. Methods: We developed a Bluetooth Low Energy proximity-based localisation system, and deployed it in a hospital for 30 days. The system recorded the position of 75 people (17 patients and 55 staff) during this period. We additionally collected ground-truth data, and used it to validate system performance and accuracy. We conducted a number of analyses to estimate how people move in the hospital, and where they spend their time. Results: Using ground truth data, we estimated our system’s accuracy to be 96%. Using mobility trace analysis, we generated occupancy rates for different rooms of the hospital, by both staff and patients. We were also able to measure how much time, on average, patients spend in different rooms of the hospital. Finally, using unsupervised hierarchical clustering we showed that the system can differentiate between staff and patients without training. Conclusions: Analysis of longitudinal location-based data can offer rich operational insights to hospitals. Pri- marily, they allow for quick and consistent assessment of new strategies and protocols, and provide a quantitative way to measure their effectiveness.

BACKGROUND: As the COVID-19 pandemic disrupted medical practice, telemedicine emerged as an alternative to outpatient visits. However, it is not known how patients and physicians responded to an accelerated implementation of this model of medical care. OBJECTIVE: The aim of this study is to report the system-wide accelerated implementation of telemedicine, compare patient satisfaction between telemedicine and in-person visits, and report provider perceptions. METHODS: This study was conducted at the UC Christus Health Network, a large private academic health network in Santiago, Chile. The satisfaction of patients receiving telemedicine care in March and April 2020 was compared to those receiving in-person care during the same period (concurrent control group) as well as in March and April 2019 (retrospective control group). Patient satisfaction with in-person care was measured using the Net Promoter Score (NPS) survey. Patient satisfaction with telemedicine was assessed with an online survey assessing similar domains. Providers rated their satisfaction and responded to open-ended questions assessing challenges, strategies used to address challenges, the diagnostic process, treatment, and the patient-provider relationship. RESULTS: A total of 3962 patients receiving telemedicine, 1187 patients from the concurrent control group, and 1848 patients from the retrospective control group completed the surveys. Satisfaction was very high with both telemedicine and in-person services. Overall, 263 physicians from over 41 specialties responded to the survey. During telemedicine visits, most providers felt their clinical skills were challenged (61.8%). Female providers felt more challenged than male providers (70.7% versus 50.9%, P=.002). Surgeons, obstetricians, and gynecologists felt their clinical skills were challenged the least, compared to providers from nonsurgical specialties (P<.001). Challenges related to the delivery modality, diagnostic process, and patient-provid

Background: Inclusion criteria for observational studies frequently contain temporal entities and relations. The use of digital phenotypes to create cohorts in electronic health record–based observational studies requires rich functionality to capture these temporal entities and relations. However, such functionality is not usually available or requires complex database queries and specialized expertise to build them. Objective: The purpose of this study is to systematically assess observational studies reported in critical care literature to capture design requirements and functionalities for a graphical temporal abstraction-based digital phenotyping tool. Methods: We iteratively extracted attributes describing patients, interventions, and clinical outcomes. We qualitatively synthesized studies, identifying all temporal and nontemporal entities and relations. Results: We extracted data from 28 primary studies and 367 temporal and nontemporal entities. We generated a synthesis of entities, relations, and design patterns. Conclusions: We report on the observed types of clinical temporal entities and their relations as well as design requirements for a temporal abstraction-based digital phenotyping system. The results can be used to inform the development of such a system.

Nowadays, assessing and improving customer experience has become a priority, and has emerged as a key differentiator for business and organizations worldwide. A customer journey (CJ) is a strategic tool, a map of the steps customers follow when engaging with a company or organization to obtain a product or service. The increase of the need to obtain knowledge about customers’ perceptions and feelings when interacting with participants, touchpoints, and channels through different stages of the customer life cycle. This study aims to describe the application of process mining techniques in healthcare as a tool to asses customer journeys. The appropriateness of the approach presented is illustrated through a case study of a key healthcare process. Results depict how a healthcare process can be mapped through the CJ components, and its analysis can serve to understand and improve the patient’s experience

BACKGROUND: The use of location-based data in clinical settings is often limited to real-time monitoring. In this study, we aim to develop a proximity-based localization system and show how its longitudinal deployment can provide operational insights related to staff and patients' mobility and room occupancy in clinical settings. Such a streamlined data-driven approach can help in increasing the uptime of operating rooms and more broadly provide an improved understanding of facility utilization. OBJECTIVE: The aim of this study is to measure the accuracy of the system and algorithmically calculate measures of mobility and occupancy. METHODS: We developed a Bluetooth low energy, proximity-based localization system and deployed it in a hospital for 30 days. The system recorded the position of 75 people (17 patients and 55 staff) during this period. In addition, we collected ground-truth data and used them to validate system performance and accuracy. A number of analyses were conducted to estimate how people move in the hospital and where they spend their time. RESULTS: Using ground-truth data, we estimated the accuracy of our system to be 96%. Using mobility trace analysis, we generated occupancy rates for different rooms in the hospital occupied by both staff and patients. We were also able to measure how much time, on average, patients spend in different rooms of the hospital. Finally, using unsupervised hierarchical clustering, we showed that the system could differentiate between staff and patients without training. CONCLUSIONS: Analysis of longitudinal, location-based data can offer rich operational insights into hospital efficiency. In particular, they allow quick and consistent assessment of new strategies and protocols and provide a quantitative way to measure their effectiveness.

Background: As the COVID-19 pandemic disrupted medical practice, telemedicine emerged as an alternative to outpatient visits. However, it is not known how patients and physicians responded to an accelerated implementation of this model of medical care. Objective: The aim of this study is to report the system-wide accelerated implementation of telemedicine, compare patient satisfaction between telemedicine and in-person visits, and report provider perceptions. Methods: This study was conducted at the UC Christus Health Network, a large private academic health network in Santiago, Chile. The satisfaction of patients receiving telemedicine care in March and April 2020 was compared to those receiving in-person care during the same period (concurrent control group) as well as in March and April 2019 (retrospective control group). Patient satisfaction with in-person care was measured using the Net Promoter Score (NPS) survey. Patient satisfaction with telemedicine was assessed with an online survey assessing similar domains. Providers rated their satisfaction and responded to open-ended questions assessing challenges, strategies used to address challenges, the diagnostic process, treatment, and the patient-provider relationship. Results: A total of 3962 patients receiving telemedicine, 1187 patients from the concurrent control group, and 1848 patients from the retrospective control group completed the surveys. Satisfaction was very high with both telemedicine and in-person services. Overall, 263 physicians from over 41 specialties responded to the survey. During telemedicine visits, most providers felt their clinical skills were challenged (61.8%). Female providers felt more challenged than male providers (70.7% versus 50.9%, P=.002). Surgeons, obstetricians, and gynecologists felt their clinical skills were challenged the least, compared to providers from nonsurgical specialties (P<.001). Challenges related to the delivery modality, diagnostic process, and patient-provid

BACKGROUND: Inclusion criteria for observational studies frequently contain temporal entities and relations. The use of digital phenotypes to create cohorts in electronic health record-based observational studies requires rich functionality to capture these temporal entities and relations. However, such functionality is not usually available or requires complex database queries and specialized expertise to build them. OBJECTIVE: The purpose of this study is to systematically assess observational studies reported in critical care literature to capture design requirements and functionalities for a graphical temporal abstraction-based digital phenotyping tool. METHODS: We iteratively extracted attributes describing patients, interventions, and clinical outcomes. We qualitatively synthesized studies, identifying all temporal and nontemporal entities and relations. RESULTS: We extracted data from 28 primary studies and 367 temporal and nontemporal entities. We generated a synthesis of entities, relations, and design patterns. CONCLUSIONS: We report on the observed types of clinical temporal entities and their relations as well as design requirements for a temporal abstraction-based digital phenotyping system. The results can be used to inform the development of such a system.

The application of Value-based Healthcare requires not only the identification of key processes in the clinical domain but also an adequate analysis of the value chain delivered to the patient. Data Science and Big Data approaches are technologies that enable the creation of accurate systems that model reality. However, classical Data Mining techniques are presented by professionals as black boxes. This evokes a lack of trust in those techniques in the medical domain. Process Mining technologies are human-understandable Data Science tools that can fill this gap to support the application of Value-Based Healthcare in real domains. The aim of this paper is to perform an analysis of the ways in which Process Mining techniques can support health professionals in the application of Value-Based Technologies. For this purpose, we explored these techniques by analyzing emergency processes and applying the critical timing of Stroke treatment and a Question-Driven methodology. To demonstrate the possibilities of Process Mining in the characterization of the emergency process, we used a real log with 9046 emergency episodes from 2145 stroke patients that occurred from January 2010 to June 2017. Our results demonstrate how Process Mining technology can highlight the differences between the flow of stroke patients compared with that of other patients in an emergency. Further, we show that support for health professionals can be provided by improving their understanding of these techniques and enhancing the quality of care.

The performance analysis of Emergency Room episodes is aimed at providing decision makers with knowledge that allows them to decrease waiting times, reduce patient congestion, and improve the quality of care provided. In this case study, Process Mining is used to determine which activities, sub-processes, interactions, and characteristics of episodes explain why some episodes have a longer duration. The employed method and the results obtained are described in detail to serve as a guide for future performance analysis in this domain. It was discovered that the main cause of the increment in the episode duration is the occurrence of a loop between the Examination and Treatment sub-processes. It was also found out that as the episode severity increases, the number of repetitions of the Examination–Treatment loop increases as well. Moreover, the episodes in which this loop is more common are those that lead to Hospitalization as discharge destination. These findings might help to reduce the occurrence of this loop, in turn lowering the episode duration and, consequently, providing faster attention to more patients.

BACKGROUND: The availability of high fidelity electronic health record (EHR) data is a hallmark of the learning health care system. Washington State's Surgical Care Outcomes and Assessment Program (SCOAP) is a network of hospitals participating in quality improvement (QI) registries wherein data are manually abstracted from EHRs. To create the Comparative Effectiveness Research and Translation Network (CERTAIN), we semi-automated SCOAP data abstraction using a centralized federated data model, created a central data repository (CDR), and assessed whether these data could be used as real world evidence for QI and research. OBJECTIVES: Describe the validation processes and complexities involved and lessons learned. METHODS: Investigators installed a commercial CDR to retrieve and store data from disparate EHRs. Manual and automated abstraction systems were conducted in parallel (10/2012-7/2013) and validated in three phases using the EHR as the gold standard: 1) ingestion, 2) standardization, and 3) concordance of automated versus manually abstracted cases. Information retrieval statistics were calculated. RESULTS: Four unaffiliated health systems provided data. Between 6 and 15 percent of data elements were abstracted: 51 to 86 percent from structured data; the remainder using natural language processing (NLP). In phase 1, data ingestion from 12 out of 20 feeds reached 95 percent accuracy. In phase 2, 55 percent of structured data elements performed with 96 to 100 percent accuracy; NLP with 89 to 91 percent accuracy. In phase 3, concordance ranged from 69 to 89 percent. Information retrieval statistics were consistently above 90 percent. CONCLUSIONS: Semi-automated data abstraction may be useful, although raw data collected as a byproduct of health care delivery is not immediately available for use as real world evidence. New approaches to gathering and analyzing extant data are required.

Background: In Chile and Latin America, cervical cancer disproportionately affects women of low socioeconomic status. Mobile technology (mobile health, mHealth) may be able to address this disparity by targeting women in underserved populations. However, there is a lack of information regarding barriers to the implementation of mHealth interventions in underserved populations. Objective: The objective of this study was to investigate the use of cell phones and text messaging (short message service, SMS) in Latina women from disadvantaged communities to design an mHealth intervention for improving cervical cancer screening rates. Methods: We conducted 9 focus groups among women aged 25-64 years to better understand the implementation barriers and perceptions of a text message (SMS)–based intervention designed to improve cervical cancer screening rates. We used the PRECEDE-PROCEED model to categorize identified themes using template analysis. Results: Focus group results indicated that older women use mobile phones to receive calls from family and friends but seldom send text messages. Furthermore, they prefer personal contact with their health care providers regarding Papanicolaou (Pap) testing. Younger women, on the other hand, find text messaging easy to use and frequently send texts to family and friends. Importantly, women of all ages mentioned they would like to receive text messages about Pap tests. Factors that facilitate the uptake of the intervention include ease of access to Pap testing, inclusion of family members, and reminder messaging. Potential barriers include cost and the impersonal nature of messaging. Health team members support an mHealth intervention even though they acknowledge the potential barriers to this strategy. Overall, these results support the implementation of an mHealth intervention to increase cervical cancer screening rates. Conclusions: This study describes the opinions of women nonadherent to Pap testing on the potential use of mo

BACKGROUND: In Chile, more than 500 women die every year from cervical cancer, and a majority of Chilean women are not up-to-date with their Papanicolau (Pap) test. Mobile health has great potential in many health areas, particularly in health promotion and prevention. There are no randomized controlled trials in Latin America assessing its use in cervical cancer screening. The 'Development of Mobile Technologies for the Prevention of Cervical Cancer in Santiago, Chile' study aims to determine the efficacy of a text-message intervention on Pap test adherence among Chilean women in the metropolitan region of Santiago. METHODS/DESIGN: This study is a parallel randomized-controlled trial of 400 Chilean women aged 25-64 who are non-adherent with current recommendations for Pap test screening. Participants will be randomly assigned to (1) a control arm (usual care) or (2) an intervention arm, where text and voice messages containing information and encouragement to undergo screening will be sent to the women. The primary endpoint is completion of a Pap test within 6 months of baseline assessment, as determined by medical record review at community-based clinics. Medical record reviewers will be blinded to randomization arms. The secondary endpoint is an evaluation of the implementation and usability of the text message intervention as a strategy to improve screening adherence. DISCUSSION: This intervention using mobile technology intends to raise cervical cancer screening adherence and compliance among a Chilean population of low and middle-low socioeconomic status. If successful, this strategy may reduce the incidence of cervical cancer. TRIAL REGISTRATION: Clinicaltrials.gov NCT02376023 Registered 2/17/2015. First participant enrolled Feb 22nd 2016.

INTRODUCTION: A key attribute of a learning health care system is the ability to collect and analyze routinely collected clinical data in order to quickly generate new clinical evidence, and to monitor the quality of the care provided. To achieve this vision, clinical data must be easy to extract and stored in computer readable formats. We conducted this study across multiple organizations to assess the availability of such data specifically for comparative effectiveness research (CER) and quality improvement (QI) on surgical procedures. SETTING: This study was conducted in the context of the data needed for the already established Surgical Care and Outcomes Assessment Program (SCOAP), a clinician-led, performance benchmarking, and QI registry for surgical and interventional procedures in Washington State. METHODS: We selected six hospitals, managed by two Health Information Technology (HIT) groups, and assessed the ease of automated extraction of the data required to complete the SCOAP data collection forms. Each data element was classified as easy, moderate, or complex to extract. RESULTS: Overall, a significant proportion of the data required to automatically complete the SCOAP forms was not stored in structured computer-readable formats, with more than 75 percent of all data elements being classified as moderately complex or complex to extract. The distribution differed significantly between the health care systems studied. CONCLUSIONS: Although highly desirable, a learning health care system does not automatically emerge from the implementation of electronic health records (EHRs). Innovative methods to improve the structured capture of clinical data are needed to facilitate the use of routinely collected clinical data for patient phenotyping.

BACKGROUND: The field of clinical research informatics includes creation of clinical data repositories (CDRs) used to conduct quality improvement (QI) activities and comparative effectiveness research (CER). Ideally, CDR data are accurately and directly abstracted from disparate electronic health records (EHRs), across diverse health-systems. OBJECTIVE: Investigators from Washington State's Surgical Care Outcomes and Assessment Program (SCOAP) Comparative Effectiveness Research Translation Network (CERTAIN) are creating such a CDR. This manuscript describes the automation and validation methods used to create this digital infrastructure. METHODS: SCOAP is a QI benchmarking initiative. Data are manually abstracted from EHRs and entered into a data management system. CERTAIN investigators are now deploying Caradigm's Amalga™ tool to facilitate automated abstraction of data from multiple, disparate EHRs. Concordance is calculated to compare data automatically to manually abstracted. Performance measures are calculated between Amalga and each parent EHR. Validation takes place in repeated loops, with improvements made over time. When automated abstraction reaches the current benchmark for abstraction accuracy - 95% - itwill 'go-live' at each site. PROGRESS TO DATE: A technical analysis was completed at 14 sites. Five sites are contributing; the remaining sites prioritized meeting Meaningful Use criteria. Participating sites are contributing 15-18 unique data feeds, totaling 13 surgical registry use cases. Common feeds are registration, laboratory, transcription/dictation, radiology, and medications. Approximately 50% of 1,320 designated data elements are being automatically abstracted-25% from structured data; 25% from text mining. CONCLUSION: In semi-automating data abstraction and conducting a rigorous validation, CERTAIN investigators will semi-automate data collection to conduct QI and CER, while advancing the Learning Healthcare System.