Rodriguez-Watson CV, Louder AM, Kabelac C, Frederick CM, Sheils NE, Eldridge EH, Lin ND, Pollock BD, Gatz JL, Grannis SJ, Vashisht R, Ghauri K, Knepper C, Leonard S, Embi PJ, Jenkinson G, Klesh R, Garner OB, Patel A, Dahm L, Barin A, Cooper DM, Andriola T, Byington CL, Crews BO, Butte AJ, and Allen J
Background: Real-world performance of COVID-19 diagnostic tests under Emergency Use Authorization (EUA) must be assessed. We describe overall trends in the performance of serology tests in the context of real-world implementation., Methods: Six health systems estimated the odds of seropositivity and positive percent agreement (PPA) of serology test among people with confirmed SARS-CoV-2 infection by molecular test. In each dataset, we present the odds ratio and PPA, overall and by key clinical, demographic, and practice parameters., Results: A total of 15,615 people were observed to have at least one serology test 14-90 days after a positive molecular test for SARS-CoV-2. We observed higher PPA in Hispanic (PPA range: 79-96%) compared to non-Hispanic (60-89%) patients; in those presenting with at least one COVID-19 related symptom (69-93%) as compared to no such symptoms (63-91%); and in inpatient (70-97%) and emergency department (93-99%) compared to outpatient (63-92%) settings across datasets. PPA was highest in those with diabetes (75-94%) and kidney disease (83-95%); and lowest in those with auto-immune conditions or who are immunocompromised (56-93%). The odds ratios (OR) for seropositivity were higher in Hispanics compared to non-Hispanics (OR range: 2.59-3.86), patients with diabetes (1.49-1.56), and obesity (1.63-2.23); and lower in those with immunocompromised or autoimmune conditions (0.25-0.70), as compared to those without those comorbidities. In a subset of three datasets with robust information on serology test name, seven tests were used, two of which were used in multiple settings and met the EUA requirement of PPA ≥87%. Tests performed similarly across datasets., Conclusion: Although the EUA requirement was not consistently met, more investigation is needed to understand how serology and molecular tests are used, including indication and protocol fidelity. Improved data interoperability of test and clinical/demographic data are needed to enable rapid assessment of the real-world performance of in vitro diagnostic tests., Competing Interests: AJB is a co-founder and consultant to Personalis and NuMedii; consultant to Samsung, Mango Tree Corporation, and in the recent past, 10x Genomics, Helix, Pathway Genomics, and Verinata (Illumina); has served on paid advisory panels or boards for Geisinger Health, Regenstrief Institute, Gerson Lehman Group, AlphaSights, Covance, Novartis, Genentech, Merck, and Roche; is a shareholder in Personalis and NuMedii; is a minor shareholder in Apple, Facebook, Alphabet (Google), Microsoft, Amazon, Snap, Snowflake, 10x Genomics, Illumina, Nuna Health, Assay Depot (Scientist.com), Vet24seven, Regeneron, Sanofi, Royalty Pharma, Pfizer, BioNTech, AstraZeneca, Moderna, Biogen, Twist Bioscience, Pacific Biosciences, Editas Medicine, Invitae, Doximity, and Sutro, and several other non-health related companies and mutual funds; and has received honoraria and travel reimbursement for invited talks from Johnson and Johnson, Roche, Genentech, Pfizer, Merck, Lilly, Takeda, Varian, Mars, Siemens, Optum, Abbott, Celgene, AstraZeneca, AbbVie, Westat, several investment and venture capital firms, and many academic institutions, medical or disease specific foundations and associations, and health systems. AJB receives royalty payments through Stanford University, for several patents and other disclosures licensed to NuMedii and Personalis. AJB’s research has been funded by NIH, Northrup Grumman (as the prime on an NIH contract), Genentech, Johnson and Johnson, FDA, Robert Wood Johnson Foundation, Leon Lowenstein Foundation, Intervalien Foundation, Priscilla Chan and Mark Zuckerberg, the Barbara and Gerson Bakar Foundation, and in the recent past, the March of Dimes, Juvenile Diabetes Research Foundation, California Governor’s Office of Planning and Research, California Institute for Regenerative Medicine, L’Oreal, and Progenity. CLB has intellectual property in and receives royalties from BioFire, Inc. She serves as a scientific advisor to IDbyDNA (San Francisco, CA and Salt Lake City, UT); and is on the Board of the Commonwealth Fund. CK is a paid employee of Aetion and hold Aetion stock options. NES is an employee of Optum Labs and owns stock in the parent company UnitedHealth group. NDL was an employee of Health Catalyst at the time the work was performed. JLG is a full-time employee of Regenstrief Institute, which provides independent research services to entities including those within the pharmaceutical and medical device industries. SJG serves as Chief Medical Information Officer for the Indiana Health Information Exchange, and is a founding partner of Uppstroms, LLC. This does not alter our adherence to PLOS ONE policies on sharing data and materials., (Copyright: © 2023 Watson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)