Search

Abstract Background Effective standardisation of the microbiome field is essential to facilitate global translational research and increase the reproducibility of microbiome studies. In this study, we describe the development and validation of a whole cell reference reagent specific to the gut microbiome by the UK National Institute for Biological Standards and Control. We also provide and test a two-step reporting framework to allow microbiome researchers to quickly and accurately validate choices of DNA extraction, sequencing, and bioinformatic pipelines. Results Using 20 strains that are commonly found in the gut, we developed a whole cell reference reagent (WC-Gut RR) for the evaluation of the DNA extraction protocols commonly used in microbiome pipelines. DNA was first analysed using the physicochemical measures of yield, integrity, and purity, which demonstrated kits widely differed in the quality of the DNA they produced. Importantly, the combination of the WC-Gut RR and the three physicochemical measures allowed us to differentiate clearly between kit performance. We next assessed the ability of WC-Gut RR to evaluate kit performance in the reconstitution of accurate taxonomic profiles. We applied a four-measure framework consisting of Sensitivity, false-positive relative abundance (FPRA), Diversity, and Similarity as previously described for DNA reagents. Using the WC-Gut RR and these four measures, we could reliably identify the DNA extraction kits’ biases when using with both 16S rRNA sequencing and shotgun sequencing. Moreover, when combining this with complementary DNA standards, we could estimate the relative bias contributions of DNA extraction kits vs bioinformatic analysis. Finally, we assessed WC-Gut RR alongside other commercially available reagents. The analysis here clearly demonstrates that reagents of lower complexity, not composed of anaerobic and hard-to-lyse strains from the gut, can artificially inflate the performance of microbiome DNA extraction kits and bioinformatic pipelines. Conclusions We produced a complex whole cell reagent that is specific for the gut microbiome and can be used to evaluate and benchmark DNA extractions in microbiome studies. Used alongside a DNA standard, the NIBSC DNA-Gut-Mix RR helps estimating where biases occur in microbiome pipelines. In the future, we aim to establish minimum thresholds for data quality through an interlaboratory collaborative study. Video Abstract

Background: Effective standardisation of the microbiome field is essential to facilitate global translational research and increase the reproducibility of microbiome studies. In this study, we describe the development and validation of a whole cell reference reagent specific to the gut microbiome by the UK National Institute for Biological Standards and Control. We also provide and test a two-step reporting framework to allow microbiome researchers to quickly and accurately validate choices of DNA extraction, sequencing, and bioinformatic pipelines. Results: Using 20 strains that are commonly found in the gut, we developed a whole cell reference reagent (WC-Gut RR) for the evaluation of the DNA extraction protocols commonly used in microbiome pipelines. DNA was first analysed using the physicochemical measures of yield, integrity, and purity, which demonstrated kits widely differed in the quality of the DNA they produced. Importantly, the combination of the WC-Gut RR and the three physicochemical measures allowed us to differentiate clearly between kit performance. We next assessed the ability of WC-Gut RR to evaluate kit performance in the reconstitution of accurate taxonomic profiles. We applied a four-measure framework consisting of Sensitivity, false-positive relative abundance (FPRA), Diversity, and Similarity as previously described for DNA reagents. Using the WC-Gut RR and these four measures, we could reliably identify the DNA extraction kits' biases when using with both 16S rRNA sequencing and shotgun sequencing. Moreover, when combining this with complementary DNA standards, we could estimate the relative bias contributions of DNA extraction kits vs bioinformatic analysis. Finally, we assessed WC-Gut RR alongside other commercially available reagents. The analysis here clearly demonstrates that reagents of lower complexity, not composed of anaerobic and hard-to-lyse strains from the gut, can artificially inflate the performance of microbiome DNA extraction kits and bioinformatic pipelines. Conclusions: We produced a complex whole cell reagent that is specific for the gut microbiome and can be used to evaluate and benchmark DNA extractions in microbiome studies. Used alongside a DNA standard, the NIBSC DNA-Gut-Mix RR helps estimating where biases occur in microbiome pipelines. In the future, we aim to establish minimum thresholds for data quality through an interlaboratory collaborative study. BEU9jL7xnwncT84Rof_ZoX Video Abstract [ABSTRACT FROM AUTHOR]

The search for a test that can predict vaccine efficacy is an important part of any vaccine development program. Although regulators hesitate to acknowledge any test as a true ‘correlate of protection’, there are many precedents for defining ‘surrogate’ assays. Surrogates can be powerful tools for vaccine optimization, licensure, comparisons between products and development of improved products. When such tests achieve ‘reference’ status however, they can inadvertently become barriers to new technologies that do not work the same way as existing vaccines. This is particularly true when these tests are based upon circularly-defined ‘reference’ or, even worse, proprietary reagents. The situation with inactivated influenza vaccines is a good example of this phenomenon. The most frequently used tests to define vaccine-induced immunity are all serologic assays: hemagglutination inhibition (HI), single radial hemolysis (SRH) and microneutralization (MN). The first two, and particularly the HI assay, have achieved reference status and criteria have been established in many jurisdictions for their use in licensing new vaccines and to compare the performance of different vaccines. However, all of these assays are based on biological reagents that are notoriously difficult to standardize and can vary substantially by geography, by chance (i.e. developing reagents in eggs that may not antigenitically match wild-type viruses) and by intention (ie: choosing reagents that yield the most favorable results). This review describes attempts to standardize these assays to improve their performance as surrogates, the dangers of over-reliance on ‘reference’ serologic assays, the ways that manufacturers can exploit the existing regulatory framework to make their products ‘look good’ and the implications of this long-established system for the introduction of novel influenza vaccines.

The European Pharmacopoeia (Ph. Eur.) prescribes that hepatitis A vaccine (HAV) batches be tested for their potency before being released onto the European market. An enzyme-linked immunosorbent assay (ELISA) method for determination of antigen content of HAV was validated through an international collaborative study in 2012. This method requires specific coating and detection antibodies, i.e. coating reagent and detection antibodies Biological Reference Reagents (BRRs). The current batch of hepatitis A virus coating reagent (batch 1) was established in 2012. Stocks of this BRR were running low and a replacement batch was needed. Therefore, the European Directorate for the Quality of Medicines & HealthCare (EDQM) organised a collaborative study to qualify a replacement batch. Candidate coating reagent batch 2 was prepared from the same starting material as batch 1 and compared to the previous batch during the collaborative study. Results confirmed that candidate coating reagent batch 2 is suitable to be used for the intended purpose. The study demonstrated that batch 2 is comparable to batch 1 and that it can be used at the same working concentration, i.e. 1:500. The candidate material was adopted as Ph. Eur. Hepatitis A virus Coating Reagent for ELISA BRR batch 2 by the Ph. Eur. Commission at its 177th session in November 2023. It will be available from the EDQM under catalogue number Y0001624 once batch 1 is exhausted., (© Council of Europe 2024.)

Allergen extracts have been used for diagnosis and treatment of allergy for around 100 years. During the second half of 20th century, the notion increasingly gained foothold that accurate standardization of such extracts is of great importance for improvement of their quality. As a consequence, manufacturers have implemented extensive protocols for standardization and quality control. These protocols have overall IgE-binding potencies as their focus. Unfortunately, each company is using their own in-house reference materials and their own unique units to express potencies. This does not facilitate comparison of different products. During the last decades, most major allergens of relevant allergen sources have been identified and it has been established that effective immunotherapy requires certain minimum quantities of these allergens to be present in the administered maintenance dose. Therefore, the idea developed to introduce major allergens measurements into standardization protocols. Such protocols based on mass units of major allergen, quantify the active ingredients of the treatment and will at the same time allow comparison of competitor products. In 2001, an EU funded project, the CREATE project, was started to support introduction of major allergen based standardization. The aim of the project was to evaluate the use of recombinant allergens as reference materials and of ELISA assays for major allergen measurements. This paper gives an overview of the achievements of the CREATE project. [ABSTRACT FROM AUTHOR]