Reproducibility of Molecular Phenotypes after Long-Term Differentiation to Human iPSC-Derived Neurons: A Multi-Site Omics Study

Summary Reproducibility in molecular and cellular studies is fundamental to scientific discovery. To establish the reproducibility of a well-defined long-term neuronal differentiation protocol, we repeated the cellular and molecular comparison of the same two iPSC lines across five distinct laboratories. Despite uncovering acceptable variability within individual laboratories, we detect poor cross-site reproducibility of the differential gene expression signature between these two lines. Factor analysis identifies the laboratory as the largest source of variation along with several variation-inflating confounders such as passaging effects and progenitor storage. Single-cell transcriptomics shows substantial cellular heterogeneity underlying inter-laboratory variability and being responsible for biases in differential gene expression inference. Factor analysis-based normalization of the combined dataset can remove the nuisance technical effects, enabling the execution of robust hypothesis-generating studies. Our study shows that multi-center collaborations can expose systematic biases and identify critical factors to be standardized when publishing novel protocols, contributing to increased cross-site reproducibility.
Highlights • Cross-site reproducibility in iPSC-based molecular experiments is poor • Factor analysis-based normalization can be used to analyze nuisance variation • External validation of iPSC experimental molecular data is critical for reproducibility • Collaborative studies are needed to reveal systematic biases to improve reproducibility
In this article, Lakics and colleagues show that, while individual laboratories are able to identify consistent molecular and seemingly statistically robust differences between iPSC neuronal models, cross-site reproducibility is poor. Their findings support multi-center collaborations to expose systematic biases and identify critical factors to be standardized to improve reproducibility in iPSC-based molecular experiments.