Search

Your search keyword '"Wang, May D."' showing total 24 results
Start Over Author "Wang, May D." Publication Type Electronic Resources
24 results on '"Wang, May D."'

1. RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Records

Author

Xu, Ran, Shi, Wenqi, Yu, Yue, Zhuang, Yuchen, Jin, Bowen, Wang, May D., Ho, Joyce C., Yang, Carl, Xu, Ran, Shi, Wenqi, Yu, Yue, Zhuang, Yuchen, Jin, Bowen, Wang, May D., Ho, Joyce C., and Yang, Carl

Abstract

We present RAM-EHR, a Retrieval AugMentation pipeline to improve clinical predictions on Electronic Health Records (EHRs). RAM-EHR first collects multiple knowledge sources, converts them into text format, and uses dense retrieval to obtain information related to medical concepts. This strategy addresses the difficulties associated with complex names for the concepts. RAM-EHR then augments the local EHR predictive model co-trained with consistency regularization to capture complementary information from patient visits and summarized knowledge. Experiments on two EHR datasets show the efficacy of RAM-EHR over previous knowledge-enhanced baselines (3.4% gain in AUROC and 7.2% gain in AUPR), emphasizing the effectiveness of the summarized knowledge from RAM-EHR for clinical prediction tasks. The code will be published at \url{https://github.com/ritaranx/RAM-EHR}., Comment: ACL 2024

Published
2024

2. EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records

Author

Shi, Wenqi, Xu, Ran, Zhuang, Yuchen, Yu, Yue, Zhang, Jieyu, Wu, Hang, Zhu, Yuanda, Ho, Joyce, Yang, Carl, Wang, May D., Shi, Wenqi, Xu, Ran, Zhuang, Yuchen, Yu, Yue, Zhang, Jieyu, Wu, Hang, Zhu, Yuanda, Ho, Joyce, Yang, Carl, and Wang, May D.

Abstract

Large language models (LLMs) have demonstrated exceptional capabilities in planning and tool utilization as autonomous agents, but few have been developed for medical problem-solving. We propose EHRAgent, an LLM agent empowered with a code interface, to autonomously generate and execute code for multi-tabular reasoning within electronic health records (EHRs). First, we formulate an EHR question-answering task into a tool-use planning process, efficiently decomposing a complicated task into a sequence of manageable actions. By integrating interactive coding and execution feedback, EHRAgent learns from error messages and improves the originally generated code through iterations. Furthermore, we enhance the LLM agent by incorporating long-term memory, which allows EHRAgent to effectively select and build upon the most relevant successful cases from past experiences. Experiments on three real-world multi-tabular EHR datasets show that EHRAgent outperforms the strongest baseline by up to 29.6% in success rate. EHRAgent leverages the emerging few-shot learning capabilities of LLMs, enabling autonomous code generation and execution to tackle complex clinical tasks with minimal demonstrations., Comment: Work in Progress

Published
2024

3. MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoning

Author

Shi, Wenqi, Xu, Ran, Zhuang, Yuchen, Yu, Yue, Wu, Hang, Yang, Carl, Wang, May D., Shi, Wenqi, Xu, Ran, Zhuang, Yuchen, Yu, Yue, Wu, Hang, Yang, Carl, and Wang, May D.

Abstract

Despite their improved capabilities in generation and reasoning, adapting large language models (LLMs) to the biomedical domain remains challenging due to their immense size and corporate privacy. In this work, we propose MedAdapter, a unified post-hoc adapter for test-time adaptation of LLMs towards biomedical applications. Instead of fine-tuning the entire LLM, MedAdapter effectively adapts the original model by fine-tuning only a small BERT-sized adapter to rank candidate solutions generated by LLMs. Experiments demonstrate that MedAdapter effectively adapts both white-box and black-box LLMs in biomedical reasoning, achieving average performance improvements of 25.48% and 11.31%, respectively, without requiring extensive computational resources or sharing data with third parties. MedAdapter also yields superior performance when combined with train-time adaptation, highlighting a flexible and complementary solution to existing adaptation methods. Faced with the challenges of balancing model performance, computational resources, and data privacy, MedAdapter provides an efficient, privacy-preserving, cost-effective, and transparent solution for adapting LLMs to the biomedical domain., Comment: Work in Progress

Published
2024

4. BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers

Author

Xu, Ran, Shi, Wenqi, Yu, Yue, Zhuang, Yuchen, Zhu, Yanqiao, Wang, May D., Ho, Joyce C., Zhang, Chao, Yang, Carl, Xu, Ran, Shi, Wenqi, Yu, Yue, Zhuang, Yuchen, Zhu, Yanqiao, Wang, May D., Ho, Joyce C., Zhang, Chao, and Yang, Carl

Abstract

Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedical tasks but still challenging due to the deficiency of sufficient publicly annotated biomedical data and computational resources. We present BMRetriever, a series of dense retrievers for enhancing biomedical retrieval via unsupervised pre-training on large biomedical corpora, followed by instruction fine-tuning on a combination of labeled datasets and synthetic pairs. Experiments on 5 biomedical tasks across 11 datasets verify BMRetriever's efficacy on various biomedical applications. BMRetriever also exhibits strong parameter efficiency, with the 410M variant outperforming baselines up to 11.7 times larger, and the 2B variant matching the performance of models with over 5B parameters. The training data and model checkpoints are released at \url{https://huggingface.co/BMRetriever} to ensure transparency, reproducibility, and application to new domains., Comment: Work in progress. The model and data will be uploaded to \url{https://github.com/ritaranx/BMRetriever}

Published
2024

5. Autonomous Soft Tissue Retraction Using Demonstration-Guided Reinforcement Learning

Author

Singh, Amritpal, Shi, Wenqi, Wang, May D, Singh, Amritpal, Shi, Wenqi, and Wang, May D

Abstract

In the context of surgery, robots can provide substantial assistance by performing small, repetitive tasks such as suturing, needle exchange, and tissue retraction, thereby enabling surgeons to concentrate on more complex aspects of the procedure. However, existing surgical task learning mainly pertains to rigid body interactions, whereas the advancement towards more sophisticated surgical robots necessitates the manipulation of soft bodies. Previous work focused on tissue phantoms for soft tissue task learning, which can be expensive and can be an entry barrier to research. Simulation environments present a safe and efficient way to learn surgical tasks before their application to actual tissue. In this study, we create a Robot Operating System (ROS)-compatible physics simulation environment with support for both rigid and soft body interactions within surgical tasks. Furthermore, we investigate the soft tissue interactions facilitated by the patient-side manipulator of the DaVinci surgical robot. Leveraging the pybullet physics engine, we simulate kinematics and establish anchor points to guide the robotic arm when manipulating soft tissue. Using demonstration-guided reinforcement learning (RL) algorithms, we investigate their performance in comparison to traditional reinforcement learning algorithms. Our in silico trials demonstrate a proof-of-concept for autonomous surgical soft tissue retraction. The results corroborate the feasibility of learning soft body manipulation through the application of reinforcement learning agents. This work lays the foundation for future research into the development and refinement of surgical robots capable of managing both rigid and soft tissue interactions. Code is available at https://github.com/amritpal-001/tissue_retract., Comment: 10 Pages, 5 figures, MICCAI 2023 conference (AECAI workshop)

Published
2023

6. Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic Review

Author

Giuste, Felipe, Shi, Wenqi, Zhu, Yuanda, Naren, Tarun, Isgut, Monica, Sha, Ying, Tong, Li, Gupte, Mitali, Wang, May D., Giuste, Felipe, Shi, Wenqi, Zhu, Yuanda, Naren, Tarun, Isgut, Monica, Sha, Ying, Tong, Li, Gupte, Mitali, and Wang, May D.

Abstract

Despite the myriad peer-reviewed papers demonstrating novel Artificial Intelligence (AI)-based solutions to COVID-19 challenges during the pandemic, few have made significant clinical impact. The impact of artificial intelligence during the COVID-19 pandemic was greatly limited by lack of model transparency. This systematic review examines the use of Explainable Artificial Intelligence (XAI) during the pandemic and how its use could overcome barriers to real-world success. We find that successful use of XAI can improve model performance, instill trust in the end-user, and provide the value needed to affect user decision-making. We introduce the reader to common XAI techniques, their utility, and specific examples of their application. Evaluation of XAI results is also discussed as an important step to maximize the value of AI-based clinical decision support systems. We illustrate the classical, modern, and potential future trends of XAI to elucidate the evolution of novel XAI techniques. Finally, we provide a checklist of suggestions during the experimental design process supported by recent publications. Common challenges during the implementation of AI solutions are also addressed with specific examples of potential solutions. We hope this review may serve as a guide to improve the clinical impact of future AI-based solutions., Comment: 23 pages, 13 figures, submitting to IEEE

Published
2021

7. Public Health Informatics: Proposing Causal Sequence of Death Using Neural Machine Translation

Author

Zhu, Yuanda, Sha, Ying, Wu, Hang, Li, Mai, Hoffman, Ryan A., Wang, May D., Zhu, Yuanda, Sha, Ying, Wu, Hang, Li, Mai, Hoffman, Ryan A., and Wang, May D.

Abstract

Each year there are nearly 57 million deaths around the world, with over 2.7 million in the United States. Timely, accurate and complete death reporting is critical in public health, as institutions and government agencies rely on death reports to analyze vital statistics and to formulate responses to communicable diseases. Inaccurate death reporting may result in potential misdirection of public health policies. Determining the causes of death is, nevertheless, challenging even for experienced physicians. To facilitate physicians in accurately reporting causes of death, we present an advanced AI approach to determine a chronically ordered sequence of clinical conditions that lead to death, based on decedent's last hospital discharge record. The sequence of clinical codes on the death report is named as causal chain of death, coded in the tenth revision of International Statistical Classification of Diseases (ICD-10); in line with the ICD-9-CM Official Guidelines for Coding and Reporting, the priority-ordered clinical conditions on the discharge record are coded in ICD-9. We identify three challenges in proposing the causal chain of death: two versions of coding system in clinical codes, medical domain knowledge conflict, and data interoperability. To overcome the first challenge in this sequence-to-sequence problem, we apply neural machine translation models to generate target sequence. Along with three accuracy metrics, we evaluate the quality of generated sequences with the BLEU (BiLingual Evaluation Understudy) score and achieve 16.04 out of 100. To address the second challenge, we incorporate expert-verified medical domain knowledge as constraint in generating output sequence to exclude infeasible causal chains. Lastly, we demonstrate the usability of our work in a Fast Healthcare Interoperability Resources (FHIR) interface to address the third challenge., Comment: 11 pages, 8 figures, 8 tables. Updates: (1) Added Section II: Recent Work (2) Added three accuracy evaluation criteria (3) Re-run experiments of OpenNMT and updated the results and discussion in Section VI: Results and Discussion (4) Finished FHIR mobile app and updated Section VII: FHIR Interface (5) Revised Section VIII: Conclusion accordingly

Published
2020

8. Can mHealth Technology Help Mitigate the Effects of the COVID-19 Pandemic?

Author

Massachusetts Institute of Technology. Institute for Medical Engineering & Science, Adans-Dester, Catherine P., Bamberg, Stacy, Bertacchi, Francesco P., Caulfield, Brian, Chappie, Kara, Demarchi, Danilo, Erb, M. Kelley, Estrada, Juan, Fabara, Eric E., Freni, Michael, Friedl, Karl E., Ghaffari, Roozbeh, Gill, Geoffrey, Greenberg, Mark S., Hoyt, Reed W., Jovanov, Emil, Kanzler, Christoph M., Katabi, Dina, Kernan, Meredith, Kigin, Colleen, Lee, Sunghoon I., Leonhardt, Steffen, Lovell, Nigel H., Mantilla, Jose, McCoy, Thomas H., Luo, Nell Meosky, Miller, Glenn A., Moore, John, O'Keeffe, Derek, Palmer, Jeffrey, Parisi, Federico, Patel, Shyamal, Po, Jack, Pugliese, Benito L., Quatieri, Thomas, Rahman, Tauhidur, Ramasarma, Nathan, Rogers, John A., Ruiz-Esparza, Guillermo U., Sapienza, Stefano, Schiurring, Gregory, Schwamm, Lee, Shafiee, Hadi, Kelly Silacci, Sara, Sims, Nathaniel M, Talkar, Tanya, Tharion, William J., Toombs, James A., Uschnig, Christopher, Vergara-Diaz, Gloria P., Wacnik, Paul, Wang, May D., Welch, James, Williamson, Lina, Zafonte, Ross, Zai, Adrian, Zhang, Yuan-Ting, Tearney, Guillermo J., Ahmad, Rushdy, Walt, David R., Bonato, Paolo, Massachusetts Institute of Technology. Institute for Medical Engineering & Science, Adans-Dester, Catherine P., Bamberg, Stacy, Bertacchi, Francesco P., Caulfield, Brian, Chappie, Kara, Demarchi, Danilo, Erb, M. Kelley, Estrada, Juan, Fabara, Eric E., Freni, Michael, Friedl, Karl E., Ghaffari, Roozbeh, Gill, Geoffrey, Greenberg, Mark S., Hoyt, Reed W., Jovanov, Emil, Kanzler, Christoph M., Katabi, Dina, Kernan, Meredith, Kigin, Colleen, Lee, Sunghoon I., Leonhardt, Steffen, Lovell, Nigel H., Mantilla, Jose, McCoy, Thomas H., Luo, Nell Meosky, Miller, Glenn A., Moore, John, O'Keeffe, Derek, Palmer, Jeffrey, Parisi, Federico, Patel, Shyamal, Po, Jack, Pugliese, Benito L., Quatieri, Thomas, Rahman, Tauhidur, Ramasarma, Nathan, Rogers, John A., Ruiz-Esparza, Guillermo U., Sapienza, Stefano, Schiurring, Gregory, Schwamm, Lee, Shafiee, Hadi, Kelly Silacci, Sara, Sims, Nathaniel M, Talkar, Tanya, Tharion, William J., Toombs, James A., Uschnig, Christopher, Vergara-Diaz, Gloria P., Wacnik, Paul, Wang, May D., Welch, James, Williamson, Lina, Zafonte, Ross, Zai, Adrian, Zhang, Yuan-Ting, Tearney, Guillermo J., Ahmad, Rushdy, Walt, David R., and Bonato, Paolo

Abstract

Goal: The aim of the study herein reported was to review mobile health (mHealth) technologies and explore their use to monitor and mitigate the effects of the COVID-19 pandemic. Methods: A Task Force was assembled by recruiting individuals with expertise in electronic Patient-Reported Outcomes (ePRO), wearable sensors, and digital contact tracing technologies. Its members collected and discussed available information and summarized it in a series of reports. Results: The Task Force identified technologies that could be deployed in response to the COVID-19 pandemic and would likely be suitable for future pandemics. Criteria for their evaluation were agreed upon and applied to these systems. Conclusions: mHealth technologies are viable options to monitor COVID-19 patients and be used to predict symptom escalation for earlier intervention. These technologies could also be utilized to monitor individuals who are presumed non-infected and enable prediction of exposure to SARS-CoV-2, thus facilitating the prioritization of diagnostic testing.

Published
2020

9. Improve Model Generalization and Robustness to Dataset Bias with Bias-regularized Learning and Domain-guided Augmentation

Author

Zhang, Yundong, Wu, Hang, Liu, Huiye, Tong, Li, Wang, May D, Zhang, Yundong, Wu, Hang, Liu, Huiye, Tong, Li, and Wang, May D

Abstract

Deep Learning has thrived on the emergence of biomedical big data. However, medical datasets acquired at different institutions have inherent bias caused by various confounding factors such as operation policies, machine protocols, treatment preference and etc. As the result, models trained on one dataset, regardless of volume, cannot be confidently utilized for the others. In this study, we investigated model robustness to dataset bias using three large-scale Chest X-ray datasets: first, we assessed the dataset bias using vanilla training baseline; second, we proposed a novel multi-source domain generalization model by (a) designing a new bias-regularized loss function; and (b) synthesizing new data for domain augmentation. We showed that our model significantly outperformed the baseline and other approaches on data from unseen domain in terms of accuracy and various bias measures, without retraining or finetuning. Our method is generally applicable to other biomedical data, providing new algorithms for training models robust to bias for big data analysis and applications. Demo training code is publicly available., Comment: 9 pages, 5 figures

Published
2019

10. DeepDeath: Learning to Predict the Underlying Cause of Death with Big Data

Author

Hassanzadeh, Hamid Reza, Sha, Ying, Wang, May D., Hassanzadeh, Hamid Reza, Sha, Ying, and Wang, May D.

Abstract

Multiple cause-of-death data provides a valuable source of information that can be used to enhance health standards by predicting health related trajectories in societies with large populations. These data are often available in large quantities across U.S. states and require Big Data techniques to uncover complex hidden patterns. We design two different classes of models suitable for large-scale analysis of mortality data, a Hadoop-based ensemble of random forests trained over N-grams, and the DeepDeath, a deep classifier based on the recurrent neural network (RNN). We apply both classes to the mortality data provided by the National Center for Health Statistics and show that while both perform significantly better than the random classifier, the deep model that utilizes long short-term memory networks (LSTMs), surpasses the N-gram based models and is capable of learning the temporal aspect of the data without a need for building ad-hoc, expert-driven features.

Published
2017

11. MotifMark: Finding Regulatory Motifs in DNA Sequences

Author

Hassanzadeh, Hamid Reza, Kolhe, Pushkar, Isbell, Charles L., Wang, May D., Hassanzadeh, Hamid Reza, Kolhe, Pushkar, Isbell, Charles L., and Wang, May D.

Abstract

The interaction between proteins and DNA is a key driving force in a significant number of biological processes such as transcriptional regulation, repair, recombination, splicing, and DNA modification. The identification of DNA-binding sites and the specificity of target proteins in binding to these regions are two important steps in understanding the mechanisms of these biological activities. A number of high-throughput technologies have recently emerged that try to quantify the affinity between proteins and DNA motifs. Despite their success, these technologies have their own limitations and fall short in precise characterization of motifs, and as a result, require further downstream analysis to extract useful and interpretable information from a haystack of noisy and inaccurate data. Here we propose MotifMark, a new algorithm based on graph theory and machine learning, that can find binding sites on candidate probes and rank their specificity in regard to the underlying transcription factor. We developed a pipeline to analyze experimental data derived from compact universal protein binding microarrays and benchmarked it against two of the most accurate motif search methods. Our results indicate that MotifMark can be a viable alternative technique for prediction of motif from protein binding microarrays and possibly other related high-throughput techniques.

Published
2017

12. DeeperBind: Enhancing Prediction of Sequence Specificities of DNA Binding Proteins

Author

Hassanzadeh, Hamid Reza, Wang, May D., Hassanzadeh, Hamid Reza, and Wang, May D.

Abstract

Transcription factors (TFs) are macromolecules that bind to \textit{cis}-regulatory specific sub-regions of DNA promoters and initiate transcription. Finding the exact location of these binding sites (aka motifs) is important in a variety of domains such as drug design and development. To address this need, several \textit{in vivo} and \textit{in vitro} techniques have been developed so far that try to characterize and predict the binding specificity of a protein to different DNA loci. The major problem with these techniques is that they are not accurate enough in prediction of the binding affinity and characterization of the corresponding motifs. As a result, downstream analysis is required to uncover the locations where proteins of interest bind. Here, we propose DeeperBind, a long short term recurrent convolutional network for prediction of protein binding specificities with respect to DNA probes. DeeperBind can model the positional dynamics of probe sequences and hence reckons with the contributions made by individual sub-regions in DNA sequences, in an effective way. Moreover, it can be trained and tested on datasets containing varying-length sequences. We apply our pipeline to the datasets derived from protein binding microarrays (PBMs), an in-vitro high-throughput technology for quantification of protein-DNA binding preferences, and present promising results. To the best of our knowledge, this is the most accurate pipeline that can predict binding specificities of DNA sequences from the data produced by high-throughput technologies through utilization of the power of deep learning for feature generation and positional dynamics modeling., Comment: in 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

Published
2016

13. A Multi-Modal Graph-Based Semi-Supervised Pipeline for Predicting Cancer Survival

Author

Hassanzadeh, Hamid Reza, Phan, John H., Wang, May D., Hassanzadeh, Hamid Reza, Phan, John H., and Wang, May D.

Abstract

Cancer survival prediction is an active area of research that can help prevent unnecessary therapies and improve patient's quality of life. Gene expression profiling is being widely used in cancer studies to discover informative biomarkers that aid predict different clinical endpoint prediction. We use multiple modalities of data derived from RNA deep-sequencing (RNA-seq) to predict survival of cancer patients. Despite the wealth of information available in expression profiles of cancer tumors, fulfilling the aforementioned objective remains a big challenge, for the most part, due to the paucity of data samples compared to the high dimension of the expression profiles. As such, analysis of transcriptomic data modalities calls for state-of-the-art big-data analytics techniques that can maximally use all the available data to discover the relevant information hidden within a significant amount of noise. In this paper, we propose a pipeline that predicts cancer patients' survival by exploiting the structure of the input (manifold learning) and by leveraging the unlabeled samples using Laplacian support vector machines, a graph-based semi supervised learning (GSSL) paradigm. We show that under certain circumstances, no single modality per se will result in the best accuracy and by fusing different models together via a stacked generalization strategy, we may boost the accuracy synergistically. We apply our approach to two cancer datasets and present promising results. We maintain that a similar pipeline can be used for predictive tasks where labeled samples are expensive to acquire., Comment: in 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

Published
2016

14. Comparison of RNA-seq and microarray-based models for clinical endpoint prediction

Author

Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, Fischer, Matthias, Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, and Fischer, Matthias

Abstract

Background: Gene expression profiling is being widely applied in cancer research to identify biomarkers for clinical endpoint prediction. Since RNA-seq provides a powerful tool for transcriptome-based applications beyond the limitations of microarrays, we sought to systematically evaluate the performance of RNA-seq-based and microarray-based classifiers in this MAQC-III/SEQC study for clinical endpoint prediction using neuroblastoma as a model. Results: We generate gene expression profiles from 498 primary neuroblastomas using both RNA-seq and 44 k microarrays. Characterization of the neuroblastoma transcriptome by RNA-seq reveals that more than 48,000 genes and 200,000 transcripts are being expressed in this malignancy. We also find that RNA-seq provides much more detailed information on specific transcript expression patterns in clinico-genetic neuroblastoma subgroups than microarrays. To systematically compare the power of RNA-seq and microarray-based models in predicting clinical endpoints, we divide the cohort randomly into training and validation sets and develop 360 predictive models on six clinical endpoints of varying predictability. Evaluation of factors potentially affecting model performances reveals that prediction accuracies are most strongly influenced by the nature of the clinical endpoint, whereas technological platforms (RNA-seq vs. microarrays), RNA-seq data analysis pipelines, and feature levels (gene vs. transcript vs. exon-junction level) do not significantly affect performances of the models. Conclusions: We demonstrate that RNA-seq outperforms microarrays in determining the transcriptomic characteristics of cancer, while RNA-seq and microarray-based models perform similarly in clinical endpoint prediction. Our findings may be valuable to guide future studies on the development of gene expression-based predictive models and their implementation in clinical practice.

Published
2015

15. Comparison of RNA-seq and microarray-based models for clinical endpoint prediction

Author

Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, Fischer, Matthias, Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, and Fischer, Matthias

Abstract

Background: Gene expression profiling is being widely applied in cancer research to identify biomarkers for clinical endpoint prediction. Since RNA-seq provides a powerful tool for transcriptome-based applications beyond the limitations of microarrays, we sought to systematically evaluate the performance of RNA-seq-based and microarray-based classifiers in this MAQC-III/SEQC study for clinical endpoint prediction using neuroblastoma as a model. Results: We generate gene expression profiles from 498 primary neuroblastomas using both RNA-seq and 44 k microarrays. Characterization of the neuroblastoma transcriptome by RNA-seq reveals that more than 48,000 genes and 200,000 transcripts are being expressed in this malignancy. We also find that RNA-seq provides much more detailed information on specific transcript expression patterns in clinico-genetic neuroblastoma subgroups than microarrays. To systematically compare the power of RNA-seq and microarray-based models in predicting clinical endpoints, we divide the cohort randomly into training and validation sets and develop 360 predictive models on six clinical endpoints of varying predictability. Evaluation of factors potentially affecting model performances reveals that prediction accuracies are most strongly influenced by the nature of the clinical endpoint, whereas technological platforms (RNA-seq vs. microarrays), RNA-seq data analysis pipelines, and feature levels (gene vs. transcript vs. exon-junction level) do not significantly affect performances of the models. Conclusions: We demonstrate that RNA-seq outperforms microarrays in determining the transcriptomic characteristics of cancer, while RNA-seq and microarray-based models perform similarly in clinical endpoint prediction. Our findings may be valuable to guide future studies on the development of gene expression-based predictive models and their implementation in clinical practice.

Published
2015

16. Comparison of RNA-seq and microarray-based models for clinical endpoint prediction

Author

Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, Fischer, Matthias, Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, and Fischer, Matthias

Published
2015

17. A Semi-Supervised Method for Predicting Cancer Survival Using Incomplete Clinical Data

Author

Hassanzadeh, Hamid Reza, Phan, John H., Wang, May D., Hassanzadeh, Hamid Reza, Phan, John H., and Wang, May D.

Abstract

Prediction of survival for cancer patients is an open area of research. However, many of these studies focus on datasets with a large number of patients. We present a novel method that is specifically designed to address the challenge of data scarcity, which is often the case for cancer datasets. Our method is able to use unlabeled data to improve classification by adopting a semi-supervised training approach to learn an ensemble classifier. The results of applying our method to three cancer datasets show the promise of semi-supervised learning for prediction of cancer survival.

Published
2015

18. Comparison of RNA-seq and microarray-based models for clinical endpoint prediction

Author

Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, Fischer, Matthias, Zhang, Wenqian, Yu, Ying, Hertwig, Falk, Thierry-Mieg, Jean, Zhang, Wenwei, Thierry-Mieg, Danielle, Wang, Jian, Furlanello, Cesare, Devanarayan, Viswanath, Cheng, Jie, Deng, Youping, Hero, Barbara, Hong, Huixiao, Jia, Meiwen, Li, Li, Lin, Simon M., Nikolsky, Yuri, Oberthuer, Andre, Qing, Tao, Su, Zhenqiang, Volland, Ruth, Wang, Charles, Wang, May D., Ai, Junmei, Albanese, Davide, Asgharzadeh, Shahab, Avigad, Smadar, Bao, Wenjun, Bessarabova, Marina, Brilliant, Murray H., Brors, Benedikt, Chierici, Marco, Chu, Tzu-Ming, Zhang, Jibin, Grundy, Richard G., He, Min Max, Hebbring, Scott, Kaufman, Howard L., Lababidi, Samir, Lancashire, Lee J., Li, Yan, Lu, Xin X., Luo, Heng, Ma, Xiwen, Ning, Baitang, Noguera, Rosa, Peifer, Martin, Phan, John H., Roels, Frederik, Rosswog, Carolina, Shao, Susan, Shen, Jie, Theissen, Jessica, Tonini, Gian Paolo, Vandesompele, Jo, Wu, Po-Yen, Xiao, Wenzhong, Xu, Joshua, Xu, Weihong, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Dong, Zirui, Zhang, Ke K., Yin, Ye, Zhao, Chen, Zheng, Yuanting, Wolfinger, Russell D., Shi, Tieliu, Malkas, Linda H., Berthold, Frank, Wang, Jun, Tong, Weida, Shi, Leming, Peng, Zhiyu, and Fischer, Matthias

Published
2015

19. A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium

Author

Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caiment, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., Shi, Leming, Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caiment, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., and Shi, Leming

Abstract

We present primary results from the Sequencing Quality Control (SEQC) project, coordinated by the US Food and Drug Administration. Examining Illumina HiSeq, Life Technologies SOLiD and Roche 454 platforms at multiple laboratory sites using reference RNA samples with built-in controls, we assess RNA sequencing (RNA-seq) performance for junction discovery and differential expression profiling and compare it to microarray and quantitative PCR (qPCR) data using complementary metrics. At all sequencing depths, we discover unannotated exon-exon junctions, with >80% validated by qPCR. We find that measurements of relative expression are accurate and reproducible across sites and platforms if specific-filters are used. In contrast, RNA-seq and microarrays do not provide accurate absolute measurements, and gene-specific biases are observed for all examined platforms, including qPCR. Measurement performance depends on the platform and data analysis pipeline, and variation is large for transcript-level profiling. The complete SEQC data sets, comprising >100 billion reads (10Tb), provide unique resources for evaluating RNA-seq analyses for clinical and regulatory settings.

Published
2014

20. A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium

Author

Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caiment, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., Shi, Leming, Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caiment, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., and Shi, Leming

Abstract

We present primary results from the Sequencing Quality Control (SEQC) project, coordinated by the US Food and Drug Administration. Examining Illumina HiSeq, Life Technologies SOLiD and Roche 454 platforms at multiple laboratory sites using reference RNA samples with built-in controls, we assess RNA sequencing (RNA-seq) performance for junction discovery and differential expression profiling and compare it to microarray and quantitative PCR (qPCR) data using complementary metrics. At all sequencing depths, we discover unannotated exon-exon junctions, with >80% validated by qPCR. We find that measurements of relative expression are accurate and reproducible across sites and platforms if specific-filters are used. In contrast, RNA-seq and microarrays do not provide accurate absolute measurements, and gene-specific biases are observed for all examined platforms, including qPCR. Measurement performance depends on the platform and data analysis pipeline, and variation is large for transcript-level profiling. The complete SEQC data sets, comprising >100 billion reads (10Tb), provide unique resources for evaluating RNA-seq analyses for clinical and regulatory settings.

Published
2014

21. A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium

Author

Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caimet, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., Shi, Leming, Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caimet, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., and Shi, Leming

Published
2014

22. A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium

Author

Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caimet, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., Shi, Leming, Su, Zhenqiang, Labaj, Pawel P., Li, Sheng, Thierry-Mieg, Jean, Thierry-Mieg, Danielle, Shi, Wei, Wang, Charles, Schroth, Gary P., Setterquist, Robert A., Thompson, John F., Jones, Wendell D., Xiao, Wenzhong, Xu, Weihong, Jensen, Roderick V., Kelly, Reagan, Xu, Joshua, Conesa, Ana, Furlanello, Cesare, Gao, Hanlin, Hong, Huixiao, Jafari, Nadereh, Letovsky, Stan, Liao, Yang, Lu, Fei, Oakeley, Edward J., Peng, Zhiyu, Praul, Craig A., Santoyo-Lopez, Javier, Scherer, Andreas, Shi, Tieliu, Smyth, Gordon K., Staedtler, Frank, Sykacek, Peter, Tan, Xin-Xing, Thompson, E. Aubrey, Vandesompele, Jo, Wang, May D., Wang, Jian, Wolfinger, Russell D., Zavadil, Jiri, Auerbach, Scott S., Bao, Wenjun, Binder, Hans, Blomquist, Thomas, Brilliant, Murray H., Bushel, Pierre R., Cain, Weimin, Catalano, Jennifer G., Chang, Ching-Wei, Chen, Tao, Chen, Geng, Chen, Rong, Chierici, Marco, Chu, Tzu-Ming, Clevert, Djork-Arne, Deng, Youping, Derti, Adnan, Devanarayan, Viswanath, Dong, Zirui, Dopazo, Joaquin, Du, Tingting, Fang, Hong, Fang, Yongxiang, Fasold, Mario, Fernandez, Anita, Fischer, Matthias, Furio-Tari, Pedro, Fuscoe, James C., Caimet, Florian, Gaj, Stan, Gandara, Jorge, Gao, Huan, Ge, Weigong, Gondo, Yoichi, Gong, Binsheng, Gong, Meihua, Gong, Zhuolin, Green, Bridgett, Guo, Chao, Guo, Lei, Guo, Li-Wu, Hadfield, James, Hellemans, Jan, Hochreiter, Sepp, Jia, Meiwen, Jian, Min, Johnson, Charles D., Kay, Suzanne, Kleinjans, Jos, Lababidi, Samir, Levy, Shawn, Li, Quan-Zhen, Li, Li, Li, Peng, Li, Yan, Li, Haiqing, Li, Jianying, Li, Shiyong, Lin, Simon M., Lopez, Francisco J., Lu, Xin, Luo, Heng, Ma, Xiwen, Meehan, Joseph, Megherbi, Dalila B., Mei, Nan, Mu, Bing, Ning, Baitang, Pandey, Akhilesh, Perez-Florido, Javier, Perkins, Roger G., Peters, Ryan, Phan, John H., Pirooznia, Mehdi, Qian, Feng, Qing, Tao, Rainbow, Lucille, Rocca-Serra, Philippe, Sambourg, Laure, Sansone, Susanna-Assunta, Schwartz, Scott, Shah, Ruchir, Shen, Jie, Smith, Todd M., Stegle, Oliver, Stralis-Pavese, Nancy, Stupka, Elia, Suzuki, Yutaka, Szkotnicki, Lee T., Tinning, Matthew, Tu, Bimeng, van Deft, Joost, Vela-Boza, Alicia, Venturini, Elisa, Walker, Stephen J., Wan, Liqing, Wang, Wei, Wang, Jinhui, Wang, Jun, Wieben, Eric D., Willey, James C., Wu, Po-Yen, Xuan, Jiekun, Yang, Yong, Ye, Zhan, Yin, Ye, Yu, Ying, Yuan, Yate-Ching, Zhang, John, Zhang, Ke K., Zhang, Wenqian, Zhang, Wenwei, Zhang, Yanyan, Zhao, Chen, Zheng, Yuanting, Zhou, Yiming, Zumbo, Paul, Tong, Weida, Kreil, David P., Mason, Christopher E., and Shi, Leming

Published
2014

23. The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models

Author

Shi, Leming, Campbell, Gregory, Jones, Wendell D, Campagne, Fabien, Wen, Zhining, Walker, Stephen J, Su, Zhenqiang, Chu, Tzu-Ming, Goodsaid, Federico M, Pusztai, Lajos, Shaughnessy, John D, Oberthuer, André, Thomas, Russell S, Paules, Richard S, Fielden, Mark, Barlogie, Bart, Chen, Weijie, Du, Pan, Fischer, Matthias, Furlanello, Cesare, Gallas, Brandon D, Ge, Xijin, Megherbi, Dalila B, Symmans, W Fraser, Wang, May D, Zhang, John, Bitter, Hans, Brors, Benedikt, Bushel, Pierre R, Bylesjö, Max, Chen, Minjun, Cheng, Jie, Cheng, Jing, Chou, Jeff, Davison, Timothy S, Delorenzi, Mauro, Deng, Youping, Devanarayan, Viswanath, Dix, David J, Dopazo, Joaquin, Dorff, Kevin C, Elloumi, Fathi, Fan, Jianqing, Fan, Shicai, Fan, Xiaohui, Fang, Hong, Gonzaludo, Nina, Hess, Kenneth R, Hong, Huixiao, Huan, Jun, Irizarry, Rafael A, Judson, Richard, Juraeva, Dilafruz, Lababidi, Samir, Lambert, Christophe G, Li, Li, Li, Yanen, Li, Zhen, Lin, Simon M, Liu, Guozhen, Lobenhofer, Edward K, Luo, Jun, Luo, Wen, McCall, Matthew N, Nikolsky, Yuri, Pennello, Gene A, Perkins, Roger G, Philip, Reena, Popovici, Vlad, Price, Nathan D, Qian, Feng, Scherer, Andreas, Shi, Tieliu, Shi, Weiwei, Sung, Jaeyun, Thierry-Mieg, Danielle, Thierry-Mieg, Jean, Thodima, Venkata, Trygg, Johan, Vishnuvajjala, Lakshmi, Wang, Sue Jane, Wu, Jianping, Wu, Yichao, Xie, Qian, Yousef, Waleed A, Zhang, Liang, Zhang, Xuegong, Zhong, Sheng, Zhou, Yiming, Zhu, Sheng, Arasappan, Dhivya, Bao, Wenjun, Lucas, Anne Bergstrom, Berthold, Frank, Brennan, Richard J, Buness, Andreas, Catalano, Jennifer G, Chang, Chang, Chen, Rong, Cheng, Yiyu, Cui, Jian, Czika, Wendy, Demichelis, Francesca, Deng, Xutao, Dosymbekov, Damir, Eils, Roland, Feng, Yang, Fostel, Jennifer, Fulmer-Smentek, Stephanie, Fuscoe, James C, Gatto, Laurent, Ge, Weigong, Goldstein, Darlene R, Guo, Li, Halbert, Donald N, Han, Jing, Harris, Stephen C, Hatzis, Christos, Herman, Damir, Huang, Jianping, Jensen, Roderick V, Jiang, Rui, Johnson, Charles D, Jurman, Giuseppe, Kahlert, Yvonne, Khuder, Sadik A, Kohl, Matthias, Li, Jianying, Li, Menglong, Li, Quan-Zhen, Li, Shao, Li, Zhiguang, Liu, Jie, Liu, Ying, Liu, Zhichao, Meng, Lu, Madera, Manuel, Martinez-Murillo, Francisco, Medina, Ignacio, Meehan, Joseph, Miclaus, Kelci, Moffitt, Richard A, Montaner, David, Mukherjee, Piali, Mulligan, George J, Neville, Padraic, Nikolskaya, Tatiana, Ning, Baitang, Page, Grier P, Parker, Joel, Parry, R Mitchell, Peng, Xuejun, Peterson, Ron L, Phan, John H, Quanz, Brian, Ren, Yi, Riccadonna, Samantha, Roter, Alan H, Samuelson, Frank W, Schumacher, Martin M, Shambaugh, Joseph D, Shi, Qiang, Shippy, Richard, Si, Shengzhu, Smalter, Aaron, Sotiriou, Christos, Soukup, Mat, Staedtler, Frank, Steiner, Guido, Stokes, Todd H, Sun, Qinglan, Tan, Pei-Yi, Tang, Rong, Tezak, Zivana, Thorn, Brett, Tsyganova, Marina, Turpaz, Yaron, Vega, Silvia C, Visintainer, Roberto, von Frese, Juergen, Wang, Charles, Wang, Eric, Wang, Junwei, Wang, Wei, Westermann, Frank, Willey, James C, Woods, Matthew, Wu, Shujian, Xiao, Nianqing, Xu, Joshua, Xu, Lei, Yang, Lun, Zeng, Xiao, Zhang, Jialu, Zhang, Li, Zhang, Min, Zhao, Chen, Puri, Raj K, Scherf, Uwe, Tong, Weida, Wolfinger, Russell D, Shi, Leming, Campbell, Gregory, Jones, Wendell D, Campagne, Fabien, Wen, Zhining, Walker, Stephen J, Su, Zhenqiang, Chu, Tzu-Ming, Goodsaid, Federico M, Pusztai, Lajos, Shaughnessy, John D, Oberthuer, André, Thomas, Russell S, Paules, Richard S, Fielden, Mark, Barlogie, Bart, Chen, Weijie, Du, Pan, Fischer, Matthias, Furlanello, Cesare, Gallas, Brandon D, Ge, Xijin, Megherbi, Dalila B, Symmans, W Fraser, Wang, May D, Zhang, John, Bitter, Hans, Brors, Benedikt, Bushel, Pierre R, Bylesjö, Max, Chen, Minjun, Cheng, Jie, Cheng, Jing, Chou, Jeff, Davison, Timothy S, Delorenzi, Mauro, Deng, Youping, Devanarayan, Viswanath, Dix, David J, Dopazo, Joaquin, Dorff, Kevin C, Elloumi, Fathi, Fan, Jianqing, Fan, Shicai, Fan, Xiaohui, Fang, Hong, Gonzaludo, Nina, Hess, Kenneth R, Hong, Huixiao, Huan, Jun, Irizarry, Rafael A, Judson, Richard, Juraeva, Dilafruz, Lababidi, Samir, Lambert, Christophe G, Li, Li, Li, Yanen, Li, Zhen, Lin, Simon M, Liu, Guozhen, Lobenhofer, Edward K, Luo, Jun, Luo, Wen, McCall, Matthew N, Nikolsky, Yuri, Pennello, Gene A, Perkins, Roger G, Philip, Reena, Popovici, Vlad, Price, Nathan D, Qian, Feng, Scherer, Andreas, Shi, Tieliu, Shi, Weiwei, Sung, Jaeyun, Thierry-Mieg, Danielle, Thierry-Mieg, Jean, Thodima, Venkata, Trygg, Johan, Vishnuvajjala, Lakshmi, Wang, Sue Jane, Wu, Jianping, Wu, Yichao, Xie, Qian, Yousef, Waleed A, Zhang, Liang, Zhang, Xuegong, Zhong, Sheng, Zhou, Yiming, Zhu, Sheng, Arasappan, Dhivya, Bao, Wenjun, Lucas, Anne Bergstrom, Berthold, Frank, Brennan, Richard J, Buness, Andreas, Catalano, Jennifer G, Chang, Chang, Chen, Rong, Cheng, Yiyu, Cui, Jian, Czika, Wendy, Demichelis, Francesca, Deng, Xutao, Dosymbekov, Damir, Eils, Roland, Feng, Yang, Fostel, Jennifer, Fulmer-Smentek, Stephanie, Fuscoe, James C, Gatto, Laurent, Ge, Weigong, Goldstein, Darlene R, Guo, Li, Halbert, Donald N, Han, Jing, Harris, Stephen C, Hatzis, Christos, Herman, Damir, Huang, Jianping, Jensen, Roderick V, Jiang, Rui, Johnson, Charles D, Jurman, Giuseppe, Kahlert, Yvonne, Khuder, Sadik A, Kohl, Matthias, Li, Jianying, Li, Menglong, Li, Quan-Zhen, Li, Shao, Li, Zhiguang, Liu, Jie, Liu, Ying, Liu, Zhichao, Meng, Lu, Madera, Manuel, Martinez-Murillo, Francisco, Medina, Ignacio, Meehan, Joseph, Miclaus, Kelci, Moffitt, Richard A, Montaner, David, Mukherjee, Piali, Mulligan, George J, Neville, Padraic, Nikolskaya, Tatiana, Ning, Baitang, Page, Grier P, Parker, Joel, Parry, R Mitchell, Peng, Xuejun, Peterson, Ron L, Phan, John H, Quanz, Brian, Ren, Yi, Riccadonna, Samantha, Roter, Alan H, Samuelson, Frank W, Schumacher, Martin M, Shambaugh, Joseph D, Shi, Qiang, Shippy, Richard, Si, Shengzhu, Smalter, Aaron, Sotiriou, Christos, Soukup, Mat, Staedtler, Frank, Steiner, Guido, Stokes, Todd H, Sun, Qinglan, Tan, Pei-Yi, Tang, Rong, Tezak, Zivana, Thorn, Brett, Tsyganova, Marina, Turpaz, Yaron, Vega, Silvia C, Visintainer, Roberto, von Frese, Juergen, Wang, Charles, Wang, Eric, Wang, Junwei, Wang, Wei, Westermann, Frank, Willey, James C, Woods, Matthew, Wu, Shujian, Xiao, Nianqing, Xu, Joshua, Xu, Lei, Yang, Lun, Zeng, Xiao, Zhang, Jialu, Zhang, Li, Zhang, Min, Zhao, Chen, Puri, Raj K, Scherf, Uwe, Tong, Weida, and Wolfinger, Russell D

Abstract

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.

Published
2010
Full Text
View/download PDF

24. The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models.

Author

DNAVision SA, Shi, Leming, Campbell, Gregory, Jones, Wendell D, Campagne, Fabien, Wen, Zhining, Walker, Stephen J, Su, Zhenqiang, Chu, Tzu-Ming, Goodsaid, Federico M, Pusztai, Lajos, Shaughnessy, John D, Oberthuer, André, Thomas, Russell S, Paules, Richard S, Fielden, Mark, Barlogie, Bart, Chen, Weijie, Du, Pan, Fischer, Matthias, Furlanello, Cesare, Gallas, Brandon D, Ge, Xijin, Megherbi, Dalila B, Symmans, W Fraser, Wang, May D, Zhang, John, Bitter, Hans, Brors, Benedikt, Bushel, Pierre R, Bylesjo, Max, Chen, Minjun, Cheng, Jie, Cheng, Jing, Chou, Jeff, Davison, Timothy S, Delorenzi, Mauro, Deng, Youping, Devanarayan, Viswanath, Dix, David J, Dopazo, Joaquin, Dorff, Kevin C, Elloumi, Fathi, Fan, Jianqing, Fan, Shicai, Fan, Xiaohui, Fang, Hong, Gonzaludo, Nina, Hess, Kenneth R, Hong, Huixiao, Huan, Jun, Irizarry, Rafael A, Judson, Richard, Juraeva, Dilafruz, Lababidi, Samir, Lambert, Christophe G, Li, Li, Li, Yanen, Li, Zhen, Lin, Simon M, Liu, Guozhen, Lobenhofer, Edward K, Luo, Jun, Luo, Wen, McCall, Matthew N, Nikolsky, Yuri, Pennello, Gene A, Perkins, Roger G, Philip, Reena, Popovici, Vlad, Price, Nathan D, Qian, Feng, Scherer, Andreas, Shi, Tieliu, Shi, Weiwei, Sung, Jaeyun, Thierry-Mieg, Danielle, Thierry-Mieg, Jean, Thodima, Venkata, Trygg, Johan, Vishnuvajjala, Lakshmi, Wang, Sue Jane, Wu, Jianping, Wu, Yichao, Xie, Qian, Yousef, Waleed A, Zhang, Liang, Zhang, Xuegong, Zhong, Sheng, Zhou, Yiming, Zhu, Sheng, Arasappan, Dhivya, Bao, Wenjun, Lucas, Anne Bergstrom, Berthold, Frank, Brennan, Richard J, Buness, Andreas, Catalano, Jennifer G, Chang, Chang, Chen, Rong, Cheng, Yiyu, Cui, Jian, Czika, Wendy, Demichelis, Francesca, Deng, Xutao, Dosymbekov, Damir, Eils, Roland, Feng, Yang, Fostel, Jennifer, Fulmer-Smentek, Stephanie, Fuscoe, James C, Gatto, Laurent, Ge, Weigong, Goldstein, Darlene R, Guo, Li, Halbert, Donald N, Han, Jing, Harris, Stephen C, Hatzis, Christos, Herman, Damir, Huang, Jianping, Jensen, Roderick V, Jiang, Rui, Johnson, Charles D, Jurman, Giuseppe, Kahlert, Yvonne, Khuder, Sadik A, Kohl, Matthias, Li, Jianying, Li, Menglong, Li, Quan-Zhen, Li, Shao, Li, Zhiguang, Liu, Jie, Liu, Ying, Liu, Zhichao, Meng, Lu, Madera, Manuel, Martinez-Murillo, Francisco, Medina, Ignacio, Meehan, Joseph, Miclaus, Kelci, Moffitt, Richard A, Montaner, David, Mukherjee, Piali, Mulligan, George J, Neville, Padraic, Nikolskaya, Tatiana, Ning, Baitang, Page, Grier P, Parker, Joel, Parry, R Mitchell, Peng, Xuejun, Peterson, Ron L, Phan, John H, Quanz, Brian, Ren, Yi, Riccadonna, Samantha, Roter, Alan H, Samuelson, Frank W, Schumacher, Martin M, Shambaugh, Joseph D, Shi, Qiang, Shippy, Richard, Si, Shengzhu, Smalter, Aaron, Sotiriou, Christos, Soukup, Mat, Staedtler, Frank, Steiner, Guido, Stokes, Todd H, Sun, Qinglan, Tan, Pei-Yi, Tang, Rong, Tezak, Zivana, Thorn, Brett, Tsyganova, Marina, Turpaz, Yaron, Vega, Silvia C, Visintainer, Roberto, von Frese, Juergen, Wang, Charles, Wang, Eric, Wang, Junwei, Wang, Wei, Westermann, Frank, Willey, James C, Woods, Matthew, Wu, Shujian, Xiao, Nianqing, Xu, Joshua, Xu, Lei, Yang, Lun, Zeng, Xiao, Zhang, Jialu, Zhang, Li, Zhang, Min, Zhao, Chen, Puri, Raj K, Scherf, Uwe, Tong, Weida, Wolfinger, Russell D, MAQC Consortium, DNAVision SA, Shi, Leming, Campbell, Gregory, Jones, Wendell D, Campagne, Fabien, Wen, Zhining, Walker, Stephen J, Su, Zhenqiang, Chu, Tzu-Ming, Goodsaid, Federico M, Pusztai, Lajos, Shaughnessy, John D, Oberthuer, André, Thomas, Russell S, Paules, Richard S, Fielden, Mark, Barlogie, Bart, Chen, Weijie, Du, Pan, Fischer, Matthias, Furlanello, Cesare, Gallas, Brandon D, Ge, Xijin, Megherbi, Dalila B, Symmans, W Fraser, Wang, May D, Zhang, John, Bitter, Hans, Brors, Benedikt, Bushel, Pierre R, Bylesjo, Max, Chen, Minjun, Cheng, Jie, Cheng, Jing, Chou, Jeff, Davison, Timothy S, Delorenzi, Mauro, Deng, Youping, Devanarayan, Viswanath, Dix, David J, Dopazo, Joaquin, Dorff, Kevin C, Elloumi, Fathi, Fan, Jianqing, Fan, Shicai, Fan, Xiaohui, Fang, Hong, Gonzaludo, Nina, Hess, Kenneth R, Hong, Huixiao, Huan, Jun, Irizarry, Rafael A, Judson, Richard, Juraeva, Dilafruz, Lababidi, Samir, Lambert, Christophe G, Li, Li, Li, Yanen, Li, Zhen, Lin, Simon M, Liu, Guozhen, Lobenhofer, Edward K, Luo, Jun, Luo, Wen, McCall, Matthew N, Nikolsky, Yuri, Pennello, Gene A, Perkins, Roger G, Philip, Reena, Popovici, Vlad, Price, Nathan D, Qian, Feng, Scherer, Andreas, Shi, Tieliu, Shi, Weiwei, Sung, Jaeyun, Thierry-Mieg, Danielle, Thierry-Mieg, Jean, Thodima, Venkata, Trygg, Johan, Vishnuvajjala, Lakshmi, Wang, Sue Jane, Wu, Jianping, Wu, Yichao, Xie, Qian, Yousef, Waleed A, Zhang, Liang, Zhang, Xuegong, Zhong, Sheng, Zhou, Yiming, Zhu, Sheng, Arasappan, Dhivya, Bao, Wenjun, Lucas, Anne Bergstrom, Berthold, Frank, Brennan, Richard J, Buness, Andreas, Catalano, Jennifer G, Chang, Chang, Chen, Rong, Cheng, Yiyu, Cui, Jian, Czika, Wendy, Demichelis, Francesca, Deng, Xutao, Dosymbekov, Damir, Eils, Roland, Feng, Yang, Fostel, Jennifer, Fulmer-Smentek, Stephanie, Fuscoe, James C, Gatto, Laurent, Ge, Weigong, Goldstein, Darlene R, Guo, Li, Halbert, Donald N, Han, Jing, Harris, Stephen C, Hatzis, Christos, Herman, Damir, Huang, Jianping, Jensen, Roderick V, Jiang, Rui, Johnson, Charles D, Jurman, Giuseppe, Kahlert, Yvonne, Khuder, Sadik A, Kohl, Matthias, Li, Jianying, Li, Menglong, Li, Quan-Zhen, Li, Shao, Li, Zhiguang, Liu, Jie, Liu, Ying, Liu, Zhichao, Meng, Lu, Madera, Manuel, Martinez-Murillo, Francisco, Medina, Ignacio, Meehan, Joseph, Miclaus, Kelci, Moffitt, Richard A, Montaner, David, Mukherjee, Piali, Mulligan, George J, Neville, Padraic, Nikolskaya, Tatiana, Ning, Baitang, Page, Grier P, Parker, Joel, Parry, R Mitchell, Peng, Xuejun, Peterson, Ron L, Phan, John H, Quanz, Brian, Ren, Yi, Riccadonna, Samantha, Roter, Alan H, Samuelson, Frank W, Schumacher, Martin M, Shambaugh, Joseph D, Shi, Qiang, Shippy, Richard, Si, Shengzhu, Smalter, Aaron, Sotiriou, Christos, Soukup, Mat, Staedtler, Frank, Steiner, Guido, Stokes, Todd H, Sun, Qinglan, Tan, Pei-Yi, Tang, Rong, Tezak, Zivana, Thorn, Brett, Tsyganova, Marina, Turpaz, Yaron, Vega, Silvia C, Visintainer, Roberto, von Frese, Juergen, Wang, Charles, Wang, Eric, Wang, Junwei, Wang, Wei, Westermann, Frank, Willey, James C, Woods, Matthew, Wu, Shujian, Xiao, Nianqing, Xu, Joshua, Xu, Lei, Yang, Lun, Zeng, Xiao, Zhang, Jialu, Zhang, Li, Zhang, Min, Zhao, Chen, Puri, Raj K, Scherf, Uwe, Tong, Weida, Wolfinger, Russell D, and MAQC Consortium

Abstract

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.

Published
2010

Catalog

Books, media, physical & digital resources
See catalog results