1. Epistatic Net allows the sparse spectral regularization of deep neural networks for inferring fitness functions
- Author
-
Yijie Huang, Kannan Ramchandran, Hunter M. Nisonoff, Orhan Ocal, Amirali Aghazadeh, David H. Brookes, O. Ozan Koyluoglu, and Jennifer Listgarten
- Subjects
Fitness landscape ,Computer science ,Science ,Green Fluorescent Proteins ,General Physics and Astronomy ,Protein function predictions ,Overfitting ,Regularization (mathematics) ,Article ,General Biochemistry, Genetics and Molecular Biology ,Sequence space ,03 medical and health sciences ,0302 clinical medicine ,Machine learning ,Prior probability ,030304 developmental biology ,0303 health sciences ,Multidisciplinary ,Bacteria ,Inductive bias ,business.industry ,Pattern recognition ,General Chemistry ,Coding theory ,Applied mathematics ,Neural Networks, Computer ,Artificial intelligence ,Computational problem ,business ,Algorithms ,030217 neurology & neurosurgery - Abstract
Despite recent advances in high-throughput combinatorial mutagenesis assays, the number of labeled sequences available to predict molecular functions has remained small for the vastness of the sequence space combined with the ruggedness of many fitness functions. While deep neural networks (DNNs) can capture high-order epistatic interactions among the mutational sites, they tend to overfit to the small number of labeled sequences available for training. Here, we developed Epistatic Net (EN), a method for spectral regularization of DNNs that exploits evidence that epistatic interactions in many fitness functions are sparse. We built a scalable extension of EN, usable for larger sequences, which enables spectral regularization using fast sparse recovery algorithms informed by coding theory. Results on several biological landscapes show that EN consistently improves the prediction accuracy of DNNs and enables them to outperform competing models which assume other priors. EN estimates the higher-order epistatic interactions of DNNs trained on massive sequence spaces-a computational problem that otherwise takes years to solve., Finding a biologically-relevant inductive bias for training DNNs on large fitness landscapes is challenging. Here, the authors propose a method called Epistatic Net that improves DNN prediction accuracy and interpretation speed by integrating the knowledge that higher-order epistatic interactions are usually sparse.
- Published
- 2021