1. Formalized Generalization Bounds for Perceptron-Like Algorithms
- Author
-
Kelby, Robin J.
- Subjects
- Computer Science, Artificial Intelligence, Kernel Perceptron, Budget Kernel Perceptron, Software Verification, Coq, Machine learning, Generalization error
- Abstract
Machine learning algorithms are integrated into many aspects of daily life. However, research into the correctness and security of these important algorithms has lagged behind experimental results and improvements. My research seeks to add to our theretical understanding of the Perceptron family of algorithms, which includes the Kernel Perceptron, Budget Kernel Perceptron, and Description Kernel Perceptron algorithms. In this thesis, I will describe three variants of the Kernel Perceptron algorithm and provide both proof and performance results for verified implementations of these algorithms written in the Coq Proof Assistant. This research employs generalization error, which bounds how poorly a model may perform on unseen testing data, as a guarantee of performance with proofs verified in Coq. These implementations are also extracted to the functional language Haskell to evaluate their generalization error and performance results on real and synthetic data sets.
- Published
- 2020