1. Deterministic bridge regression for compressive classification.
- Author
-
Toh, Kar-Ann, Molteni, Giuseppe, and Lin, Zhiping
- Subjects
- *
ARTIFICIAL intelligence , *PROBLEM solving - Abstract
Pattern classification using a compact representation is a crucial component of machine intelligence. Specifically, it is essential to learn a model with well-regulated parameters to achieve good generalization. Bridge regression provides a mechanism for regulating parameters through a penalized ℓ p -norm. However, due to the nonlinear nature of the formulation, an iterative numerical search is typically used to solve the optimization problem. In this work, we propose an analytic solution for bridge regression based on solving a penalized error formulation using an approximated ℓ p -norm. The solution is presented in primal form for over-determined systems and in dual form for under-determined systems. The primal form is suitable for low-dimensional problems with a large number of data samples, while the dual form is suitable for high-dimensional problems with a small number of data samples. We also extend the solution to problems with multiple classification outputs. Numerical studies using simulated and real-world data demonstrate the effectiveness of our proposed solution. • An analytic solution for bridge regression has been derived for overdetermined and under-determined systems. • The solution in dual form can be useful for few-shots learning when data is scarce. • The analytic solution in primal and dual forms are extended to solve problems with multiple outputs. • An algorithm that packs the two analytic solutions for multiple outputs has been constructed. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF