1. A practical streaming approximate matrix multiplication algorithm
- Author
-
Kumudha Raimond and Deena P. Francis
- Subjects
Approximate matrix multiply ,Frequent directions ,General Computer Science ,Concept drift ,Deterministic algorithm ,Computer science ,Parallelism ,020207 software engineering ,0102 computer and information sciences ,02 engineering and technology ,QA75.5-76.95 ,Streaming ,01 natural sciences ,Matrix multiplication ,Running time ,Big data ,010201 computation theory & mathematics ,Large matrices ,Electronic computers. Computer science ,0202 electrical engineering, electronic engineering, information engineering ,Matrix sketching ,Performance improvement ,Invariant (mathematics) ,Streaming algorithm ,Algorithm - Abstract
Approximate Matrix Multiplication (AMM) has emerged as a useful and computationally inexpensive substitute for actual multiplication of large matrices. Randomized as well as deterministic solutions to AMM were provided in the past. The latest work provides a deterministic algorithm that solves AMM more accurately than the other works. It is a streaming algorithm that is both fast and accurate. But, it is less robust to noise and is also liable to have less than optimal performance in the presence of concept drift in the input matrices. We propose an algorithm that is more accurate, robust to noise, invariant to concept drift in the data, while having almost the same running time as the state-of-the-art algorithm. We also prove that theoretical guarantees exist for the proposed algorithm. An empirical performance improvement of up to 90 % is obtained over the previous algorithm. We also propose a general framework for parallelizing the proposed algorithm. The two parallelized versions of the algorithm achieve up to 1.9 x and 3.6 x speedups over the original version of the proposed algorithm.
- Published
- 2022