1. Distributed mining of time-faded heavy hitters
- Author
-
Italo Epicoco, Marco Pulimeno, Massimo Cafaro, Pulimeno, Marco, Epicoco, Italo, and Cafaro, Massimo
- Subjects
FOS: Computer and information sciences ,Information Systems and Management ,Correctness ,Computer science ,Computer Science Applications ,Theoretical Computer Science ,Computer Science - Distributed, Parallel, and Cluster Computing ,Artificial Intelligence ,Control and Systems Engineering ,Simple (abstract algebra) ,Distributed algorithm ,Computer Science - Data Structures and Algorithms ,Convergence (routing) ,Scalability ,Data Structures and Algorithms (cs.DS) ,Distributed, Parallel, and Cluster Computing (cs.DC) ,Gossip protocol ,Computer Science::Data Structures and Algorithms ,Algorithm ,Software ,Sequential algorithm - Abstract
We present \textsc{P2PTFHH} (Peer--to--Peer Time--Faded Heavy Hitters) which, to the best of our knowledge, is the first distributed algorithm for mining time--faded heavy hitters on unstructured P2P networks. \textsc{P2PTFHH} is based on the \textsc{FDCMSS} (Forward Decay Count--Min Space-Saving) sequential algorithm, and efficiently exploits an averaging gossip protocol, by merging in each interaction the involved peers' underlying data structures. We formally prove the convergence and correctness properties of our distributed algorithm and show that it is fast and simple to implement. Extensive experimental results confirm that \textsc{P2PTFHH} retains the extreme accuracy and error bound provided by \textsc{FDCMSS} whilst showing excellent scalability. Our contributions are three-fold: (i) we prove that the averaging gossip protocol can be used jointly with our augmented sketch data structure for mining time--faded heavy hitters; (ii) we prove the error bounds on frequency estimation; (iii) we experimentally prove that \textsc{P2PTFHH} is extremely accurate and fast, allowing near real time processing of large datasets., arXiv admin note: text overlap with arXiv:1806.06580
- Published
- 2021
- Full Text
- View/download PDF