Back to Search
Start Over
Deep Learning-Based Bloom Filter for Efficient Multi-key Membership Testing
- Source :
- Data Science and Engineering, Vol 8, Iss 3, Pp 234-246 (2023)
- Publication Year :
- 2023
- Publisher :
- SpringerOpen, 2023.
-
Abstract
- Abstract Multi-key membership testing plays a crucial role in computing systems and networking applications, encompassing web search, mail systems, distributed databases, firewalls, and network routing. Traditional approaches, such as the Bloom filter, encounter limitations within this specific context. Addressing these challenges, we propose the Multi-key Learned Bloom Filter (MLBF), a hybrid method that combines machine learning techniques with the Bloom filter. The MLBF introduces a value-interaction-based multi-key classifier and a multi-key Bloom filter. Furthermore, we introduce an Interval-based MLBF approach, which categorizes keys into specific intervals based on data distribution to minimize the False Positive Rate (FPR). Additionally, MLBF incorporates an out-of-distribution (OOD) detection component to identify data shifts. Through extensive experimental evaluations on three authentic datasets, we demonstrate the superiority of the proposed MLBF in terms of FPR and query efficiency.
Details
- Language :
- English
- ISSN :
- 23641185 and 23641541
- Volume :
- 8
- Issue :
- 3
- Database :
- Directory of Open Access Journals
- Journal :
- Data Science and Engineering
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.621649f2408b460aa9f3fbac2ce821fa
- Document Type :
- article
- Full Text :
- https://doi.org/10.1007/s41019-023-00224-9