Back to Search Start Over

Dynamic Index Construction with Deep Reinforcement Learning.

Authors :
Wu, Sai
Li, Ying
Zhu, Haoqi
Zhao, Junbo
Chen, Gang
Source :
Data Science & Engineering; Jun2022, Vol. 7 Issue 2, p87-101, 15p
Publication Year :
2022

Abstract

Thanks to the rapid advances in artificial intelligence, a brand new venue for database performance optimization is through deep neural networks and the reinforcement learning paradigm. Alongside the long literature in this regime, an iconic and crucial problem is the index structure building. For this problem, the prior works have largely adopted a pure learning-based solution replacing the traditional methods such as a B-tree and Hashing. While this line of research has drawn much attention in the field, they ubiquitously abandon the semantic guarantees and also suffer from performance loss in certain scenarios. In this work, we propose the Neural Index Search (NIS) framework. The core to this framework is to train a search policy to find a near optimal combination plan over the existing index structures, together with the required configuration parameters associated with each index structure in the plan. We argue that compared against the pure learning approaches, NIS enjoys the advantages brought by the chosen conventional index structures and further robustly enhances the performance from any singular index structure. Extensive empirical results demonstrate that our framework achieves state-of-the-art performances on several benchmarks. [ABSTRACT FROM AUTHOR]

Subjects

Subjects :
ARTIFICIAL intelligence

Details

Language :
English
ISSN :
23641185
Volume :
7
Issue :
2
Database :
Complementary Index
Journal :
Data Science & Engineering
Publication Type :
Academic Journal
Accession number :
156839586
Full Text :
https://doi.org/10.1007/s41019-022-00186-4