Back to Search
Start Over
Attention-Based CNN-BLSTM Networks for Joint Intent Detection and Slot Filling
- Source :
- Lecture Notes in Computer Science ISBN: 9783030017156, CCL
- Publication Year :
- 2018
- Publisher :
- Springer International Publishing, 2018.
-
Abstract
- Dialogue intent detection and semantic slot filling are two critical tasks in nature language understanding (NLU) for task-oriented dialog systems. In this paper, we present an attention-based encoder-decoder neural network model for joint intent detection and slot filling, which encodes sentence representation with a hybrid Convolutional Neural Networks and Bidirectional Long Short-Term Memory Networks (CNN-BLSTM), and decodes it with an attention-based recurrent neural network with aligned inputs. In the encoding process, our model firstly extracts higher-level phrase representations and local features from each utterance using convolutional neural network, and then propagates historical contextual semantic information with a bidirectional long short-term memory network layer architecture. Accordingly, we could obtain sentence representation by merging the two architectures mentioned above. In the decoding process, we introduce attention mechanism in long short-term memory networks that can provide additional sematic information. We conduct experiment on dialogue intent detection and slot filling tasks with standard data set Airline Travel Information System (ATIS). Experimental results manifest that our proposed model can achieve better overall performance.
- Subjects :
- Phrase
Artificial neural network
Process (engineering)
Computer science
Speech recognition
02 engineering and technology
Convolutional neural network
03 medical and health sciences
0302 clinical medicine
Recurrent neural network
Encoding (memory)
030221 ophthalmology & optometry
0202 electrical engineering, electronic engineering, information engineering
Information system
020201 artificial intelligence & image processing
Sentence
Subjects
Details
- ISBN :
- 978-3-030-01715-6
- ISBNs :
- 9783030017156
- Database :
- OpenAIRE
- Journal :
- Lecture Notes in Computer Science ISBN: 9783030017156, CCL
- Accession number :
- edsair.doi...........34e6d7595b0d2708b49ad960dcf317b9