Journal
KNOWLEDGE-BASED SYSTEMS
Volume 142, Issue -, Pages 149-159Publisher
ELSEVIER
DOI: 10.1016/j.knosys.2017.11.033
Keywords
Human-computer conversation system; Human-robot interaction; Text matching; Natural language processing; Artificial intelligence
Categories
Funding
- National Natural Science Foundation of China [61672081, U1636211, 61370126]
- Beijing Advanced Innovation Center for Imaging Technology [BAICIT-2016001]
- National High Technology Research and Development Program of China [2015AA016004]
Ask authors/readers for more resources
This paper studies response selection for human-computer conversation systems. Existing retrieval based human-computer conversation systems are intended to reply to user utterances based on existing utterance-response pairs. However, collecting sufficient utterance-response pairs is intractable in practical situations, especially for many specific domains. We introduce DocChat a novel information retrieval approach for human-computer conversation systems that can use unstructured documents rather than semi-structured utterance-response pairs, to react to user utterances. The key of DocChat is a learning to rank model with features designed at various levels of granularity which is proposed to quantify the relevance between utterances and responses directly. We conduct comprehensive experiments on both sentence selection and real human-computer conversation scenarios. Empirical studies of sentence selection datasets shows reasonable improvements and the strong adaptability of our model. We compare DocChat with Xiaoice, a famous open domain chitchat engine in China. Side-by-side evaluation shows that DocChat is a good complement for human-computer conversation systems using utterance-response pairs as the primary source of responses. Furthermore, we release a large scale open-domain dataset for sentence selection which contains 304,413 query-sentence pairs. (C) 2017 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available