UPM Institutional Repository

Corpus-based analysis on cross-domain experiments in classification-and-ranking generation


Citation

Aida, Mustapha and Sulaiman, Md. Nasir and Mahmod, Ramlan and Selamat, Mohd. Hasan (2010) Corpus-based analysis on cross-domain experiments in classification-and-ranking generation. Journal of Computer Science, 6 (11). pp. 1305-1312. ISSN 1549-3636

Abstract

Problem statement: Overgeneration-and-ranking architecture works well in written language where sentence is the basic unit. However, in spoken language where utterance is the basic unit, the disadvantage becomes critical as spoken language also render intentions, hence short strings may be of equivalent impact. Approach: In classification-and-ranking, response was deliberately chosen from dialogue corpus rather than wholly generated, such that it allows short ungrammatical utterances as long as they satisfy the intended meaning of input utterance. Because the architecture is intention-based, it adopted an open-domain knowledge representation, whereby response utterances were semantically represented using some ontology general enough for future reuse in another domain. Results: This study presented corpus-based analysis on cross-domain experimentation using different type of corpus to validate the consistency of the response classifier that delimits the searching space for ranking. The open-domain quality for classification-an-ranking architecture was tested on two mixed-initiative, transaction dialogue corpus in theater reservation and emergency planning. Results showed consistent distribution accuracies in both classification and ranking experiment, indicating that the approach is viable for cross-domain implementations. Conclusion: The ability of a response generation system to directly learn response utterances from the domain corpus suggested the possibility to build a dialogue system by feeding the learning module with a target corpus and the system learned the response behavior directly from the training corpus.


Download File

[img]
Preview
PDF (Abstract)
Corpus.pdf

Download (85kB) | Preview

Additional Metadata

Item Type: Article
Subject: Computational linguistics.
Subject: Natural language processing (Computer science).
Divisions: Faculty of Computer Science and Information Technology
DOI Number: https://doi.org/10.3844/jcssp.2011.59.64
Publisher: Science Publications
Keywords: Corpus-based; Open-domain; Natural language generation; Dialogue systems
Depositing User: Umikalthom Abdullah
Date Deposited: 04 Apr 2012 03:10
Last Modified: 28 Oct 2015 04:36
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.3844/jcssp.2011.59.64
URI: http://psasir.upm.edu.my/id/eprint/13804
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item