Carnegie Mellon University
Browse

A Principled Approach for Rejection Threshold Optimization in Spoken Dialog Systems

Download (68.44 kB)
journal contribution
posted on 2003-01-01, 00:00 authored by Dan Bohus, Alexander RudnickyAlexander Rudnicky

A common design pattern in spoken dialog systems is to reject an input when the recognition confidence score falls below a preset rejection threshold.  However, this introduces a potentially non-optimal tradeoff between various types of errors such as misunderstandings and false rejections. In this paper, we propose a data-driven method for determining the relative costs of these errors, and then use these costs to optimize state-specific rejection thresholds. We illustrate the use of this approach with data from a spoken dialog system that handles conference room reservations. The results obtained confirm our intuitions about the costs of the errors, and are consistent with anecdotal evidence gathered throughout the use of the system.

History

Publisher Statement

All Rights Reserved

Date

2003-01-01

Usage metrics

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC