The Spoken Dialog Challenge 2010

Comparing different spoken dialog systems of the same task

As the field of spoken dialog system research matures, the time has come to directly compare systems on similar tasks. The goal of the Spoken Dialog Challenge is to help the community to understand the differences between systems and techniques when they are compared under controlled conditions on a controlled task. Many variables can affect spoken dialog system performance, so it is hard to properly evaluate a wide variety of techniques. For this reason, we have created a common task that affords realistic comparison.

The Task

For the first year of the challenge, the task is to build a telephone-based spoken dialog system that provides bus schedule information for the City of Pittsburgh, PA (USA). This task is chosen because there is already a substantial existing collection of example dialogs in the domain. The task is also relatively simple and well-defined and will not require massive effort to support it in various dialog platforms. The third reason for choosing this domain is because there is an existing and significantly large real user group that we can use as part of the evaluation of the participant systems.

Call for Participation

Spoken Dialog Challenge wiki is available for discussion.

Timeline

For more details please contact Alan W Black

Organizing Committee:

Page last modified: 2009.10.15 12:04:36 EDT