10.1184/R1/6625592.v1 Jaime G. Carbonell Jaime G. Carbonell Requirements for Robust Natural Language Interfaces: The XCALIBUR and LanguageCraft Experiences Carnegie Mellon University 1986 Software Research 1986-01-01 00:00:00 Journal contribution https://kilthub.cmu.edu/articles/journal_contribution/Requirements_for_Robust_Natural_Language_Interfaces_The_XCALIBUR_and_LanguageCraft_Experiences/6625592 <p>Natural Language interfaces to data bases and expert systems require the integration of several crucial capabilities in order to be judged <em>habitable </em>by their end users and <em>productive </em>by the developers of applications. User habitability is measured in terms of linguistic coverage, robustness of behavior and speed of response, whereas implementer productivity is measured by the amount of effort required to connect the interface to a new application, to develop its syntactic and semantic grammar, and to test and test and debug the resultant system assuring a certain level of performance• These latter criteria have not been addressed directly by natural language researchers in pure laboratory settings, with the exception of user-defined extensions to an existing interface (e.g., NanoKLAUS [4], vex [6]). But, in order to amortize the cost of developing practical, robust and efficient interfaces over multiple applications, the implementer productivity requirements are as important as user habitability. We treat each set of criteria in turn, drawing from our experience in XCALIBUR [2] and in LanguageCraft TM [5], a commercially available environment and run time module for rapid development of domain-oriented natural language interfaces, f In our discussion we distill the general lessons accrued from several years of experience using these systems, and conducting several small-scale user studies.</p>