file.pdf (42.25 kB)
Download file

Optimizing Lexical and Ngram Coverage via Judicious Use of Linguistic Data

Download (42.25 kB)
journal contribution
posted on 01.01.1989, 00:00 by Roni Rosenfeld

I study the effect of various types and amounts of North American Business language data on the quality of the derived vocabulary, and use my findings to derive an improved ranking of the words, using only 19% of the NAB corpus. I then study the conflicting effects of increased vocabulary size on a speech recognizer’s accuracy, and use the result to pick an optimal vocabulary size. A similar analysis of ngram coverage yields a very different outcome, with the best system being the one based on the most data.


Publisher Statement

All Rights Reserved



Usage metrics