Optimizing Lexical and Ngram Coverage via Judicious Use of Linguistic Data
Any type of content formally published in an academic journal, usually following a peer-review process.
I study the effect of various types and amounts of North American Business language data on the quality of the derived vocabulary, and use my ﬁndings to derive an improved ranking of the words, using only 19% of the NAB corpus. I then study the conﬂicting effects of increased vocabulary size on a speech recognizer’s accuracy, and use the result to pick an optimal vocabulary size. A similar analysis of ngram coverage yields a very different outcome, with the best system being the one based on the most data.