SmartNotes: Implicit Labeling of Meeting Data through User Note–Taking and Browsing

We have built SmartNotes, a system with two goals: first to help users take multi–media notes during meetings and browse those notes afterwards, and second to acquire labeled data from users’ interactions with the system with which to later improve the performance of components that perform automatic meeting understanding. SmartNotes consists of a stand–alone laptop based note taking system, and a web based note retrieval system. We shall demonstrate both systems, and will also show the kinds of labeled data that get created during typical meetings and browsing sessions.