Feng_CMU-CS-21-120.pdf (16.15 MB)
Download file

Human-efficient Discovery of Edge-based Training Data for Visual Machine Learning

Download (16.15 MB)
posted on 04.05.2022, 18:56 by Ziqiang FengZiqiang Feng

Deep learning enables effective computer vision without hand crafting feature extractors. It has great potential if applied to specialized domains such as ecology, military, and medical science. However, the laborious task of creating labeled training sets of rare targets is a major deterrent to achieving its goal. A domain expert’s time and attention is precious. We address this problem by designing, implementing, and evaluating Eureka, a system for human-efficient discovery of rare phenomena from unlabeled visual data. Eureka’s central idea is interactive contentbased

search of visual data based on early-discard and machine learning. We first demonstrate its effectiveness for curating training sets of rare objects. By analyzing contributing factors to human efficiency, we identify and evaluate important systemlevel optimizations that utilize edge computing and intelligent storage. Lastly, we extend Eureka to the task of discovering temporal events from video data.




Degree Type



Computer Science

Degree Name

  • Doctor of Philosophy (PhD)


Mahadev Satyanarayanan

Usage metrics