Carnegie Mellon University
Browse
- No file added yet -

Prior-Free Rare Category Detection

Download (402.18 kB)
journal contribution
posted on 2009-04-01, 00:00 authored by Jingrui He, Jaime G. Carbonell

Rare category detection is an open challenge in machine learning. It plays the central role in applications such as detecting new ¯nancial fraud patterns, detecting new network malware, and scienti¯c discovery. In such cases rare categories are hidden among huge volumes of normal data and observations. In this paper, we propose a new method for rare category detection named SEDER, which requires no prior information about the data set. It implicitly performs semiparametric density estimation using specially designed exponentially families, and then picks the examples for labeling where the neighborhood density changes the most. SEDER can work in the cases where the data is not separable. Its unique feature over all existing methods lies in its prior-free nature, i.e. it does not require any prior information about the data set (e.g. the number of classes, the proportion of the di®erent classes, etc.). Therefore, it is more suitable for real applications. Experimental results on both synthetic and real data sets demonstrate the superiority of SEDER.

History

Publisher Statement

Copyright SIAM

Date

2009-04-01

Usage metrics

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC