Bayes Vector Quantizer for Class-Imbalance Problem

TitleBayes Vector Quantizer for Class-Imbalance Problem
Publication TypeBook Chapter
Year of Publication2009
AuthorsDiamantini C, Potena, D
Book TitleIEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
Edition21(5)
Pagination638 - 651
Publisher IEEE / INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS INCORPORATED:445 HOES LANE:PISCATAWAY, NJ 08854:(800)701-4333, (732)981-0060, EMAIL: SUBSCRIPTION-SERVICE@IEEE.ORG, INTERNET: HTTP://WWW.IEEE.ORG, FAX: (732)981-9667
AbstractThe class-imbalance problem is the problem of learning a classification rule from data that are skewed in favor of one class. On these datasets traditional learning techniques tend to overlook the less numerous class, at the advantage of the majority class. However, the minority class is often the most interesting one for the task at hand. For this reason, the class-imbalance problem has received increasing attention in the last few years. In the present paper we point the attention of the reader to a learning algorithm for the minimization of the average misclassification risk. In contrast to some popular class-imbalance learning methods, this method has its roots in statistical decision theory. A particular interesting characteristic is that when class distributions are unknown, the method can work by resorting to stochastic gradient algorithm. We study the behavior of this algorithm on imbalanced datasets, demonstrating that this principled approach allows to obtain better classification performances compared to the principal methods proposed in the literature.