Title | Hard or Soft Classification? Large-margin Unified Machines. |
Publication Type | Journal Article |
Year of Publication | 2011 |
Authors | Liu, Yufeng, Hao Helen Zhang, and Yichao Wu |
Journal | J Am Stat Assoc |
Volume | 106 |
Issue | 493 |
Pagination | 166-177 |
Date Published | 2011 Mar 01 |
ISSN | 0162-1459 |
Abstract | Margin-based classifiers have been popular in both machine learning and statistics for classification problems. Among numerous classifiers, some are hard classifiers while some are soft ones. Soft classifiers explicitly estimate the class conditional probabilities and then perform classification based on estimated probabilities. In contrast, hard classifiers directly target on the classification decision boundary without producing the probability estimation. These two types of classifiers are based on different philosophies and each has its own merits. In this paper, we propose a novel family of large-margin classifiers, namely large-margin unified machines (LUMs), which covers a broad range of margin-based classifiers including both hard and soft ones. By offering a natural bridge from soft to hard classification, the LUM provides a unified algorithm to fit various classifiers and hence a convenient platform to compare hard and soft classification. Both theoretical consistency and numerical performance of LUMs are explored. Our numerical study sheds some light on the choice between hard and soft classifiers in various classification problems. |
DOI | 10.1198/jasa.2011.tm10319 |
Alternate Journal | J Am Stat Assoc |
Original Publication | Hard or soft classification? Large-margin unified machines. |
PubMed ID | 22162896 |
PubMed Central ID | PMC3233196 |
Grant List | P01 CA142538-01 / CA / NCI NIH HHS / United States R01 CA085848 / CA / NCI NIH HHS / United States R01 CA149569-02 / CA / NCI NIH HHS / United States R01 CA149569 / CA / NCI NIH HHS / United States P01 CA142538 / CA / NCI NIH HHS / United States R01 CA085848-11 / CA / NCI NIH HHS / United States |
Hard or Soft Classification? Large-margin Unified Machines.
Project: