Machine Learning

, Volume 92, Issue 2, pp 457–477

On using nearly-independent feature families for high precision and confidence

Article

DOI: 10.1007/s10994-013-5377-0

Cite this article as:
Madani, O., Georg, M. & Ross, D. Mach Learn (2013) 92: 457. doi:10.1007/s10994-013-5377-0

Abstract

Consider learning tasks where the precision requirement is very high, for example a 99 % precision requirement for a video classification application. We report that when very different sources of evidence such as text, audio, and video features are available, combining the outputs of base classifiers trained on each feature type separately, aka late fusion, can substantially increase the recall of the combination at high precisions, compared to the performance of a single classifier trained on all the feature types, i.e., early fusion, or compared to the individual base classifiers. We show how the probability of a joint false-positive mistake can be less—in some cases significantly less—than the product of individual probabilities of conditional false-positive mistakes (a NoisyOR combination). Our analysis highlights a simple key criterion for this boosted precision phenomenon and justifies referring to such feature families as (nearly) independent. We assess the relevant factors for achieving high precision empirically, and explore combination techniques informed by the analysis.

Keywords

Classifier combination Independent features High precision Late fusion Early fusion Ensembles Multiple views Supervised learning 

Copyright information

© The Author(s) 2013

Authors and Affiliations

  1. 1.Google Inc.Mountain ViewUSA

Personalised recommendations