Learning Weights in Discrimination Functions using a priori Constraints

Abstract

We introduce a learning algorithm for the weights in a very common class of discrimination functions usually cailed “weighted average”. Different submodules are produced by some feature extraction and are weighted according to their significance for the actual discrimination task. The learning algorithm can reduce the number of free variables by simple but effective a prion criteria about significant features. We apply our algorithm to three different tasks all concerned with face recognition: a 40 dimensional and an 1800 dimensional problem in face discrimination, and a 42 dimensional problem in pose estimation. For the first and second task, the same weights are applied to the discrimination of all classes; for the third problem, a metric for every class is learned. For all tasks significant improvements could be achieved. In the third task the performance was increased from 80% to 90%. The idea of our algorithm is so general that it can be applied to improve a large number of existing pattern recognition systems.

Supported by grants from the German Federal Ministry for Science and Technology (413-5839-01 IN 101 B9) and from the US Army Research Lab (01/93/K-0109).