Machine Learning in Subject Classification

Abstract

This paper describes the application of Machine Learning (ML) techniques to the problem of Information Retrieval. Specifically, it presents a system which incorporates machine learning techniques in determining the subject(s) of a piece of text. This system is part of a much larger information management system which provides software support for the creation, management and querying of very large information bases. The information stored in these information bases is typically technical manuals, technical reports or other full-text documents. This paper gives a brief description of the overall system, followed by an overview of Machine Learning and a summary of a number of ML systems. We then describe the classification algorithm used in the system. Finally, the learning module, which will be incorporated into the classification algorithm, is described.