Abstract
Researchers in the field of Pattern Recognition (PR) have traditionally presumed the availability of a representative set of data drawn from the classes of interest, say ω 1 and ω 2 in a 2-class problem. These samples are typically utilized in the development of the system’s discriminant function. It is, however, widely recognized that there exists a particularly challenging class of PR problems for which a representative set is not available for the second class, which has motivated a great deal of research into the so-called domain of One Class (OC) classification. In this paper, we extend the frontiers of novelty detection by the introduction of a new field of problems open for analysis. In particular, we note that this new realm deviates from the standard set of OC problems based on the presence of three characteristics, which ultimately amplify the classification challenge. They involve the temporal nature of the appearance of the data, the fact that the data from the classes are “interwoven”, and that a labelling procedure is not merely impractical - it is almost, by definition, impossible. As a first attempt to tackle these problems, we present two specialized classification strategies denoted by Scenarios S1 and S2 respectively. In Scenarios S1, the data is such that standard binary and one-class classifiers can be applied. Alternatively, in Scenarios S2, the labelling challenge prevents the application of binary classifiers, and instead dictates the novel application of one-class classifiers. The validity of these scenarios has been demonstrated for the exemplary domain involving the Comprehensive Nuclear Test-Ban-Treaty (CTBT), for which our research endeavour has also developed a simulation model. As far as we know, our research in this field is of a pioneering sort, and the results presented here are novel.
The first author is also an Adjunct Professor with the University of Agder in Grimstad, Norway. Both the authors are grateful for the partial support provided by NSERC, the Natural Sciences and Engineering Research Council of Canada. A preliminary version of this paper was presented at ACIIDS’11, the 2011 Asian Conference on Intelligent Information and Database Systems, in Daegu, Korea, in April 2011.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aha, D.W.: Generalizing from case studies: A case study. In: Proceedings of the Ninth International Conference on Machine Learning, pp. 1–10 (1992)
Bellinger, C.: Modelling and Classifying Stochastically Episodic Events. Master’s thesis, Carleton University, Ottawa, Ontario (2010)
Bellinger, C., Oommen, B.J.: On simulating episodic events against a background of noise-like non-episodic events. In: Proceedings of 42nd Summer Computer Simulation Conference, SCSC 2010, Ottawa, Canada, July 11-14 (2010)
Bishop, C.M.: Novelty detection and neural network validation. IEEE Proceedings-Vision Image and Signal Processing 141(4), 217–222 (1994)
Bishop, C.M.: Neural networks for pattern recognition. Oxford University Press, Walton Street (1995)
Chen, Y., Zhou, X., Huang, T.S.: One-class svm for learning in image retrieval. In: IEEE International Conference on Image Processing, pp. 34–37 (2001)
Datta, P.: Characteristic concept representations. Ph.D. thesis, Irvine, CA, USA (1997)
Dietterich, T.G., Lathrop, R.H., Lozano-Pérez, T.: Solving the multiple instance problem with axis-parallel rectangles. Artificial Intelligence 89(1-2), 31–71 (1997)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2001)
Ghosh, A.K., Schwartzbard, A., Schatz, M.: Learning program behavior profiles for intrusion detection. In: Proceedings of the Workshop on Intrusion Detection and Network Monitoring, vol. 1, pp. 51–62 (1999)
Hanson, S.J., Kegl, J.: PARSNIP: A connectionist network that learns natural language grammar from exposure to natural language sentences. In: Ninth Annual Conference of the Cognitive Science Society, pp. 106–119 (1987)
Hempstalk, K., Frank, E., Witten, I.H.: One-Class Classification by Combining Density and Class Probability Estimation. In: Daelemans, W., Goethals, B., Morik, K. (eds.) ECML PKDD 2008, Part I. LNCS (LNAI), vol. 5211, pp. 505–519. Springer, Heidelberg (2008)
Horton, P., Nakai, K.: Better prediction of protein cellular localization sites with the k nearest neighbors classifier. In: International Conference on Intelligent Systems for Molecular Biology, vol. 5, pp. 147–152 (1997)
Japkowicz, N.: Concept-Learning in the Absence of Counter-Examples: An Autoassociation-Based Approach to Classication. Ph.D. thesis, Rutgers University (1999)
Kowalczyk, A., Raskutti, B.: One class SVM for yeast regulation prediction. SIGKDD Explorations Newsletter 4(2), 99–100 (2002)
Kubat, M., Holte, R.C., Matwin, S.: Machine learning for the detection of oil spills in satellite radarimages. Machine Learning 30(2), 195–215 (1998)
Manevitz, L.M., Yousef, M.: One-class svms for document classification. Journal Machine Learning Research 2, 139–154 (2002)
Mitchell, T.: Machine learning. McGraw-Hill (1997)
Parzen, E.: On estimation of a probability density function and mode. The Annals of Mathematical Statistics 33(3), 1065–1076 (1962), http://www.jstor.org/stable/2237880
Petsche, T., Marcantonio, A., Darken, C., Hanson, S.J., Kuhn, G.M., Santoso, I.: A neural network autoassociator for induction motor failure prediction. Advances in Neural Information Processing Systems, 924–930 (1996)
Ritter, G., Gallegos, M.T.: Outliers in statistical pattern recognition and an application to automatic chromosome classification. Pattern Recognition Letters 18(6), 525–539 (1997)
Roberts, S., Tarassenko, L.: A probabilistic resource allocating network for novelty detection. Neural Computation 6(2), 270–284 (1994), http://www.mitpressjournals.org/doi/abs/10.1162/neco.1994.6.2.270
Roberts, S.J.: Novelty detection using extreme value statistics. IEE Proceedings - Vision, Image, and Signal Processing 146(3), 124–129 (1999), http://link.aip.org/link/?IVI/146/124/1
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation, pp. 318–362 (1986)
Saey, P.R.J., Bowyer, T.W., Ringbom, A.: Isotopic noble gas signatures released from medical isotope production facilities – Simulation and measurements. Applied Radiation and Isotpes (2010)
Saey, P.R.: The influence of radiopharmaceutical isotope production on the global radioxenon background. Journal of Environmental Radioactivity 100(5), 396–406 (2009), http://www.sciencedirect.com/science/article/B6VB2-4VP1CRK-1/2/ac5135ae3e61e80e9145e24cf1405efd
Schölkopf, B., Platt, J.C., Shawe-Taylor, J., Smola, A.J., Williamson, R.C.: Estimating the support of a high-dimensional distribution. Neural Computation 13(7), 1443–1471 (2001)
Schölkopf, B., Williamson, R.C., Smola, A.J., Shawe-Taylor, J., Platt, J.: Support vector method for novelty detection. Advances in Neural Information Processing Systems, 12, 582–588 (2000)
Stocki, T.J., Japkowicz, N., Li, G., Ungar, R.K., Hoffman, I., Yi, J.: Summary of the data mining contest for the IEEE International Conference on Data Mining, Pisa, Italy (2008)
Tarassenko, L., Hayton, P., Cerneaz, N., Brady, M.: Novelty detection for the identification of masses in mammograms. IEE Conference Publications 1995(CP409), 442–447 (1995), http://link.aip.org/link/abstract/IEECPS/v1995/iCP409/p442/s1
Tax, D.M.J.: One-class classification; Concept-learning in the absence of counter-examples. Ph.D. thesis, Technische Universiteit Delft, Netherlands (2001)
Witten, I.H., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann Publishers (2005)
Yeung, D., Chow, C.: Parzen-window network intrusion detectors. In: International Conference on Pattern Recognition, vol. 4, p. 40385 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Bellinger, C., Oommen, B.J. (2012). On the Pattern Recognition and Classification of Stochastically Episodic Events. In: Nguyen, N.T. (eds) Transactions on Computational Collective Intelligence VI. Lecture Notes in Computer Science, vol 7190. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29356-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-29356-6_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29355-9
Online ISBN: 978-3-642-29356-6
eBook Packages: Computer ScienceComputer Science (R0)