On the Pattern Recognition and Classification of Stochastically Episodic Events

  • Colin Bellinger
  • B. John Oommen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7190)


Researchers in the field of Pattern Recognition (PR) have traditionally presumed the availability of a representative set of data drawn from the classes of interest, say ω 1 and ω 2 in a 2-class problem. These samples are typically utilized in the development of the system’s discriminant function. It is, however, widely recognized that there exists a particularly challenging class of PR problems for which a representative set is not available for the second class, which has motivated a great deal of research into the so-called domain of One Class (OC) classification. In this paper, we extend the frontiers of novelty detection by the introduction of a new field of problems open for analysis. In particular, we note that this new realm deviates from the standard set of OC problems based on the presence of three characteristics, which ultimately amplify the classification challenge. They involve the temporal nature of the appearance of the data, the fact that the data from the classes are “interwoven”, and that a labelling procedure is not merely impractical - it is almost, by definition, impossible. As a first attempt to tackle these problems, we present two specialized classification strategies denoted by Scenarios S1 and S2 respectively. In Scenarios S1, the data is such that standard binary and one-class classifiers can be applied. Alternatively, in Scenarios S2, the labelling challenge prevents the application of binary classifiers, and instead dictates the novel application of one-class classifiers. The validity of these scenarios has been demonstrated for the exemplary domain involving the Comprehensive Nuclear Test-Ban-Treaty (CTBT), for which our research endeavour has also developed a simulation model. As far as we know, our research in this field is of a pioneering sort, and the results presented here are novel.


Pattern Recognition Rare Events Stochastic Events Erroneous Data 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aha, D.W.: Generalizing from case studies: A case study. In: Proceedings of the Ninth International Conference on Machine Learning, pp. 1–10 (1992)Google Scholar
  2. 2.
    Bellinger, C.: Modelling and Classifying Stochastically Episodic Events. Master’s thesis, Carleton University, Ottawa, Ontario (2010)Google Scholar
  3. 3.
    Bellinger, C., Oommen, B.J.: On simulating episodic events against a background of noise-like non-episodic events. In: Proceedings of 42nd Summer Computer Simulation Conference, SCSC 2010, Ottawa, Canada, July 11-14 (2010)Google Scholar
  4. 4.
    Bishop, C.M.: Novelty detection and neural network validation. IEEE Proceedings-Vision Image and Signal Processing 141(4), 217–222 (1994)CrossRefGoogle Scholar
  5. 5.
    Bishop, C.M.: Neural networks for pattern recognition. Oxford University Press, Walton Street (1995)Google Scholar
  6. 6.
    Chen, Y., Zhou, X., Huang, T.S.: One-class svm for learning in image retrieval. In: IEEE International Conference on Image Processing, pp. 34–37 (2001)Google Scholar
  7. 7.
    Datta, P.: Characteristic concept representations. Ph.D. thesis, Irvine, CA, USA (1997)Google Scholar
  8. 8.
    Dietterich, T.G., Lathrop, R.H., Lozano-Pérez, T.: Solving the multiple instance problem with axis-parallel rectangles. Artificial Intelligence 89(1-2), 31–71 (1997)zbMATHCrossRefGoogle Scholar
  9. 9.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2001)zbMATHGoogle Scholar
  10. 10.
    Ghosh, A.K., Schwartzbard, A., Schatz, M.: Learning program behavior profiles for intrusion detection. In: Proceedings of the Workshop on Intrusion Detection and Network Monitoring, vol. 1, pp. 51–62 (1999)Google Scholar
  11. 11.
    Hanson, S.J., Kegl, J.: PARSNIP: A connectionist network that learns natural language grammar from exposure to natural language sentences. In: Ninth Annual Conference of the Cognitive Science Society, pp. 106–119 (1987)Google Scholar
  12. 12.
    Hempstalk, K., Frank, E., Witten, I.H.: One-Class Classification by Combining Density and Class Probability Estimation. In: Daelemans, W., Goethals, B., Morik, K. (eds.) ECML PKDD 2008, Part I. LNCS (LNAI), vol. 5211, pp. 505–519. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  13. 13.
    Horton, P., Nakai, K.: Better prediction of protein cellular localization sites with the k nearest neighbors classifier. In: International Conference on Intelligent Systems for Molecular Biology, vol. 5, pp. 147–152 (1997)Google Scholar
  14. 14.
    Japkowicz, N.: Concept-Learning in the Absence of Counter-Examples: An Autoassociation-Based Approach to Classication. Ph.D. thesis, Rutgers University (1999)Google Scholar
  15. 15.
    Kowalczyk, A., Raskutti, B.: One class SVM for yeast regulation prediction. SIGKDD Explorations Newsletter 4(2), 99–100 (2002)CrossRefGoogle Scholar
  16. 16.
    Kubat, M., Holte, R.C., Matwin, S.: Machine learning for the detection of oil spills in satellite radarimages. Machine Learning 30(2), 195–215 (1998)CrossRefGoogle Scholar
  17. 17.
    Manevitz, L.M., Yousef, M.: One-class svms for document classification. Journal Machine Learning Research 2, 139–154 (2002)zbMATHGoogle Scholar
  18. 18.
    Mitchell, T.: Machine learning. McGraw-Hill (1997)Google Scholar
  19. 19.
    Parzen, E.: On estimation of a probability density function and mode. The Annals of Mathematical Statistics 33(3), 1065–1076 (1962), zbMATHCrossRefMathSciNetGoogle Scholar
  20. 20.
    Petsche, T., Marcantonio, A., Darken, C., Hanson, S.J., Kuhn, G.M., Santoso, I.: A neural network autoassociator for induction motor failure prediction. Advances in Neural Information Processing Systems, 924–930 (1996)Google Scholar
  21. 21.
    Ritter, G., Gallegos, M.T.: Outliers in statistical pattern recognition and an application to automatic chromosome classification. Pattern Recognition Letters 18(6), 525–539 (1997)CrossRefGoogle Scholar
  22. 22.
    Roberts, S., Tarassenko, L.: A probabilistic resource allocating network for novelty detection. Neural Computation 6(2), 270–284 (1994), CrossRefGoogle Scholar
  23. 23.
    Roberts, S.J.: Novelty detection using extreme value statistics. IEE Proceedings - Vision, Image, and Signal Processing 146(3), 124–129 (1999), CrossRefGoogle Scholar
  24. 24.
    Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation, pp. 318–362 (1986)Google Scholar
  25. 25.
    Saey, P.R.J., Bowyer, T.W., Ringbom, A.: Isotopic noble gas signatures released from medical isotope production facilities – Simulation and measurements. Applied Radiation and Isotpes (2010)Google Scholar
  26. 26.
    Saey, P.R.: The influence of radiopharmaceutical isotope production on the global radioxenon background. Journal of Environmental Radioactivity 100(5), 396–406 (2009), CrossRefGoogle Scholar
  27. 27.
    Schölkopf, B., Platt, J.C., Shawe-Taylor, J., Smola, A.J., Williamson, R.C.: Estimating the support of a high-dimensional distribution. Neural Computation 13(7), 1443–1471 (2001)zbMATHCrossRefGoogle Scholar
  28. 28.
    Schölkopf, B., Williamson, R.C., Smola, A.J., Shawe-Taylor, J., Platt, J.: Support vector method for novelty detection. Advances in Neural Information Processing Systems, 12, 582–588 (2000)Google Scholar
  29. 29.
    Stocki, T.J., Japkowicz, N., Li, G., Ungar, R.K., Hoffman, I., Yi, J.: Summary of the data mining contest for the IEEE International Conference on Data Mining, Pisa, Italy (2008)Google Scholar
  30. 30.
    Tarassenko, L., Hayton, P., Cerneaz, N., Brady, M.: Novelty detection for the identification of masses in mammograms. IEE Conference Publications 1995(CP409), 442–447 (1995),
  31. 31.
    Tax, D.M.J.: One-class classification; Concept-learning in the absence of counter-examples. Ph.D. thesis, Technische Universiteit Delft, Netherlands (2001)Google Scholar
  32. 32.
    Witten, I.H., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd edn. Morgan Kaufmann Publishers (2005)Google Scholar
  33. 33.
    Yeung, D., Chow, C.: Parzen-window network intrusion detectors. In: International Conference on Pattern Recognition, vol. 4, p. 40385 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Colin Bellinger
    • 1
  • B. John Oommen
    • 2
  1. 1.The School of Information Technology and EngineeringUniversity of OttawaOttawaCanada
  2. 2.IEEE and IAPR School of Computer ScienceCarleton UniversityOttawaCanada

Personalised recommendations