Skip to main content

Combining Recurrent Neural Networks and Support Vector Machines for Structural Pattern Recognition

  • Conference paper
KI 2004: Advances in Artificial Intelligence (KI 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3238))

Included in the following conference series:

  • 1201 Accesses

Abstract

We apply support vector learning to attributed graphs where the kernel matrices are based on approximations of the Schur-Hadamard (SH) inner product by means of recurrent neural networks. We present and discuss experimental results of different classifiers constructed by a SVM operating on positive semi-definite (psd) and non-psd kernel matrices.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cumby, C., Roth, D.: On kernel methods for relational learning. In: Fawcett, T., Mishra, N. (eds.) Proceedings of the Twentieth International Conference on Machine Learning, pp. 107–115. AAAI Press, Menlo Park (2003)

    Google Scholar 

  2. Debnath, A.K., de Compadre, L., Debnath, G., Shusterman, A.J., Hansch, C.: Structure-activity relationship of mutagenic aromatic and heteroaromatic nitro compounds. Correlation with molecular orbital energies and hydrophobicity. J. Med. Chem. 34, 786–797 (1991)

    Google Scholar 

  3. Gärtner, T.: A survey of kernels for structured data. SIGKDD Explorations 5(2), 49–58 (2003)

    Article  Google Scholar 

  4. Gärtner, T., Flach, P.A., Wrobel, S.: On graph kernels: Hardness results and efficient alternatives. In: Proceedings of the 16th Annual Conference on Computational Learning Theory and the 7th Kernel Workshop (2003) (to appear)

    Google Scholar 

  5. Geibel, P., Wysotzki, F.: Learning relational concepts with decision trees. In: Saitta, L. (ed.) Machine Learning: Proceedings of the Thirteenth International Conference, pp. 166–174. Morgan Kaufmann Publishers, San Fransisco (1996)

    Google Scholar 

  6. Graepel, T., Herbrich, R., Bollmann-Sdorra, P., Obermayer, K.: Classification on pairwise proximity data. Advances in Neural Information Processing Systems 11, 438–444 (1999)

    Google Scholar 

  7. Haasdonk, B., Keysers, D.: Tangent distance kernels for support vector machines. In: ICPR 2002, International Conference on Pattern Recognition, vol. II, pp. 864–868 (2002)

    Google Scholar 

  8. Hopfield, J.J., Tank, D.W.: Neural computation of decisions in optimization problems. Biological Cybernetics 52, 141–152 (1985)

    MATH  MathSciNet  Google Scholar 

  9. Jain, B.J., Wysotzki, F.: Perceptron learning in the domain of graphs. In: Proc. of the International Joint Conference on Neural Networks, IJCNN 2003 (2003)

    Google Scholar 

  10. Jain, B.J., Wysotzki, F.: Central clustering of attributed graphs. Machine Learning Journal. Special Issue: Theoretical Advances in Data Clustering 56(1-3), 169–207 (2004)

    MATH  Google Scholar 

  11. Jain, B.J., Wysotzki, F.: In: Verleysen, M. (ed.) Proc. of the 12th European Symposium on Artificial Neural Networks, ESANN 2004, D-Facto, Brussels, pp. 331–336 (2004)

    Google Scholar 

  12. Jain, B.J., Wysotzki, F.: Multi-layer perceptron learning in the domain of attributed graphs. In: Proceedings of the International Joint Conference on Neural Networks IJCNN 2004. Accepted for publication (2004)

    Google Scholar 

  13. Jain, B.J., Wysotzki, F.: Structural perceptrons for attributed graphs. In: Joint IAPR International Workshops on Structural and Syntactical Pattern Recognition and Statistical Pattern Recognition. Accepted for publication (2004)

    Google Scholar 

  14. Joachims, T.: Learning to Classify Text using Support Vector Machines: Machines, Theory and Algorithms. Kluwer Academic Publishers, Boston (2002)

    Google Scholar 

  15. Kashima, H., Tsuda, K., Inokuchi, A.: Marginalized kernels between labeled graphs. In: Fawcett, T., Mishra, N. (eds.) Proceedings of the Twentieth International Conference on Machine Learning, pp. 321–328. AAAI Press, Menlo Park (2003)

    Google Scholar 

  16. LeCun, Y.: The MNIST Database of Handwritten Digits. NEC Research Institute, Princeton, NJ (2003), http://yann.lecun.com/exdb/mnist/

  17. Schoelkopf, B., Smola, A.J.: Learning with Kernels. The MIT Press, Cambridge (2002)

    Google Scholar 

  18. Srinivasan, A., Muggleton, S., Sternberg, M.J.E., King, R.D.: Theories for mutagenicity: A study in first-order and feature-based induction. Artificial Intelligence 85(1,2), 227–299 (1996)

    Google Scholar 

  19. Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1995)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jain, B.J., Geibel, P., Wysotzki, F. (2004). Combining Recurrent Neural Networks and Support Vector Machines for Structural Pattern Recognition. In: Biundo, S., Frühwirth, T., Palm, G. (eds) KI 2004: Advances in Artificial Intelligence. KI 2004. Lecture Notes in Computer Science(), vol 3238. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30221-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30221-6_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23166-0

  • Online ISBN: 978-3-540-30221-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics