Abstract
The use of speech as a biometric gives limited accuracy in the problems of speaker recognition and verification. The need of better recognition scores has resulted in the fusion of speech with other biometric modalities. This chapter discusses the fusion of speech with face which gives a high recognition score at the same time making the system convenient to be used for the user. We discuss three distinct ways to carry out this fusion. The first method is by directly mixing the attributes. This method has problems of excessive dimensionality of the resultant system. Hence many attributes from both modalities need to be deleted. The other method we discuss is the application of modular neural networks with division of attributes. In this technique the various attributes are divided between the various modules. The results are combined by an integrator. The last method is the use of clustering based division of input space by the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Campbell, J.P.: Speaker Recognition: A Tutorial. Proc. IEEE 85(9), 1437–1462 (1997)
Card, S.K., Mackinlay, J.D., Robertson, G.G.: A morphological analysis of the design space of input devices. ACM Trans. Inform. Syst. 9(2), 99–122 (1991)
Er, M.J., Wu, S., Lu, J., Toh, H.L.: Face Recognition with Radial Basis Function(RBF) Neural Networks. IEEE Trans. on Neural Nets 13(3), 697–710 (1999)
Farrell, K.R., Mammone, R.J., Assaleh, K.T.: Speaker Recognition using Neural Networks and Conventional Classifiers. IEEE Trans. Speech Audio. Process. 2(1), 194–205 (1994)
Fierrez-Aguilar, J., Ortega-Garcia, J., Garcia-Romero, D., Gonzalez-Rodriguez, J.: A Comparative Evaluation of Fusion Strategies for Multimodal Biometric Verification. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688. Springer, Heidelberg (2003)
Fox, N., Cohn, J.F., Gross, R., Reilly, R.B.: Person Identification Using Automatic Integration of Speech, Lip, and Face Experts. In: Proc. ACM 2003 Multimedia Biometrics Methods and Applications Workshop, WBMA, pp. 25–32 (2003)
Huang, S.Y., Hwang, C.R. (2005) Kernel fisher’s discriminant analysis in gaussian reproducing kernel hilbert space. Technical report, Institute of Statistical Science, Academia Sinica, Taiwan (2005)
Jain, A.K.: Biometric Recognition:How do I know who you are? In: Kalviainen, H., Parkkinen, J., Kaarna, A. (eds.) SCIA 2005. LNCS, vol. 3540, pp. 1–5. Springer, Heidelberg (2005)
Jain, A.K., Hong, L., Kulkarni, Y.: A Multimodal Biometric System using Fingerprint, Face and Speech. In: Proc. of Second Int. Conf. on AVBPA, March 1999, pp. 182–187 (1999)
Jollife, I.T.: Principle Component Analysis. Springer, USA (2002)
Kala, R., Shukla, A., Tiwari, R.: Fuzzy Neuro Systems for Machine Learning for Large Data Sets. In: Proc. of the IEEE Intl. Advance Comput. Conf., pp. 541-545, Patiala, India (2009)
Kala, R., Vazirani, H., Shukla, A., Tiwari, R.: Fusion of Speech and Face by Enhanced Modular Neural Network. In: Proc. of the Intl. Conf. on Info. Syst., Technol. and Manag., ICISTM 2010, pp. 363–372, Bankok, Thailand (2010)
Kumar, R., Ranjan, R., Singh, S.K., Kala, R., Shukla, A., Tiwari, R.: Multilingual Speaker Recognition Using Neural Network. In: Proc. of the Frontiers of Res. on Speech and Music, FRSM 2009, Gwalior, India, pp. 1–8 (2009)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Face Recognition Using LDA-Based Algorithms. IEEE Trans. Neural Networks 14(1), 195–200 (2003)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognition Lett. 26(2), 181–191 (2005)
Mammone, R.J., Zhang, X., Ramachandran, R.P.: Robust Speaker Recognition. IEEE Signal Process. Mag. 13, 58–71 (1996)
Martin, A., Przybocki, M.: The NIST 1999 Speaker Recognition Evaluation - An Overview. Digital Signal Process 10(1), 1–18 (2000)
Naik, J.M.: Speaker Verification: A Review. IEEE Comm. Mag. 28(1), 42–48 (1990)
Phillips, P.J., et al.: Overview of the Face Recognition Grand Challenge. In: Proc. of the 2005 IEEE Conf. on Compu. Vision and Pattern Recog., CVPR 2005, vol. 1, pp. 947–954 (2005)
Rabiner, L., Juang, B.H.: Fundamentals of Speech Recognition. Prentice Hall International, Englewood Cliffs (1993)
Reynolds, D.A.: An Overview of Automatic Speaker Recognition Technology. In: Proc. of the IEEE Intl. Conf. Acoustics, Speech, and Signal Process (2002)
Rose, R.C., Hofstetter, E.M., Reynolds, D.A.: Integrated Models of Signal and Background with Applications to Speaker Authentication in Noise. IEEE Trans. Speech Audio Process. 2(2), 245–257 (1994)
Ross, A., Jain, A.: Information fusion in biometrics. Pattern Recognition Lett. archive, 2115–2125 (2003)
Shukla, A., Tiwari, R.: Fusion of face and speech features with ANN for speaker authentication. IETE Tech. Rev. 4(5), 359–368 (2007)
Shukla, A., Tiwari, R.: A Novel Approach Of Speaker authentication By Fusion of Speech and Image Feature using ANN. Intl. J. Info. Comm. Technol. 1(2), 159–170 (2008)
Shukla, A., et al.: Intelligent Biometric System using PCA and R-LDA. In: Proc. IEEE Intl. Global Cong. on Intel. Syst., Xiamen, China (2009a)
Shukla, A., et al.: Face Recognition using morphological method. In: Proc. of the IEEE Intel. Advance Comput. Conf., Patiala, India (2009b)
Shukla, A., et al.: Face Recognition based on PCA, R-LDA and Supervised Neural networks. Intl. J. of Engg. Res. Ind. Appl. 2(3), 243–255 (2009c)
Li, S.: A Tutorial on Principle Component Analysis (2002), http://www.cs.otago.ac.nz/cosc453/student_tutorials/principal_components.pdf
Snelick, R.: Large-Scale Evaluation of Multimodal Biometric Authentication Using State-of-the-Art Systems. IEEE Trans. Pattern Analysis and Machine Intell. 27(3), 450–455 (2005)
Turk, M.A., Pentland, A.P.: Face Recognition Using Eigenfaces. In: IEEE Conf. on Comput. Vision and Pattern Recog., pp. 586–591 (1991)
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Shukla, A., Tiwari, R., Kala, R. (2010). Fusion Methods in Biometrics. In: Towards Hybrid and Adaptive Computing. Studies in Computational Intelligence, vol 307. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14344-1_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-14344-1_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14343-4
Online ISBN: 978-3-642-14344-1
eBook Packages: EngineeringEngineering (R0)