Optimization of Score-Level Biometric Data Fusion by Constraint Construction Training

  • Andrea F. Abate
  • Carmen BisogniEmail author
  • Aniello Castiglione
  • Riccardo Distasi
  • Alfredo Petrosino
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1122)


This paper illustrates a multibiometric method to optimize the fusion of multiple biometries at the score level. The fused score is a linear combination of the individual scores. As a consequence, well-known traditional linear optimization techniques become suitable to determine the constants to be used in the linear combination. The proposed method uses training to optimize the constants. After experimenting with dummy datasets, a fresh multi-biometric dataset of infrared images has been prepared. The data has been subject to extra distortion and occlusions, and then used to train first the individual biometric systems, based on GoogleNet CNNs, and then the fusion engine. Results obtained through the proposed method have an accuracy over 99% in the best configuration. The system at present performs user verification, but an extension to identification can be obtained by reworking the constraints in the optimization problem. A sketch of such extension is provided.


Multibiometric Score-level fusion Optimization Training IR Fingerprint Face biometric Ear biometric CNN 


  1. 1.
    Hosseini, S.: Fingerprint vulnerability: a survey. In: IEEE, 2018 4th International Conference on Web Research (ICWR).
  2. 2.
    Galbally, J., Marcel, S., Fierrez, J.: Biometric antispoofing methods: a survey in face recognition. IEEE Access. 2, 1530–1552 (2014). Scholar
  3. 3.
    De Marsico, M., Distasi, R., Nappi, M., Riccio, D.: Fractal indexing in multimodal biometric contexts. In: Kocarev, L., Galias, Z., Lian, S. (eds.) Intelligent Computing Based on Chaos. Studies in Computational Intelligence, vol. 184. Springer, Heidelberg (2009). Scholar
  4. 4.
    De Marsico, M., Distasi, R., Nappi, M., Riccio, D.: Multiple traits for people identification: face, ear and fingerprints. In: Sencar, H.T., Kocarev, L., Galias, Z., Lian, S. (eds.) Intelligent Multimedia Analysis for Security Applications. Studies in Computational Intelligence, vol. 282, pp. 79–98. Springer, Heidelberg (2010). Scholar
  5. 5.
    Singh, S.A.: Review on multibiometrics: classifications, normalization and fusion levels. In: IEEE, 2018 International Conference on Advances in Computing and Communication Engineering (ICACCE).
  6. 6.
    Jaafar, H., Ramli, D.A.: A review of multibiometric system with fusion strategies and weighting factor. Int. J. Comput. Sci. Eng. (IJCSE) 2(4), 158–165 (2013)Google Scholar
  7. 7.
    Imran, M., Rao, A., Kumar, G.H.: A new hybrid approach for information fusion in multibiometric systems. In: IEEE, 2011 Third National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics.
  8. 8.
    Talreja, V., Valenti, M.C., Nasrabadi, N.M.: Multibiometric secure system based on deep learning. In: 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).
  9. 9.
    Rattani, A., Reddy, N., Derakhshani, R.: Multi-biometric convolutional neural networks for mobile user authentication. In: 2018 IEEE International Symposium on Technologies for Homeland Security (HST).
  10. 10.
    Nair, V.S., Reshmypriya, G.N., Rubeena, M.M., Fasila, K.A.: Multibiometric cryptosystem based on decision level fusion for file uploading in cloud. In: IEEE, 2017 International Conference on Recent Advances in Electronics and Communication Technology (ICRAECT).
  11. 11.
    Li, C., Hu, J., Pieprzyk, J., Susilo, W.: A new biocryptosystem-oriented security analysis framework and implementation of multibiometric cryptosystems based on decision level fusion. IEEE Trans. Inf. Forensics Secur. 10(6), 1193–1206 (2015). CrossRefGoogle Scholar
  12. 12.
    Sharma, R., Das, S., Joshi, P.: Rank level fusion in multibiometric systems. In: IEEE, 2015 Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).
  13. 13.
    Kadri, F., Meraoumia, A., Bendjenna, H., Chitroub, S.: Palmprint & iris for a multibiometric authentication scheme using Log-Gabor filter response. In: IEEE, 2016 International Conference on Information Technology for Organizations Development (IT4OD).
  14. 14.
    Kabir, W., Ahmad, M.O., Swamy, M.N.S.: Score reliability based weighting technique for score-level fusion in multi-biometric systems. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).
  15. 15.
    Patil, A.P., Bhalke, D.G.: Fusion of fingerprint, palmprint and iris for person identification. In: IEEE, 2016 International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT).
  16. 16.
    Abate, A.F., Nappi, M., Riccio, D., De Marsico, M.: Face, ear and fingerprint: designing multibiometric architectures. In: 14th International Conference on Image Analysis and Processing (ICIAP 2007) (2007)Google Scholar
  17. 17.
    Abate, A.F., Nappi, M., Ricciardi, S.: Smartphone enabled person authentication based on ear biometrics and arm gesture. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (2016)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Andrea F. Abate
    • 1
  • Carmen Bisogni
    • 1
    Email author
  • Aniello Castiglione
    • 2
  • Riccardo Distasi
    • 1
  • Alfredo Petrosino
    • 2
  1. 1.Department of Computer ScienceUniversity of SalernoFiscianoItaly
  2. 2.Department of Science and TechnologyUniversity of Naples ParthenopeNaplesItaly

Personalised recommendations