Speaker Diarization of Multi-party Conversations Using Participants Role Information: Political Debates and Professional Meetings

  • Fabio Valente
  • Alessandro Vinciarelli
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8045)


Speaker Diarization aims at inferring who spoke when in an audio stream and involves two simultaneous unsupervised tasks: (1) the estimation of the number of speakers, and (2) the association of speech segments to each speaker. Most of the recent efforts in the domain have addressed the problem using machine learning techniques or statistical methods (for a review see [11]) ignoring the fact that the data consists of instances of human conversations.


Automatic Speech Recognition Speech Segment Acoustic Vector Speaker Diarization Meeting Recording 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bales, R.F.: Interaction Process Analysis: A Method for the Study of Small Groups. Addison-Wesley (1950)Google Scholar
  2. 2.
    Banerjee, S., Rudnicky, A.I.: Using simple speech based features to detect the state of a meeting and the roles of the meeting participants. In: Proceedings of International Conference on Spoken Language Processing, vol. (2-3), pp. 221–231 (2004)Google Scholar
  3. 3.
    Dong, W., Lepri, B., Cappelletti, A., Pentland, A., Pianesi, F., Zancanaro, M.: Using the influence model to recognize functional roles in meetings. In: Proceedings of the International Conference on Multimodal Interfaces (ICMI), pp. 271–278 (2007)Google Scholar
  4. 4.
    Garg, N., Favre, S., Salamin, H., Hakkani-Tür, D., Vinciarelli, A.: Role recognition for meeting participants: an approach based on lexical information and Social Network Analysis. In: Proceedings of the ACM International Conference on Multimedia, pp. 693–696 (2008)Google Scholar
  5. 5.
    Han, K.J., Narayanan, S.S.: Improved speaker diarization of meeting speech with recurrent selection of representative speech segments and participant interaction pattern modeling. In: Proceedings of Interspeech, pp. 1067–1070 (2009)Google Scholar
  6. 6.
    Laskowski, K., Ostendorf, M., Schultz, T.: Modeling vocal interaction for text-independent participant characterization in multi-party conversation. In: Proceedings of the 9th ISCA/ACL SIGdial Workshop on Discourse and Dialogue, pp. 148–155 (June 2008)Google Scholar
  7. 7.
    McCowan, I., Carletta, J., Kraaij, W., Ashby, S., Bourban, S., Flynn, M., Guillemot, M., Hain, T., Kadlec, J., Karaiskos, V.: The AMI meeting corpus. In: Proceedings of the International Conference on Methods and Techniques in Behavioral Research, vol. 88 (2005)Google Scholar
  8. 8.
    Oreström, B.: Turn-taking in English conversation. Krieger Pub. Co. (1983)Google Scholar
  9. 9.
    Sacks, H., Schegloff, E.A., Jefferson, G.: A simplest systematics for the organization of turn-taking for conversation. Language, 696–735 (1974)Google Scholar
  10. 10.
    Tischler, H.: Introduction to sociology. Harcourt Barce College Publishers (1990)Google Scholar
  11. 11.
    Tranter, S.E.E., Reynolds, D.A.: An overview of automatic speaker diarization systems. IEEE Transactions on Audio, Speech, and Language Processing 14(5), 1557–1565 (2006)CrossRefGoogle Scholar
  12. 12.
    Vijayasenan, D., Valente, F., Bourlard, H.: An information theoretic approach to speaker diarization of meeting data. IEEE Transactions on Audio, Speech, and Language Processing 17(7), 1382–1393 (2009)CrossRefGoogle Scholar
  13. 13.
    Vinciarelli, A.: Capturing order in social interactions. IEEE Signal Processing Magazine 26(5), 133–152 (2009)CrossRefGoogle Scholar
  14. 14.
    Vinciarelli, A., Dielmann, A., Favre, S., Salamin, H.: Canal9: A database of political debates for analysis of social interactions. In: Proceedings of International Workshop on Social Signal Processing, pp. 1–4 (2009)Google Scholar
  15. 15.
    Zancanaro, M., Lepri, B., Pianesi, F.: Automatic detection of group functional roles in face to face interactions. In: Proceedings of International Conference on Mutlimodal Interfaces, pp. 47–54 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Fabio Valente
    • 1
  • Alessandro Vinciarelli
    • 1
    • 2
  1. 1.Idiap Research InstituteMartignySwitzerland
  2. 2.University of GlasgowGlasgowUK

Personalised recommendations