Skip to main content
Log in

Social network analysis in a movie using character-net

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

There have been various approaches to analyzing movie stories using social networks. Social network analysis is an effective means to extract semantic information from movies. Movie analysis through social relationships among characters can support various types of information retrieval better than audio-visual feature analysis. The relationships among characters form the main structure of the story. Therefore, through social network analysis among characters, movie story information such as the major roles and the corresponding communities can be determined. Progression of most movie stories is done by characters, and the scriptwriter or director narrates the story and relationships among characters using character dialogs. A dialog has a direction and time that supplies information. Therefore, the dialog is better for constructing social networks of characters than the co-appearance. Additionally, through social networks using the dialog, we can extract accurate movie stories such as classification of major, minor or extra roles, community clustering, and sequence detection. To achieve this, we propose a Character-net that can represent the relationships between characters using dialogs, and a method that can extract the sequences via clustering communities composed of characters. Our experiments show that our proposed method can efficiently detect sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Ajmera J, Wooters C (2003) A robust speaker clustering algorithm, in Proc. IEEE Workshop on Automatic Speech Recognition Understanding, pp. 411–416

  2. Cour T, Jordan C, Miltsakaki E, Taskar B (2008) Movie/script: Alignment and parsing of video and text transcription. Proc. 10th European Conf. Computer Vision, pp. 158–171

  3. Everingham M, Sivic J, Zisserman A (2008) Taking the bite out of automated naming of characters in TV video. Image and Vision Computing, In Press, Corrected Proof, Available online, 4 May

  4. Freebase, http://www.freebase.com

  5. Garg NP, Favre S, Salamin H, Hakkani Tur D, Vinciarelli A (2008) Role recognition for meeting participants: an approach based on lexical information and social network analysis, in cedinging of ACM Multimedia Conf., pp. 693–696

  6. Guimera R, Danon L, Diaz-Guilera A, Giralt F, Arenas A (2003) Self-similar community structure in a network of human interactions. Phys Rev 68:651031–651034

    Google Scholar 

  7. Hung H, Jayagopi D, Yeo C, Friendland G, Ba S, Ramchandran J, Mirghafori N, Gatica-Perez D (2007) Using audio and video features to classify the most dominant person in a group meeting, in Proc. ACM Multimedia Conf., pp. 835–838

  8. Jung B, Kwak T, Song J, Lee Y (2004) Narrative abstraction model for story-oriented video. Proceedings of the 12th annual ACM international conference on Multimedia, 10–16 Oct

  9. Khatoonabadi SH, Rahmati M (2009) Automatic soccer players tracking in goal scenes by camera motion elimination. Image Vis Comput 27(4):469–479

    Article  Google Scholar 

  10. Kwon OB (2003) ‘I know what you need to buy’: context-aware multimedia-based recommendation system. Expert Syst Appl 25(3):387–400

    Article  Google Scholar 

  11. Liang L, Haifeng G, Li L, Liang W (2009) Semantic event representation and recognition using syntactic attribute graph grammar. Pattern Recognit Lett 30(2):180–186

    Article  Google Scholar 

  12. Lienhart R, Pfeiffer S, Effelsberg W (1997) Video abstracting. J ACM 40:55–62

    Google Scholar 

  13. Linked Movie Data Base, http://www.linkedmdb.org

  14. Linking Open Data (W3C SWEO Community Project), http://esw.w3.org/SweoIG/TaskForces/CommunityProjects/LinkingOpenData

  15. Money G, Agius H (2008) Video summarisation: a conceptual framework and survey of the state of the art. J Vis Commun Image Represent 19(2):121–143

    Article  Google Scholar 

  16. Naver Movie, http://movie.naver.com/index.html

  17. Neti C, Potamianos G, Luettin J, Matthews I, Glotin H, Vergyri D, Sison J, Mashari A, Zhou J (2000) Audio-visual speech recognition, Center Lang. Speech Process., Johns Hopkins Univ., Baltimore, MD

  18. Otsuka I, Nakane K, Divakaran A, Hatanaka K, Ogawa M (2005) A highlight scene detection and video summarization system using audio feature for a personal video recorder. IEEE Trans Consum Electron 51(1):112–116

    Article  Google Scholar 

  19. Park S-B, Kim Y-W, Nazim M, Jo G-S (2009) Character-Net: character network analysis from video. Web Intelligence and Intelligent Agent Technologies 2009 (WI-IAT ‘09). IEEE/WIC/ACM International Joint Conferences on, Vol. 1, pp 305–308, 15–18 Sept

  20. Poppe C, Martens G, Mannens E, de Walle RV (2009) Personal content management system: a semantic approach. J Vis Commun Image Represent 20(2):131–144

    Article  Google Scholar 

  21. Rienks R, Zhang D, Post W (2006) Detection and application of influence rankings in small group meetings, in Proc. Int. Conf. Multimodal Interfaces, pp. 257–264

  22. Ronfard R, Thuong TT (2003) A framework for aligning and indexing movies with their script. Proc. IEEE Int. Conf. Multimedia and Expo (ICME 2003), pp. 21–24

  23. Roth V (1999) Content-based retrieval from digital video. Image Vis Comput 17(7):531–540

    Article  Google Scholar 

  24. Rui Y, Huang TS, Mehrotra S (1999) Constructing Table-of-Content for Videos, to appear in ACM Multimedia Systems Journal, Special Issue Multimedia Systems on Video Libraries, September

  25. SAMI, http://en.wikipedia.org/wiki/SAMI

  26. Smeaton AF (2007) Techniques used and open challenges to the analysis, indexing and retrieval of digital video. Inf Syst 32(4):545–559

    Article  Google Scholar 

  27. Smoliar S, Zhang H (1994) Content-based video indexing and retrieval. IEEE Trans Multimedia 1:62–72

    Article  Google Scholar 

  28. Turetsky R, Dimitrova N (2004) Screenplay alignment for closed-system speaker identification and analysis of feature films. Proc IEEE Int Conf Multimedia Expo 3:1659–1662

    Google Scholar 

  29. Vinciarelli A, Fernandez F, Favre S (2006) Semantic segmentation of radio programs using social network analysis and duration distribution modeling, in Proc. IEEE Int. Conf. Multimedia & Expo., pp. 779–782

  30. Wasserman S, Faust K (1994) Social network analysis: methods and applications. Cambridge University Press, Cambrige

  31. Weng CY, Chu WT, Wu JL (2009) RoleNet: movie analysis from the perspective of social network. IEEE Trans Multimedia 11(2):256–271

    Article  Google Scholar 

  32. Yeung M, Yeo B-L, Liu B (1996) Extracting story units from long programs for video browsing and navigation. In Proceedings of lEEE Multimedia Computing & Systems 1996, IEEE Computer Society Press, pp. 296–305. 17–23 June

  33. Zabih R, Miller J, Mai K (1995) A feature-based algorithm for detecting and classifying scene break. ACM International Conference on Multi-media, pp. 189–200

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seung-Bo Park.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, SB., Oh, KJ. & Jo, GS. Social network analysis in a movie using character-net. Multimed Tools Appl 59, 601–627 (2012). https://doi.org/10.1007/s11042-011-0725-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0725-1

Keywords

Navigation