Abstract
Classification of movies into genres from the accompanying promotional materials such as posters is a typical multi-label classification problem. Posters usually highlight a movie scene or characters, and at the same time should inform about the genre or the plot of the movie to attract the potential audience, so our assumption was that the relevant information can be captured in visual features.
We have used three typical methods for transforming the multi-label problem into a number of single-label problems that can be solved with standard classifiers. We have used the binary relevance, random k-labelsets (RAKEL), and classifier chains with Naïve Bayes classifier as a base classifier. We wanted to compare the classification performance using structural features descriptor extracted from poster images, with the performance obtained using the Classeme feature descriptors that are trained on general images datasets. The classification performance of used transformation methods is evaluated on a poster dataset containing 6000 posters classified into 18 and 11 genres.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
The movie database, March 2014. http://www.themoviedb.org/
Madjarov, G., Kocev, D., Gjorgjevikj, D., Džeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recogn. 45(9), 3084–3104 (2012)
Rasheed, Z., Sheikh, Y., Shah, M.: On the use of computable features for film classification. IEEE Trans. Circ. Syst. Video Technol. 15(1), 52–64 (2005)
Zhou, H., Hermans, T., Karandikar, A.V., Rehg, J.M.: Movie genre classification via scene categorization. In: Proceedings of the International Conference on Multimedia, pp. 747–750. ACM (2010)
Huang, H.-Y., Shih, W.-S., Hsu, W.-H.: A film classifier based on low-level visual features. In: 9th IEEE Workshop on Multimedia Signal Processing, MMSP 2007, pp. 465–468 (2007)
Ivašić-Kos, M., Pobar, M., Mikec, L.: Movie posters classification into genres based on low-level features. In: Proceedings of International Conference MIPRO, pp. 1448–1453, Opatija (2014)
Ivasic-Kos, M., Pobar, M., Ipsic, I.: Automatic movie posters classification into genres. In: Bogdanova, A.M., Gjorgjevikj, D. (eds.) ICT Innovations 2014. AISC, vol. 311, pp. 319–328. Springer, Cham (2015). doi:10.1007/978-3-319-09879-1_32
Fu, Z., Li, B., Li, J., Wei, S.: Fast film genres classification combining poster and synopsis. In: He, X., Gao, X., Zhang, Y., Zhou, Z.-H., Liu, Z.-Y., Fu, B., Hu, F., Zhang, Z. (eds.) IScIDE 2015. LNCS, vol. 9242, pp. 72–81. Springer, Cham (2015). doi:10.1007/978-3-319-23989-7_8
Torresani, L., Szummer, M., Fitzgibbon, A.: Efficient object category recognition using classemes. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6311, pp. 776–789. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15549-9_56
Tsoumakas, G., Vlahavas, I.: Random k-label sets: an ensemble method for multi-label classification. In: Machine Learning: ECML 2007, pp. 406–417 (2007). Springer
Tsoumakas, G., Katakis, I.: Multi-label classification: an overview. Int. J. Data Warehouse. Min. 3(3), 1–13 (2007)
Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. J. 85(3), 254–269 (2011). Springer
Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42(3), 145–175 (2001)
Gehler, P., Nowozin, S.: On feature combination for multiclass object classification. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 221–228. IEEE, September 2009
Shechtman, E., Irani, M.: Matching local self-similarities across images and videos. In: CVPR 2007, pp. 1–8. IEEE, June 2007
Naphade, M., Smith, J.R., Tesic, J., Chang, S.F., Hsu, W., Kennedy, L., Curtis, J.: Large-scale concept ontology for multimedia. IEEE Multimed. 13(3), 86–91 (2006)
Yang, Y.: An evaluation of statistical approaches to text categorization. Inf. Retrieval 1(1–2), 69–90 (1999)
Acknowledgment
This research was fully supported by Croatian Science Foundation under the project Automatic recognition of actions and activities in multimedia content from the sports domain (RAASS).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Pobar, M., Ivasic-Kos, M. (2017). Multi-label Poster Classification into Genres Using Different Problem Transformation Methods. In: Felsberg, M., Heyden, A., Krüger, N. (eds) Computer Analysis of Images and Patterns. CAIP 2017. Lecture Notes in Computer Science(), vol 10425. Springer, Cham. https://doi.org/10.1007/978-3-319-64698-5_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-64698-5_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-64697-8
Online ISBN: 978-3-319-64698-5
eBook Packages: Computer ScienceComputer Science (R0)