Abstract
Synaesthesia is a neurological phenomenon in which stimulation of one sense triggers an involuntary experience in a secondary sense. This paper draws on this phenomenon to generate a system that creates music using colors as a synaesthete input. The system optimizes a function based on the Tonal Interval Space by applying the Particle Swarm Optimization algorithm to automatically generate a tonal melody. The final result is a musical line that is evaluated in terms of musical quality.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agmon, E.: Functional harmony revisited: a prototype-theoretic approach. Music Theor. Spectr. 17(2), 196–214 (1995)
Bernardes, G., Cocharro, D., Caetano, M., Guedes, C., Davies, M.E.: A multi-level tonal interval space for modelling pitch relatedness and musical consonance. J. New Music Res. 45(4), 281–294 (2016)
Bernardes, G., Cocharro, D., Guedes, C., Davies, M.E.: Conchord: an application for generating musical harmony by navigating in a perceptually motivated tonal interval space. In: Proceedings of the 11th International Symposium on Computer Music Modeling and Retrieval (CMMR), pp. 71–86 (2015)
Casado-Vara, R., Corchado, J.M.: Blockchain for democratic voting: How blockchain could cast off voter fraud. Orient. J. Comp. Sci. Technol. 11(1) (2018)
Chamoso, P., Prieta Pintado, F.d.l.: Swarm-based smart city platform: A traffic application (2015)
Eigenfeldt, A., Thorogood, M., Bizzocchi, J., Pasquier, P.: Mediascape: towards a video, music, and sound metacreation. J. Sci. Technol. Arts 6(1), 61–73 (2014)
Faia, R., Pinto, T., Abrishambaf, O., Fernandes, F., Vale, Z., Corchado, J.M.: Case based reasoning with expert system and swarm intelligence to determine energy reduction in buildings energy management. Energ. Build. 155, 269–281 (2017)
Horn, B., Smith, G., Masri, R., Stone, J.: Visual information vases: towards a framework for transmedia creative inspiration. In: Proceedings of the Sixth International Conference on Computational Creativity, p. 182 (2015)
Jo, K., Nagano, N.: Monalisa: see the sound, hear the image. In: Proceedings of the 8th International Conference New Interface for Musical Expression, NIME, vol. 8, pp. 315–318 (2008)
Kennedy, J.: Particle swarm optimization. In: Encyclopedia of Machine Learning, pp. 760–766. Springer (2010)
Kruger, A.: Median-cut color quantization. Dr Dobb’s J. Softw. Tools Prof. Programmer 19(10), 46–55 (1994)
Krumhansl, C.L., Cuddy, L.L.: A theory of tonal hierarchies in music. In: Music perception, pp. 51–87. Springer (2010)
Navarro, M., Caetano, M., Bernardes, G., de Castro, L.N., Corchado, J.M.: Automatic generation of chord progressions with an artificial immune system. In: Evolutionary and Biologically Inspired Music, Sound, Art and Design, pp. 175–186. Springer (2015)
Poli, R.: An analysis of publications on particle swarm optimization applications. Department of Computer Science, University of Essex, Essex, UK (2007)
Ranjan, A., Gabora, L., OConnor, B.: The cross-domain re-interpretation of artistic ideas. In: Proceedings 35th Annual Meeting of the Cognitive Science Society, pp. 3251–3256 (2013)
Sanz, J.C.: Lenguaje Del Color: Sinestesia cromática en poesía y arte visual. H. Blume (2009)
Scirea, M., Nelson, M., Cheong, Y.G., Bae, B.C.: Mood expression in real-time computer generated music using pure data (2014)
Sysoev, I., Chitloor, R.D., Rajaram, A., Summerlin, R.S., Davis, N., Walker, B.N.: Middie mercury: an ambient music generator for relaxation. In: Proceedings of the 8th Audio Mostly Conference, p. 20. ACM (2013)
Unemi, T., Matsui, Y., Bisig, D.: Identity sa 1.6: an artistic software that produces a deformed audiovisual reflection based on a visually interactive swarm. In: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, pp. 297–300. ACM (2008)
Wu, X., Li, Z.N.: A study of image-based music composition. In: 2008 IEEE International Conference on Multimedia and Expo, pp. 1345–1348. IEEE (2008)
Acknowledgments
This work was supported by the Spanish Ministry, Ministerio de Economía y Competitividad and FEDER funds. Project. SURF: Intelligent System for integrated and sustainable management of urban fleets TIN2015-65515-C4-3-R.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Navarro-Cáceres, M., Martín-Gómez, L., Sittón-Candanedo, I., Rodríguez-González, S., Pérez-Lancho, B. (2019). Modeling a Synaesthete System to Generate a Tonal Melody from a Color Distribution. In: Graña, M., et al. International Joint Conference SOCO’18-CISIS’18-ICEUTE’18. SOCO’18-CISIS’18-ICEUTE’18 2018. Advances in Intelligent Systems and Computing, vol 771. Springer, Cham. https://doi.org/10.1007/978-3-319-94120-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-94120-2_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94119-6
Online ISBN: 978-3-319-94120-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)