Abstract
The paper presents conception regarding speech and music research on the basis of semiotics. The speech and music semiotic systems are examined as special hierarchical subsystems of the common human semiotic interpersonal communication system. And what is more every speech semiotic subsystem has its own subsystems: e.g., articulatory, phonatory, acoustic, perceptual-auditory etc. The speech semiotic acoustic subsystem has its own subsystems, e.g. duration (tn – ms), intensity (In – dB), fundamental frequency (F0n – Hz), spectrum values (Fn – Hz). Speech and music are considered as two congeneric phenomena subsystems of the common semiotic interpersonal communication system with regard to semantics, syntactics and pragmatics: semantics as an area of relations between speech and music expressions, on the one hand, and objects and processes in the world, on the other hand; syntactics as an area of the interrelations of these expressions; pragmatics as an area of the influence of the meaning of these expressions on their users. This speech and music semiotic conception includes binary oppositions “ratio-emotio”, actual “thema-rhema” segmentation of speech and musical text/discourse, “segmental-suprasegmental items”, “prosody-timbre items”, etc. In this research was made an attempt to show the progressiveness of using the method of music “score” (composed on the basis of the results of speech prosodic characteristics analysis), which can help to determine the informativeness of parameters used for determining the speakers’ emotional state. Creation of music score based on this analysis is viewed as a model for a prosodic vocal outline of the utterance. At the same time the prosodic basis of speech and basic expressive means of the “music language” are connected. Speech as well as music uses the same space and time coordinates representing sound item movements. The height metric grid is based on this principle, which determines sound item in dynamics. Time organization of music and speech creates a common temporal basis. The music score created on the basis of the results of the prosodic features acoustic analysis meets the requirements taking into consideration the restrictions caused by the absence of segmented (sound-syllable) text. Thus, with the help of special music synthesis of speech utterance on the basis of the acoustic and further perceptual-auditory analysis it is possible to conduct an “analysis-synthesis” research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aldoshina, I., Pritts, R.: Musical acoustics. Publishing House “Composer”, St.-Petersburg (2006). (in Russian)
Aranovsky, M.: Musical text: structure and features. Publishing house “Composer”, Moscow (1998). (in Russia)
Bonfeld, M.: Music: Language. Speech. Thinking. Experience of system research for musical arts. Publishing House “Composer”, St.-Petersburg (2006). (in Russian)
Crystal, D.: A Dictionary of Linguistics and Phonetics, 6th edn. Blackwell Publishing, Hoboken (2009)
Crystal, D.: Die Cambridge Enzyklopädie der Sprache. Campus Verlag, Frankfurt/New York (1998)
Eyges, K.: Essays on the philosophy of music. In: Spoken Meanings. Publishing House of St.-Petersburg University, St. Petersburg, pp. 175–222 (2007). (in Russian)
Linguistic Encyclopedic Dictionary/Yartseva, V.N. (ed.): Soviet Encyclopedia, Moscow (1990). (in Russian)
Music Encyclopedic Dictionary/Keldysh, G.V. (ed.): Soviet Encyclopedia, Moscow (1990). (in Russian)
Potapova, R.K.: On the possibility of research of identification of emotions (on the basis of method “analysis–synthesis–analysis”). In: Annual Conference of International Association for Forensic Phonetics (IAFP), Wiesbaden, 7–11 July 1996, p. 12 (1996)
Potapova, R.K.: Speech driving of robots: linguistics and modern automated systems, 2nd edn. Comkniga, Moscow (2005). (in Russian)
Potapova, R.K.: Semiotic heterogeneity of spoken speech communication. In: Neurocomputers: Development and Use. Publishing House “Radiotekhnika”, Moscow, no. 1, pp. 4–6 (2013). (in Russian)
Potapova, R.K.: Spoken language as a subsystem in the general semiotic system of interpersonal communication. Phonetics: Problems and Perspectives. MSLU, Moscow, pp. 189–196 (2014). (Moscow State Linguistic University Bulletin, № 1 (687). Series of Linguistics). (in Russian)
Potapova, R.: Speech dialog as a part of interactive “human-machine” systems. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds.) ICR 2016. LNCS (LNAI), vol. 9812, pp. 208–218. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-43955-6_25
Potapova, R.K., Potapov, V.V.: Kommunikative Sprechtätigkeit: Russland und Deutschland im Vergleich. Böhlau Verlag, Köln, Weimar, Wien (2011)
Potapova, R.K., Potapov, V.V.: Language, speech, personality. Languages of the Slavic Culture, Moscow (2006). (in Russian)
Potapova, R.K., Potapov, V.V.: Speech communication: from sound to utterance. Languages of the Slavic Cultures, Moscow (2012). (in Russian)
Spencer, H.: The origin and function of music. In: Spoken Meanings. Publishing House of St. Petersburg University, St. Petersburg, p. 219 (2007). (in Russian)
The Encyclopedia of Music: Max Wade - Matthews & Wendy Tompson. Hermes House, London (2005)
Vargha, B., Dimeny, J., Loparits, E.: Language, music, mathematics. Publishing House “World”, Moscow (1981). (in Russian)
Veidle, V.: Spoken Meanings. New Journal, New York, pp. 103–137 (1973). (in Russian)
Veidle, V.: Spoken meanings. In: Spoken Meanings. Publishing House of St. Petersburg University, St. Petersburg, pp. 574–641 (2007). (in Russian)
Acknowledgements
This research is supported by the Russian Science Foundation, Project № 18-18-00477.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Potapova, R., Potapov, V. (2019). Acoustic and Perceptual-Auditory Determinants of Transmission of Speech and Music Information (in Regard to Semiotics). In: Eismont, P., Mitrenina, O., Pereltsvaig, A. (eds) Language, Music and Computing. LMAC 2017. Communications in Computer and Information Science, vol 943. Springer, Cham. https://doi.org/10.1007/978-3-030-05594-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-05594-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05593-6
Online ISBN: 978-3-030-05594-3
eBook Packages: Computer ScienceComputer Science (R0)