Abstract
Mental health disorders have become a social problem, and countermeasures are thus required. Previously, the authors developed the MIMOSYS (Mind Monitoring System) algorithm to evaluate an individual’s mental health state using their voice. An individual’s mental health state is detected using aspects of emotions that are present in their voice; however, since emotions change subtly, influence to emotions will be concerned owing to voice acquisition methods such as a natural conversation with someone else or reading fixed phrases. The aim of this research was to evaluate the influence of the type of voice acquisition method on the estimation of emotion and mental health state using the vocal analysis in MIMOSYS. In the experiments, we collected emotions and MIMOSYS analysis results from voice recordings during calls and during readings of fixed phrases from the application for over two weeks. In addition, the Beck’s Depression Inventory (BDI) test was used to evaluate participants’ subjective depression levels at the beginning of the experiment. In the evaluation, we analyzed recordings of calls and readings of fixed phrases for the participants in the normal range of the BDI test. Results indicated that the expression of emotions was suppressed in the recordings of readings of fixed phrases when compared to the recordings of calls, and the analysis result by MIMOSYS tended to be lower. Consequently, when measuring an individual’s mental health state from their voice, it may be necessary to match the type of voice acquisition methods or correct the estimations according to acquisition method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Goldberg, D., Hillier, V.: A scaled version of the General Health Questionnaire. Psychological Medicine 9(1), 139–145 (1979).
Beck, A.T., Ward, C.H., Mendelson, M., Mock, J., Erbaugh, J.: An Inventory for Measuring Depression. Arch Gen Psychiatry 4, 561–571 (1961).
Ito, Y., Iida, T., Yamamura, Y., Teramura, M., Nakagami, Y., Kawai, K., Nagamura, Y., Teradaira, R.: Relationships between Salivary Melatonin Levels, Quality of Sleep, and Stress in Young Japanese Females. International Journal of Tryptophan Research 6(Suppl 1), 75–85 (2013).
Kawamura, N., Shinoda, K., Ohashi, Y., Ishikawa, T., Sato, H.: Biomarker for depression, method for measuring a biomarker for depression, computer program, and recording medium., U. S. Patent, US2015126623 (2015).
Shinohara, S., Mitsuyoshi, S., Nakamura, M., Omiya, Y., Tsumatori, G., Tokuno, S.: Validity of a voice-based evaluation method for effectiveness of behavioral therapy. Pervasive Computing Paradigms for Mental Health, Springer International Publishing, 43–51 (2015).
Shinohara, S., Nakamura, M., Omiya, Y., Hagiwara, N., Mitsuyoshi, S., Tokuno, S.: A mental health assessment method based on emotional level derived from voice, in preparation.
Mitsuyoshi, S., Ren, F., Tanaka, Y., Kuroiwa, S.: Non-verbal voice emotion analysis system. International Journal of Innovative Computing, Information and Control. 2(4), 819–830 (2006).
Mitsuyoshi, S., Tanaka, Y., Shibasaki K., Kato M., Minami T., Murata T.: Emotion voice analysis system connected to the human brain. In: International Conference on Natural Language Processing and Knowledge Engineering, 476–484 (2007).
Mitsuyoshi, S.: Emotion recognizing method, sensibility creating method, device, and software. U. S. Patent, US20030182123 (2003).
Beck, AT, Steer RA, Garbin MG J.: Psychometric properties of the Beck Depression Inventory Twenty-five years of evaluation. Clinical Psychology Review 8(1), 77–100 (1988).
Hagiwara N., Omiya Y., Shinohara S., Nakamura M., Higuchi M., Mitsuyoshi S., Yasunaga H., Tokuno S.: Validity of Mind Monitoring System as a Mental Health Indicator using Voice. Advances in Science, Technology and Engineering Systems Journal 2(3), 338–344 (2017).
Omiya Y., Hagiwara N., Takano T., Kirita T., Shinohara S., Nakamura M., Higuchi M., Mitsuyoshi S., Tokuno S.: Evaluation by difference of recording method in Mind Monitoring System using Voice. In: Japanese Society for Medical and Biological Engineering Symposium 2017, Nagano (2017). (in Japanese).
Shinohara S., Omiya Y., Nakamura M., Hagiwara N., Higuchi M., Mitsuyoshi S., Tokuno S.: Multilingual evaluation of voice disability index using pitch rate. Advances in Science, Technology and Engineering Systems Journal 2(3), 765–772 (2017).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Department of Voice Analysis of Pathophysiology, Graduate School of Medicine, The University of Tokyo was the University-Community Relations Projects funded by PST Inc.
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Omiya, Y. et al. (2019). The Influence of the Voice Acquisition Method to the Mental Health State Estimation Based on Vocal Analysis. In: Lhotska, L., Sukupova, L., Lacković, I., Ibbott, G.S. (eds) World Congress on Medical Physics and Biomedical Engineering 2018. IFMBE Proceedings, vol 68/1. Springer, Singapore. https://doi.org/10.1007/978-981-10-9035-6_59
Download citation
DOI: https://doi.org/10.1007/978-981-10-9035-6_59
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-9034-9
Online ISBN: 978-981-10-9035-6
eBook Packages: EngineeringEngineering (R0)