Advertisement

Immersive Episodic Memory Assessment with 360° Videos: The Protocol and a Case Study

  • Claudia RepettoEmail author
  • Silvia Serino
  • Mauro Maldonato
  • Teresa Longobardi
  • Raffaele Sperandeo
  • Daniela Iennaco
  • Giuseppe Riva
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 288)

Abstract

Episodic memory has been conceptualized as the memory for personal events with specific spatiotemporal components. The assessment of episodic memory is usually conducted by means of verbal recall tasks, in which the individual is required to repeat what (s)he remembers from a previously presented verbal material (either single words or a brief story). However, the need of a more ecological approach to memory assessment led researchers to investigate the potential use of 360° videos as a suitable tool to present real life scenes to be remembered. The present study presents the protocol of the assessment of episodic memory employing five 360° video that represent interpersonal, emotional experiences known to be altered in psychopathological conditions. Furthermore, a case study in which the assessment protocol is applied to a patient with Borderline Personality Disorder is described. The results of the case study seem to indicate that our 360° videos are able to detect anomalies in remembering the behaviors displayed, the connected emotion together with details regarding the “where” and “when” components of the episodic recall.

Keywords

360° videos Episodic memory Assessment Borderline Personality Disorder 

References

  1. 1.
    Tulving, E.: Episodic memory: from mind to brain. Annu. Rev. Psychol. 53, 1–25 (2002).  https://doi.org/10.1146/annurev.psych.53.100901.135114CrossRefGoogle Scholar
  2. 2.
    Tulving, E.: Episodic memory and common sense: how far apart? Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 356, 1505–1515 (2001).  https://doi.org/10.1098/rstb.2001.0937CrossRefGoogle Scholar
  3. 3.
    Parsons, T.D.: Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front. Hum. Neurosci. 9, 660 (2015).  https://doi.org/10.3389/fnhum.2015.00660CrossRefGoogle Scholar
  4. 4.
    Parsons, T.D., Carlew, A.R., Magtoto, J., Stonecipher, K.: The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. Neuropsychol. Rehabil. 27, 777–807 (2017).  https://doi.org/10.1080/09602011.2015.1109524CrossRefGoogle Scholar
  5. 5.
    Bohil, C.J., Alicea, B., Biocca, F.A.: Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12, 752–762 (2011).  https://doi.org/10.1038/nrn3122nrn3122CrossRefGoogle Scholar
  6. 6.
    Parsons, T.D., Gaggioli, A., Riva, G.: Virtual reality for research in social neuroscience. Brain Sci. 7 (2017).  https://doi.org/10.3390/brainsci7040042CrossRefGoogle Scholar
  7. 7.
    Rizzo, A.A., Schultheis, M., Kerns, K.A., Mateer, C.: Analysis of assets for virtual reality applications in neuropsychology. Neuropsychol. Rehabil. 14, 207–239 (2004).  https://doi.org/10.1080/09602010343000183CrossRefGoogle Scholar
  8. 8.
    Compère, L., et al.: Gender identity better than sex explains individual differences in episodic and semantic components of autobiographical memory and future thinking. Conscious. Cogn. 57, 1–19 (2018).  https://doi.org/10.1016/J.CONCOG.2017.11.001CrossRefGoogle Scholar
  9. 9.
    Plancher, G., Gyselinck, V., Nicolas, S., Piolino, P.: Age effect on components of episodic memory and feature binding: a virtual reality study. Neuropsychology 24, 379–390 (2010).  https://doi.org/10.1037/a0018680CrossRefGoogle Scholar
  10. 10.
    Plancher, G., Gyselinck, V., Piolino, P.: The integration of realistic episodic memories relies on different working memory processes: evidence from virtual navigation. Front. Psychol. 9, 47 (2018).  https://doi.org/10.3389/fpsyg.2018.00047CrossRefGoogle Scholar
  11. 11.
    Plancher, G., Tirard, A., Gyselinck, V., Nicolas, S., Piolino, P.: Using virtual reality to characterize episodic memory profiles in amnestic mild cognitive impairment and Alzheimer’s disease: influence of active and passive encoding. Neuropsychologia 50, 592–602 (2012).  https://doi.org/10.1016/j.neuropsychologia.2011.12.013CrossRefGoogle Scholar
  12. 12.
    Negro Cousa, E., Brivio, E., Serino, S., Heboyan, V., Riva, G., de Leo, G.: New frontiers for cognitive assessment: an exploratory study of the potentiality of 360° technologies for memory evaluation. Cyberpsychol. Behav. Soc. Netw. Cyber. 2017, 0720 (2018).  https://doi.org/10.1089/cyber.2017.0720CrossRefGoogle Scholar
  13. 13.
    Serino, S., Repetto, C.: New trends in episodic memory assessment: immersive 360° ecological videos. Front. Psychol. 9, 1878 (2018).  https://doi.org/10.3389/fpsyg.2018.01878CrossRefGoogle Scholar
  14. 14.
    Minzenberg, M.J., Fisher-Irving, M., Poole, J.H., Vinogradov, S.: Reduced self-referential source memory performance is associated with interpersonal dysfunction in borderline personality disorder. J. Pers. Disord. 20, 42–54 (2006).  https://doi.org/10.1521/pedi.2006.20.1.42CrossRefGoogle Scholar
  15. 15.
    Schnell, K., Dietrich, T., Schnitker, R., Daumann, J., Herpertz, S.C.: Processing of autobiographical memory retrieval cues in borderline personality disorder. J. Affect. Disord. 97, 253–259 (2007).  https://doi.org/10.1016/J.JAD.2006.05.035CrossRefGoogle Scholar
  16. 16.
    Winter, D., Herbert, C., Koplin, K., Schmahl, C., Bohus, M., Lis, S.: Negative evaluation bias for positive self-referential information in borderline personality disorder. PLoS ONE 10, e0117083 (2015).  https://doi.org/10.1371/journal.pone.0117083CrossRefGoogle Scholar
  17. 17.
    Spinnler, H., Tognoni, G.: Italian group on the neuropsychological study of ageing: Italian standardization and classification of neuropsychological tests. Ital. J. Neurol. Sci. 8, 1–120 (1987)Google Scholar
  18. 18.
    Giovagnoli, A.R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., Capitani, E.: Trail making test: normative values from 287 normal adult controls. Ital. J. Neurol. Sci. 17, 305–309 (1996).  https://doi.org/10.1007/BF01997792CrossRefGoogle Scholar
  19. 19.
    Schimmenti, A.: Dissociative experiences and dissociative minds: exploring a nomological network of dissociative functioning. J. Trauma Dissociation. 17, 338–361 (2016).  https://doi.org/10.1080/15299732.2015.1108948CrossRefGoogle Scholar
  20. 20.
    Derogatis, L.R.: Symptom Checklist-90-R: Administration, Scoring, and Procedures Manual, 3rd edn. National Computer Systems, Minneapolis (1994)Google Scholar
  21. 21.
    First, M.B.: Structured clinical interview for the DSM (SCID). In: The Encyclopedia of Clinical Psychology, pp. 1–6. John Wiley & Sons, Inc., Hoboken (2015)Google Scholar
  22. 22.
    Niedtfeld, I., et al.: Facing the problem: impaired emotion recognition during multimodal social information processing in borderline personality disorder. J. Pers. Disord. 31, 273–288 (2017).  https://doi.org/10.1521/pedi_2016_30_248CrossRefGoogle Scholar
  23. 23.
    Regenbogen, C., et al.: The differential contribution of facial expressions, prosody, and speech content to empathy. Cogn. Emot. 26, 995–1014 (2012).  https://doi.org/10.1080/02699931.2011.631296CrossRefGoogle Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Claudia Repetto
    • 1
    Email author
  • Silvia Serino
    • 2
  • Mauro Maldonato
    • 3
  • Teresa Longobardi
    • 4
  • Raffaele Sperandeo
    • 4
  • Daniela Iennaco
    • 4
  • Giuseppe Riva
    • 1
    • 5
  1. 1.Department of PsychologyUniversità Cattolica del Sacro CuoreMilanItaly
  2. 2.MySpace Lab, Department of Clinical NeurosciencesUniversity Hospital Lausanne (CHUV)LausanneSwitzerland
  3. 3.Dipartimento di Neuroscienze, Scienze Riproduttive e OdontostomatologicheUniversità di Napoli Federico IINaplesItaly
  4. 4.School of Integrated Gestalt PsychotherapyTorre AnnunziataItaly
  5. 5.Applied Technology for Neuro-Psychology LaboratoryIstituto Auxologico ItalianoMilanItaly

Personalised recommendations