Immersive Episodic Memory Assessment with 360° Videos: The Protocol and a Case Study

  • Claudia RepettoEmail author
  • Silvia Serino
  • Mauro Maldonato
  • Teresa Longobardi
  • Raffaele Sperandeo
  • Daniela Iennaco
  • Giuseppe Riva
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 288)


Episodic memory has been conceptualized as the memory for personal events with specific spatiotemporal components. The assessment of episodic memory is usually conducted by means of verbal recall tasks, in which the individual is required to repeat what (s)he remembers from a previously presented verbal material (either single words or a brief story). However, the need of a more ecological approach to memory assessment led researchers to investigate the potential use of 360° videos as a suitable tool to present real life scenes to be remembered. The present study presents the protocol of the assessment of episodic memory employing five 360° video that represent interpersonal, emotional experiences known to be altered in psychopathological conditions. Furthermore, a case study in which the assessment protocol is applied to a patient with Borderline Personality Disorder is described. The results of the case study seem to indicate that our 360° videos are able to detect anomalies in remembering the behaviors displayed, the connected emotion together with details regarding the “where” and “when” components of the episodic recall.


360° videos Episodic memory Assessment Borderline Personality Disorder 


  1. 1.
    Tulving, E.: Episodic memory: from mind to brain. Annu. Rev. Psychol. 53, 1–25 (2002). Scholar
  2. 2.
    Tulving, E.: Episodic memory and common sense: how far apart? Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 356, 1505–1515 (2001). Scholar
  3. 3.
    Parsons, T.D.: Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front. Hum. Neurosci. 9, 660 (2015). Scholar
  4. 4.
    Parsons, T.D., Carlew, A.R., Magtoto, J., Stonecipher, K.: The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. Neuropsychol. Rehabil. 27, 777–807 (2017). Scholar
  5. 5.
    Bohil, C.J., Alicea, B., Biocca, F.A.: Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12, 752–762 (2011). Scholar
  6. 6.
    Parsons, T.D., Gaggioli, A., Riva, G.: Virtual reality for research in social neuroscience. Brain Sci. 7 (2017). Scholar
  7. 7.
    Rizzo, A.A., Schultheis, M., Kerns, K.A., Mateer, C.: Analysis of assets for virtual reality applications in neuropsychology. Neuropsychol. Rehabil. 14, 207–239 (2004). Scholar
  8. 8.
    Compère, L., et al.: Gender identity better than sex explains individual differences in episodic and semantic components of autobiographical memory and future thinking. Conscious. Cogn. 57, 1–19 (2018). Scholar
  9. 9.
    Plancher, G., Gyselinck, V., Nicolas, S., Piolino, P.: Age effect on components of episodic memory and feature binding: a virtual reality study. Neuropsychology 24, 379–390 (2010). Scholar
  10. 10.
    Plancher, G., Gyselinck, V., Piolino, P.: The integration of realistic episodic memories relies on different working memory processes: evidence from virtual navigation. Front. Psychol. 9, 47 (2018). Scholar
  11. 11.
    Plancher, G., Tirard, A., Gyselinck, V., Nicolas, S., Piolino, P.: Using virtual reality to characterize episodic memory profiles in amnestic mild cognitive impairment and Alzheimer’s disease: influence of active and passive encoding. Neuropsychologia 50, 592–602 (2012). Scholar
  12. 12.
    Negro Cousa, E., Brivio, E., Serino, S., Heboyan, V., Riva, G., de Leo, G.: New frontiers for cognitive assessment: an exploratory study of the potentiality of 360° technologies for memory evaluation. Cyberpsychol. Behav. Soc. Netw. Cyber. 2017, 0720 (2018). Scholar
  13. 13.
    Serino, S., Repetto, C.: New trends in episodic memory assessment: immersive 360° ecological videos. Front. Psychol. 9, 1878 (2018). Scholar
  14. 14.
    Minzenberg, M.J., Fisher-Irving, M., Poole, J.H., Vinogradov, S.: Reduced self-referential source memory performance is associated with interpersonal dysfunction in borderline personality disorder. J. Pers. Disord. 20, 42–54 (2006). Scholar
  15. 15.
    Schnell, K., Dietrich, T., Schnitker, R., Daumann, J., Herpertz, S.C.: Processing of autobiographical memory retrieval cues in borderline personality disorder. J. Affect. Disord. 97, 253–259 (2007). Scholar
  16. 16.
    Winter, D., Herbert, C., Koplin, K., Schmahl, C., Bohus, M., Lis, S.: Negative evaluation bias for positive self-referential information in borderline personality disorder. PLoS ONE 10, e0117083 (2015). Scholar
  17. 17.
    Spinnler, H., Tognoni, G.: Italian group on the neuropsychological study of ageing: Italian standardization and classification of neuropsychological tests. Ital. J. Neurol. Sci. 8, 1–120 (1987)Google Scholar
  18. 18.
    Giovagnoli, A.R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., Capitani, E.: Trail making test: normative values from 287 normal adult controls. Ital. J. Neurol. Sci. 17, 305–309 (1996). Scholar
  19. 19.
    Schimmenti, A.: Dissociative experiences and dissociative minds: exploring a nomological network of dissociative functioning. J. Trauma Dissociation. 17, 338–361 (2016). Scholar
  20. 20.
    Derogatis, L.R.: Symptom Checklist-90-R: Administration, Scoring, and Procedures Manual, 3rd edn. National Computer Systems, Minneapolis (1994)Google Scholar
  21. 21.
    First, M.B.: Structured clinical interview for the DSM (SCID). In: The Encyclopedia of Clinical Psychology, pp. 1–6. John Wiley & Sons, Inc., Hoboken (2015)Google Scholar
  22. 22.
    Niedtfeld, I., et al.: Facing the problem: impaired emotion recognition during multimodal social information processing in borderline personality disorder. J. Pers. Disord. 31, 273–288 (2017). Scholar
  23. 23.
    Regenbogen, C., et al.: The differential contribution of facial expressions, prosody, and speech content to empathy. Cogn. Emot. 26, 995–1014 (2012). Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Claudia Repetto
    • 1
    Email author
  • Silvia Serino
    • 2
  • Mauro Maldonato
    • 3
  • Teresa Longobardi
    • 4
  • Raffaele Sperandeo
    • 4
  • Daniela Iennaco
    • 4
  • Giuseppe Riva
    • 1
    • 5
  1. 1.Department of PsychologyUniversità Cattolica del Sacro CuoreMilanItaly
  2. 2.MySpace Lab, Department of Clinical NeurosciencesUniversity Hospital Lausanne (CHUV)LausanneSwitzerland
  3. 3.Dipartimento di Neuroscienze, Scienze Riproduttive e OdontostomatologicheUniversità di Napoli Federico IINaplesItaly
  4. 4.School of Integrated Gestalt PsychotherapyTorre AnnunziataItaly
  5. 5.Applied Technology for Neuro-Psychology LaboratoryIstituto Auxologico ItalianoMilanItaly

Personalised recommendations