Skip to main content

Immersive Episodic Memory Assessment with 360° Videos: The Protocol and a Case Study

  • Conference paper
  • First Online:

Abstract

Episodic memory has been conceptualized as the memory for personal events with specific spatiotemporal components. The assessment of episodic memory is usually conducted by means of verbal recall tasks, in which the individual is required to repeat what (s)he remembers from a previously presented verbal material (either single words or a brief story). However, the need of a more ecological approach to memory assessment led researchers to investigate the potential use of 360° videos as a suitable tool to present real life scenes to be remembered. The present study presents the protocol of the assessment of episodic memory employing five 360° video that represent interpersonal, emotional experiences known to be altered in psychopathological conditions. Furthermore, a case study in which the assessment protocol is applied to a patient with Borderline Personality Disorder is described. The results of the case study seem to indicate that our 360° videos are able to detect anomalies in remembering the behaviors displayed, the connected emotion together with details regarding the “where” and “when” components of the episodic recall.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Tulving, E.: Episodic memory: from mind to brain. Annu. Rev. Psychol. 53, 1–25 (2002). https://doi.org/10.1146/annurev.psych.53.100901.135114

    Article  Google Scholar 

  2. Tulving, E.: Episodic memory and common sense: how far apart? Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 356, 1505–1515 (2001). https://doi.org/10.1098/rstb.2001.0937

    Article  Google Scholar 

  3. Parsons, T.D.: Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front. Hum. Neurosci. 9, 660 (2015). https://doi.org/10.3389/fnhum.2015.00660

    Article  Google Scholar 

  4. Parsons, T.D., Carlew, A.R., Magtoto, J., Stonecipher, K.: The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. Neuropsychol. Rehabil. 27, 777–807 (2017). https://doi.org/10.1080/09602011.2015.1109524

    Article  Google Scholar 

  5. Bohil, C.J., Alicea, B., Biocca, F.A.: Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12, 752–762 (2011). https://doi.org/10.1038/nrn3122nrn3122

    Article  Google Scholar 

  6. Parsons, T.D., Gaggioli, A., Riva, G.: Virtual reality for research in social neuroscience. Brain Sci. 7 (2017). https://doi.org/10.3390/brainsci7040042

    Article  Google Scholar 

  7. Rizzo, A.A., Schultheis, M., Kerns, K.A., Mateer, C.: Analysis of assets for virtual reality applications in neuropsychology. Neuropsychol. Rehabil. 14, 207–239 (2004). https://doi.org/10.1080/09602010343000183

    Article  Google Scholar 

  8. Compère, L., et al.: Gender identity better than sex explains individual differences in episodic and semantic components of autobiographical memory and future thinking. Conscious. Cogn. 57, 1–19 (2018). https://doi.org/10.1016/J.CONCOG.2017.11.001

    Article  Google Scholar 

  9. Plancher, G., Gyselinck, V., Nicolas, S., Piolino, P.: Age effect on components of episodic memory and feature binding: a virtual reality study. Neuropsychology 24, 379–390 (2010). https://doi.org/10.1037/a0018680

    Article  Google Scholar 

  10. Plancher, G., Gyselinck, V., Piolino, P.: The integration of realistic episodic memories relies on different working memory processes: evidence from virtual navigation. Front. Psychol. 9, 47 (2018). https://doi.org/10.3389/fpsyg.2018.00047

    Article  Google Scholar 

  11. Plancher, G., Tirard, A., Gyselinck, V., Nicolas, S., Piolino, P.: Using virtual reality to characterize episodic memory profiles in amnestic mild cognitive impairment and Alzheimer’s disease: influence of active and passive encoding. Neuropsychologia 50, 592–602 (2012). https://doi.org/10.1016/j.neuropsychologia.2011.12.013

    Article  Google Scholar 

  12. Negro Cousa, E., Brivio, E., Serino, S., Heboyan, V., Riva, G., de Leo, G.: New frontiers for cognitive assessment: an exploratory study of the potentiality of 360° technologies for memory evaluation. Cyberpsychol. Behav. Soc. Netw. Cyber. 2017, 0720 (2018). https://doi.org/10.1089/cyber.2017.0720

    Article  Google Scholar 

  13. Serino, S., Repetto, C.: New trends in episodic memory assessment: immersive 360° ecological videos. Front. Psychol. 9, 1878 (2018). https://doi.org/10.3389/fpsyg.2018.01878

    Article  Google Scholar 

  14. Minzenberg, M.J., Fisher-Irving, M., Poole, J.H., Vinogradov, S.: Reduced self-referential source memory performance is associated with interpersonal dysfunction in borderline personality disorder. J. Pers. Disord. 20, 42–54 (2006). https://doi.org/10.1521/pedi.2006.20.1.42

    Article  Google Scholar 

  15. Schnell, K., Dietrich, T., Schnitker, R., Daumann, J., Herpertz, S.C.: Processing of autobiographical memory retrieval cues in borderline personality disorder. J. Affect. Disord. 97, 253–259 (2007). https://doi.org/10.1016/J.JAD.2006.05.035

    Article  Google Scholar 

  16. Winter, D., Herbert, C., Koplin, K., Schmahl, C., Bohus, M., Lis, S.: Negative evaluation bias for positive self-referential information in borderline personality disorder. PLoS ONE 10, e0117083 (2015). https://doi.org/10.1371/journal.pone.0117083

    Article  Google Scholar 

  17. Spinnler, H., Tognoni, G.: Italian group on the neuropsychological study of ageing: Italian standardization and classification of neuropsychological tests. Ital. J. Neurol. Sci. 8, 1–120 (1987)

    Google Scholar 

  18. Giovagnoli, A.R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., Capitani, E.: Trail making test: normative values from 287 normal adult controls. Ital. J. Neurol. Sci. 17, 305–309 (1996). https://doi.org/10.1007/BF01997792

    Article  Google Scholar 

  19. Schimmenti, A.: Dissociative experiences and dissociative minds: exploring a nomological network of dissociative functioning. J. Trauma Dissociation. 17, 338–361 (2016). https://doi.org/10.1080/15299732.2015.1108948

    Article  Google Scholar 

  20. Derogatis, L.R.: Symptom Checklist-90-R: Administration, Scoring, and Procedures Manual, 3rd edn. National Computer Systems, Minneapolis (1994)

    Google Scholar 

  21. First, M.B.: Structured clinical interview for the DSM (SCID). In: The Encyclopedia of Clinical Psychology, pp. 1–6. John Wiley & Sons, Inc., Hoboken (2015)

    Google Scholar 

  22. Niedtfeld, I., et al.: Facing the problem: impaired emotion recognition during multimodal social information processing in borderline personality disorder. J. Pers. Disord. 31, 273–288 (2017). https://doi.org/10.1521/pedi_2016_30_248

    Article  Google Scholar 

  23. Regenbogen, C., et al.: The differential contribution of facial expressions, prosody, and speech content to empathy. Cogn. Emot. 26, 995–1014 (2012). https://doi.org/10.1080/02699931.2011.631296

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Claudia Repetto .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Repetto, C. et al. (2019). Immersive Episodic Memory Assessment with 360° Videos: The Protocol and a Case Study. In: Cipresso, P., Serino, S., Villani, D. (eds) Pervasive Computing Paradigms for Mental Health. MindCare 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 288. Springer, Cham. https://doi.org/10.1007/978-3-030-25872-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-25872-6_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-25871-9

  • Online ISBN: 978-3-030-25872-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics