Skip to main content

Decoding Action Selectivity of Observed Images Using fMRI Pattern Analysis

  • Conference paper
  • First Online:
Advances in Cognitive Neurodynamics (II)
  • 706 Accesses

Abstract

Previous research indicates that mirror neuron system (MNS), comprising posterior parietal (PPC) and ventral premotor (PMv) cortices, has a role in action understanding. However, action selectivity within these regions has not been elucidated. We investigated whether the MNS contains information about observed actions. Participants observed object-directed hand actions. We independently manipulated five dimensions of observed images: action (grasp/touch), object (cup/bottle), perspective (egocentric/allocentric), hand (right/left), and image size (large/small), and investigated whether this information could be decoded from multi-voxel pattern activity. The early visual area showed significant above-chance classification accuracy consistent with dissimilarity of input images. In contrast, significant decoding accuracy was observed for action, object, and mirror-image of hand in the PPC and for action and object in the PMv. Our study indicates that the MNS processes observed actions in a hierarchical manner, where the PPC represents action together with hand, and the PMv encodes more abstracted representations of transitive action.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rizzolatti, G., Fogassi, L., Gallese, V.: Neurophysiological mechanisms underlying the understanding and imitation of action. Nat. Rev. Neurosci. 2 (2001) 661–670.

    Article  CAS  PubMed  Google Scholar 

  2. Norman, K.A., Polyn, S.M., Detre, G.J., Haxby, J.V.: Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 10 (2006) 424–430.

    Article  PubMed  Google Scholar 

  3. Kamitani, Y., Tong, F.: Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 8 (2005) 679–685.

    Article  CAS  PubMed  Google Scholar 

  4. Chong, T.T., Cunnington, R., Williams, M.A., Kanwisher, N., Mattingley, J.B.: fMRI adaptation reveals mirror neurons in human inferior parietal cortex. Curr. Biol. 18 (2008) 1576–1580.

    Article  CAS  PubMed  Google Scholar 

  5. Dinstein, I., Gardner, J.L., Jazayeri, M., Heeger, D.J.: Executed and observed movements have different distributed representations in human aIPS. J. Neurosci. 28 (2008) 11231–11239.

    Article  CAS  PubMed  Google Scholar 

  6. Kriegeskorte, N., Goebel, R., Bandettini, P.: Information-based functional brain mapping. Proc. Natl. Acad. Sci. U. S. A. 103 (2006) 3863–3868.

    Article  CAS  PubMed  Google Scholar 

  7. Ferrari, P.F., Rozzi, S., Fogassi, L.: Mirror neurons responding to observation of actions made with tools in monkey ventral premotor cortex. J. Cogn. Neurosci. 17 (2005) 212–226.

    Article  PubMed  Google Scholar 

  8. Kohler, E., Keysers, C., Umilta, M.A., Fogassi, L., Gallese, V., Rizzolatti, G.: Hearing sounds, understanding actions: action representation in mirror neurons. Science. 297 (2002) 846–848.

    Article  CAS  PubMed  Google Scholar 

  9. Shmuelof, L., Zohary, E.: Mirror-image representation of action in the anterior parietal cortex. Nat. Neurosci. 11 (2008) 1267–1269.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kenji Ogawa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media B.V.

About this paper

Cite this paper

Ogawa, K., Inui, T. (2011). Decoding Action Selectivity of Observed Images Using fMRI Pattern Analysis. In: Wang, R., Gu, F. (eds) Advances in Cognitive Neurodynamics (II). Springer, Dordrecht. https://doi.org/10.1007/978-90-481-9695-1_20

Download citation

Publish with us

Policies and ethics