Cross-Modal Processing of Orthography-Phonology Interface in Hindi-English Bilinguals

  • Ramesh Kumar MishraEmail author
Part of the Literacy Studies book series (LITS, volume 17)


The chapter presents an overview of Devanagari script. Later it presents experimental data from one eye tracking experiment that examined interface between spoken words and orthographic activation. The chapter also touches upon discussion of dyslexia in the Indian setting. The chapter emphasizes the point that much psycholinguistic work needs to be done in Indian languages that link orthographic, phonological and visual processing.


Akshara Orthography Eye movements Visual world Bilingualism 


  1. Abu-Rabia, S., & Taha, H. (2005). Reading in Arabic orthography. In R. M. Joshi & P. G. Aaron (Eds.), Handbook of orthography and literacy. Amsterdam: Lawrence Erlbaum Associates.Google Scholar
  2. Baddeley, A. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4(11), 417–423.CrossRefGoogle Scholar
  3. Barr, D. J. (2008). Analyzing ‘visual world’eyetracking data using multilevel logistic regression. Journal of Memory and Language, 59(4), 457–474.CrossRefGoogle Scholar
  4. Bhatia, D., Prasad, S. G., Sake, K., & Mishra, R. K. (2017). Task irrelevant external cues can influence language selection in voluntary object naming: Evidence from Hindi-English bilinguals. PLoS One, 12(1), e0169284.CrossRefGoogle Scholar
  5. Chéreau, C., Gaskell, M. G., & Dumay, N. (2007). Reading spoken words: Orthographic effects in auditory priming. Cognition, 102(3), 341–360.CrossRefGoogle Scholar
  6. Cohen, L., Dehaene, S., Naccache, L., Lehéricy, S., Dehaene-Lambertz, G., Hénaff, M. A., & Michel, F. (2000). The visual word form area. Brain, 123(2), 291–307.CrossRefGoogle Scholar
  7. Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6(1), 84–107.CrossRefGoogle Scholar
  8. Das, T., Kumar, U., Bapi, R. S., Padakannaya, P., & Singh, N. C. (2009). Neural representation of an alphasyllabary-The story of Devanagari. Current Science, 97(7), 1033–1038.Google Scholar
  9. De Luca, M., Borrelli, M., Judica, A., Spinelli, D., & Zoccolotti, P. (2002). Reading words and pseudowords: An eye movement study of developmental dyslexia. Brain and Language, 80(3), 617–626.CrossRefGoogle Scholar
  10. Ellis, N. C., Natsume, M., Stavropoulou, K., Hoxhallari, L., Daal, V. H., Polyzoe, N., et al. (2004). The effects of orthographic depth on learning to read alphabetic, syllabic, and logographic scripts. Reading Research Quarterly, 39(4), 438–468.CrossRefGoogle Scholar
  11. Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11(1), 19–23.CrossRefGoogle Scholar
  12. Facoetti, A., Paganoni, P., Turatto, M., Marzola, V., & Mascetti, G. G. (2000). Visual-spatial attention in developmental dyslexia. Cortex, 36(1), 109–123.CrossRefGoogle Scholar
  13. Guo, T., & Peng, D. (2006). Event-related potential evidence for parallel activation of two languages in bilingual speech production. NeuroReport, 17(17), 1757–1760.Google Scholar
  14. Gupta, A. (2004). Reading difficulties of Hindi-speaking children with developmental dyslexia. Reading and Writing, 17(1–2), 79–99.CrossRefGoogle Scholar
  15. Huang, X., Jing, J., Zou, X. B., Wang, M. L., Li, X. H., & Lin, A. H. (2008). Eye movements characteristics of Chinese dyslexic children in picture searching. Chinese Medical Journal, 121(17), 1617–1621.CrossRefGoogle Scholar
  16. Huettig, F., & Janse, E. (2016). Individual differences in working memory and processing speed predict anticipatory spoken language processing in the visual world. Language, Cognition and Neuroscience, 31(1), 80–93.CrossRefGoogle Scholar
  17. Huettig, F., & McQueen, J. M. (2007). The tug of war between phonological, semantic and shape information in language-mediated visual search. Journal of Memory and Language, 57(4), 460–482.Google Scholar
  18. Huettig, F., Olivers, C. N., & Hartsuiker, R. J. (2011). Looking, language, and memory: Bridging research from the visual world and visual search paradigms. Acta Psychologica, 137(2), 138–150.CrossRefGoogle Scholar
  19. Jeffries, S., & Everatt, J. (2004). Working memory: Its role in dyslexia and other specific learning difficulties. Dyslexia, 10(3), 196–214.CrossRefGoogle Scholar
  20. Karanth, P. (1992). Developmental dyslexia in bilingual-biliterates. Reading and Writing, 4(3), 297–306.CrossRefGoogle Scholar
  21. Katz, L., & Frost, R. (1992). The reading process is different for different orthographies: The orthographic depth hypothesis. Advances in Psychology, 94, 67–84.CrossRefGoogle Scholar
  22. Knoeferle, P., & Crocker, M. W. (2006). The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science, 30(3), 481–529.CrossRefGoogle Scholar
  23. Kroll, J. F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connections between bilingual memory representations. Journal of Memory and Language, 33(2), 149–174.CrossRefGoogle Scholar
  24. Leong, C. K. (1986). What does accessing a morphemic script tell us about reading and reading disorders in an alphabetic script? Annals of Dyslexia, 36(1), 82–102.CrossRefGoogle Scholar
  25. Marian, V., & Spivey, M. (2003). Competing activation in bilingual language processing: Within-and between-language competition. Bilingualism: Language and Cognition, 6(02), 97–115.CrossRefGoogle Scholar
  26. Miles, E. (2000). Dyslexia may show a different face in different languages. Dyslexia, 6(3), 193–201.CrossRefGoogle Scholar
  27. Mishra, R. K. (2009). Interface of language and visual attention: Evidence from production and comprehension. Progress in Brain Research, 176, 277–292.CrossRefGoogle Scholar
  28. Mishra, R. K., Huettig, F., & Olivers, C. N. (2012). Automaticity and conscious decisions during language-mediated eye gaze in the visual world. Progress in Brain Research, 212.Google Scholar
  29. Mishra, R. K., & Singh, N. (2014). Language non-selective activation of orthography during spoken word processing in Hindi–English sequential bilinguals: an eye tracking visual world study. Reading and Writing, 27(1), 129–151.CrossRefGoogle Scholar
  30. Mishra, R. K., & Singh, N. (2016). The influence of second language proficiency on bilingual parallel language activation in Hindi–English bilinguals. Journal of Cognitive Psychology, 28(4), 396–411.CrossRefGoogle Scholar
  31. Nag, S. (2011). The akshara languages: What do they tell us about children’s literacy learning? In Language-cognition: State of the art (pp. 291–310). Munich, Germany: Lincom Europa.Google Scholar
  32. Nehru, R. (2001). Distorted grapheme representation: A new hypothesis to explain dyslexic reading errors. Poster presented at the Fifth British Dyslexia Association international conference, York, UK.Google Scholar
  33. Padakannaya, P., Pandey, A., Saligram, D., & Ranga Rao, S. (2016). Visual-orthographic complexity of Akshara and eye movements in reading: A study in Kannada alphasyllabary. Writing Systems Research, 8(1), 32–43.CrossRefGoogle Scholar
  34. Padakannaya, P., Pandey, A., Saligram, D., & Ranga Rao, S. (2016). Visual-orthographic complexity of Akshara and eye movements in reading: A study in Kannada alphasyllabary. Writing Systems Research, 8(1), 32–43.Google Scholar
  35. Perre, L., & Ziegler, J. C. (2008). On-line activation of orthography in spoken word recognition. Brain Research, 1188, 132–138.Google Scholar
  36. Purushothama, G. (1990). Reading vowels in Kannada script. Journal of Learning Disabilities, 23(3), 198–200.CrossRefGoogle Scholar
  37. Ramaa, S. (2000). Two decades of research on learning disabilities in India. Dyslexia, 6(4), 268–283.CrossRefGoogle Scholar
  38. Rao, C., & Singh, N. C. (2015). Visuospatial complexity modulates reading in the brain. Brain and Language, 141, 50–61.CrossRefGoogle Scholar
  39. Rao, C., Vaid, J., & Chen, H. C. (2017). The processing cost for reading misaligned words is script-specific: Evidence from Hindi and Kannada/Hindi readers. Journal of Cultural Cognitive Science, 1(1), 39–48.Google Scholar
  40. Rao, C., Vaid, J., Srinivasan, N., & Chen, H. C. (2011). Orthographic characteristics speed Hindi word naming but slow Urdu naming: Evidence from Hindi/Urdu biliterates. Reading and Writing, 24(6), 679–695.Google Scholar
  41. Rayner, K. (1985). Do faulty eye movements cause dyslexia? Developmental Neuropsychology, 1(1), 3–15.CrossRefGoogle Scholar
  42. Roychoudhuri, K. S., Prasad, S. G., & Mishra, R. K. (2016). Iconic native culture cues inhibit second language production in a non-immigrant population: Evidence from Bengali-English bilinguals. Frontiers in Psychology, 7, 1516.CrossRefGoogle Scholar
  43. Salverda, A. P., & Tanenhaus, M. K. (2010). Tracking the time course of orthographic information in spoken-word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36(5), 1108.Google Scholar
  44. Seidenberg, M. S., & Tanenhaus, M. K. (1979). Orthographic effects on rhyme monitoring. Journal of Experimental Psychology: Human Learning and Memory, 5(6), 546.Google Scholar
  45. Singh, N., & Mishra, R. K. (2015). Unintentional activation of translation equivalents in bilinguals leads to attention capture in a cross-modal visual task. PLoS One, 10(3), e0120131.Google Scholar
  46. Spivey, M. (2008). The continuity of mind. Oxford, UK: Oxford University Press.Google Scholar
  47. Spivey, M. J., & Marian, V. (1999). Cross talk between native and second languages: Partial activation of an irrelevant lexicon. Psychological Science, 10(3), 281–284.CrossRefGoogle Scholar
  48. Sunderman, G. L., & Priya, K. (2012). Translation recognition in highly proficient Hindi–English bilinguals: The influence of different scripts but connectable phonologies. Language and Cognitive Processes, 27(9), 1265–1285.CrossRefGoogle Scholar
  49. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217), 1632–1634.CrossRefGoogle Scholar
  50. Vaid, J., & Gupta, A. (2002). Exploring word recognition in semi-alphabetic script: The case of Devanagari. Brain and Language, 81, 679–690.Google Scholar
  51. Weber, A., & Cutler, A. (2004). Lexical competition in non-native spoken-word recognition. Journal of Memory and Language, 50(1), 1–25.CrossRefGoogle Scholar
  52. Weekes, B. S. (2005). Acquired disorders of reading and writing: Cross-script comparisons. Behavioural Neurology, 16(2–3), 51–57.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Center for Neural and Cognitive Sciences , School of Medical SciencesUniversity of HyderabadHyderabadIndia

Personalised recommendations