Skip to main content
SpringerLink
Log in

Constructing a holistic view of shopping with people with visual impairment: a participatory design approach

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

We report and reflect on a participatory design (PD) process in which we engaged with people with visual impairments (PVI) over an extended period of time; these interactions were aimed at understanding and assessing PVI experiences about shopping and assistive technologies. In particular, we examined in detail how PVI conduct grocery shopping with the help of different technologies, and found that activities taking place in the homes of PVI reflect aspects of the shopping activity that are challenging but understudied in prior work. Our participants revealed that identifying products that have run short, itemizing needed products in a list, and organizing newly purchased products at home were difficult for them; we also discussed the tools they used and whether the tools did or did not help. We synthesize our findings and explain how the extended PD activities informed our ideas for future design, as well as suggesting principles for PD engagement with PVI participants.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://www.cdc.gov/ncbddd/developmentaldisabilities/casedefinitions.html.

  2. http://blindsquare.com/about/.

  3. http://www.taptapseeapp.com/.

  4. http://www.afb.org/info/blindnessstatistics/adults/facts-and-figures/235#educationlevel.

References

  1. Allman, T.: From bat sonar to canes for the blind. In: Imitating Nature. KidHaven Press (2006)

  2. Ankolekar, A., Sandholm, T., Yu, L.: Play it by ear: a case for serendipitous discovery of places with musicons. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2959–2968. ACM (2013)

  3. Avital, M., Lyytinen, K., Boland, R., Butler, B., Dougherty, D., Fineout, M., Jansen, W., Levina, N., Rifkin, W., Venable, J.: Design with a positive lens: an affirmative approach to designing information and organizations. Commun. Assoc. Inf. Syst. 18, 519–545 (2006)

    Google Scholar 

  4. Blum, J.R., Bouchard, M., Cooperstock, J.R.: What’s around me? Spatialized audio augmented reality for blind users with a smartphone. In: Mobile and Ubiquitous Systems: Computing, Networking, and Services, pp. 49–62 (2012)

  5. Bratteteig, T., Wagner, I.: Design decisions and the sharing of power in PD. In: Proceedings of the 13th Participatory Design Conference, pp. 29–32. ACM (2014)

  6. Brock, A.M.: Touch the map! Designing interactive maps for visually impaired people. In: Proceedings of the ACM SIGACCESS Accessibility and Computing, pp. 9–14. ACM (2013)

  7. Buskermolen, D.O., Terken, J.: Co-constructing stories: a participatory design technique to elicit in-depth user feedback and suggestions about design concepts. In: Proceedings of the 12th Participatory Design Conference, pp. 33–36. ACM (2012)

  8. Cahill, C.: Including excluded perspectives in participatory action research. Des. Stud. 28(3), 325–340 (2007)

    Article  Google Scholar 

  9. Carroll, J.M., Convertino, G., Farooq, U., Rosson, M.B.: The firekeepers: aging considered as a resource. Univ. Access Inf. Soc. 11(1), 7–15 (2012)

    Article  Google Scholar 

  10. Carroll, J.M., Chin, G., Rosson, M.B., Neale, D.C.: The development of cooperation: five years of participatory design in the virtual school. In: Proceedings of Designing Interactive Systems (DIS ’00), pp. 239–251. ACM (2000)

  11. Duckett, P.S., Pratt, R.: The researched opinions on research: visually impaired people and visual impairment research. Disabil. Soc. 16(6), 815–835 (2001)

    Article  Google Scholar 

  12. Foley, A., Ferri, B.A.: Technology for people, not disabilities: ensuring access and inclusion. J. Res. Spec. Educ. Needs 12(4), 192–200 (2012)

    Article  Google Scholar 

  13. Gerrard, V., Ricardo, S.: Examining participation. In: Proceedings of the 13th Participatory Design Conference: Research Papers (PDC ‘14), pp. 111–120. ACM (2014)

  14. Gharpure, C.P., Kulyukin, V.A.: Robot-assisted shopping for the blind: issues in spatial cognition and product selection. Intel. Serv. Robot. 1(3), 237–251 (2008)

    Article  Google Scholar 

  15. Heylighen, A., Nijs, G.: Designing in the absence of sight: design cognition re-articulated. Des. Stud. 35(2), 113–132 (2014)

    Article  Google Scholar 

  16. Katz, B.F., Kammoun, S., Parseihian, G., Gutierrez, O., Brilhault, A., Auvray, M., Truillet, P., Denis, M., Thorpe, S., Jouffrais, C.: NAVIG: augmented reality guidance system for the visually impaired. Virtual Real. 16(4), 253–269 (2012)

    Article  Google Scholar 

  17. Kuber, R., Yu, W., McAllister, G.: Towards developing assistive haptic feedback for visually impaired internet users. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘07), pp. 1525–1534. ACM (2007)

  18. Khambadkar, V., Folmer, E.: GIST: a gestural interface for remote nonvisual spatial perception. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST ‘13), pp. 301–310. ACM (2013)

  19. Kulyukin, V., Kutiyanawala, A.: Accessible shopping systems for blind and visually impaired individuals: design requirements and the state of the art. Open Rehabil. J. 3, 158–168 (2010)

    Article  Google Scholar 

  20. Kulyukin, V., Gharpure, C., Nicholson, J.: RoboCart: toward robot-assisted navigation of grocery stores by the visually impaired. In: Proceedings of the IEEE/RSJ IROS, pp. 2845–2850. IEEE Press, Edmonton (2005)

  21. Lamoureux, E.L., Hassell, J.B., Keeffe, J.E.: The determinants of participation in activities of daily living in people with impaired vision. Am. J. Ophthalmol. 137(2), 265–270 (2004)

    Article  Google Scholar 

  22. Lanigan, P.E., Paulos, A.M., Williams, A.W., Rossi, D., Narasimhan, P.: Trinetra: assistive technologies for grocery shopping for the blind. In: International IEEE-BAIS Symposium on Research on Assistive Technologies (RAT ’07) (2007)

  23. Liu, X.A.: Camera phone based currency reader for the visually impaired. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets ’08), pp. 305–306. ACM (2008)

  24. Lopez-de Ipina, D., Lorido, T., Lopez, U.: Indoor navigation and product recognition for blind people assisted shopping. In: Proceedings of the 2011 Third International Workshop on Ambient Assisted Living (IWAAL’ 11), pp. 33–40. IWAAL (2011)

  25. Magnusson, C., Rassmus-Gröhn, K., Szymczak, D.: Exploring history: a mobile inclusive virtual tourist guide. In: Proceedings of the 8th Nordic Conference on Human–Computer Interaction: Fun, Fast, Foundational, pp. 69–78. ACM (2014)

  26. Medeiros, V.U.S., Araújo, R.P., Silva, R.L.A., Slaets, A.F.F.: Device for location assistance and identification of products in a closed environment. In: VI Latin American Congress on Biomedical Engineering CLAIB 2014, Paraná, Argentina 29, 30 & 31 October 2014, pp. 992–994. Springer, Berlin (2015)

  27. McCarthy, J., Wright, P.: Taking [A]part: The Politics and Aesthetics of Participation in Experience-Centered Design. MIT Press, Cambridge (2015)

    Book  Google Scholar 

  28. McDaniel, T.L., Kahol, K., Villanueva, D., Panchanathan, S.: Integration of RFID and computer vision for remote object perception for individuals who are blind. In: Proceedings of the 2008 Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS’08), pp. 7:1–7:10. ACM (2008)

  29. Min, B.C., Saxena, S., Steinfeld, A., Dias, M.B.: Incorporating information from trusted sources to enhance urban navigation for blind travelers. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 4511–4518. IEEE (2015)

  30. Pal, J., Pradhan, M., Shah, M., Babu, R.: Assistive technology for vision-impairments: an agenda for the ICTD community. In: Proceedings of the 20th International Conference Companion on World Wide Web, pp. 513–522. ACM (2011)

  31. Pereira, A., Nunes, N., Vieira, D., Costa, N., Fernandes, H., Barroso, J.: Blind Guide: an ultrasound sensor-based body area network for guiding blind people. Proc. Comput. Sci. 67, 403–408 (2015)

    Article  Google Scholar 

  32. Phillips, B., Zhao, H.: Predictors of assistive technology abandonment. Assist. Technol. 5(1), 36–45 (1993)

    Article  Google Scholar 

  33. Shakespeare, T.: Disability Rights and Wrongs Revisited. Routledge, London (2013)

    Google Scholar 

  34. Shakespeare, T., Watson, N.: The social model of disability: an outdated ideology? In: Exploring Theories and Expanding Methodologies: Where We Are and Where We Need to Go, pp. 9–28. Emerald Group Publishing Limited (2001)

  35. Shinohara, K., Wobbrock, J.O.: In the shadow of misperception: assistive technology use and social interactions. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 705–714 (2011)

  36. Vines, J., Clarke, R., Wright, P., McCarthy, J., Olivier, P.: Configuring participation: on how we involve people in design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13), pp. 429–438. ACM (2013)

  37. Williams, M.A., Hurst, A., Kane, S.K.: Pray before you step out: describing personal and situational blind navigation behaviors. In: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’13), pp. 281–288. ACM (2013)

  38. Winlock, T., Christiansen, E., Belongie, S.: Toward real-time grocery detection for the visually impaired. In: Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, pp. 49–56. IEEE (2010)

  39. Yuan, C.W., Hanrahan, B.V., Lee, S., Carroll, J.M.: Designing equal participation in informal learning for people with visual impairment. Interact. Des. Archit. 27, 93–106 (2016)

    Google Scholar 

  40. Zientara, P.A., Lee, S., Smith, G.H., Brenner, R., Itti, L., Rosson, M.B., Carroll, J.M., Irick, K.M., Narayanan, V.: Third Eye: a shopping assistant for the visually impaired. IEEE Trans. Comput. 50(2), 16–24 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Advertising and Public Relations, Fu Jen University, Taipei, Taiwan

    Chien Wen Yuan

  2. College of Information Sciences and Technology, Pennsylvania State University, State College, PA, USA

    Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, Mary Beth Rosson & John M. Carroll

Authors
  1. Chien Wen Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin V. Hanrahan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sooyeon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mary Beth Rosson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John M. Carroll
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chien Wen Yuan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, C.W., Hanrahan, B.V., Lee, S. et al. Constructing a holistic view of shopping with people with visual impairment: a participatory design approach. Univ Access Inf Soc 18, 127–140 (2019). https://doi.org/10.1007/s10209-017-0577-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-017-0577-1

Keywords

Search

Navigation