Abstract
Once simple and static, many web pages have now evolved into complex web applications. Hundreds of web development libraries are providing ready-to-use dynamic widgets, which can be further customized to fit the needs of individual web application. With such wide selection of widgets and a lack of standardization, dynamic widgets have proven to be an insurmountable problem for blind users who rely on screen readers to make web pages accessible. Screen readers generally do not recognize widgets that dynamically appear on the screen; as a result, blind users either cannot benefit from the convenience of using widgets (e.g., a date picker) or get stuck on inaccessible content (e.g., alert windows). In this paper, we propose a general approach to identifying or classifying dynamic widgets with the purpose of “reverse engineering” web applications and improving their accessibility. To demonstrate the feasibility of the approach, we report on the experiments that show how very popular dynamic widgets such as date picker, popup menu, suggestion list, and alert window can be effectively and accurately recognized in live web applications.
Chapter PDF
Similar content being viewed by others
Keywords
References
Bezemer, C.-P., Mesbah, A., Deursen, A.V.: Automated security testing of web widget interactions. In: Proceedings of the the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, pp. 81–90. ACM, Amsterdam (2009)
Bolin, M., Webber, M., Rha, P., Wilson, T., Miller, R.C.: Automation and customization of rendered web pages. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 163–172. ACM, Seattle (2005)
Borodin, Y., Bigham, J.P., Dausch, G., Ramakrishnan, I.V.: More than meets the eye: a survey of screen-reader browsing strategies. In: Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), pp. 1–10. ACM, Raleigh (2010)
Borodin, Y., Bigham, J.P., Raman, R., Ramakrishnan, I.V.: What’s new?: making web page updates accessible. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Halifax (2008)
Borodin, Y., Sovyak, A., Dimitriyadi, A., Puzis, Y., Melnyk, V., Ahmed, F., Dausch, G., Ramakrishnan, I.V.: Universal and ubiquitous web access with Capti. In: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, pp. 1–2. ACM, Lyon (2012)
Brown, A., Jay, C., Chen, A.Q., Harper, S.: The uptake of Web 2.0 technologies, and its impact on visually disabled users. Univers. Access Inf. Soc. 11(2), 185–199 (2012)
Brown, A., Jay, C., Harper, S.: Audio access to calendars. In: Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), pp. 1–10. ACM, Raleigh (2010)
Chen, A., Harper, S., Lunn, D., Brown, A.: Widget Identification: A High-Level Approach to Accessibility. World Wide Web 16(1), 73–89 (2013)
Chen, C.L., Raman, T.V.: AxsJAX: a talking translation bot using Google IM: bringing Web-2.0 applications to life. In: Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A). ACM, Beijing (2008)
DevExpress. DevExpress Widget Library (2014), https://www.devexpress.com (cited 2014)
Dixon, M., Leventhal, D., Fogarty, J.: Content and hierarchy in pixel-based methods for reverse engineering interface structure. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 969–978. ACM, Vancouver (2011)
DOM. W3C Document Object Model (2004), http://www.w3.org/DOM/DOMTR (cited 2010)
Google. Google Web Toolkit (2014), http://gwt-ext.com/demo/ (cited 2014)
Hailpern, J., Guarino-Reid, L., Boardman, R., Annam, S.: Web 2.0: blind to an accessible new world. In: Proceedings of the 18th International Conference on World Wide Web, pp. 821–830. ACM, Madrid (2009)
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA Data Mining Software: An Update. SIGKDD Explorations (2009)
HTML5. Hyper-Text Markup Language v.5.0 (2010), http://dev.w3.org/html5/spec/ (cited 2010)
JAWS. Screen reader from Freedom Scientific (2013), http://www.freedomscientific.com/products/fs/jaws-product-page.asp (cited 2013)
Jay, C., Brown, A.J., Harper, S.: Internal evaluation of the SASWAT audio browser: method, results and experimental materials, The University of Manchester (2010)
Joseph Scheuhammer, M.C.: WAI-ARIA 1.0 Authoring Practices (2013), http://www.w3.org/TR/wai-aria-practices/ (cited 2014)
Linaje, M., Lozano-Tello, A., Perez-Toledano, M.A., Preciado, J.C., Rodriguez-Echeverria, R., Sanchez-Figueroa, F.: Providing RIA user interfaces with accessibility properties. Journal of Symbolic Computation 46(2), 207–217 (2011)
Lourdes, M.: Toward an Equal Opportunity Web: Applications, Standards, and Tools that Increase Accessibility. In: Paloma, M., Belen, R., Ana, I. (eds.), pp. 18–26 (2011)
Mesbah, A., Bozdag, E., Deursen, A.V.: Crawling AJAX by inferring user interface state changes. In: Proceedings of the 2008 8th International Conference on Web Engineering. IEEE Computer Society (2008)
MiniwattsMarketingGroup. Internet Usage Statistics: The Internet Big Picture World Internet Users and Population Stats (2013), http://www.internetworldstats.com/stats.htm (cited 2013)
NVDA. NonVisual Desktop Access (2013), http://www.nvda-project.org/ (cited 2013)
Rayson, P., Wilson, A., Leech, G.: Grammatical word class variation within the British National Corpus sampler. Language and Computers 36(1), 295–306 (2001)
SaToGo, Screen reader from Serotek (2010)
SuperNova. Screen Reader from Dolphin (2013), http://www.yourdolphin.com/productdetail.asp?id=1 (cited 2013)
Telerik. Telerik Widget Library, http://www.telerik.com (cited 2014)
Thiessen, P., Chen, C.: Ajax live regions: chat as a case example. In: Proceedings of the 2007 International Cross-Disciplinary Conference on Web Accessibility (W4A), pp. 7–14. ACM, Banff (2007)
VoiceOver, Screen reader from Apple (2010)
W3C. Important Terms (2014), http://www.w3.org/TR/wai-aria/terms (cited 2014)
WAI-ARIA. W3C Accessible Rich Internet Applications (2013), http://www.w3.org/TR/wai-aria (cited 2013)
Window-Eyes, Screen Reader GW Micro (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Melnyk, V., Ashok, V., Puzis, Y., Soviak, A., Borodin, Y., Ramakrishnan, I.V. (2014). Widget Classification with Applications to Web Accessibility. In: Casteleyn, S., Rossi, G., Winckler, M. (eds) Web Engineering. ICWE 2014. Lecture Notes in Computer Science, vol 8541. Springer, Cham. https://doi.org/10.1007/978-3-319-08245-5_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-08245-5_20
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08244-8
Online ISBN: 978-3-319-08245-5
eBook Packages: Computer ScienceComputer Science (R0)