Skip to main content

Test-Driven Development of Graphical User Interfaces: A Pilot Evaluation

  • Conference paper
Agile Processes in Software Engineering and Extreme Programming (XP 2011)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 77))

Included in the following conference series:

Abstract

This paper presents a technique for test-driven development of GUI based applications, as well as a pilot evaluation. In our approach, user interface prototypes are created in such a way as to allow capture/replay tools to record interactions with them. These recordings can then be replayed on the actual GUI as it is being developed in a test-driven fashion. The pilot evaluation found that developers integrated GUI tests, based on user interface prototypes,into their development process and used them as a way to determine when a feature is actually complete.Study participants felt that TDD of GUI based applications is useful.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Nagappan, N., Maximilien, E., Bhat, T., Williams, L.: Realizing Quality Improvement through Test Driven Development: Results and Experiences of Four Industrial Teams. In: Empirical Software Engineering, pp. 289–302 (2008)

    Google Scholar 

  2. Jeffries, R., Melnik, G.: Guest Editors’ Introduction: TDD - The Art of Fearless Programming. IEEE Software, 24–30 (2007)

    Google Scholar 

  3. Holmes, A., Kellogg, M.: Automating Functional Tests Using Selenium. In: AGILE 2006, pp. 270–275 (2006)

    Google Scholar 

  4. Itkonon, J., Mäntylä, M., Lassenius, C.: Defect Detection Efficiency: Test Case Based vs. Exploratory Testing. In: First International Symposium on Empirical Software Engineering and Measurement, Madrid, Spain, pp. 61–70 (2007)

    Google Scholar 

  5. Hellmann, T., Hosseini-Khayat, A., Maurer, F.: Supporting Test-Driven Development of Graphical User Interfaces Using Agile Interaction Design. In: Third International Conference on Software Testing, Verification, and Validation Workshops, Paris, pp. 444–447 (2010)

    Google Scholar 

  6. Microsoft: SketchFlow. In: Microsoft Expression, http://www.microsoft.com/expression/products/Sketchflow_Overview.aspx

  7. Buxton, B.: Sketching User Experiences. Morgan Kaufmann, San Francisco (2007)

    Google Scholar 

  8. Barnum, C.: Usability Testing and Research. Pearson Education, New York (2002)

    Google Scholar 

  9. Hosseini-Khayat, A.: Distributed Wizard of Oz Usability Testing for Agile Teams. Master’s Thesis, University of Calgary, Calgary (2010)

    Google Scholar 

  10. Wilson, P.: Active Story: A Low Fidelity Prototyping and Distributed Usability Testing Tool for Agile Teams. MSc Thesis, Univerity of Calgary (August 2008)

    Google Scholar 

  11. Hellmann, T.: LEET (LEET Enhances Exploratory Testing) - CodePlex. http://leet.codeplex.com/ (accessed 2010)

  12. Xie, Q., Memon, A.: Using a Pilot Study to Derive a GUI Model for Automated Testing. ACM Transactions on Software Engineering and Methodology 18(2), 1–35 (2008)

    Article  Google Scholar 

  13. Xie, Q., Memon, A.: Studying the Characteristics of a ”Good” GUI Test Suite. In: Proceedings of the 17th International Symposium on Software Reliability Engineering, Raleigh, NC, pp. 159–168 (2006)

    Google Scholar 

  14. Kaner, C., Bach, J.: Black Box Software Testing. In: Center for Software Testing Education and Research, http://www.testingeducation.org/k04/documents/BBSTOverviewPartC.pdf (accessed Fall 2005)

  15. Memon, A., Benerjee, I., Nagarajan, A.: What Test Oracle Should I Use for Effective GUI Testing. In: 18th IEEE International Conference on Automated Software Engineering, Montreal, pp. 164–173 (2003)

    Google Scholar 

  16. Memon, A., Soffa, M.: Regression Testing of GUIs. In: ACM SIGSOFT International Symposium on Foundations of Software Engineering, pp. 118–127 (2003)

    Google Scholar 

  17. Memon, A.: Automatically Repairing Event Sequence-Based GUI Test Suites for Regression Testing. ACM Transactions on Software Engineering and Methodology 18(2), 1–36 (2008)

    Article  MathSciNet  Google Scholar 

  18. Ruiz, A., Price, W.: Test-Driven GUI Development with TestNG and Abbot. IEEE Software, 51–57 (2007)

    Google Scholar 

  19. Ruiz, A., Price, Y.: GUI Testing Made Easy. In: Testing: Academic and Industrial Conference - Practice and Research Techniques, pp. 99–103 (2008)

    Google Scholar 

  20. Burbeck, S.: Appplications Programming in Smalltalk-80: How to Use Model-View-Controller (MVC). In: How to Use Model-View-Controller (MVC), http://st-www.cs.illinois.edu/users/smarch/st-docs/mvc.html (accessed 1987, 1992)

  21. Marick, B.: Bypasing the GUI. Software Testing and Quality Engineering Magazine, 41–47 (September/October 2002)

    Google Scholar 

  22. Brooks, P., Robinson, B., Memon, A.: An Initial Characterization of Industrial Graphical User Interface Systems. In: International Conference on Software Testing, Verification, and Validation, Denver, pp. 11–20 (2009)

    Google Scholar 

  23. Robinson, B., Brooks, P.: An Initial Study of Customer-Reported GUI Defects. In: Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops, pp. 267–274 (2009)

    Google Scholar 

  24. Memon, A.: A Comprehensive Framework for Testing Graphical User Interfaces. PhD Thesis, University of Pittsburgh (2001)

    Google Scholar 

  25. Chen, W., Tsai, T., Chao, H.: Integration of Specification-Based and CR-Based Approaches for GUI Testing. In: 19th International Conference on Advanced Information Networking and Applications, pp. 967–972 (2005)

    Google Scholar 

  26. Calgary Agile Methods User Group. In: CAMUG, http://calgaryagile.com/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hellmann, T.D., Hosseini-Khayat, A., Maurer, F. (2011). Test-Driven Development of Graphical User Interfaces: A Pilot Evaluation. In: Sillitti, A., Hazzan, O., Bache, E., Albaladejo, X. (eds) Agile Processes in Software Engineering and Extreme Programming. XP 2011. Lecture Notes in Business Information Processing, vol 77. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20677-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20677-1_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20676-4

  • Online ISBN: 978-3-642-20677-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics