Abstract
Many studies of ubiquitous computing systems involve deploying a system to a group of users who will be studied through direct observation, interviews and the gathering of system log data. However, such studies are often limited in the number of participants and duration of the trial, particularly if the researchers are providing the participants with hardware. Apple’s App Store and similar application repositories have become popular with smartphone users, yet few ubiquitous computing studies have yet utilised these distribution mechanisms. We describe our experiences of running a very large scale trial where such a distribution model is used to recruit thousands of users for a mobile system trial that can be run continuously with no constrained end date. We explain how we conducted such a trial, covering issues such as data logging and interviewing users based in several different continents. Benefits and potential shortcomings of running a trial in this way are discussed and we offer guidance on ways to help manage a large and disparate user-base using in-application feedback measures and web-based social networking applications. We describe how, through these methods, we were able to further the development of a piece of ubiquitous computing software through user-informed design on a mass scale.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Rogers, Y., et al.: Why it’s worth the hassle: The value of in-situ studies when designing UbiComp. In: Krumm, J., Abowd, G.D., Seneviratne, A., Strang, T. (eds.) UbiComp 2007. LNCS, vol. 4717, pp. 336–353. Springer, Heidelberg (2007)
IDC, Worldwide Converged Mobile Device Market Grows 39.0% Year Over Year in Fourth Quarter, http://www.idc.com/getdoc.jsp?containerId=prUS22196610
Zhai, S., et al.: Shapewriter on the iPhone: from the laboratory to the real world. In: Proc. ACM CHI Extended Abstracts, pp. 2667–2670 (2009)
Bell, M., et al.: Interweaving Mobile Games with Everyday Life. In: Proc. ACM CHI, pp. 417–426 (2006)
Hall, M., et al.: Adapting Ubicomp Software and its Evaluation. In: Proc. ACM Engineering Interactive Computing Systems, pp. 143–148 (2009)
O’Neill, E., et al.: Instrumenting the city: developing methods for observing and understanding the digital cityscape. In: Dourish, P., Friday, A. (eds.) UbiComp 2006. LNCS, vol. 4206, pp. 315–332. Springer, Heidelberg (2006)
Reades, J., et al.: Cellular Census: Explorations in Urban Data Collection. Pervasive Computing 6(3), 30–38 (2007)
Chin, A.: Finding Cohesive Subgroups and Relevant Members in the Nokia Friend View Mobile Social Network. In: Proc. Social Computing, pp. 278–283 (2009)
Licoppe, C., Inada, Y.: Emergent Uses of a Multiplayer Location-aware Mobile Game: the Interactional Consequences of Mediated Encounters. Mobilities 1(1), 39–61 (2006)
Crabtree, A., et al.: Supporting Ethnographic Studies of Ubiquitous Computing in the Wild. In: Proc. ACM DIS, pp. 60–69 (2006)
Froehlich, J., et al.: Voting With Your Feet: An Investigative Study of the Relationship Between Place Visit Behavior and Preference. In: Dourish, P., Friday, A. (eds.) UbiComp 2006. LNCS, vol. 4206, pp. 333–350. Springer, Heidelberg (2006)
Carter, S., et al.: Support for Situated Ubicomp Experimentation. In: Proc. ACM CHI, pp. 125–134 (2007)
Morrison, A., et al.: Using Location and Motion Data to Filter System Logs. In: LaMarca, A., Langheinrich, M., Truong, K.N. (eds.) Pervasive 2007. LNCS, vol. 4480, pp. 109–126. Springer, Heidelberg (2007)
Common European Framework of Reference for Languages, http://www.coe.int/T/DG4/Linguistic/CADRE_EN.asp
Facebook Statistics, http://www.facebook.com/press/info.php?statistics
FAST, Federation Asks: Do you know what you’re agreeing to?, http://www.fastiis.org/resources/press/id/304/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
McMillan, D., Morrison, A., Brown, O., Hall, M., Chalmers, M. (2010). Further into the Wild: Running Worldwide Trials of Mobile Systems. In: Floréen, P., Krüger, A., Spasojevic, M. (eds) Pervasive Computing. Pervasive 2010. Lecture Notes in Computer Science, vol 6030. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12654-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-12654-3_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12653-6
Online ISBN: 978-3-642-12654-3
eBook Packages: Computer ScienceComputer Science (R0)