Abstract
Many work environments can benefit from integrated computing devices to provide information to users, record users’ actions, and prompt users about the next steps to take in a procedure. We focus on the cell biology laboratory, where previous work on the Labscape project has provided a framework to organize experiment plans and store data. Currently developed sensor systems allow amount and type of materials used in experiments to be recorded. This paper focuses on providing the last piece: determining where the materials are deposited. Using a camera and projector setup over a lab bench, vision techniques allow a specially marked well tray and pipette to be located in real time with enough precision to determine which well the pipette tip is over. Using the projector, the tray can be augmented with relevant information, such as the next operation to be performed, or the contents of the tray. Without changing the biologist’s work practice, it is possible to record the physical interactions and provide easily available status and advice to the user. Preliminary user feedback suggests this system would indeed be a useful addition to the laboratory environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arnstein, L., Hung, C.Y., Franza, R., Zhou, Q.H., Borriello, G., Consolvo, S., Su, J.: Labscape: A smart environment for the cell biology laboratory. Pervasive Computing Magazine 1, 13–21 (2002)
University of Washington CSI website (2003), http://csi.washington.edu
TeraNode website (2003), http://www.teranode.com
Arnstein, L., Grimm, R., Hung, C.Y., Kang, J.H., LaMarca, A., Look, G., Sigurdsson, S.B., Su, J., Borriello, G.: Systems support for ubiquitous computing: A case study of two implementations of labscape. In: Pervasive Computing Conference (2002)
Fishkin, K., Wang, M.: A flexible, low-overhead ubiquitous system for medication monitoring. In: Intel Research Technical Report 03-011 (2003)
Arnstein, L., Sigdursson, S., Franza, B.: Ubiquitous computing in the biology laboratory. Journal of Lab Automation 6 (2001)
Kjeldsen, R., Levas, A., Pinhanez, C.: Dynamically reconfigurable vision-based user interfaces. In: 3rd International Conference on Computer Vision Systems, pp. 323–332 (2003)
Pinhanez, C.: The everywhere displays projector: A device to create ubiquitous graphical interfaces. In: Ubiquitous Computing, UbiComp 2003 (2003)
Crowley, J.L., Coutaz, J.: Vision for man machine interaction. In: EHCI, pp. 28–45 (1995)
Ishii, Y., Nakanishi, Y., Koike, H., Oka, K., Sato, Y.: Enhancedmovie: Movie editing on an augmented desk. In: Ubiquitous Computing, UbiComp 2003 (2003)
Rekimoto, J., Saitoh, M.: Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 378–385. ACM Press, New York (1999)
Ishii, H., Ullmer, B.: Tangible bits: Towards seamless interfaces between people, bits and atoms. In: CHI, pp. 234–241 (1997)
Ullmer, B., Ishii, H.: The metadesk: Models and prototypes for tangible user interfaces. In: ACM Symposium on User Interface Software and Technology, pp. 223–232 (1997)
Fjeld, M., Bichsel, M., Rauterberg, M.: BUILD-IT: An intuitive design tool based on direct object manipulation. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, p. 297. Springer, Heidelberg (1998)
Beckmann, C., Dey, A.K.: Siteview: Tangibly programming active environments with predictive visualization. In: Intel Research Tech Report 03-019 (2003)
Wellner, P.: Interacting with paper on the DigitalDesk. Communications of the ACM 36, 86–97 (1993)
Takao, N., Shi, J., Baker, S.: Tele-graffiti: A camera-projector based remote sketching system with hand-based user interface and automatic session summarization. International Journal of Computer Vision 53 (2003)
Sanneblad, J., Holmquist, L.E.: Total recall: In-place viewing of captured whiteboard annotations. In: Ubiquitous Computing, UbiComp 2003 (2003)
Klemmer, S.R., Newman, M.W., Farrell, R., Bilezikjian, M., Landay, J.A.: The designers’ outpost: a tangible interface for collaborative web site. In: Proceedings of the 14th annual ACM symposium on User interface software and technology, pp. 1–10. ACM Press, New York (2001)
ARToolkit website (2003), http://www.hitl.washington.edu/artoolkit
Billinghurst, M., Kato, H.: Collaborative augmented reality. Communications of the ACM 45, 64–70 (2002)
Gong, Y.: Detection of regions matching specified chromatic features. Computer Vision and Image Understanding 61, 263–269 (1995)
Jamzad, M., Sadjad, B.S., Mirrokni, V.S., Kazemi, M., Chitsaz, H., Heydarnoori, A., Hajiaghai, M.T., Chiniforooshan, E.: A fast vision system for middle size robots in robocup. In: RoboCup Symposium (2001)
Schulz, D., Fox, D., Hightower, J.: People tracking with anonymous and id-sensors using rao-blackwellised particle filters. In: IJCAI (2003)
Rekimoto, J., Ayatsuka, Y.: Cybercode: Designing augmented reality environments with visual tags. In: Proceedings of DARE (2000)
Virtual Ink Mimio website (2003), http://www.mimio.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hile, H., Kim, J., Borriello, G. (2004). Microbiology Tray and Pipette Tracking as a Proactive Tangible User Interface. In: Ferscha, A., Mattern, F. (eds) Pervasive Computing. Pervasive 2004. Lecture Notes in Computer Science, vol 3001. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24646-6_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-24646-6_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21835-7
Online ISBN: 978-3-540-24646-6
eBook Packages: Springer Book Archive