Skip to main content

Pervasive System for Consumer Behaviour Analysis in Retail Environments

  • Conference paper
  • First Online:
Video Analytics. Face and Facial Expression Recognition and Audience Measurement (VAAM 2016, FFER 2016)

Abstract

In the context of retailing, the monitoring of consumer behaviours is particularly important for supporting vendors in their management and marketing decisions. Many studies have been carried out about various aspects and consequences of different behaviours. However, only recently the potential of computing systems is being used for automated data collection and processing. In this work, we present a novel pervasive system able to automatically monitor consumer behaviour in front of shelves in an intelligent retail environment (IRE). Data collected are stored into a cloud server for data analysis and insights, ready to be used by a Decision Support System (DSS).

The completely autonomous and low cost system proposed in this paper is based on a software infrastructure connected to a video sensor network. A set of computer vision algorithms, embedded in the distributed RGB-D cameras, provides information concerning customer behaviour, in particular, user-shelf interactions described with temporal and spatial features. This large number of analytics allows insight deductions. The use of distributed vision sensors inside a retail environment is novel and produces really valuable data for brands and retailers.

The feasibility and the effectiveness of the proposed architecture and approach have been tested on real retail environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bedagkar-Gala, A., Shah, S.K.: A survey of approaches and trends in person re-identification. Image Vis. Comput. 32(4), 270–286 (2014)

    Article  Google Scholar 

  2. Chandon, P., Hutchinson, J., Bradlow, E., Young, S.H.: Measuring the value of point-of-purchase marketing with commercial eye-tracking data. INSEAD Business School Research Paper (2007/22) (2006)

    Google Scholar 

  3. Frontoni, E., Mancini, A., Zingaretti, P.: Embedded vision sensor network for planogram maintenance in retail environments. Sens. (Switz.) 15(9), 21114–21133 (2015)

    Article  Google Scholar 

  4. Frontoni, E., Raspa, P., Mancini, A., Zingaretti, P., Placidi, V.: Customers’ activity recognition in intelligent retail environments. In: Petrosino, A., Maddalena, L., Pala, P. (eds.) ICIAP 2013. LNCS, vol. 8158, pp. 509–516. Springer, Heidelberg (2013). doi:10.1007/978-3-642-41190-8_55

    Chapter  Google Scholar 

  5. Güven, S., Oda, O., Podlaseck, M., Stavropoulos, H., Kolluri, S., Pingali, G.: Social mobile augmented reality for retail. In: PerCom, pp. 1–3. IEEE Computer Society (2009)

    Google Scholar 

  6. Iwai, M., Mori, M., Touda, H.: A marketing analysis using massive tiny sensor nodes. In: 2009 Sixth International Conference on Networked Sensing Systems (INSS), pp. 1–4. IEEE (2009)

    Google Scholar 

  7. Kourouthanassis, P., Roussos, G.: Developing consumer-friendly pervasive retail systems. IEEE Pervasive Comput. 2(2), 32–39 (2003)

    Article  Google Scholar 

  8. Krockel, J., Bodendorf, F.: Customer tracking and tracing data as a basis for service innovations at the point of sale. In: 2012 Annual SRII Global Conference (SRII), pp. 691–696. IEEE (2012)

    Google Scholar 

  9. Krüger, A., Schöning, J., Olivier, P.: How computing will change the face of retail. IEEE Comput. 44(4), 84–87 (2011)

    Article  Google Scholar 

  10. Liciotti, D., Contigiani, M., Frontoni, E., Mancini, A., Zingaretti, P., Placidi, V.: Shopper analytics: a customer activity recognition system using a distributed RGB-D camera network. In: Distante, C., Battiato, S., Cavallaro, A. (eds.) VAAM 2014. LNCS, vol. 8811, pp. 146–157. Springer, Cham (2014). doi:10.1007/978-3-319-12811-5_11

    Google Scholar 

  11. Liciotti, D., Ferroni, G., Frontoni, E., Squartini, S., Principi, E., Bonfigli, R., Zingaretti, P., Piazza, F.: Advanced integration of multimedia assistive technologies: a prospective outlook. In: 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA), pp. 1–6. IEEE (2014)

    Google Scholar 

  12. Määttä, T., Härmä, A., Aghajan, H., Corporaal, H.: Collaborative detection of repetitive behavior by multiple uncalibrated cameras. Inf. Fusion 21, 68–81 (2015)

    Article  Google Scholar 

  13. Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Comput. Vis. Image Underst. 81(3), 231–268 (2001)

    Article  MATH  Google Scholar 

  14. Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2), 90–126 (2006)

    Article  Google Scholar 

  15. Puccinelli, N.M., Goodstein, R.C., Grewal, D., Price, R., Raghubir, P., Stewart, D.: Customer experience management in retailing: understanding the buying process. J. Retail. 85(1), 15–30 (2009)

    Article  Google Scholar 

  16. Strandvall, T.: Eye tracking as a tool in package and shelf testing. White Paper (Toby technology) (2008)

    Google Scholar 

  17. Strohbach, M., Martin, M.: Toward a platform for pervasive display applications in retail environments. IEEE Pervasive Comput. 10(2), 19–27 (2011)

    Article  Google Scholar 

  18. Sturari, M., Liciotti, D., Pierdicca, R., Frontoni, E., Mancini, A., Contigiani, M., Zingaretti, P.: Robust and affordable retail customer profiling by vision and radio beacon sensor fusion. Pattern Recogn. Lett. 81, 30–40 (2016)

    Article  Google Scholar 

  19. Wang, L., Hu, W., Tan, T.: Recent developments in human motion analysis. Pattern Recogn. 36(3), 585–601 (2003)

    Article  Google Scholar 

  20. Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction. In: 2004 Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 2, pp. 28–31. IEEE (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniele Liciotti .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Liciotti, D., Frontoni, E., Mancini, A., Zingaretti, P. (2017). Pervasive System for Consumer Behaviour Analysis in Retail Environments. In: Nasrollahi, K., et al. Video Analytics. Face and Facial Expression Recognition and Audience Measurement. VAAM FFER 2016 2016. Lecture Notes in Computer Science(), vol 10165. Springer, Cham. https://doi.org/10.1007/978-3-319-56687-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56687-0_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56686-3

  • Online ISBN: 978-3-319-56687-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics