Food Object Recognition Using a Mobile Device: State of the Art

  • Simon Knez
  • Luka ŠajnEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9281)


In this paper nine mobile food recognition systems are described based on their system architecture and their core properties (the core properties and experimental results are shown on the last page). While the mobile hardware increased its power through the years (2009 - 2013) and the food detection algorithms got optimized, still there was no uniform approach to the question of food detection. Also, some system used additional information for better detection, like voice data, OCR and bounding boxes. Three systems included a volume estimation feature. First five systems were implemented on a client-server architecture, while the last three took advantage of the available hardware in later years and proposed a client only based architecture.


Mobile Phone Mobile Device Food Item System Architecture Volume Estimation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Joutou, T., Yanai, K.: A food image recognition system with multiple kernel learning. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 285–288. IEEE (2009)Google Scholar
  2. 2.
    Puri, M., Zhu, Z., Yu, Q., Divakaran, A., Sawhney, H.: Recognition and volume estimation of food intake using a mobile device. In: 2009 Workshop on Applications of Computer Vision (WACV), pp. 1–8. IEEE (2009)Google Scholar
  3. 3.
    Hoashi, H., Joutou, T., Yanai, K.: Image recognition of 85 food categories by feature fusion. In: 2010 IEEE International Symposium on Multimedia (ISM), pp. 296–301. IEEE (2010)Google Scholar
  4. 4.
    Kong, F., Tan, J.: Dietcam: Automatic dietary assessment with mobile camera phones. Pervasive and Mobile Computing 8(1), 147–163 (2012)CrossRefGoogle Scholar
  5. 5.
    Rahmana, M.H., Pickering, M.R., Kerr, D., Boushey, C.J., Delp, E.J.: A new texture feature for improved food recognition accuracy in a mobile phone based dietary assessment system. In: 2012 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 418–423. IEEE (2012)Google Scholar
  6. 6.
    Kawano, Y., Yanai, K.: Real-time mobile food recognition system. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1–7. IEEE (2013)Google Scholar
  7. 7.
    Kawano, Y., Yanai, K.: Rapid mobile object recognition using fisher vector. In: 2013 2nd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 476–480. IEEE (2013)Google Scholar
  8. 8.
    Anthimopoulos, M., Dehais, J., Diem, P., Mougiakakou, S.: Segmentation and recognition of multi-food meal images for carbohydrate counting. In: 2013 IEEE 13th International Conference on Bioinformatics and Bioengineering (BIBE), pp. 1–4. IEEE (2013)Google Scholar
  9. 9.
    Pouladzadeh, P., Shirmohammadi, S., Arici, T.: Intelligent svm based food intake measurement system. In: 2013 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 87–92. IEEE (2013)Google Scholar
  10. 10.
    Perronnin, F., Sánchez, J., Mensink, T.: Improving the fisher kernel for large-scale image classification. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 143–156. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  11. 11.
    Kawano, Y., Yanai, K.: Foodcam: A real-time food recognition system on a smartphone. Multimedia Tools and Applications, 1–25 (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Faculty of Computer and Information ScienceUniversity of LjubljanaLjubljanaSlovenia

Personalised recommendations