, Volume 32, Issue 2, pp 315–326 | Cite as

A Supporting Platform for Semi-Automatic Hyoid Bone Tracking and Parameter Extraction from Videofluoroscopic Images for the Diagnosis of Dysphagia Patients

  • Jun Chang Lee
  • Kyoung Won Nam
  • Dong Pyo Jang
  • Nam Jong Paik
  • Ju Seok Ryu
  • In Young KimEmail author
Original Article


Conventional kinematic analysis of videofluoroscopic (VF) swallowing image, most popular for dysphagia diagnosis, requires time-consuming and repetitive manual extraction of diagnostic information from multiple images representing one swallowing period, which results in a heavy work load for clinicians and excessive hospital visits for patients to receive counseling and prescriptions. In this study, a software platform was developed that can assist in the VF diagnosis of dysphagia by automatically extracting a two-dimensional moving trajectory of the hyoid bone as well as 11 temporal and kinematic parameters. Fifty VF swallowing videos containing both non-mandible-overlapped and mandible-overlapped cases from eight patients with dysphagia of various etiologies and 19 videos from ten healthy controls were utilized for performance verification. Percent errors of hyoid bone tracking were 1.7 ± 2.1% for non-overlapped images and 4.2 ± 4.8% for overlapped images. Correlation coefficients between manually extracted and automatically extracted moving trajectories of the hyoid bone were 0.986 ± 0.017 (X-axis) and 0.992 ± 0.006 (Y-axis) for non-overlapped images, and 0.988 ± 0.009 (X-axis) and 0.991 ± 0.006 (Y-axis) for overlapped images. Based on the experimental results, we believe that the proposed platform has the potential to improve the satisfaction of both clinicians and patients with dysphagia.


Dysphagia Videofluoroscopic Hyoid bone Diagnosis Deglutition Deglutition disorders 



This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (NRF-2013R1A1A1004622 and NRF-2015R1D1A1A01058652).

Compliance with Ethical Standards

Conflict of interest

There are no conflict of interest to report.

Supplementary material

Supplementary material 1 (AVI 22902 kb)


  1. 1.
    Ertekin C, Aydogdu I, Yuceyar N, Kiylioglu N, Tarlaci S, Uludag B. Pathophysiological mechanisms of oropharyngeal dysphagia in amyotrophic lateral sclerosis. Brain. 2000;123:125–40.CrossRefPubMedGoogle Scholar
  2. 2.
    Han TR, Paik NJ, Park JW. Quantifying swallowing function after stroke: a functional dysphagia scale based on videofluoroscopic studies. Arch Phys Med Rehab. 2001;82:677–82.CrossRefGoogle Scholar
  3. 3.
    Ryu JS, Kang JY, Park JY, et al. The effect of electrical stimulation therapy on dysphagia following treatment for head and neck cancer. Oral Oncol. 2009;45:665–8.CrossRefPubMedGoogle Scholar
  4. 4.
    Golabbakhsh M, Rajaei A, Derakhshan M, Sadri S, Taheri M, Adibi P. Automated acoustic analysis in detection of spontaneous swallows in Parkinson’s disease. Dysphagia. 2014;29:572–7.CrossRefPubMedGoogle Scholar
  5. 5.
    DeFabrizio ME, Rajappa A. Contemporary approaches to dysphagia management. J Nurse Pract. 2010;6:622–30.CrossRefGoogle Scholar
  6. 6.
    Yamamura K, Kitagawa J, Kurose M, et al. Neural mechanisms of swallowing and effects of taste and other stimuli on swallow initiation. Biol Pharm Bull. 2010;33:1786–90.CrossRefPubMedGoogle Scholar
  7. 7.
    US Census 2010—US Census Bureau. Populations Projections Program. Department of Commerce, Population Division. Accessed
  8. 8.
    DJO Global. Who is Affected: dysphagia by the numbers. DJO Global. Accessed
  9. 9.
    Martino R, Foley N, Bhogal S, Diamant N, Speechley M, Teasell R. Dysphagia after stroke incidence, diagnosis, and pulmonary complications. Stroke. 2005;36:2756–63.CrossRefPubMedGoogle Scholar
  10. 10.
    Lazareck LJ, Moussavi ZM. Classification of normal and dysphagic swallows by acoustical means. IEEE Trans Biomed Eng. 2004;51:2103–12.CrossRefPubMedGoogle Scholar
  11. 11.
    Smith NR, Klongtruagrok T, DeSouza GN, Shyu CR, Dietrich M, Page MP. Non-invasive ambulatory monitoring of complex sEMG patterns and its potential application in the detection of vocal dysfunctions. E-Health networking, applications and services (Healthcom), 2014 IEEE 16th international conference on. 2014: pp 447–452.Google Scholar
  12. 12.
    Imtiaz U, Yamamura K, Kong W, Sessa S, Lin Z, Bartolomeo L, Takanishi A. Application of wireless inertial measurement units and EMG sensors for studying deglutition—preliminary results. International Conference IEEE EMBC. 2014: pp 5381–5384.Google Scholar
  13. 13.
    Kalantarian H, Alshurafa N, Le T, Sarrafzadeh M. Monitoring eating habits using a piezo electric sensor-based necklace. Comput Biol Med. 2015;58:46–55.CrossRefPubMedGoogle Scholar
  14. 14.
    Paik NJ, Kim SJ, Lee HJ, Jeon JY, Lim JY, Han TR. Movement of the hyoid bone and the epiglottis during swallowing in patients with dysphagia from different etiologies. J Electromyogr Kines. 2008;18:329–35.CrossRefGoogle Scholar
  15. 15.
    Lee SI, Yoo JY, Kim M, Ryu JS. Changes of timing variables in swallowing of boluses with different viscosities in patients with dysphagia. Arch Phys Med Rehab. 2013;94:120–6.CrossRefGoogle Scholar
  16. 16.
    Wang TG, Chang YC, Chen WS, Lin PH, Hsiao TY. Reduction in hyoid bone forward movement in irradiated nasopharyngeal carcinoma patients with dysphagia. Arch Phys Med Rehabil. 2010;91:926–31.CrossRefPubMedGoogle Scholar
  17. 17.
    Stoeckli SJ, Huisman TA, Seifert BA, Martin Harris BJ. Interrater reliability of videofluoroscopic swallow evaluation. Dysphagia. 2003;18:53–7.CrossRefPubMedGoogle Scholar
  18. 18.
    Kim DH, Choi KH, Kim HM, et al. Inter-rater reliability of videofluoroscopic dysphagia scale. Ann Phys Rehabil Med. 2012;36:791–6.CrossRefGoogle Scholar
  19. 19.
    Kellen PM, Becker DL, Reinhardt JM, Van Daele DJ. Computer-assisted assessment of hyoid bone motion from videofluoroscopic swallow studies. Dysphagia. 2010;25:298–306.CrossRefPubMedGoogle Scholar
  20. 20.
    Canny J. A Computational Approach To Edge Detection. IEEE Trans Pattern Anal Mach Intell. 1986;8:679–98.CrossRefPubMedGoogle Scholar
  21. 21.
    Ojala T, Pietikäinen M, Harwood D. A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 1996;29:51–9.CrossRefGoogle Scholar
  22. 22.
    Ojala T, Pietikäinen M, Mäenpää TT. Multiresolution gray-scale and rotation invariant texture classification with local binary pattern. IEEE Trans Pattern Anal Mach Intell. 2002;24:971–87.CrossRefGoogle Scholar
  23. 23.
    Mccullouh GH, Wertz RT, Rosenbek JC. Sensitivity and specificity of clinical/bedside examination signs for detecting aspiration in adults subsequent to stroke. J Commun Disord. 2001;34:55–72.CrossRefGoogle Scholar
  24. 24.
    Daniels SK, Ballo LA, Mahoney MC, Foundas AL. Clinical predictors of dysphagia and aspiration risk: outcome measures in acute stroke patients. Arch Phys Med Rehabil. 2000;81:1030–3.CrossRefPubMedGoogle Scholar
  25. 25.
    Jensen K, Lambertsen K, Grau C. Late swallowing dysfunction and dysphagia after radiotherapy for pharynx cancer: frequency, intensity and correlation with dose and volume parameters. Radiother Oncol. 2007;85:74–82.CrossRefPubMedGoogle Scholar
  26. 26.
    O’Neil KH, Purdy M, Falk J, Gallo L. The dysphagia outcome and severity scale. Dysphagia. 1999;14:139–45.CrossRefPubMedGoogle Scholar
  27. 27.
    Aboofazeli M, Moussavi Z. Analysis and classification of swallowing sounds using reconstructed phase space features. International Conference IEEE ICASSP’05. 2005: pp 421–424.Google Scholar
  28. 28.
    Spadotto AA, Gatto AR, Guido RC, Montagnoli AN, Cola PC, Pereira JC, Schelp AO. Classification of normal swallowing and oropharyngeal dysphagia using wavelet. Appl Math Comput. 2009;207:75–82.Google Scholar
  29. 29.
    Aung SH, Goulermas JY, Hamdy S. Spatiotemporal visualizations for the measurement of oropharyngeal transit time from videofluoroscopy. IEEE Trans Biomed Eng. 2010;57:432–41.CrossRefPubMedGoogle Scholar
  30. 30.
    Hsu CC, Chen WH, Chiu HC. Using swallow sound and surface electromyography to determine the severity of dysphagia in patients with myasthenia gravis. Biomed Signal Process Control. 2013;8:432–41.CrossRefGoogle Scholar
  31. 31.
    Reddy NP, Thomas R, Canilang EP, Casterline J. Toward classification of dysphagic patients using biomechanical measurements. J Rehab Res Develop. 1994;31:335–44.Google Scholar
  32. 32.
    Suryanarayanana S, Reddy NP, Canilang EP. A fuzzy logic diagnosis system for classification of pharyngeal dysphagia. Int J Biomed Comput. 1995;38:207–15.CrossRefGoogle Scholar
  33. 33.
    Chaves RDD, Mangilli LD, Sassi FC, Jayanthi SK, Zilberstein B, Andrade CRFD. Two-dimensional perceptual videofluoroscopic swallowing analysis of the pharyngeal phase in patients older than 50 years. Arq Bras Cir Dig. 2013;26:274–9.CrossRefGoogle Scholar
  34. 34.
    Pearson WG Jr, Molfenter SM, Smith ZM, Steele CM. Image-based measurement of post-swallow residue: the normalized residue ratio scale. Dysphagia. 2013;28:167–77.CrossRefPubMedGoogle Scholar
  35. 35.
    Kim Y, McCullough GH. Maximal hyoid excursion in poststroke patients. Dysphagia. 2010;25:20–5.CrossRefPubMedGoogle Scholar
  36. 36.
    Molfenter SM, Steele CM. Kinematic and temporal factors associated with penetration-aspiration in swallowing liquids. Dysphagia. 2014;29:269–76.CrossRefPubMedPubMedCentralGoogle Scholar
  37. 37.
    Bingjie L, Tong Z, Xinting S, Jianmin X, Guijun J. Quantitative videofluoroscopic analysis of penetration-aspiration in post-stroke patients. Neurol India. 2010;58:42–7.CrossRefPubMedGoogle Scholar
  38. 38.
    Inamoto Y, Fujii N, Saitoh E, Baba M, Okada S, Katada K, Palmer JB. Evaluation of swallowing using 320-detector-row multislice CT Part II: kinematic analysis of laryngeal closure during normal swallowing. Dysphagia. 2011;26:209–17.CrossRefPubMedGoogle Scholar
  39. 39.
    Okada T, Aoyagi Y, Inamoto Y, Saitoh E, Kagaya H, Shibata S, Ueda K. Dynamic change in hyoid muscle length associated with trajectory of hyoid bone during swallowing: analysis using 320-row area detector computed tomography. J Appl Physiol. 2013;115:1138–45.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Jun Chang Lee
    • 1
  • Kyoung Won Nam
    • 1
  • Dong Pyo Jang
    • 1
  • Nam Jong Paik
    • 2
  • Ju Seok Ryu
    • 2
  • In Young Kim
    • 1
    Email author
  1. 1.Department of Biomedical EngineeringHanyang UniversitySeoulKorea
  2. 2.Department of Rehabilitation MedicineSeoul National University Bundang HospitalSeoulKorea

Personalised recommendations