Skip to main content

Variational Shape Completion for Virtual Planning of Jaw Reconstructive Surgery

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 (MICCAI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11768))

Abstract

The premorbid geometry of the mandible is of significant relevance in jaw reconstructive surgeries and occasionally unknown to the surgical team. In this paper, an optimization framework is introduced to train deep models for completion (reconstruction) of the missing segments of the bone based on the remaining healthy structure. To leverage the contextual information of the surroundings of the dissected region, the voxel-weighted Dice loss is introduced. To address the non-deterministic nature of the shape completion problem, we leverage a weighted multi-target probabilistic solution which is an extension to the conditional variational autoencoder (CVAE). This approach considers multiple targets as acceptable reconstructions, each weighted according to their conformity with the original shape. We quantify the performance gain of the proposed method against similar algorithms, including CVAE, where we report statistically significant improvements in both deterministic and probabilistic paradigms. The probabilistic model is also evaluated on its ability to generate anatomically relevant variations for the missing bone. As a unique aspect of this work, the model is tested on real surgical cases where the clinical relevancy of its reconstructions and their compliance with surgeon’s virtual plan are demonstrated as necessary steps towards clinical adoption.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abdi, A.H., et al.: AnatomyGen: deep anatomy generation from dense representation with applications in mandible synthesis. Technical report (2019)

    Google Scholar 

  2. Achlioptas, P., et al.: Representation learning and adversarial generation of 3D point clouds. 2(3), 4 arXiv preprint arXiv:1707.02392 (2017)

  3. Brinkley, J.F., et al.: The FaceBase consortium: a comprehensive resource for craniofacial researchers. Development 143(14), 2677–2688 (2016). www.facebase.org

    Article  Google Scholar 

  4. Hidalgo, D.A.: Fibula free flap: a new method of mandible reconstruction. Plast. Reconstr. Surg. 84(1), 71–79 (1989)

    Article  Google Scholar 

  5. Milletari, F., et al.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 Fourth International Conference on 3D Vision (3DV). IEEE (2016)

    Google Scholar 

  6. Nash, C., Williams, C.K.I.: The shape variational autoencoder: a deep generative model of part-segmented 3D objects. Comput. Graph. Forum 36(5), 1–12 (2017)

    Article  Google Scholar 

  7. Ravikumar, N., Gooya, A., Çimen, S., Frangi, A.F., Taylor, Z.A.: A multi-resolution T-mixture model approach to robust group-wise alignment of shapes. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9902, pp. 142–149. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46726-9_17

    Chapter  Google Scholar 

  8. Siegel, R.L., et al.: Cancer statistics. CA Cancer J. Clin. 67(1), 7–30 (2017)

    Article  Google Scholar 

  9. Sohn, K., et al.: Learning structured output representation using deep conditional generative models. In: Cortes, C., et al. (ed.) Advances in Neural Information Processing Systems, vol. 28, pp. 3483–3491. Curran Associates, Inc. (2015)

    Google Scholar 

  10. Stranix, J.T., et al.: A virtual surgical planning algorithm for delayed maxillomandibular reconstruction. Plast. Reconstr. Surg. 143(4), 1197–1206 (2019)

    Article  Google Scholar 

  11. Wu, J., et al.: Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In: Advances in Neural Information Processing Systems, pp. 82–90 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amir H. Abdi .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 215 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Abdi, A.H., Pesteie, M., Prisman, E., Abolmaesumi, P., Fels, S. (2019). Variational Shape Completion for Virtual Planning of Jaw Reconstructive Surgery. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11768. Springer, Cham. https://doi.org/10.1007/978-3-030-32254-0_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32254-0_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32253-3

  • Online ISBN: 978-3-030-32254-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics