Abstract
Image registration is often very slow because of the high dimensionality of the images and complexity of the algorithms. Adaptive stochastic gradient descent (ASGD) outperforms deterministic gradient descent and even quasi-Newton in terms of speed. This method, however, only exploits first-order information of the cost function. In this paper, we explore a stochastic quasi-Newton method (s-LBFGS) for non-rigid image registration. It uses the classical limited memory BFGS method in combination with noisy estimates of the gradient. Curvature information of the cost function is estimated once every L iterations and then used for the next L iterations in combination with a stochastic gradient. The method is validated on follow-up data of 3D chest CT scans (19 patients), using a B-spline transformation model and a mutual information metric. The experiments show that the proposed method is robust, efficient and fast. s-LBFGS obtains a similar accuracy as ASGD and deterministic LBFGS. Compared to ASGD the proposed method uses about 5 times fewer iterations to reach the same metric value, resulting in an overall reduction in run time of a factor of two. Compared to deterministic LBFGS, s-LBFGS is almost 500 times faster.
Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Sotiras, A., Davatzikos, C., Paragios, N.: Deformable medical image registration: A survey. IEEE Transactions on Medical Imaging 32(7), 1153–1190 (2013)
Klein, S., Staring, M., Pluim, J.P.: Evaluation of optimization methods for nonrigid medical image registration using mutual information and B-splines. IEEE Transactions on Image Processing 16(12), 2879–2890 (2007)
Klein, S., Pluim, J., Staring, M., Viergever, M.: Adaptive stochastic gradient descent optimisation for image registration. International Journal of Computer Vision 81(3), 227–239 (2009)
Klein, S., Staring, M., Andersson, P., Pluim, J.P.W.: Preconditioned stochastic gradient descent optimisation for monomodal image registration. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part II. LNCS, vol. 6892, pp. 549–556. Springer, Heidelberg (2011)
Schraudolph, N., Yu, J., Günter, S.: A stochastic quasi-Newton method for online convex optimization (2007)
Bordes, A., Bottou, L., Gallinari, P.: SGD-QN: Careful quasi-Newton stochastic gradient descent. The Journal of Machine Learning Research 10, 1737–1754 (2009)
Mokhtari, A., Ribeiro, A.: RES: Regularized stochastic BFGS algorithm. IEEE Transactions on Signal Processing 62(23), 6089–6104 (2014)
Byrd, R.H., Hansen, S., Nocedal, J., Singer, Y.: A stochastic quasi-Newton method for large-scale optimization. arXiv preprint arXiv:1401.7020 (2014)
O’Donoghue, B., Candés, E.: Adaptive restart for accelerated gradient schemes. Foundations of Computational Mathematics, 1–18 (2013)
Kiefer, J., Wolfowitz, J.: Stochastic estimation of the maximum of a regression function. The Annals of Mathematical Statistics 23(3), 462–466 (1952)
Qiao, Y., Lelieveldt, B., Staring, M.: Fast automatic estimation of the optimization step size for nonrigid image registration. In: SPIE Medical Imaging, International Society for Optics and Photonics, pp. 90341A–90341A (2014)
Klein, S., Staring, M., et al.: Elastix: a toolbox for intensity-based medical image registration. IEEE Transactions on Medical Imaging 29(1), 196–205 (2010)
Stolk, J., Putter, H., Bakker, E.M., et al.: Progression parameters for emphysema: a clinical investigation. Respiratory Medicine 101(9), 1924–1930 (2007)
Sun, W., Niessen, W., van Stralen, M., Klein, S.: Simultaneous multiresolution strategies for nonrigid image registration. IEEE Transactions on Image Processing 22(12), 4905–4917 (2013)
Modarres Khiyabani, F., Leong, W.: Limited memory methods with improved symmetric rank-one updates and its applications on nonlinear image restoration. Arabian Journal for Science and Engineering 39(11), 7823–7838 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Qiao, Y., Sun, Z., Lelieveldt, B.P.F., Staring, M. (2015). A Stochastic Quasi-Newton Method for Non-Rigid Image Registration. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds) Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science(), vol 9350. Springer, Cham. https://doi.org/10.1007/978-3-319-24571-3_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-24571-3_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24570-6
Online ISBN: 978-3-319-24571-3
eBook Packages: Computer ScienceComputer Science (R0)