Deep Learning for Isotropic Super-Resolution from Non-isotropic 3D Electron Microscopy
The most sophisticated existing methods to generate 3D isotropic super-resolution (SR) from non-isotropic electron microscopy (EM) are based on learned dictionaries. Unfortunately, none of the existing methods generate practically satisfying results. For 2D natural images, recently developed super-resolution methods that use deep learning have been shown to significantly outperform the previous state of the art. We have adapted one of the most successful architectures (FSRCNN) for 3D super-resolution, and compared its performance to a 3D U-Net architecture that has not been used previously to generate super-resolution. We trained both architectures on artificially downscaled isotropic ground truth from focused ion beam milling scanning EM (FIB-SEM) and tested the performance for various hyperparameter settings.
Our results indicate that both architectures can successfully generate 3D isotropic super-resolution from non-isotropic EM, with the U-Net performing consistently better. We propose several promising directions for practical application.
- 1.Abadi, M., Barham, P., Chen, J., Chen, Z., et al.: Tensorflow: a system for large-scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016), pp. 265–283 (2016)Google Scholar
- 2.Chollet, F.: Keras (2015). https://github.com/fchollet/keras
- 5.Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: ICCV, pp. 349–356 (2009)Google Scholar
- 9.Hu, T., Nunez-Iglesias, J., Vitaladevuni, S., Scheffer, L., et al.: Super-resolution using sparse representations over learned dictionaries: reconstruction of brain structure using electron microscopy. arXiv preprint arXiv:1210.0564 (2012)
- 11.Kingma, D., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)Google Scholar
- 12.Ledig, C., Theis, L., Huszar, F., Caballero, J., et al.: Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. arXiv:1609.04802 (2016)
- 16.Veeraraghavan, A., Genkin, A.V., Vitaladevuni, S., Scheffer, L., et al.: Increasing depth resolution of electron microscopy of neural circuits using sparse tomographic reconstruction. In: CVPR, pp. 1767–1774 (2010)Google Scholar