Plausible 3D Colour Surface Completion Using Non-parametric Techniques

  • Toby P. Breckon
  • Robert B. Fisher
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3604)


We consider the combined completion of 3D surface relief and colour for the hidden and missing portions of objects captured with \(2\frac{1}{2}D\) (or 3D) capture techniques. Through an extension of non-parametric texture synthesis to facilitate the completion of localised 3D surface structure (relief) over an underlying geometric surface completion we achieve realistic, plausible completion and extension of \(2\frac{1}{2}D\) partially visible surfaces. Additionally we show how this technique can be extended to the completion of increasingly available colour \(2\frac{1}{2}D\) / 3D range data.


Surface Relief Nyquist Frequency Texture Synthesis Tree Bark Target Vertex 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Besl, P.J., McKay, N.D.: A method for registration of 3D shapes. IEEE Transactions Pattern Analysis and Machine Intelligence 14, 239–256 (1992)CrossRefGoogle Scholar
  2. 2.
    Rodrigues, M., Fisher, R., Liu, Y.: Special issue on registration and fusion of range images. Computer Vision and Image Understanding 87, 1–7 (2002)CrossRefGoogle Scholar
  3. 3.
    Davis, J., Marschner, S., Garr, M., Levoy, M.: Filling holes in complex surfaces using volumetric diffusion. In: Proc. First Int. Sym. on 3D Data Processing, Visualization and Transmission, pp. 428–861 (2002)Google Scholar
  4. 4.
    Carr, J.C., Beatson, R.K., Cherrie, J.B., Mitchell, T.J., Fright, W.R., McCallum, B.C., Evans, T.R.: Reconstruction and representation of 3D objects with radial basis functions. In: Proc. 28th SIGGRAPH, pp. 67–76. ACM Press, New York (2001)Google Scholar
  5. 5.
    Wang, J., Oliveira, M.: A hole-filling strategy for reconstruction in smooth surfaces in range images. In: 16th Brazilian Symp. on Computer Graphics and Image Processing, pp. 11–18. IEEE Computer Society, Los Alamitos (2003)Google Scholar
  6. 6.
    Liepa, P.: Filling holes in meshes. In: Proc. of the Eurographics/ACM SIGGRAPH symp. on Geometry processing, pp. 200–205. Eurographics Association (2003)Google Scholar
  7. 7.
    Ju, T.: Robust repair of polygonal models. ACM Transactions on Graphics 23, 888–895 (2004)CrossRefGoogle Scholar
  8. 8.
    Tekumalla, L., Cohen, E.: A hole-filling algorithm for triangular meshes. Technical Report UUCS-04-019, School of Computing, University of Utah (2004)Google Scholar
  9. 9.
    Stulp, F., Dell’Acqua, F., Fisher, R.: Reconstruction of surfaces behind occlusions in range images. In: Proc. 3rd Int. Conf. on 3D Digital Imaging and Modelling, pp. 232–239 (2001)Google Scholar
  10. 10.
    Dell’Acqua, F., Fisher, R.B.: Reconstruction of planar surfaces behind occlusions in range images. IEEE Transactions Pattern Analysis and Machine Intelligence 24, 569–575 (2002)CrossRefGoogle Scholar
  11. 11.
    Castellani, U., Livatino, S., Fisher, R.: Improving environment modelling by edge occlusion surface completion. In: Proc. First Int. Sym. on 3D Data Processing, Visualization and Transmission, pp. 672–675 (2002)Google Scholar
  12. 12.
    Fisher, R.: Solving architectural modelling problems using knowledge. In: Proc. 4th Int. Conf. on 3D Digital Imaging and Modelling, pp. 343–351 (2003)Google Scholar
  13. 13.
    Chalmoviansky, P., Juttler, B.: Filling holes in point clouds. In: Wilson, M., Martin, R. (eds.) Mathematics of Surfaces. LNCS, vol. 2768, pp. 196–212. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  14. 14.
    Sharf, A., Alexa, M., Cohen-Or, D.: Context-based surface completion. ACM Transactions on Graphics 23, 878–887 (2004)CrossRefGoogle Scholar
  15. 15.
    Praun, E., Finkelstein, A., Hoppe, H.: Lapped textures. In: Proc. ACM SIGGRAPH, pp. 465–470 (2000)Google Scholar
  16. 16.
    Turk, G.: Texture synthesis on surfaces. In: Proc. ACM SIGGRAPH, pp. 347–354 (2001)Google Scholar
  17. 17.
    Wei, L.Y., Levoy, M.: Texture synthesis over arbitrary manifold surfaces. In: SIGGRAPH: Proc. 28th annual conference on Computer graphics and interactive techniques, pp. 355–360. ACM Press, New York (2001)CrossRefGoogle Scholar
  18. 18.
    Gorla, G., Interrante, V., Sapiro, G.: Texture synthesis for 3d shape representation. IEEE Transactions Visualization and Computer Graphics 9, 512–524 (2003)CrossRefGoogle Scholar
  19. 19.
    Zelinka, S., Garland, M.: Interactive texture synthesis on surfaces using jump maps. In: Proc. 14th Eurographics workshop on Rendering. Eurographics Association, pp. 90–96 (2003)Google Scholar
  20. 20.
    Biermann, H., Martin, I., Bernardini, F., Zorin, D.: Cut-and-paste editing of multiresolution surfaces. ACM Transactions on Graphics 21, 312–321 (2002)CrossRefGoogle Scholar
  21. 21.
    Bhat, P., Ingram, S., Turk, G.: Geometric texture synthesis by example. In: Eurographics/ACM SIGGRAPH symp. on Geometry processing, pp. 41–44. ACM Press, New York (2004)CrossRefGoogle Scholar
  22. 22.
    Sorkine, O., Lipman, Y., Cohen-Or, D., Alexa, M., Rössl, C., Seidel, H.P.: Laplacian surface editing. In: Proc. Eurographics/ACM SIGGRAPH symp. on Geometry processing, pp. 179–188. Eurographics Association (2004)Google Scholar
  23. 23.
    Zelinka, S., Garland, M.: Similarity-based surface modelling using geodesic fans. In: Proc. Eurographics/ACM SIGGRAPH symp. on Geometry processing, pp. 204–213. ACM Press, New York (2004)CrossRefGoogle Scholar
  24. 24.
    Lai, Y.K., Hu, S.M., Gu, D., Martin, R.: Geometric texture synthesis and transfer via geometry images. In: ACM Solid and Physical Modelling (2005) (in publication)Google Scholar
  25. 25.
    Breckon, T., Fisher, R.: Non-parametric 3D surface completion. In: Proc. 5th Int. Conf. on 3D Digital Imaging and Modelling, IEEE Press, Los Alamitos (2005) (to appear)Google Scholar
  26. 26.
    Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: IEEE Int. Conf. on Computer Vision, pp. 1033–1038 (1999)Google Scholar
  27. 27.
    Zhu, S., Wu, Y., Mumford, D.: Filters, random-fields and maximum-entropy (frame): Towards a unified theory for texture modelling. Int. Journal of Computer Vision 27, 107–126 (1998)CrossRefGoogle Scholar
  28. 28.
    Kokaram, A.: Parametric texture synthesis for filling holes in pictures. In: Proc. Int. Conf. on Image Processing, vol. I, pp. 325–328 (2002)Google Scholar
  29. 29.
    Forbes, A.: Least-squares best-fit geometric elements. Technical Report 140/89, National Physical Laboratory, Teddington, UK (1989)Google Scholar
  30. 30.
    Faber, P., Fisher, R.: Euclidean fitting revisited. In: Arcelli, C., Cordella, L.P., Sanniti di Baja, G. (eds.) IWVF 2001. LNCS, vol. 2059, p. 165. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  31. 31.
    Dey, T.K., Giesen, J.: Detecting undersampling in surface reconstruction. In: Proc. 17th ann. symp. on Computational Geometry, pp. 257–263. ACM Press, New York (2001)Google Scholar
  32. 32.
    Dey, T.K., Goswami, S.: Tight cocone: a water-tight surface reconstructor. In: Proc. 8th ACM sym. on Solid modelling and applications, pp. 127–134. ACM Press, New York (2003)CrossRefGoogle Scholar
  33. 33.
    Taubin, G.: Geometric signal processing on polygonal meshes. In: Proc. EUROGRAPHICS: State of the Art Report (STAR), Interlaken, Switzerland (2000)Google Scholar
  34. 34.
    Shannon, C.: Communication in the presence of noise. Proc. Inst. of Radio Engineers 37, 10–21 (1949)MathSciNetGoogle Scholar
  35. 35.
    Matsumoto, M., Nishimura, T.: Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Modelling and Computer Simulation 8, 3–30 (1998)zbMATHCrossRefGoogle Scholar
  36. 36.
    Wandell, B.: Foundations of Vision. Sinauer Associates (1995)Google Scholar
  37. 37.
    Krishnamurthy, V., Levoy, M.: Fitting smooth surfaces to dense polygon meshes. In: Proc. SIGGRAPH, pp. 313–324. ACM Press, New York (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Toby P. Breckon
    • 1
  • Robert B. Fisher
    • 1
  1. 1.Institute for Perception, Action & Behaviour, School of InformaticsUniversity of EdinburghUK

Personalised recommendations