Advertisement

Automated Data Generation for Training of Neural Networks by Recombining Previously Labeled Images

  • Peter-Nicholas GronerthEmail author
  • Benjamin Hahn
  • Lutz Eckstein
Conference paper
Part of the Lecture Notes in Mobility book series (LNMOB)

Abstract

In this paper, we present our approach to data generation for the training of neural networks in order to achieve semantic segmentation in an autonomous environment. Using a small set of previously labeled images, this approach allows to automatically increase the amount of training data available. This is achieved by recombining parts of the images, while keeping the overall structure of the scene intact. Doing so allows for early network training, even with only few training samples at hand. Furthermore, first results show that training networks using the so created datasets allow for good segmentation results when compared to publicly available datasets.

Keywords

ADAS Semantic segmentation Convolutional neural networks Semi artificial datasets Training data generation Image stitching 

References

  1. Arbeláez P, Hariharan B, Gu C, Gupta S, Bourdev L, Malik J (2012) Semantic segmentation using regions and parts. In: IEEE conference on computer vision and pattern recognition (CVPR)Google Scholar
  2. Brostow G, Fauquer J, Cipolla R (2009) Semantic object classes in video: a high-definition ground truth database. Pattern Recogn Lett 30:88–97CrossRefGoogle Scholar
  3. Carreira J, Caseiro R, Batista J, Sminchisescu C (2012) Semantic segmentation with second-order pooling. In: Computer vision – ECCV 2012. Lecture Notes in Computer Science, vol 7578, pp 430–443Google Scholar
  4. Cho T, Butman M, Avidan S, Freeman W (2008) The patch transform and its applications to image editing. In: IEEE conference on computer vision and pattern recognitionGoogle Scholar
  5. Cho T, Avidan S, Freeman W (2010) The patch transform. IEEE Trans Pattern Anal Mach Intell 32:1489–1501CrossRefGoogle Scholar
  6. Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3213–3223Google Scholar
  7. Geiger A, Lenz P, Stiller C, Urtasun R (2013) Vision meets robotics: the KITTI dataset. Int J Robot Res 32(11):1231–1237Google Scholar
  8. Girshik R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE conference on computer vision and pattern recognitionGoogle Scholar
  9. Iizuka S, Endo Y, Hirose M, Kanamori Y, Mitani J, Fukui Y (2014) Object repositioning based on the perspective in a single image. Comput Gr Forum 33(8):157–166CrossRefGoogle Scholar
  10. Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105Google Scholar
  11. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3431–3440Google Scholar
  12. Mansfield A, Gehler P, Gool L, Rother C (2010) Scene carving: scene consistent image retargeting. Lecture Notes in Computer Science, vol. 6311, pp 143–156Google Scholar
  13. Richter S, Vineet V, Roth S, Koltun V (2016) Playing for data: ground truth from computer games. In: European conference on computer vision (ECCV), pp 102–118Google Scholar
  14. Ros G, Sellart L, Materzynska J, Vazquez D, Lopez AM (2016) The SYNTHIA dataset: a large collection of synthetic images for semantic segmentation of urban scenes. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 3234–3243Google Scholar
  15. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: IEEE conference on computer vision and pattern recognitionGoogle Scholar
  16. Tao M, Johnson M, Paris S (2010) Error-tolerant image compositing. Lecture Notes in Computer Science, vol 6311, pp 31–44Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Peter-Nicholas Gronerth
    • 1
    Email author
  • Benjamin Hahn
    • 2
  • Lutz Eckstein
    • 1
  1. 1.Institut für KraftfahrzeugeRWTH AachenAachenGermany
  2. 2.fka Forschungsgesellschaft Kraftfahrwesen mbH AachenAachenGermany

Personalised recommendations