Lessons and Insights from Creating a Synthetic Optical Flow Benchmark
With the MPI-Sintel Flow dataset, we introduce a naturalistic dataset for optical flow evaluation derived from the open source CGI movie Sintel. In contrast to the well-known Middlebury dataset, the MPI-Sintel Flow dataset contains longer and more varied sequences with image degradations such as motion blur, defocus blur, and atmospheric effects. Animators use a variety of techniques that produce pleasing images but make the raw animation data inappropriate for computer vision applications if used “out of the box”. Several changes to the rendering software and animation files were necessary in order to produce data for flow evaluation and similar changes are likely for future efforts to construct a scientific dataset from an animated film. Here we distill our experience with Sintel into a set of best practices for using computer animation to generate scientific data for vision research.
- 3.Roth, S., Black, M.: On the spatial statistics of optical flow. In: ICCV 2005, vol. 1, pp. 42–49 (2005)Google Scholar
- 4.Geiger, A., Lenz, P., Urtasun, R.: Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite. In: CVPR 2012 (2012)Google Scholar
- 7.Mac Aodha, O., Humayun, A., Pollefeys, M., Brostow, G.J.: Learning a Confidence Measure for Optical Flow. IEEE Trans. Pattern Anal. Mach. Intell. 34 (to appear, 2012)Google Scholar
- 8.Vaudrey, T., Rabe, C., Klette, R., Milburn, J.: Differences between stereo and motion behavior on synthetic and real-world stereo sequences. In: 23rd International Conference of Image and Vision Computing New Zealand (IVCNZ 2008), pp. 1–6 (2008)Google Scholar
- 9.Meister, S., Kondermann, D.: Real versus realistically rendered scenes for optical flow evaluation. In: CEMT 2011, pp. 1–6. IEEE (2011)Google Scholar