Advertisement

Deep Learning-Based Automatic Classification of Slide Frames and Presenter Frames

  • Nehru KasthuriEmail author
  • Kumar Rajamani
  • E. R. Rajkumar
Conference paper
  • 21 Downloads
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1148)

Abstract

Online learning has become very popular among the current generation. In many of the online learning contents, the only shared content is only the video which has the presenter making the presentation interspersed with slides from the presentation. Presentation slides or lesson notes are sometimes not shared or not available. Our current work explores automatic lesson notes creation from education lecture videos. The final goal is to make presentation slides of the lecture content from the video. As a first step in this regard, we currently explore automatic classification of video frames as either being slide frames or presenter frames. We have used a pre-trained deep neural network—ResNet trained on Imagenet. Our data is frames generated from cs231n Stanford course. We had retrained the fully connected layers of our model on our data. Our experiment results show that we are able to classify slide frames and presenter frames with 98.8% accuracy with as less as 20% of our datasets as training. Our approach is promising in getting to the final goal of automatically creating presentation slides from lecture videos.

Keywords

Deep learning ResNet ImageNet Confusion matrix Transfer learning 

References

  1. 1.
  2. 2.
    Yang, H., et al.: Automated extraction of lecture outlines from lecture videos. In: 4th International Conference on Computer Supported Education, CSEDU 2012 (2012)Google Scholar
  3. 3.
    Howard, J., et al.: Fastai. GitHub (2018). https://github.com/fastai/fastai
  4. 4.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Computer Vision and Pattern Recognition (CVPR) (2016)Google Scholar
  5. 5.
    Deng, J., et al.: ImageNet: A large-scale hierarchical image database. In: CVPR09 (2009)Google Scholar
  6. 6.
    Smith, L.N.: Cyclical learning rates for training neural networks. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 464–472 (2017)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Nehru Kasthuri
    • 1
    Email author
  • Kumar Rajamani
    • 2
  • E. R. Rajkumar
    • 2
  1. 1.Department of ECEKongu Engineering CollegePerundurai, ErodeIndia
  2. 2.Robert Bosch Engineering and Business SolutionsBangaloreIndia

Personalised recommendations