Real-time constraints and prediction of video decoding time for multimedia systems
The implementation of software based video/audio decoders is an advantageous solution over traditional dedicated hardware systems. However, simultaneously guaranteeing real-time performance, needed for processing video/audio bit-streams, and an efficient use of the processing power, remains a very difficult task. In this paper, we briefly discuss the main reasons of such difficulties and we present a new technique able to predict the decoding time of compressed video bit-streams without the need of the actual decoding. This result can be obtained when appropriate statistics about the actual decoding process are included and transmitted with the compressed video data. We also show how such results can be used to implement new efficient processing resource allocation strategies. New possible schemes of intelligent interactions, and in particular an efficient implementation of Computational Graceful Degradation, between the encoder and the real-time OS are also proposed. An example of results obtained implementing the proposed technique for the MPEG-4 VM6 video algorithm is presented. Although the techniques and concepts presented in this paper are of general application, they can only be used for video compression standards capable of transmitting in any appropriate form the associated statistical coding information. This capability has been included in the new defined MPEG-4 standard.
KeywordsDecode Process Video Decode Code Option Decode Time Video Compression Standard
Unable to display preview. Download preview PDF.
- 1.M., Mattavelli, S., Brunetton: A statistical study of MPEG-4 VM texture decoding complexity. ISO/IEC JTC1/SC29/WG11, Doc. M924. Tampere Finland, July 1996.Google Scholar
- 2.ISO/IEC 13818-2: Information technology, generic coding of moving pictures and associated audio information.Google Scholar
- 3.M., Mattavelli, S., Brunetton: Scalability of MPEG-4 VM based on the computational power of texture decoding. ISO/IEC JTC1/SC29/WG11, Doc. M925. Tampere, Finland, July 1996.Google Scholar
- 4.S., Battista, F., Gasperoni, B., Klaiber, M., Mattavelli, L., Pautet, S., Tardieu: Concurrent over Sequential Modeling for MSDL. ISO/IEC JTC1/SC29/WG11, Doc. M1525. Maceio, Brazil, November 1996.Google Scholar
- 5.Telenor H.263 GNU license software release, available at: “http://www.fou.telenor.no/brukere/DVC/h263_software/”.Google Scholar
- 6.M., Mattavelli, S., Brunetton, D., Mlynek: Computational graceful degradation for video sequence decoding. In: Proceedings of ICIP-97. International Conference on Image Processing, Oct. 26–29, 330–333, Santa Barbara, CA, USA.Google Scholar