QoS Functional Testing for Multi-media Systems

  • Tao Sun
  • Keiichi Yasumoto
  • Masaaki Mori
  • Teruo Higashino
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2767)


In this paper, we propose a testing method for QoS functions in distributed multi-media systems, where we test whether playback of media objects is correctly implemented or not in a client side program according to the quality designated in advance, and/or whether a time lag between parallel playbacks of multiple media objects is controlled within the specified time interval. In the proposed technique, we describe test scenarios in timed EFSMs where we specify behavior of an input flow transfered to a given IUT (implementation under test) and behavior of playback with certain QoS functions observed from the IUT (e.g., the range of fluctuation of frame rates) . From the scenarios, we generate test sequences to test whether a given IUT realizes the QoS functions specified in the scenarios. In the proposed test method, we use a statistical approach where test sequences take samplings of actual frame rates and/or time lags when an IUT is executed, and report test results from ratio of samplings with low quality below a threshold in a normal distribution of all samplings. We have implemented a test system for test sequence execution in Java, and applied it to a video playback system.


  1. 1.
    Alur, R., Dill, D.L.: Theory of timed automata. Theoretical Computer Science 126, 183–235 (1994)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Alur, R., Henzinger, T.A.: REX 1991. LNCS, vol. 600, pp. 74–106. Springer, Heidelberg (1992)CrossRefGoogle Scholar
  3. 3.
    Bowman, H., Faconti, G., Massink, M.: Specification and verification of media constraints using UPPAAL. In: Proc. of 5th Eurographics Workshop on the Design, Specification and Verification of Interactive Systems, pp. 261–277 (1998)Google Scholar
  4. 4.
    Cheung, S.C., Chanson, S.T., Xu, Z.: Toward Generic Timing Tests for Distributed Multimedia Software Systems. In: IEEE Int’l. Symp. on Software Reliability Engineering (2001)Google Scholar
  5. 5.
    Fibush, D.K.: Testing multimedia transmission systems. IEEE Design & Test of Computers 12(4), 24–44 (1995)CrossRefGoogle Scholar
  6. 6.
    Grabowski, J., Walter, T.: Testing Quality-of-Service Aspects in Multimedia Applications. In: Proc. of 2nd Workshop on Protocols for Multi-media Systems, PROMS (1995)Google Scholar
  7. 7.
    Higashino, T., Nakata, A., Taniguchi, K., Cavalli, A.R.: Generating Test Cases for a Timed I/O Automaton Model. In: Proc. 12th IFIP Workshop on Testing of Communicating Systems (IWTCS 1999), pp. 197–214 (1999)Google Scholar
  8. 8.
    Huang, C.M., Wang, C.: Synchronization for Interactive Multimedia Presentations. IEEE MULTIMEDIA 5(4), 44–62 (1998)CrossRefGoogle Scholar
  9. 9.
    ISO : Information Processing System, Open Systems Interconnection, LOTOS - A Formal Description Technique Based on the Temporal Ordering of Observational Behaviour, ISO 8807 (1989) Google Scholar
  10. 10.
    Kone, O.: A Local Approach to the Testing of Real-time Systems. The Computer Journal 44(5) (2001)Google Scholar
  11. 11.
    Lee, D., Yannakakis, M.: Principles and Methods of Testing Finite State Machines – A Survey. Proc. of the IEEE 84(8) (1996)Google Scholar
  12. 12.
    Misic, V.B., Chanson, S.T., Cheung, S.: Towards a Framework For Testing Distributed Multimedia Software Systems. In: Proc. of 1998 Int’l. Symp. on Software Engineering for Parallel and Distributed Systems, PDSE 1998 (1998)Google Scholar
  13. 13.
    Vissers, C.A., Scollo, G., Sinderen, M.v.: Specification Styles in Distributed Systems Design and Verification. Theoretical Computer Science 89(1), 178–206 (1991)CrossRefzbMATHGoogle Scholar
  14. 14.
    Walter, T., Scheferdecker, I., Grabowski, J.: Test Architectures for Distributed Systems - State of the Art and Beyond (Invited Paper). Testing of Communication Systems, vol. II. Chapman & Hall, Boca Raton (1998)Google Scholar
  15. 15.
    W3C: Synchronized Multimedia Integration Language (SMIL) 1.0 Specification,
  16. 16.
    Yamada, M., Mori, T., Fukada, A., Nakata, A., Higashino, T.: A Method for Functional Testing of Media Synchronization Protocols. In: Proc. of the 16th Int’l. Conf. on Information Networking, ICOIN-16 (2002)Google Scholar
  17. 17.
    Yasumoto, K., Umedu, T., Yamaguchi, H., Nakata, A., Higashino, T.: Protocol animation based on event-driven visualization scenarios in real-time LOTOS. Computer Networks 40(5), 639–663 (2002)CrossRefGoogle Scholar
  18. 18.
    Sun Microsystems: Java Media Framework Home Page,

Copyright information

© IFIP International Federation for Information Processing 2003

Authors and Affiliations

  • Tao Sun
    • 1
  • Keiichi Yasumoto
    • 1
  • Masaaki Mori
    • 2
  • Teruo Higashino
    • 3
  1. 1.Graduate School of Information ScienceNara Institute of Science and TechnologyJapan
  2. 2.Department of Information Processing and ManagementShiga UniversityJapan
  3. 3.Graduate School of Information Science and TechnologyOsaka UniversityJapan

Personalised recommendations