Abstract
Rastering of a digital image usually reflects the spatial coordinates of the optical image which is projected onto the sensor. Stacking images to a sequence allows to record a third dimension which in most applications corresponds to time. Selected applications are classified according to the techniques they use in order to extract or handle the temporal variations of phenomena recorded in the sequence. The intensity variations of a translating object image are approximately described by equations which are used to estimate the frame-to-frame displacement. Recently reported refinements to this estimation approach are discussed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
R.F. Adler and D.D. Fenn “Thunderstorm Monitoring from a Geosynchronous Satellite”, 7th Conference on Aerospace and Aeronautical Meteorology (1976) pp. 307–311
J.K. Aggarwal and R.O. Duda “Computer Analysis of Moving Polygonal Images”, IEEE Trans Computers C-24 (1975) 966–976
Y. Ariki, T. Kanade, and T. Sakai “An Interactive Image Modeling and Tracing System for Moving Pictures”, IJCPR-78 Nov. 7–10, 1978 Kyoto/Japan, pp. 681–685
A.A. Arking, R.C. Lo, and A. Rosenfeld “An Evaluation of Fourier Transform Techniques for Cloud Motion Estimation”, TR-351 (January 1975) Computer Science Department, University of Maryland, College Park/MD
S.T. Barnard and W.B. Thompson “Visual Disparity as a Cue for Depth and Velocity in Real World Scenes”, IEEE Conference on Pattern Recognition and Image Processing Chicago/Ill., May 31–June 2, 1978 pp. 402–404
R. Brennecke, T.K. Brown, J. Buersch, and P.H. Heintzen “Digital Processing of Video angio-cardiographic Image Series Using a Minicomputer”, Proc. IEEE Conference on Computers in Cardiology, St. Louis 1976
R. Brennecke, T.K. Brown, J. Buersch, and P.H. Heintzen “Computerized Video-Image Preprocessing with Applications to Cardio-Angiographic Roentgen-Image-Series”, GI/NTG Fachtagung Digitale Bildverarbeitung Muenchen, 28.-30. Maerz 1977, (H.-H. Nagel, ed.) Informatik Fachberichte 8 (1977) pp. 244–262, Springer Verlag Berlin-Heidelberg-New York.
R. Brennecke, T.K. Brown, J. Buersch, and P.H. Heintzen “A Digital System for Roentgen Video Image Processing”, in: Roentgen-Video-Techniques for Dynamic Studies of Structure and Function of the Heart and Circulation P.H. Heintzen and J.H. Buersch (eds.) Georg Thieme Verlag, Stuttgart 1978, pp. 150–157
J.R. Birk, R.B. Kelley, and V.V. Badami “Workpiece Orientation Correction with a Robot Arm Using Visual Information”, IJCAI-77, p. 758
S. Brofferio and F. Rocca “Interframe Redundancy Reduction of Video Signals Generated by Translating Objects”, IEEE Trans. Communications COM-25 (1977) 448–455
C. Cafforio and F. Rocca “Methods for Measuring Small Displacements of Television Images”, IEEE Trans. Information Theory IT-22 (1976) 573–579
J.C. Candy, M.A. Franke, B.G. Haskell, and F.W. Mounts “Transmitting Television as Clusters of Frame-to-Frame Differences”, Bell System Techn. J. 50 (1971) 1889–1917
R.T. Chien and V.C. Jones “Acquisition of Moving Objects and Hand-Eye Coordination”, IJCAI-75, pp. 737–741, Tbilisi, Georgia/USSR, September 3–8, 1975
W.K. Chow and J.K. Aggarwal “Computer Analysis of Planar Curvilinear Moving Images”, IEEE Trans. Computers C-26 (1977) 179–185
C.K. Chow and T. Kaneko “Automatic Boundary Detection of the Left Ventricle from Cineangiograms”, Computers and Biomedical Research 5 (1972) 388–410
C.K. Chow, S.K. Hilal, and K.E. Niebuhr “X-ray Image Subtraction by Digital Means”, IBM J. Res. Develop. 17 (1973) 206–218
D.J. Connor and J.O. Limb “Properties of Frame-Difference Signals Generated by Moving Images”, IEEE Trans. on Communications COM-22 (1974) 1564–1575
D.J. Connor, B.G. Haskell, F.W. Mounts “A Frame-to-Frame Picturephone Coder for Signals Containing Differential Quantizing Noise”, Bell System Techn. J. 52 (1973) 35–51
D.L. Davies and P.H. Smith “Digital Analysis of Internal Machine Part Motion in a Time Series of Radiographs”, WCATVI-79, pp. 128–130
L. Dreschler and H.-H. Nagel “Using ‘Affinity’ for Extracting Images of Moving Objects from TV-Frame Sequences”, IfI-HH-B-44/78 (February 1978)
R.M. Endlich, D.E. Wolf, D.J. Hall, and A.E. Brain “Use of a Pattern Recognition Technique for Determining Cloud Motions from Sequences of Satellite Photographs”, J. of Applied Meteorology 10 (1971) 105–117
R. Eskenazi and R.T. Cunningham “Real-Time Tracking of Moving Objects in TV Images”, IEEE Workshop on Pattern Recognition and Artificial Intelligence Princeton/NJ, April 12–14, 1978, pp. 4–6
C.L. Fennema and W.B. Thompson “Velocity Determination in Scenes Containing Several Moving objects”, Computer Graphics and Image Processing 9 (1979) 301–315
T.T. Fujita “Present Status of Cloud Velocity Computations from the ATS I and ATS III Satellites”, Space Research IX, pp. 557–570, North Holland Publ. Co., Amsterdam 1969
T. Fukinuki “Measurement of Movement and Velocity of Moving Objects with Picture Signals”, Record of Technical Group on Image Technology of the Institute of Electronics and Communications Engineers (IECE) of Japan October 29, 1978 (IE 78-67, pp. 35–41)
D.B. Gennery “A Stereo Vision System for an Autonomous Vehicle”, IJCAI-77, pp. 576–582
D.B. Gennery “A Stereo Vision System”, Proc. Image Understanding Workshop L.S. Baumann (ed.) pp. 31–46 Palo Alto/CA, Oct. 20–21, 1977 Science Applications, Inc., Arlington/VA
H. Gerlach “Digitale Bildfolgenauswertung zun Wiederfinden von Objekten in natuerlicher Umgebung”, in: Angewandte Szenenanalyse, J.P. Foith (ed.) Informatik Fachberichte 20, pp. 199–207 Springer Verlag, Berlin-Heidelberg-New York 1979
J.O.B. Greaves “The Bugsystem: The Software Structure for the Reduction of Quantized Video Data of Moving Organisms”, Proc. IEEE 63 (1975) 1415–1425
F.M. Greene, Jr., and F.S. Barnes “System for Automatically Tracking White Blood Cells”, Rev. Sci. Instruments 48 (1977) 602–604
U. Haass and T.A. Brubaker “Estimation of Lateral and Rotational Cloud Displacement from Satellite Pictures”, WCATVI-79, pp. 103–104
A. Habibi “Survey of Adaptive Image Coding Techniques”, IEEE Trans. Communications COM-25 (1977) 1275–1284
K. Hachimura, M. Kuwahara, and M. Kinoshita “Left Ventricular Contour Extraction from Radioisotope Angiocardiograms and Classification of Left Ventricular Wall Motion”, IJCPR-78 Nov. 7–10, 1978 Kyoto/Japan, pp. 911–913
D.J. Hall, R.M. Endlich, D.E. Wolf, and A.E. Brain “Objective Methods for Registering Landmarks and Determining Cloud Motions from Satellite Data”, IEEE Trans. Computers C-21 (1972) 768–776
B.G. Haskell “Frame-to-Frame Coding of Television Pictures Using Two-Dimensional Fourier Transforms”, IEEE Trans. Information Theory IT-20 (1974) 119–120
B.G. Haskell “Entropy Measurements for Nonadaptive and Adaptive, Frame-to-Frame, Linear Predictive Coding of Videotelephone Signals”, Bell System Techn. J. 54 (1975) 1155–1174
B.G. Haskell, F.W. Mounts, and J.C. Candy “Interframe Coding of Videotelephone Pictures”, Proc. IEEE 60 (1972) 792–800
J.A. Heller “A Real Time Hadamard Transform Video Compression System Using Frame-to-Frame Differencing”, Proc. Nat. Telecommunications Conference, San Diego, 1974, pp. 77–82
G.T. Herman and H.K. Liu “Dynamic Boundary Surface Detection”, Computer Graphics and Image Processing 7 (1978) 130–138 see also: Proc. Symposium on Computer-Aided Diagnosis of Medical Images, J. Sklansky (ed.) Coronado/CA, November 11, 1976, pp. 27–32
M.A. Hernan and J. Jimenez “Automatic Analysis of Movies in Fluid Mechanics”, WCATVI-79, pp. 134–135
K.H. Hoehne, G. Nicolae, G. Pfeiffer, R.-W. Dix, W. Ebenritter, D. Novak, M. Boehm, B. Sonne, and E. Buecheler “An Interactive System for Clinical Application of Angiodensitometry”, GI/NTG Fachtagung Digitale Bildverarbeitung Muenchen, 28.-30. Maerz 1977 (H.-H. Nagel, ed.) Informatik Fachberichte 8 (1977) pp. 232–243, Springer Verlag, Berlin-Heidelberg-New York 1977
D.C. Hogg “A Methodology for Real Time Scene Analysis”, IJCAI-77, p. 627
G. Hughes, C. Novak, and R. Schreitz “Automated Techniques for the Detection and Displacement Measurement of Selected Cloud Imagery Observed in Geostationary Satellite Data”, Proc. 8th Annual Automatic Imagery Pattern Recognition Symposium, R.A. Kirsch and R.N. Nagel (eds.) Gaithersburg/MD, April 3–4, 1978, pp. 81–90 Electronic Industries Association, Washington/DC 1978
R. Jain and H.-H. Nagel “On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes”, IEEE Trans. Pattern Analysis and Machine Intelligence PAMI-1 (1979) 206–214
R. Jain, D. Militzer, and H.-H. Nagel “Separating Non-Stationary from Stationary Scene Components in a Sequence of Real World TV-Images”, IJCAI-77, 612–618 and IfI-HH-B-32/77 (March 1977) Institut fuer Informatik, Universitaet Hamburg
H.W. Jones “A Real-Time Adaptive Hadamard Transform Video Compressor”, SPIE 87 (1976) 2–9
L.N. Kanal and J.A. Parikh “Severe Storm Pattern Recognition from Meteorological Satellite Data: a Report on Current Status and Prospects”, Research and Development Technical Report ECOM-77-3, Atmospheric Sciences Lab., US Army Electronics Command, White Sands Missile Range/NM (March 1, 1977)
J.G. Kawamura “Automatic Recognition of Changes in Urban Development from Aerial Photographs”, IEEE Trans. Systems, Man, and Cyb. SMC-1 (1971) 230–239
J. Klie “Codierung von Fernsehsignalen fuer niedrige Uebertragungsbitraten”, Dissertation, Juni 1978 Lehrstuhl fuer Theoretische Nachrichtentechnik und Informationsverarbeitung, Techn. Universitaet Hannover, D-3000 Hannover 1
S.C. Knauer “Real-Time Video Compression Algorithm for Hadamard Transform Processing”, IEEE Trans. Electromagnetic Compatibility EMC-18 (1976) 28–36
R.S. Ledley “Some Clinical Applications of Pattern Recognition”, IJCPR-73, pp. 89–112
J.A. Leese, C.S. Novak, and V.R. Taylor “The Determination of Cloud Pattern Motions from Geosynchronous Satellite Image Data”, Pattern Recognition 2 (1970) 279–292
J.A. Leese, C.S. Novak, and B.B. Clark “An Automated Technique for Obtaining Cloud Motion from Geosynchronous Satellite Data Using Cross-Correlation”, J. of Applied Meteorology 10 (1971) 118–132
M.D. Levine, D.A. O’Handley, G.M. Yagi “Computer Determination of Depth Maps”, Computer Graphics and Image Processing 2 (1973) 131–150
M.D. Levine, Y.M. Youssef, and F. Ferrie “Cell Movements: Its Characterization and Analysis”, WCATVI-79, pp. 93–95
R.A. Lewis and A.R. Johnston “A Scanning Laser Rangefinder for a Robot Vehicle”, IJCAI-77, pp. 762–768
R.L. Lillestrand “Techniques for Change Detection”, IEEE Trans. Computers C-21 (1972) 654–659
J.O. Limb “Distortion Criteria of the Human Viewer”, IEEE Trans. Systems, Man, and Cybernetics SCM-9 (1979) 778–793
J.O. Limb and J.A. Murphy “Measuring the Speed of Moving Objects from Television Signals”, IEEE Trans. Communications COM-23 (1975) 474–478
J.O. Limb and J.A. Murphy “Estimating the Velocity of Moving Images in Television Signals”, Computer Graphics and Image Processing 4 (1975) 311–327
J.O. Limb and R.F.W. Pease “A Simple Interframe Coder for Video Telephony”, Bell System Techn. J. 50 (1971) 1877–1888
J.O. Limb, R.F.W. Pease, and K.A. Walsh “Combining Intra-Frame and Frame-to-Frame Coding for Television”, Bell System Techn. J. 53 (1974) 1137–1173
L.E. Lipkin, P. Lemkin, and M. Wade “Digital Analysis of Living Cell Image Sequences in Support of Cytotoxicity-Carcinogenesis Research”, WCATVI-79, p. 25
H.K. Liu “Two- and Three-Dimensional Boundary Detection”, Computer Graphics and Image Processing 6 (1977) 123–134
R.C. Lo “The Application of a Thresholding Technique in Cloud Motion Estimation from Satellite Observations”, TR-357 (February 1975) Computer Science Department, University of Maryland, College Park/MD
W.N. Martin and J.K. Aggarwal “Survey: Dynamic Scene Analysis”, Computer Graphics and Image Processing 7 (1978) 356–374
W.N. Martin and J.K. Aggarwal “Computer Analysis of Dynamic Scenes Containing Curvilinear Figures”, Pattern Recognition 11 (1979) 169–178
B.H. McCormick, J.S. Read, R.T. Borovec, and R.C. Amendola “Image Processing in Television Ophthalmoscopy”, Digital Processing of Biomedical Images K. Preston, jr., and M. Onoe (eds.) Plenun Publ. Co., New York 1976
D.L. Milgram “Region Tracking Using Dynamic Programming”, TR-539 (May 1977), Computer Science Center, University of Maryland, College Park/MD see, too, WCATVI-79, p. 13
H.P. Moravec “Towards Automatic Visual Obstacle Avoidance”, IJCAI-77, p. 584
F.W. Mounts “A Video Encoding System with Conditional Picture-Element Replenishment”, Bell System Techn. J. 48 (1969) 2545–2554
H.-H. Nagel “Formation of an Object Concept by Analysis of Systematic Time Variations in the Optically Perceptible Environment”, Computer Graphics and Image Processing 7 (1978) 149–194
H.-H. Nagel “Analysis Techniques for Image Sequences”, IJCPR-78, pp. 186–211
H.-H. Nagel “Analysis of Image Sequences: What Can We Learn from Applications?”, to appear in: Image Sequence Analysis, T.S. Huang (ed.), Springer Verlag Berlin-Heidelberg-New York 1980
T.R. Natarajan and N. Ahmed “On Interframe Transform Coding”, IEEE Trans. Communications COM-25 (1977) 1323–1329
A.N. Netravali and J.D. Robbins “Motion Compensated Television Coding: Part 1”, Bell System Technical J. 58 (1979) 631–670
B. Neumann “Interpretation of Imperfect Object Contours for Identification and Tracking”, IJCPR-78 Nov. 7–10, 1978 Kyoto/Japan, pp. 691–693
D.A. O’Handley “Scene Analysis in Support of a Mars Rover”, Computer Graphics and Image Processing 2 (1973) 281–297
M. Onoe and K. Ohba “Digital Image Analysis of Traffic Flow”, IJCPR-76, pp. 803–808
M. Onoe, N. Hamano, K. Ohba “Computer Analysis of Traffic Flow Observed by Subtractive Television”, Computer Graphics and Image Processing 2 (1973) 377–392
J.A. Parikh and A. Rosenfeld “Automatic Segmentation and Classification of Infrared Meteorological Satellite Data”, IEEE Trans. Systems, Man, and Cybernetics SMC-8 (1978) 736–743
R.F.W. Pease and J.O. Limb “Exchange of Spatial and Temporal Resolution in Television Coding”, Bell System Techn. J. 50 (1971) 191–200
J. Potter “Velocity as a Cue to Segmentation”, IEEE Trans. Systems, Man and Cybernetics, SCM-5 (1975) 390–394
J.L. Potter “Scene Segmentation Using Motion Information”, Computer Graphics and Image Processing 6 (1977) 558–581
W.K. Pratt (ed.) “Image Transmission Techniques”, Academic Press New York/NY 1979
K.E. Price “Change Detection and Analysis in Multi-Spectral Images”, Ph.D. Thesis, December 18, 1976 Department of Computer Science, Carnegie-Mellon University, Pittsburgh/PA
K. Price and R. Reddy “Matching Segments of Images”, IEEE Trans. Pattern Analysis and Machine Intelligence PAMI-1 (1979) 110–116
B. Radig “Description of Moving Objects Based on Parameterized Region Extracting”, IJCPR-78 Nov. 7–10, 1978 Kyoto/Japan, pp. 723–725
J.S. Read, R.T. Borovec, R.C. Amendola, A.C. Petersen, M.H. Goldbaum, M. Kottow, B.H. McCormick, and M.F. Goldberg “The Television Ophthalmoscope Image Processor”, Proc. IEEE Workshop on Picture Data Description and Management Chicao/Ill., April 21–22, 1977, pp. 64–67
C. Reader “Intraframe and Interframe Adaptive Transform Coding”, Proc SPIE 66 (1975) 108–117
J. Roach and J.K. Aggarwal “Computer Tracking of Objects Moving in Space”, IEEE Trans. Pattern Analysis and Machine Intelligence PAMI-1 (1979) 127–135
J.D. Robbins and A.N. Netravali “Interframe Television Coding Using Movement Compensation”, International Conference on Communications June 1979, IEEE publication CH 1435-7/79 pp. 23.4.1–23.4.5
F. Rocca “Television Bandwidth Compression Utilizing Frame-to-Frame Correlation and Movement Compensation”, Symposium on Picture Bandwidth Compression MIT, Cambridge/MA, April 1969 (T.S. Huang and O.J. Tretiak, eds.) Gordon and Breach, New York 1972, pp. 675–693
J.A. Roese and G. S. Robinson “Combined Spatial and Temporal Coding of Digital Image Sequences”, Proc. SPIE 66 (1975) 172–180
J.A. Roese, W.V. Pratt, and G.S. Robinson “Interframe Cosine Transform Image Coding”, IEEE Trans. Communications COM-25 (1977) 1329–1339
W. Scacchi “Visual Motion Perception by Intelligent Systems”, IEEE Conference on Pattern Recognition and Image Processing, Chicago/IL, August 6–8, 1979, pp. 646–652
R.J. Schalkoff and E.S. McVey “Algorithm Development for Real-Time Automatic Video Tracking System”, preprint 1979
W.E. Shenk and E.R. Kreins “A Comparison Between Observed Winds and Cloud Motions Derived from Satellite Infrared Measurements”, J. of Applied Meteorology 9 (1970) 702–710
R.W. Smalling, M.H. Skolnick, D. Myers, R. Shabetai, J.C. Cole, and D. Johnston “Digital Boundary Detection, Volunetric and Wall Motion Analysis of Left Ventricular Cine Angiograms”, Comput. Biol Med. 6 (1976) 78–85
E.A. Smith and D.R. Phillips “Automated Cloud Tracking Using Precisely Aligned Digital ATS Pictures”, IEEE Trans. Computers C-21 (1972) 715–729
J.A. Stuller and A.N. Netravali “Transform Domain Motion Estimation”, WCATVI-79, p. 82
M. Takagi and K. Sakaue “The Analysis of Moving Granules in a Pancreatic Cell by Digital Moving Image Processing”, IJCPR-78 Nov. 7–10,1978 Kyoto/Japan, pp. 735–739
M. Tasto “Guided Boundary Detection for Left Ventricular Volune Measurements”, IJCPR-73, pp. 119–124
M. Tasto “Motion Extraction for Left-Ventricular Volune Measurement”, IEEE Trans. Biomedical Engineering BME-21 (1974) 207–213
M. Tasto, M. Felgendreher, W. Spiesberger, and P. Spiller “Comparison of Manual versus Computer Determination of Left Ventricular Boundaries from X-Ray Cineangiocardiograms”, in: Roentgen-Video-Techniques for Dynamic Studies of Structure and Function of the Heart and Circulation P.H. Heintzen and J.H. Buersch (eds.) Georg Thieme Verlag, Stuttgart 1978, pp. 168–183
A.M. Thompson “The Navigation System of the JPL Robot”, IJCAI-77, pp. 749–757
J.K. Tsotsos “A Framework for Visual Motion Understanding”, Department of Computer Science, University of Toronto Toronto/Canada 1980
M.S. Ulstad “An Algorithm for Estimating Small Scale Differences between Two Digital Images”, Pattern Recognition 5 (1973) 323–333
S. Ullman “The Interpretation of Visual Motion”, The MIT Press, Cambridge/Mass., 1979
T. Uno, M. Ejiri, and T. Tokunaga “A Method of Real-Time Recognition of Moving Objects and its Application”, Pattern Recognition 8 (1976) 201–208
M.P. Waters, III “Time Compositing of Meteorological Satellite Data for Ocean Current Identification”, Proc. 8th Annual Automatic Imagery Pattern Recognition Symposium, R.A. Kirsch and R.N. Nagel (eds.) Gaithersburg/MD, April 3–4, 1978, Electronics Industries Association, Washington/DC 1978, pp. 59–65
G. Winkler and K. Vattrodt “Measures for Conspicuousness of Images”, Computer Graphics and Image Processing 8 (1978) 355–368
D.E. Wolf, D.J. Hall, and R.M. Endlich “Experiments in Automatic Cloud Tracking Using SMS-GOES Data”, J. Applied Meteorology 16 (1977) 1219–1230
D.E. Wolf, D.J. Hall, and R.M. Endlich “An Automatic Method for Determining Cloud Motions from Pictures Taken by Geosynchronous Weather Satellites”, WCATVI-79, pp. 101–102
K. Wolferts “Special Problems in Interactive Image Processing for Traffic Analysis”, IJCPR-74, pp. 1–2 Copenhagen, August 13–15, 1974
E.H. Wood “New Horizons for Study of the Cardiopulmonary and Circulatory Systems”, Chest 69 (1976) 394–408
M. Yachida, M. Asada, and S. Tsuji “Automatic Motion Analysis System of Moving Objects from the Records of Natural Processes”, IJCPR-78 Nov. 7–10, 1978 Kyoto/Japan, pp. 726–730
Y. Yakimovsky and R.T. Cunningham “A System for Extracting Three-Dimensional Measurements from a Stereo-Pair of TV-Cameras”, Computer Graphics and Image Processing 7 (1978) 195–210
H.W. Yates and W.R. Bandeen “Meteorological Applications of Remote Sensing from Satellites”, Proc. IEEE 63 (1975) 148–163
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1981 D. Reidel Publishing Company
About this paper
Cite this paper
Radig, B., Nagel, HH. (1981). Evaluation of Image Sequences: A Look Beyond Applications. In: Simon, J.C., Haralick, R.M. (eds) Digital Image Processing. NATO Advanced Study Institutes Series, vol 77. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-8543-8_28
Download citation
DOI: https://doi.org/10.1007/978-94-009-8543-8_28
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-009-8545-2
Online ISBN: 978-94-009-8543-8
eBook Packages: Springer Book Archive