Abstract
This chapter considers several research topics that encompass the area of Dynamic Data Driven Applications Systems (DDDAS), and describes the multidisciplinary methods required for the analysis and prediction of complex systems. It focuses on developing new algorithms and tools for the collection, assimilation and harnessing of data by threading together ideas from random dynamical systems to information theory. A general overview of the multi-scale signal and observation processes, the multidisciplinary methods required for their analysis, and a new particle filtering algorithm that combines homogenization with filtering theory are presented. Importance sampling and control methods are then used as a basic and flexible tool for the construction of the proposal density inherent in particle filtering for approximating the real time filtering of chaotic signals. Finally the chapter describes an information theoretic method, which follows naturally from the expected uncertainty minimization criterion, for dynamic sensor selection in filtering problems. It is compared with a strategy based on finite-time Lyapunov exponents of the dynamical system, which provide insight into error growth due to signal dynamics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
E.H. Aoki, A. Bagchi, P. Mandal, Y. Boers, A theoretical look at information-driven sensor management criteria, in Proceedings of the 14th International Conference on Information Fusion (FUSION) (IEEE, Chicago, 2011), pp. 1180–1187
L. Arnold, Random Dynamical Systems, Springer Monographs in Mathematics (Springer, Berlin, 1998)
L. Arnold, M. Scheutzow, Perfect cocycles through stochastic differential equations. Probab. Theory Relat. Fields 101, 65–88 (1995)
L. Arnold, N.S. Namachchivaya, K.L. Schenk, Toward an understanding of stochastic hopf bifurcations: a case study. J. Bifurcation Chaos 6, 1947–1975 (1996)
A. Bain, D. Crisan, Fundamentals of stochastic filtering (Springer, Berlin, 2009).
N. Berglund, B. Gentz, Noise-induced phenomena in slow-fast dynamical systems: a sample paths approach, (Springer, London, 2006)
R. Buizza, M. Miller, T.N. Palmer, Stochastic simulation of model uncertainties. Q. J. R. Meteorol. Soc. 125, 2887–2908 (1999)
T.M. Cover, J.A. Thomas, Elements of Information Theory, 2nd edn. (Wiley-Interscience J.A., Hoboken, 2006)
A. Doucet, B.-N. Vo, C. Andrieu, M. Davy, Particle filtering for multi-target tracking and sensor management, in Proceedings of the 5th International Conference on Information Fusion (FUSION) (IEEE, Annapolis, MD, 2002), pp. 474–481
J. Dunik, O. Straka, M. Simandl, E. Blasch, Random-point-based filters: analysis and comparison in target tracking. IEEE Trans. Aerosp. Electron. Syst. 51(2), 1403–1421 (2015)
E. Ertin, J.W. Fisher, L.C. Potter, Maximum mutual information principle for dynamic sensor query problems in Information Processing in Sensor Networks. Lecture Notes in Computer Science, vol. 2634 (Springer, Berlin, 2003), pp. 405–416
S.N. Ethier, T.G. Kurtz, Markov Processes: Characterization and Convergence (Wiley, New York, 1986)
G. Evensen, The ensemble Kalman Filter: theoretical formulation and practical implementation. Ocean Dyn. 53(4), 343–367 (2003)
M.I. Freidlin, A.D. Wentzell, Random Perturbations of Dynamical Systems. Grundlehren der Mathematischen Wissenschaften, 260 (Springer, Berlin, 1998)
C. Kreucher, J. Wegrzyn, M. Beauvais, R. Conti, Multiplatform information-based sensor management: an inverted UAV demonstration, in Defense and Security Symposium, International Society for Optics and Photonics: 65780Y-65780Y, 2007
P. Imkeller, N.S. Namachchivaya, N. Perkowski, H.C. Yeong, Dimensional reduction in nonlinear filtering: a homogenization approach. Ann. Appl. Probab. 23(6), 2161–2603 (2013)
A.H. Jazwinski, Stochastic Processes and Filtering Theory (Academic, New York, 1970)
C. Kreucher, K. Kastella, A.O. Hero III, Information based sensor management for multitarget tracking, in Proceedings of SPIE 5204, Signal and Data Processing of Small Targets, vol. 480 (San Diego, CA, 2003)
C.M. Kreucher, A.O. Hero, K.D. Kastella, M.R. Morelande, An information-based approach to sensor management in large dynamic networks. Proc. IEEE 95(5), 978–999 (2007)
H. Kunita, Some extensions of Itô’s formula. Séminaire de probabilités (Strasbourg), vol. 15 (Springer, Berlin/Heidelberg, 1981), pp. 118–141
H. Kunita, Stochastic Flows and Stochastic Differential Equations (Cambridge University Press, Cambridge, 1990)
F. Ledrappier, L.-S. Young, The metric entropy of diffeomorphisms: part I: characterization of measures satisfying Pesin’s Entropy formula. Ann. Math. 122(3), 509–539 (1985)
J. Li, K. Lu, P.W. Bates, Geometric singular perturbation theory with real noise. J. Differ. Equ. 259(10), 5137–5167 (2015)
N. Lingala, N.S. Namachchivaya, N. Perkowski, H.C. Yeong, Particle filtering in high-dimensional chaotic systems. Chaos 22, 047509 (2012)
N. Lingala, N.S. Namachchivaya, N. Perkowski, H.C. Yeong, Optimal nudging in particle filters. Probab. Eng. Mech. 32, 21–30 (2014)
E.N. Lorenz, Deterministic nonperiodic flow. J. Atmos. Sci. 20, 130–141 (1963)
M. Mamlouk, Information based sensor control in a two-vortex flowfield. M.S. Thesis, University of Illinois-Urbana Champaign, Department of Aerospace Engineering, Urbana, Illinois (2013)
S. Mitter, N. Newton, Information and Entropy Flow in the Kalma-Bucy Filter. J. Stat. Phys. 118(1), 145–176 (2005)
S. Martinez, F. Bullo, Optimal sensor placement and motion coordination for target tracking. Automatica 42, 661–668 (2006)
E. Mayer-Wolf, M. Zakai, On a formula relating the Shannon information to the Fisher information for the filtering problem, in Filtering and Control of Random Processes: Proceedings of the E.N.S.T.-C.N.E.T. Colloquium, Paris, 23–24 Feb 1983, vol. 61 (Springer, Berlin/Heidelberg, 1984), pp. 164–171
N.S. Namachchivaya, R.B. Sowers, Rigorous stochastic averaging at a center with additive noise. Meccanica 37(2), 85–114 (2002)
N.S. Namachchivaya, R.B. Sowers, L. Vedula, Nonstandard reduction of Noisy Duffing-van der Pol equation. J. Dyn. Syst. 16(3), 223–245 (2001)
V.I. Oseledec, A Multiplicative Ergodic Theorem. Lyapunov characteristic numbers for dynamical systems. Trans. Moscow Math. Soc. 19, 197–231 (1968)
K. Onu, N.S. Namachchivaya, stochastic averaging of surface waves. Proc R Soc A 466(3), 2363–2381 (2010)
J.H. Park, N.S. Namachchivaya, R.B. Sowers, Dimensional reduction in nonlinear filtering. Nonlinearity 23(2), 305–325 (2010)
G.C. Papanicolaou, D. Stroock, S.R.S. Varadhan, Martingale approach to some limit theorems, in Papers from the Duke Turbulence Conference, Duke University, Durham, 1976, paper no. 6 (Duke University, Durham, 1977)
J.H. Park, N.S. Namachchivaya, H.C. Yeong, Particle filters in a multiscale environment: homogenized hybrid particle filter. J. Appl. Mech. 78(6), 1–10 (2011)
Y. Pesin, Characteristic Lyapunov exponents and smooth ergodic theory. Rus. Math. Surv. 32(4), 55–114 (1977)
D. Ruelle, Ergodic theory of differentiable dynamical systems. Publ. IHES 50, 27–58 (1979)
A. Ryan, J.K. Hedrick, Particle filter based information-theoretic active sensing. Robot. Auton. Syst. 58(5), 574–584 (2010)
D.W. Stroock, S.R.S. Varadhan, Multidimensional diffusion processes Grundlehren der Mathematischen Wissenschaften 233 (Springer, Berlin, 1979)
E. Weinan, D. Liu, E. Vanden-Eijnden, Analysis of multiscale methods for stochastic differential equations. Commun. Pure Appl. Math. 58, 1544–1585 (2005)
C. Yang, I. Kadar, E. Blasch, M. Bakich, Comparison of information theoretic divergences for sensor management, in Proceedings of SPIE 8050, Signal Processing, Sensor Fusion, and Target Recognition XX, 80500C, Bellingham, 2011
Acknowledgements
The authors acknowledge the support of the AFOSR under grant numbers FA9550-12-1-0390 and FA9550-16-1-0390.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Yeong, H.C., Beeson, R., Namachchivaya, N.S., Perkowski, N., Sauer, P.W. (2018). Dynamic Data-Driven Adaptive Observations in Data Assimilation for Multi-scale Systems. In: Blasch, E., Ravela, S., Aved, A. (eds) Handbook of Dynamic Data Driven Applications Systems. Springer, Cham. https://doi.org/10.1007/978-3-319-95504-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-95504-9_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-95503-2
Online ISBN: 978-3-319-95504-9
eBook Packages: Computer ScienceComputer Science (R0)