Abstract
This paper revisits the concept of dependence.We view statistical dependence as the state of variables being influenced by others. Our viewpoint accords well with the daily understanding of the notion of dependence, while classical dependence measures such as Pearson’s correlation coefficient, Kendall’s τ and Spearman’s ρ have different meanings.With this understanding of dependence, we introduce new dependence measures which are easy to work with and they are useful for developing an asymptotic theory for complicated stochastic systems. We also explore relations of the introduced dependence concept with nonlinear system theory, experimental design, information theory and risk management.
Keywords
- Central Limit Theorem
- Dependence Measure
- Dependent Random Variable
- Lebesgue Dominate Convergence Theorem
- Sequential Probability Ratio Test
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arjas, E. and Lehtonen, T. (1978) Approximating many server queues by means of single server queues. Math. Operation Research 3, 205-223.
Barlow, R. and Proschan, F. (1975) Statistical theory of reliability and life testing, Rinehart and Winston, New York.
Bjerve S. and Doksum, K. (1993) Correlation curves: measures of association as functions of covariates values. Annals of Statistics 21, 890-902.
Blyth, S. (1994) Local divergence and association. Biometrika 81, 579–584.
Block, H.W., Sampson A. R. and Savits, T. H. (1990) (eds) Topics in statistical dependence, IMS Lecture Notes-Monograph Series, 16 IMS, Hayward, CA.
Borkar, V. S. (1993) White-noise representations in stochastic realization theory. SIAM J. Control Optim. 31 1093–1102.
Bradley, R. (2005) Basic properties of strong mixing conditions. A Survey and some open questions. Probability Surveys 2, 107-144
Bryk, A. and Mielniczuk, J. (2005) Asymptotic properties of kernel density estimates for linear processes: application of projection method. Nonparametric Statistics 14, 121-133.
Capéraà, P. and Genest, C. (1990). Concepts de dépendance et ordres stochastiques pour des lois bidimensionelles. Canadian Journal of Statistics 18, 315-326.
Cowell, R. G., Dawid, A. P. and Spiegelhalter, D. J. (1999) Probabilistic Networks and Systems, Springer, New York.
Crutchfeld, J.P. and Feldman, D.P. (2003) Regularities unseen, randomness observed: The entropy convergence hierarchy. Chaos 15, 25-54.
Deák, I. (1990) Random Numbers Generators and Simulation, Akadémiai Kiadó, Budapest.
Dedecker, J., Merlevède, F. (2002) Necessary and sufficient conditions for the conditional central limit theorem. Ann. Probab. 30, 1044–1081.
Dedecker, J., P. Doukhan, G. Lang, J.R. Leon R. S. Louhichi and C. Prieur (2007) Weak Dependence: With Examples and Applications, Springer, New York.
Diaconis, P. and Freedman, D. (1999) Iterated random functions. SIAM Review 41 41-76.
Doksum, K. and Froda, S. M. (2000) Neighborhood correlation. J. Statist. Plan. Inf. 91, 267–294.
Doksum, K. and Samarov, A. (1995) Nonparametric estimation of global functionals and measure of the explanatory powers in regression. Annals of Statistics 23, 1443-1473.
Doukhan, P. and Louhichi, S. (1999) A new weak dependence condition and applications to moment inequalities. Stochastic Process. Appl. 84 313–342.
Drouet Mari, D. and Kotz, S. (2001) Correlation and dependence, Imperial College Press, London.
Efron, B. and Stein, C. (1981) The jackknife estimate of variance. Annals of Statistics 9, 586–596.
Embrechts, P., McNeil, A. and Straumann, D. (2002) Correlatation and dependence in risk management: properties and pitfalls. In: RiskManagement: Value at Risk and Beyond. (M.A.H. Dempster, ed.), Cambridge University Press, 176-223.
Esary, J. D., Proschan, F. and Walkup, D.W. (1967) Association of random variables with applications, Annals of Mathematical Statistics 38, 1466–1474.
Esary, J. D. and Proschan, F. (1972) Relationships between some concepts of bivariate dependence. Annals of Mathematical Statistics 43, 651-655.
Glymour, C. (2006) Causation-II. Encyclopedia of Statistical Sciences, Wiley. 782–794
Gordin, M.I. (1969) The central limit theorem for stationary processes. Dokl. Akad. Nauk SSSR 188, 739–741
Gordin, M.I. and Lifsic, B.A.(1973) The central limit theorem for stationary Markov processes. Dokl. Akad. Nauk SSSR 239, 392–393
Granger, C.W.J. (1969) Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37, 424–438.
Hannan, E.J. (1979) The central limit theorem for time series regression. Stochastic Processes Appl., 9, 281–289
Joe, H. (1997) Multivariate models and dependence concepts, Chapman and Hall, London.
Jogdeo, K. (1978) On a probability bound of Marshall and Olkin. Ann. Statist. 6, 232–234.
Jogdeo, K. (2006) Concepts of dependence. Encyclopedia of Statistical Sciences, Wiley, 163–1647.
Kalikow, S. A. (1982) T, T−1 transformation is not loosely Bernoulli. Ann. Math. 115, 393–409.
Kallianpur, G. (1981) Some ramifications of Wieners ideas on nonlinear prediction. In: Norbert Wiener, Collected Works with Commentaries, MIT Press, Mass., 402–424.
Lai, C. D. and Xie, M. (2006) Stochastic Ageing and Dependence for Reliability. Springer, New York.
Lehmann, E. L. (1966) Some concepts of dependence. Ann. Math. Statist. 37, 1137–1153.
Li, H., Scarsini, M. and Shaked, M. (1996) Linkages: A tool for construction of multivariate distributions with nonoverlapping multivariate marginals. J. Multivariate. Anal. 56, 20–41.
Liggett, T.M. (1985) Interacting Particle Systems, Springer, New York
Mellor, D. H. (1998) The Facts of Causation, Routledge, New York.
Merlevède F., and Peligrad, M. (2006) On the weak invariance principle for stationary sequences under projective criteria. J. Theor. Probab. 19, 647–689
J. P. Morgan (1996) RiskMetrics. Technical Document. New York.
Mosteller, F. and Tukey, J.W. (1977) Data Analysis and Regression, Addison-Wesley Reading, Mass.
Newman, C.M. (1984) Asymptotic independence and limit theorems for positively and negatively dependent random variables. In: Inequalities in Statistics and Probability (Y.L. Tong, ed.), IMS Lecture Notes - Monograph Series 7, 127–140.
Ornstein, D. S. (1973) An example of a Kolmogorov automorphism that is not a Bernoulli shift. Advances in Math. 10 49–62
Rényi, A. (1959) On measures of dependence. Acta Math. Acad. Sci. Hungar. 10 441–451
Rosenblatt, M. (1952). Remarks on a multivariate transformation. Ann. Math. Statist. 23 470–472.
Rosenblatt, M. (1959). Stationary processes as shifts of functions of independent random variables. J. Math. Mech. 8, 665–681.
Rosenblatt, M. (1971) Markov Processes. Structure and Asymptotic Behavior, Springer, New York.
Rosenblatt, M. (2009) A comment on a conjecture of N. Wiener. Statist. Probab. Letters, 79, 347–348
Rubin, D. (1990) Formal modes of statistical inference for causal effects. Journal of Statistical Planning and Inference 25, 279–292.
Rüschendorf, L. (1981) Stochastically ordered distributions and monotonicity of the OC-function of sequential probability ratio tests. Mathematische Operationsforschung und Statistik. Series Statistcis 12, 327–338.
Rüschendorf, L. and de Valk, V.(1981) On regression representation of stochastic processes. Stochastic Processes and Their Applications 46, 183–198.
Scarsini, M. (1984) On measures of concordance. Stochastica 8, 201–218.
Skaug, H. J. and Tjøstheim, D. (1993) A nonparametric test of serial independence based on the empirical distribution function. Biometrika 80 591–602.
Stigler, S. M. (1986) The history of statistics, Harvard University Press, Cambridge, MA.
Szekli, R. (1995) Stochastic ordering and dependence in applied probability, Springer, New York
Tjøstheim, D. (1996) Measures of dependence and tests of independence. Statistics 28 249–284.
Tong, H. (1990) Nonlinear time series analysis: A dynamic approach., Oxford University Press, Oxford.
Vol?ny, D. (1993) Approximating martingales and the central limit theorem for strictly stationary processes. Stochastic Processes and their Applications 44, 41–74
Wiener, N. (1958) Nonlinear Problems in Random Theory., MIT Press, Cambridge, MA.
Woodroofe, M. (1992) A central limit theorem for functions of aMarkov chain with applications to shifts. Stochastic Processes and Their Applications 41, 33–44.
Wu, W.B. and Woodroofe, M. (2004) Martingale approximations for sums of stationary processes. Ann. Probab. 32, 1674–1690.
Wu, W. B. (2005) Nonlinear system theory: Another look at dependence. Proceedings of the National Academy of Sciences, USA, 102, 14150–14154.
Wu, W. B. (2007) Strong invariance principles for dependent randomvariables. Ann. Probab., 35, 2294–2320.
Wu, W. B. (2008) Empirical processes of stationary sequences. Statistica Sinica, 18 313–333.
Wu, W. B. and Shao, X. (2004) Limit theorems for iterated random functions. Journal of Applied Probability, 41 425–436.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wu, W.B., Mielniczuk, J. (2010). A new look at measuring dependence. In: Doukhan, P., Lang, G., Surgailis, D., Teyssière, G. (eds) Dependence in Probability and Statistics. Lecture Notes in Statistics(), vol 200. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14104-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-14104-1_7
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14103-4
Online ISBN: 978-3-642-14104-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)