Abstract
A Monte Carlo-based power analysis is proposed for t-test to deal with non-normality and heterogeneity in real data. The step-by-step procedure of the proposed method is introduced in the paper. For comparing the performance of the Monte Carlo-based power analysis to that of conventional pooled-variance t-test, a simulation study was conducted. The results indicate the Monte Carlo-based power analysis provided well-controlled empirical Type I error rate, whereas the conventional pooled-variance t-test failed to yield nominal-level Type I error rate. Both an R package and its corresponding online interface are provided to implement the proposed method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
J. Cohen, Statistical Power Analysis for the Behavioral Sciences, 2nd edn. (Lawrence Erlbaum, Hillsdale, NJ, 1988)
B.L. Welch, The generalization of student's' problem when several different population variances are involved. Biometrika 34(1/2), 28–35 (1947)
B.K. Moser, G.R. Stevens, C.L. Watts, The two-sample t test versus Satterthwaite's approximate F test. Commun. Stat. Theory Methods 18(11), 3963–3975 (1989)
R.L. Disantostefano, K.E. Muller, A comparison of power approximations for Satterthwaite's test. Commun. Stat. Simul. Comput. 24(3), 583–593 (1995)
M.J. Blanca, J. Arnau, D. López-Montiel, R. Bono, R. Bendayan, Skewness and kurtosis in real data samples. Methodology 9(2), 78–84 (2013)
T. Micceri, The unicorn, the normal curve, and other improbable creatures. Psychol. Bull. 105(1), 156 (1989)
M. Cain, Z. Zhang, K. Yuan, Univariate and multivariate skewness and kurtosis for measuring nonnormality: prevalence, Influence and estimation. Behav. Res. Methods (in press)
L.K. Muthén, B.O. Muthén, How to use a Monte Carlo study to decide on sample size and determine power. Struct. Equation Model. 9(4), 599–620 (2002)
Z. Zhang, Monte Carlo based statistical power analysis for mediation models: methods and software. Behav. Res. Methods 46(4), 1184–1198 (2014)
F.L. Schmidt, J.E. Hunter, Methods of Meta-Analysis: Correcting Error and Bias in Research Findings (Sage, Newbury Park, CA, 2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Du, H., Zhang, Z., Yuan, KH. (2017). Power Analysis for t-Test with Non-normal Data and Unequal Variances. In: van der Ark, L.A., Wiberg, M., Culpepper, S.A., Douglas, J.A., Wang, WC. (eds) Quantitative Psychology. IMPS 2016. Springer Proceedings in Mathematics & Statistics, vol 196. Springer, Cham. https://doi.org/10.1007/978-3-319-56294-0_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-56294-0_32
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-56293-3
Online ISBN: 978-3-319-56294-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)