The Role of Statistics Education in the Big Data Era

  • Ryan H. L. IpEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 996)


With the increasing availability and trendiness of “big data”, data science has become a fast growing discipline. Data analysis techniques are shifting from classical statistical inferences to algorithmic machine learnings. Will the rise of data science lead to the fall of statistics? If education is the key to defend statistics as a discipline, what should statisticians teach to respond to the challenges brought by big data? This paper aims to provide the current situation of data science and statistics programs within the higher education sector in Australia and some personal thoughts on statistics education in this era.


Statistics teaching Data science Small data 



Helpful comments from three reviewers are greatly appreciated.


  1. 1.
    Anderson, C.: The End of Theory: The Data Deluge Makes the Scientific Method Obsolete (2008). Accessed 26 July 2018
  2. 2.
    Berger, J.O., Sellke, T.: Testing a point null hypothesis: the irreconcilability of P value and evidence. J. Am. Stat. Assoc. 82, 112–122 (1987)MathSciNetzbMATHGoogle Scholar
  3. 3.
    Cox, D.R.: Big data and precision. Biometrika 102, 712–716 (2015)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Davenport, T., Patil, D.: Data scientist: the sexiest job of the 21st century. Harvard Bus. Rev. 90, 70–76 (2012)Google Scholar
  5. 5.
    Dua, D., Karra Taniskidou, E.: UCI machine learning repository (2017). Accessed 6 Oct 2018
  6. 6.
    Dunson, D.B.: Statistics in the big data era: failures of the machine. Stat. Probabil. Lett. 136, 4–9 (2018)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Evans, S.J., Mills, P., Dawson, J.: The end of the \(p\) value? Brit. Heart J. 60, 177–180 (1988)CrossRefGoogle Scholar
  8. 8.
    Faraway, J., Augustin, N.: When small data beats big data. Stat. Probabil. Lett. 136, 142–145 (2018)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Gal, I., Ginsburg, L.: The role of beliefs and attitudes in learning statistics: towards an assessment framework. J. Stat. Educ. 2, 2 (1994). Scholar
  10. 10.
    Ioannidis, J.: The proposal to lower \(p\) value threshold to.005. J. Am. Med. Assoc. 319, 1429–1430 (2018)CrossRefGoogle Scholar
  11. 11.
    James, G.: Statistics within business in the era of big data. Stat. Probabil. Lett. 136, 155–159 (2018)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Lin, M., Lucas Jr., H., Shmueli, G.: Too big to fail: large samples and the \(p\)-value problem. Inform. Syst. Res. 24, 906–917 (2013)CrossRefGoogle Scholar
  13. 13.
    Meinshausen, N., Bühlmann, P.: Maximin effects in inhomogeneous large-scale data. Ann. Statist. 43, 1801–1830 (2015)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Reid, N.: Statistical science in the world of big data. Stat. Probabil. Lett. 136, 42–45 (2018)MathSciNetCrossRefGoogle Scholar
  15. 15.
    SCImago: SJR-SCImago Journal & Country Rank. Accessed 26 July 2018
  16. 16.
    Secchi, P.: On the role of statistics in the era of big data: a call for a debate. Stat. Probabil. Lett. 136, 10–14 (2018)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Sherman, M.: Spatial Statistics and Spatio-Temporal Data: Covariance Functions and Directional Properties. Wiley, New York (2011)zbMATHGoogle Scholar
  18. 18.
    Simmons, J.P., Nelson, L.D., Simonsohn, U.: False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol. Sci. 22, 1359–1366 (2011)CrossRefGoogle Scholar
  19. 19.
    Sterne, J.: Teaching hypothesis tests - time for significant change? Statist. Med. 21, 985–994 (2002)CrossRefGoogle Scholar
  20. 20.
    Wasserstein, R., Lazar, N.: The ASA’s statement on \(p\)-values: context, process, and purpose. Am. Stat. 70, 129–133 (2016)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Wit, E.C.: Big data and biostatistics: the death of the asymptotic Valhalla. Stat. Probabil. Lett. 136, 30–33 (2018)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Zieffler, A., Garfield, J., Alt, S., Dupuis, D., Holleque, K., Chang, B.: What does research suggest about the teaching and learning of introductory statistics at the college level? A review of the literature. J. Stat. Educ. 16, 2 (2017). Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.School of Computing and MathematicsCharles Sturt UniversityWagga WaggaAustralia

Personalised recommendations