Skip to main content
SpringerLink
Log in

Facilitating the Exploration of Open Health-Care Data Through BOAT: A Big Data Open Source Analytics Tool

  • Conference paper
  • First Online:
Emerging Challenges in Business, Optimization, Technology, and Industry

Part of the book series: Springer Proceedings in Business and Economics ((SPBE))

Abstract

Big Data Analytics is the use of advanced analytic techniques on very large data sets to discover hidden patterns and useful information. Many governments publicly release significant amounts of health data, including hospital ratings and patient outcomes. We propose applying Big Data Analytics to understand open health data. Ideally, citizens would use this data to choose hospitals or evaluate care options. There are major challenges, including merging data from disparate sources and applying interpretive analytics.

We are building an open-source tool to facilitate analytical exploration. Such a tool could enable researchers, hospitals, insurers, and citizens to obtain integrated global-to-local perspectives on health-care expenditures, procedure costs, and emerging trends. Our tool is based on the Python ecosystem, and contains a variety of modules from database analytics to machine learning and visualization. We analyzed data from the New York Statewide Planning and Research Cooperative System and determined the distribution of costs for hip replacement surgery across the state. The mean cost over 168,676 patients is $22,700, the standard deviation is $20,900, and 88% of these patients had hip replacement costs of less than $30,000. This provides the background to understand why in a state with similar demographics, The California Public Employees’ Retirement System capped hip replacement reimbursements at $30,000, which resulted in significant medical savings. Obtaining transparency of medical costs is important to control expenditure. Even though such information is available, consumers have trouble utilizing it effectively. Our tool could be truly transformative, allowing consumers to fully use available data, and to perhaps demand access to data that ought to be made public.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Baigent C, Blackwell L, Collins R, Emberson J, Godwin J, Peto R et al (2009) Aspirin in the primary and secondary prevention of vascular disease: collaborative meta-analysis of individual participant data from randomized trials. Lancet 373:1849–1860

    Article  Google Scholar 

  • Bibbins-Domingo K (2016) Aspirin use for the primary prevention of cardiovascular disease and colorectal cancer: US preventive services task force recommendation. Ann Intern Med 164:836–845

    Article  Google Scholar 

  • Borgman CL (2012) The conundrum of sharing research data. J Assoc Inf Sci Technol 63:1059–1078

    Article  Google Scholar 

  • Boulton G, Rawlins M, Vallance P, Walport M (2011) Science as a public enterprise: the case for open data. Lancet 377:1633–1635

    Article  Google Scholar 

  • Bridgewater B, Grayson AD, Brooks N, Grotte G, Fabri BM, Au J et al (2007) Has the publication of cardiac surgery outcome data been associated with changes in practice in northwest England: an analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over eight years. Heart 93:744–748

    Article  Google Scholar 

  • Bullinger AC, Rass M, Adamczyk S, Moeslein KM, Sohn S (2012) Open innovation in health care: analysis of an open health platform. Health Policy 105:165–175

    Article  Google Scholar 

  • Centre for disease control and prevention. http://wwwcdcgov/DataStatistics/

  • Choudhry NK, Fletcher RH, Soumerai SB (2005) Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med 142:260–273

    Article  Google Scholar 

  • CMS.GOV, Private correspondence with the data vendor for CMS.

    Google Scholar 

  • Conradie P, Choenni S (2014) On the barriers for local government releasing open data. Gov Inf Q 31:S10–S17

    Article  Google Scholar 

  • DATAUSA. https://datausa.io/about/

  • Davies T, Perini F (2016) Researching the emerging impacts of open data: revisiting the ODDC conceptual framework. J Commun Inform 12

    Google Scholar 

  • DeJong C, Aguilar T, Tseng C-W, Lin GA, Boscardin WJ, Dudley RA (2016) Pharmaceutical industry–sponsored meals and physician prescribing patterns for Medicare beneficiaries. JAMA Intern Med 176:1114–1110

    Article  Google Scholar 

  • Department of Health and Human Services. Secondary analyses of existing data sets and stored biospecimens to address clinical aging research questions (R01)

    Google Scholar 

  • Department of Health and Human Services. Secondary dataset analyses in heart, lung, and blood diseases and sleep disorders (R21)

    Google Scholar 

  • Estrin D, Sim I (2010) Health care delivery open mHealth architecture: an engine for health care innovation. Science 330:759–760

    Article  Google Scholar 

  • Fontenot SF (2013) Understanding the affordable care act bit by bit: will transparency and sunshine shrink costs? Physician Exec 39:86

    Google Scholar 

  • Frakt A (2016) How common procedures became 20 percent cheaper for many Californians. The New York Times 2016

    Google Scholar 

  • github.com/fdudatamining/framework. Base Frame Work for Data Mining

    Google Scholar 

  • Harding AJ, Pritchard C (2016) UK and twenty comparable countries GDP-expenditure-on-health 1980-2013: the historic and continued low priority of UK health-related expenditure. Int J Health Policy Manag 5:519

    Article  Google Scholar 

  • Hardy Q (2013) Technology workers are young (really young). The New York Times

    Google Scholar 

  • Hunter JD (2007) Matplotlib: a 2D graphics environment. Comput Sci Eng 9:90–95

    Article  Google Scholar 

  • Jena AB, Romley J (2015) Changes in hospitalizations, treatment patterns, and outcomes during major cardiovascular meetings—reply. JAMA Intern Med 175:1420–1421

    Article  Google Scholar 

  • Jetzek T (2015) The sustainable value of open government data: uncovering the generative mechanisms of open data through a mixed methods approach. Copenhagen Business School, Institute for IT-Ledelse Department of IT Management

    Google Scholar 

  • Krumholz HM (2014) Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system. Health Aff (Millwood) 33:1163–1170

    Article  Google Scholar 

  • Kupfer JM (2016) The graying of US physicians: implications for quality and the future supply of physicians. JAMA 315:341–342

    Article  Google Scholar 

  • Le ME, Kurd MF (2014) A review and analysis of the YODA trials: what can we glean clinically? Curr Rev Musculoskelet Med 7:189–192

    Article  Google Scholar 

  • Martin EG, Helbig N, Shah NR (2014) Liberating data to transform health care: New york’s open data experience. JAMA 311:2481–2482

    Article  Google Scholar 

  • Martin AB, Hartman M, Benson J, Catlin A, Team NHEA (2016) National health spending in 2014: faster growth driven by coverage expansion and prescription drug spending. Health Aff 35:150–160

    Article  Google Scholar 

  • MartĂ­nez-Torres MR, Diaz-Fernandez MDC (2014) Current issues and research trends on open-source software communities. Tech Anal Strat Manag 26:55–68

    Article  Google Scholar 

  • McAlister FA, Youngson E, Bakal JA, Holroyd-Leduc J, Kassam N (2015) Physician experience and outcomes among patients admitted to general internal medicine teaching wards. CMAJ 187:1041–1048

    Article  Google Scholar 

  • McKinney W (2010) Data structures for statistical computing in python. In: Proceedings of the 9th python in science conference, pp 51–56

    Google Scholar 

  • McKinney W (2012) Python for data analysis: data wrangling with Pandas, NumPy, and IPython. O’Reilly Media, Inc

    Google Scholar 

  • Medicare.gov. The total performance score information. https://www.medicare.gov/hospitalcompare/data/total-performance-scores.html

  • Miller RH, Sim I (2004) Physicians’ use of electronic medical records: barriers and solutions. Health Aff 23:116–126

    Article  Google Scholar 

  • New York State Department of Health, Statewide Planning and Research Cooperative System (SPARCS). https://www.health.ny.gov/statistics/sparcs/

  • Nisen P, Rockhold F (2013) Access to patient-level data from GlaxoSmithKline clinical trials. N Engl J Med 369:475–478

    Article  Google Scholar 

  • Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O et al (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830

    Google Scholar 

  • PĂ©rez F, Granger BE (2007) IPython: a system for interactive scientific computing. Comput Sci Eng 9:21–29

    Article  Google Scholar 

  • Physician specialty data book (2014). https://members.aamc.org/eweb/upload/Physician%20Specialty%20Databook%202014.pdf. Accessed 5 Jul 2017.

  • Rao AR, Clarke D (2016) A fully integrated open-source toolkit for mining healthcare big-data: architecture and applications. In: IEEE international conference on healthcare informatics ICHI, Chicago, vol 2016, pp 255–261

    Google Scholar 

  • Rao AR, Chhabra A, Das R, Ruhil V (2015) A framework for analyzing publicly available healthcare data. In 17th international conference on E-health networking. Appl Services (IEEE HealthCom) vol 2015, pp 653–656

    Google Scholar 

  • Roshan Paul AC (2011) An open source approach to medical research. Stanford Social Innovation Review

    Google Scholar 

  • Russell SAGE Foundation Funding opportunity: the social, economic, and political effects of the affordable care act

    Google Scholar 

  • Safran C, Bloomrosen M, Hammond WE, Labkoff S, Markel-Fox S, Tang PC et al (2007) Toward a national framework for the secondary use of health data: an American Medical Informatics Association White Paper. J Am Med Inform Assoc 14:1–9

    Article  Google Scholar 

  • Salthouse TA (2009) When does age-related cognitive decline begin? Neurobiol Aging 30:507–514

    Article  Google Scholar 

  • Schenarts PJ, Cemaj S (2016) The aging surgeon: implications for the workforce, the surgeon, and the patient. Surg Clin North Am 96:129–138

    Article  Google Scholar 

  • Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM (2014) Measuring low-value care in Medicare. JAMA Intern Med 174:1067–1076

    Article  Google Scholar 

  • Shadbolt N, O’Hara K, Berners-Lee T, Gibbins N, Glaser H, Hall W (2012) Linked open government data: lessons from data.gov.uk. IEEE Intell Syst 27:16–24

    Article  Google Scholar 

  • Specks U, Merkel PA, Seo P, Spiera R, Langford CA, Hoffman GS et al (2013) Efficacy of remission-induction regimens for ANCA-associated vasculitis. N Engl J Med 369:417–427

    Article  Google Scholar 

  • Stilgoe J, Lock SJ, Wilsdon J (2014) Why should we promote public engagement with science? Public Underst Sci 23:4–15

    Article  Google Scholar 

  • Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J et al (2015) UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med 12:e1001779

    Article  Google Scholar 

  • Thibodeau P (2015) Median age at Google is 29, says age discrimination lawsuit. Computerworld

    Google Scholar 

  • Thomas K (2016) Furor over drug prices puts patient advocacy groups in bind. The New York Times

    Google Scholar 

  • Walker J, Darer JD, Elmore JG, Delbanco T (2014) The road toward fully transparent medical records. N Engl J Med 370:6–8

    Article  Google Scholar 

  • Zarin DA (2013) Participant-level data and the new frontier in trial transparency. N Engl J Med 369:468–469

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Fairleigh Dickinson University, Teaneck, NJ, USA

    A. Ravishankar Rao & Daniel Clarke

Authors
  1. A. Ravishankar Rao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel Clarke
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. Ravishankar Rao .

Editor information

Editors and Affiliations

  1. Information Systems and Decision Sciences Department, Fairleigh Dickinson University, Vancouver, British Columbia, Canada

    Lotfi Tadj

  2. Administrative Sciences Department, Fairleigh Dickinson University, Vancouver, British Columbia, Canada

    Ajay K. Garg

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Ravishankar Rao, A., Clarke, D. (2018). Facilitating the Exploration of Open Health-Care Data Through BOAT: A Big Data Open Source Analytics Tool. In: Tadj, L., Garg, A. (eds) Emerging Challenges in Business, Optimization, Technology, and Industry. Springer Proceedings in Business and Economics. Springer, Cham. https://doi.org/10.1007/978-3-319-58589-5_7

Download citation

Publish with us

Policies and ethics

Search

Navigation