Evaluating the quality of data from the Japanese National Clinical Database 2011 via a comparison with regional government report data and medical charts
The aim of this study was to examine the quality of data from the National Clinical Database (NCD) via a comparison with regional government report data and medical charts.
A total of 1,165,790 surgical cases from 3007 hospitals were registered in the NCD in 2011. To evaluate the NCD’s data coverage, we retrieved regional government report data for specified lung and esophageal surgeries and compared the number with registered cases in the NCD for corresponding procedures. We also randomly selected 21 sites for on-site data verification of eight demographic and surgical data components to assess the accuracy of data entry.
The numbers of patients registered in the NCD and regional government report were 46,143 and 48,716, respectively, for lung surgeries and 7494 and 8399, respectively, for esophageal surgeries, leading to estimated coverages of 94.7% for lung surgeries and 89.2% for esophageal surgeries. According to on-site verification of 609 cases at 18 sites, the overall agreement between the NCD data components and medical charts was 97.8%.
Approximately, 90–95% of the specified lung surgeries and esophageal surgeries performed in Japan were registered in the NCD in 2011. The NCD data were accurate relative to medical charts.
KeywordsClinical registry Data quality National Clinical Database Quality improvement initiatives
The authors thank all of the staff and academic societies involved in the National Clinical Database. AT, HK, and HM are affiliated with the Department of Healthcare Quality Assessment at the University of Tokyo, which is a social collaboration department supported by the National Clinical Database, Johnson & Johnson K.K., and Nipro corporation. The authors have no other conflicts of interest to declare. The data verification activities were supported by the National Clinical Database.
- 14.Ministry of Health, Labor and Welfare. Survey of medical institutions of 2013. http://www.mhlw.go.jp/toukei/saikin/hw/iryosd/13/. Accessed 1 May 2017.
- 15.Kanto-Shinetsu Regional Bureau of Health and Welfare (in Japanese). https://kouseikyoku.mhlw.go.jp/kantoshinetsu/iryo_shido/sisetukijyunntodokede.html. Accessed 26 Oct 2017.
- 16.Miyata H, Tomotaki A, Okubo S, Motomura N, Murakami A, Kiuchi T, et al. Quality improvement initiative based on National Clinical Database (2) to enhance reliability and neutrality of quality assessment. Surg Ther. 2011;104:381–6.Google Scholar
- 17.The North American Association of Central Cancer Registries. https://www.naaccr.org/certification-criteria/. Accessed 26 Oct 2017.
- 20.Allepuz A, Serra-Sutton V, Martínez O, Tebé C, Nardi J, Portabella F, Espallargues M, en nombre del Registro de Artroplastias de Cataluña (RACat). Arthroplasty registers as post-marketing surveillance systems: the Catalan Arthroplasty Register. Rev Esp Cir Ortop Traumatol. 2013;57(1):27–37.PubMedGoogle Scholar
- 23.Ministry of Health, Labor and Welfare. Outline of 2010 revision of medical fee (in Japanese). http://www.mhlw.go.jp/stf/seisakunitsuite/bunya/kenkou_iryou/iryouhoken/iryouhoken12/index.html. Accessed 26 Oct 2017.
- 24.Takahashi A, Kumamaru H, Tomotaki A, Matsumura G, Fukuchi E, Hirata Y, Murakami A, Hashimoto H, Ono M, Miyata H. Verification of data accuracy in Japan Congenital Cardiovascular Surgery Database including its postprocedural complication reports. World J Pediatr Congenit Heart Surg. 2018;9:150–6.CrossRefPubMedGoogle Scholar