Some Statistical Considerations in Design and Analysis for Nonrandomized Comparative Studies Using Existing Data as Controls for Medical Device Premarket Evaluation
Nonrandomized comparative studies have been widely proposed and conducted in the premarket safety and effectiveness evaluation of medical devices. Sometimes, applicants conduct such studies in which the control data are formed from external sources, such as prior clinical studies. This type of study becomes even more popular with the availability of widely available real-world data such as patient registries of reasonable quality being sources for the control group. While such studies may potentially save time and money, bias can be introduced in every stage of such studies. To maintain the objectivity of study design and validity of study results, propensity score methodology is utilized and proper procedure of study design need to be implemented. In this article, considerations of the design and analysis of the non-randomized studies using the propensity score methodology are discussed from the statistical and regulatory perspectives.
KeywordsNon-randomized study Real world data Propensity score Estimand Two-stage design
- Code of Federal Regulations 21CFR860.7(c)(2).: U.S. Government Publishing Office. https://www.ecfr.gov/cgi-bin/text-idx?SID=b7516459b287456a33a3a31c67da82b0&mc=true&node=se21.8.860_17&rgn=div8 (2012). Accessed 30 Nov 2017
- Hill, J.L., Reiter, J.P., Zanutto, E.L.: A comparison of experimental and observational data analyses. In: Gelman, A., Meng, X.-L. (eds.) Applied Bayesian Modeling and Causal Inference from an Incomplete-Data Perspective, pp. 44–56. Wiley, New York (2004)Google Scholar
- International Conference on Harmonisation.: Final concept paper E9(R1): addendum to statistical principles for clinical trials on choosing appropriate estimands and defining sensitivity analyses in clinical trials. http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E9/E9__R1__Final_Concept_Paper_October_23_2014.pdf (2014). Accessed 13 Nov 2017
- US Food and Drug Administration.: Use of real-world evidence to support regulatory decision making for medical devices. Guidance for industry and Food and Drug Administration staff. http://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/UCM513027.pdf (2017). Accessed 18 Nov 2017