Advertisement

Trials

, 14:P43 | Cite as

External validation of a prognostic index

  • Laura Bonnett
  • Anthony Marson
  • Tony Johnson
  • Lois Kim
  • Ley Sander
  • Nicholas Lawn
  • Ettore Beghi
  • Maurizio Leone
  • Catrin Tudur Smith
Open Access
Poster presentation
  • 607 Downloads

Keywords

Eligible Patient External Validation Original Model Trial Data Multiple Imputation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Background

Prognostic indices, derived from prognostic models, can be used to stratify patients in clinical trials. This includes stratifying eligible patients for randomisation, stratifying randomisation, or identifying subgroups for the trial analysis. However, before an index can be used for these purposes, it needs to be validated externally in independent data. We demonstrate methods of external validation, including methods for handling a covariate missing from the validation dataset, via a prognostic model for risk of seizure recurrence following a first ever seizure.

Methods

Three independent datasets were obtained. External validation was evaluated for each dataset via discrimination using Harrell's c-index. Calibration plots were also considered. Five imputation methods were examined to handle a covariate missing from one validation dataset. These included hot deck imputation and multiple imputation.

Results

Trial data for 620 people with epilepsy was used to develop the original model; the validation datasets consisted of 274, 307 and 847 trial participants respectively. The model generalised relatively well to the other datasets - two out of three calibration plots demonstrated excellent fits while two of the three datasets had c-indexes within 0.01 of each other. All five methods of imputation performed fairly similarly.

Conclusions

Prognostic models, and consequently prognostic indices, can be validated by considering calibration and discrimination methods. Although there are limitations to external validation, it is still a necessary part of modelling.

Copyright information

© Bonnett et al; licensee BioMed Central Ltd. 2013

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Authors and Affiliations

  • Laura Bonnett
    • 1
  • Anthony Marson
    • 1
  • Tony Johnson
    • 2
    • 3
  • Lois Kim
    • 4
  • Ley Sander
    • 8
    • 9
  • Nicholas Lawn
    • 7
  • Ettore Beghi
    • 6
  • Maurizio Leone
    • 5
  • Catrin Tudur Smith
    • 1
  1. 1.University of LiverpoolLiverpoolUK
  2. 2.MRC Biostatistics UnitCambridgeUK
  3. 3.MRC Clinical Trials UnitLondonUK
  4. 4.London School of Hygiene & Tropical MedicineLondonUK
  5. 5.Clinica Neurologica, Ospedale Maggiore della CaritaNovaraItaly
  6. 6.IRCCS Istituto di Ricerche Farmacologiche Mario NegriMilanoItaly
  7. 7.Royal Perth and Fremantle HospitalsPerthAustralia
  8. 8.UCLLondonUK
  9. 9.Epilepsy SocietyChalfont St PeterUK

Personalised recommendations