, Volume 14, Issue 3, pp 251–257 | Cite as

Methodological Quality of Economic Modelling Studies

A Case Study with Hepatitis B Vaccines
  • Tom Jefferson
  • Vittorio Demicheli
Current Opinion


The notable increase in the quantity of economic evaluations in the last 2 decades has not been matched by good methodological standards. This problem is particularly evident in the field of economic evaluations of hepatitis B vaccines. The results of 2 systematic reviews conducted by us in 1993 and 1996 showed three problem areas. A sizeable minority of study reports failed to provide a clear study aim, showing a basic ignorance of the first rule of conducting scientific research. The basic epidemiological assumptions upon which the economic models were based showed variability which persisted even after stratification, raising the question of the accuracy of the epidemiological knowledge base of hepatitis B infection and its progression. Lastly, many of the studies showed weaknesses in basic methods of conducting and reporting economic evaluations.

Examination of these problem areas led us to conclude that no conclusions about the efficiency of hepatitis B vaccines could be drawn from the available evidence. Addressing the problem of poor methodological standards concerns the whole research community. However, as a proportion of economic evaluations are published, one obvious means of exerting pressure to increase and maintain methodological standards is the editorial and peer review process. Editors of specialist and general medical journals should agree on and enforce common explicit guidelines for study conduct and reporting, following the example of the British Medical Journal.


Adis International Limited Economic Evaluation British Medical Journal Pharmaceutical Benefit Advisory Committee Sizeable Minority 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Elixhauser A, editor. Health care cost-benefit and cost-effectiveness analysis (CBA/CEA). From 1979 to 1990: a bibliography. Med Care 1993; 31 Suppl.: JS1–149Google Scholar
  2. 2.
    Gerard K. Cost-utility in practice: a policy maker’s guide to the state of the art. Health Policy 1992; 21: 249–79PubMedCrossRefGoogle Scholar
  3. 3.
    Udvarhelyi S, Colditz GA, Rai A, et al. Cost-effectiveness and Cost-benefit analyses in the medical literature: are methods being used correctly? Ann Intern Med 1992: 116: 238–44PubMedGoogle Scholar
  4. 4.
    Adams ME, McCall NT, Gray DT, et al. Economic analysis in randomised controlled trials. Med Care 1992; 30: 231–8PubMedCrossRefGoogle Scholar
  5. 5.
    Drummond MF, Jefferson TO, Buxton M, BMJ Working Party on Guidelines for Authors and Peer-Reviewers of Economic Submissions to the British Medical Journal, et al. Guidelines for authors and peer-reviewers of economic submissions to the British Medical Journal. BMJ 1996; 313: 275–83PubMedCrossRefGoogle Scholar
  6. 6.
    Jefferson TO, Drummond MF, Smith R, et al. Evaluating the BMJ guidelines on economic submissions: prospective audit of economic submissions to the BMJ and Lancet. JAMA 1998; 280: 275–7PubMedCrossRefGoogle Scholar
  7. 7.
    Williams AH. The cost-benefit approach. Br Med Bull 1974; 30: 252–6PubMedGoogle Scholar
  8. 8.
    Commonwealth Department of Health, Housing and Community Services. Guidelines for the pharmaceutical industry on preparation of submissions to the pharmaceutical benefits advisory committee. Canberra: Australian Government Publishing Service, 1992Google Scholar
  9. 9.
    Detsky AS. Guidelines for economic analysis of pharmaceutical products: a draft for Ontario and Canada. Pharmacoeconomics 1993; 3 (5): 354–61PubMedCrossRefGoogle Scholar
  10. 10.
    Department of Health and Association of British Pharmaceutical Industry. Guidelines for the economic evaluation of pharmaceuticals [press release]. London: Department of Health, 1994Google Scholar
  11. 11.
    Canadian Co—ordinating Office for Health Technology Assessment (CCOHTA). Guidelines for economic evaluation of pharmaceuticals: Canada. Ottawa: CCOHTA, 1994Google Scholar
  12. 12.
    Gold MR, Siegel JC, Russell LB, et al. Cost—effectiveness analysis in health and medicine. New York: Oxford University Press, 1996Google Scholar
  13. 13.
    Jefferson TO, Demicheli V. Is vaccination against Hepatitis B efficient? A review of world literature. Health Econ 1994 3: 25–37PubMedCrossRefGoogle Scholar
  14. 14.
    Demicheli V, Jefferson TO. An exploratory review of the economics of recombinant vaccines against Hepatitis B (HB). In: Ronchi E, editor. Biotechnology and medical innovation: socio-economic assessment of the technology, the potential and the products. Paris: Organisation for Economic Cooperation and Development (OECD), 1997: 105–23Google Scholar
  15. 15.
    Sherlock S, Hepatitis B. The disease. In: Blumberg BS, Hepburn A, André FE, editors. Proceedings of the international conference on prospects for eradication of Hepatitis B virus. Vaccine 1990; 8: S6–9PubMedCrossRefGoogle Scholar
  16. 16.
    World Health Organization (WHO). International list of availability of vaccines and sera. 4th ed. Geneva: WHO, 1996Google Scholar
  17. 17.
    Maynard JE. Hepatitis B: global importance and need for control. In: Blumberg BS, Hepburn A, André FE, editors. Proceedings of the international conference on prospects for eradication of Hepatitis B virus. Vaccine 1990; 8: S6–9CrossRefGoogle Scholar
  18. 18.
    Margolis HS, Schats GC, Kane MA. Development of recommendations for control of Hepatitis B virus infections: the role of cost analysis. In: Blumberg BS, Hepburn A, André FE, editors. Proceedings of the international conference on prospects for eradication of Hepatitis B virus. Vaccine 1990; 8: S81–5PubMedCrossRefGoogle Scholar
  19. 19.
    Francis DP. The public’s health unprotected: reversing a decade of underutilization of Hepatitis B vaccine [editorial]. JAMA 1995; 274: 1242–3PubMedCrossRefGoogle Scholar
  20. 20.
    Van Damme P, Kane MA, Meheus A. Integration of hepatitis B vaccination into national immunisation programmes. BMJ 1997; 314: 1033–7PubMedCrossRefGoogle Scholar
  21. 21.
    Badia X, Nocea G, Rovira J. Differences in the methodology and data of economic evaluations of a health programme: the case of Hepatitis B programmes vaccination in Spain. Pharmacoeconomics 1997; 11 (2): 175–83PubMedCrossRefGoogle Scholar
  22. 22.
    Jefferson TO, Jefferson VM. The quest for trials on the efficacy of human vaccines: results of the handsearch of ‘Vaccine’. Vaccine 1996; 14: 461–4PubMedCrossRefGoogle Scholar
  23. 23.
    Ricciardi G, De Giusti M, De Vito E. Tentativo di valutazione dell’impatto economico dell’epatite B in Italia e comparazione con i costi delle strategie di prevenzione vaccinale. Nuovi Ann Ig Microbiol 1988; 39: 241–61PubMedGoogle Scholar
  24. 24.
    Demicheli V, Jefferson TO. Cost-benefit analysis of the introduction of mass vaccination against Hepatitis B in Italy. J Public Health Med 1992; 14: 367–75PubMedGoogle Scholar
  25. 25.
    Ginsberg GM, Berger S, Shouval D. Cost-benefit analysis of a nationwide inoculation programme against viral hepatitis B in an area of intermediate endemicity. Bull World Health Organ 1992; 70: 757–67PubMedGoogle Scholar
  26. 26.
    Antonazas F, Forcen T, Garuz R. Analisis de cost-efectividad de la vacunacion frente al virus de la hepatite B. Med Clin Barc 1992; 99: 41–6Google Scholar
  27. 27.
    Jönsson B, Horisberger B, Bruguera M, et al. Cost-benefit analysis of Hepatitis B vaccination: a computerised decision model for Spain. Int J Technol Assess Health Care 1991; 7: 379–402PubMedCrossRefGoogle Scholar
  28. 28.
    Bethwaite JG, Bethwaite PB. An economic evaluation of vaccination strategies aganist hepatits B virus: health care workers and homosexual men. N Z Econ Papers 1991; 25: 19–38CrossRefGoogle Scholar
  29. 29.
    Garuz Bellido R, Torrea Hernandez JL, Arnal Alonso JM, et al. Vaccination against hepatitis B virus: a cost—effectiveness analysis. Vaccine. In pressGoogle Scholar
  30. 30.
    Bloom BS, Hillman AL, Fendrick AM, et al. A reappraisal of Hepatitis B virus vaccination strategies using cost—effectiveness analysis. Ann Intern Med 1993; 118: 298–306PubMedGoogle Scholar
  31. 31.
    Margolis HS, Coleman PJ, Brown RE, et al. Prevention of hepatitis B virus transmission by immunization. JAMA 1995; 274: 1201–8PubMedCrossRefGoogle Scholar
  32. 32.
    Tormans G, van Damme P, Carrin G, et al. Cost—effectiveness analysis of prenatal screening and vaccination against Hepatitis B virus, the case of Belgium. Soc Sci Med 1993; 37 (2): 173–81PubMedCrossRefGoogle Scholar
  33. 33.
    Drummond MF, Brandt A, Luce B, et al. Standardising methodologiesfor economic evaluation in health care. Int J Technol Assess Health Care 1993; 9: 26–36PubMedCrossRefGoogle Scholar
  34. 34.
    Jefferson TO, Demicheli V. Are guidelines for peer-reviewing economic evaluations necessary? A survey of current editorial practice. Health Econ 1995; 4: 383–8PubMedCrossRefGoogle Scholar

Copyright information

© Adis International Limited 1998

Authors and Affiliations

  1. 1.Cochrane Vaccines FieldMinistry of DefenceAsh ValeEngland
  2. 2.Institute of Medical StatisticsUniversity of PaviaPaviaItaly

Personalised recommendations