Impact of a Global Pandemic on Health Technology Assessment

Unprecedented Times

The COVID-19 pandemic will have unprecedented impacts on individuals, healthcare systems and economies worldwide. The exponential growth of infected individuals [1] will soon be matched by the growth rate of scientific literature [2] on: the disease mechanism [3], transmission dynamics [4], prevention strategies [5], treatment [6], consequences for other diseases and their management [7], other health and/or social impacts [8], public health impacts [9, 10] and the economic impacts [11].

As healthcare systems turn their entire attention to ‘fighting this war’ [12], it will not be without casualties in other parts of the system. This commentary offers some insights on what the COVID-19 pandemic specifically means for health technology assessment (HTA) given the extreme measures that governments have taken to ‘flatten the curve’ and treat the affected. COVID-19 will change life as we know it, but as we adapt so will our approach and it is likely that HTA will similarly adapt to this shock.

Health Systems: Crisis Precipitates Change

Caring for people with COVID-19 has overwhelmed hospitals and health centres: there are capacity constraints on the number of critical care beds, the number of ventilators, and the ability to test for active infection with the virus and evidence of antibodies reflecting previous infection. Worldwide healthcare systems have responded with an ‘all hands on deck’ approach. Clinicians, nurses, allied health and public health professionals, students, and retired staff are being retrained and deployed to join the frontline in the face of increased patient numbers and absences among healthcare workers. Routine non-urgent surgery and outpatient appointments have been postponed or cancelled [13, 14] and clinicians are using telemedicine to provide care remotely [15]. This is to minimise transmission in the public, to protect the healthcare workforce and to manage staff shortages.

Clinical Trials in Lockdown

A consequence of this is that most clinical trials and other research involving patients and healthcare professionals, not directly related to COVID-19 (e.g. RECOVERY [16]), have been suspended [17]. There is little if any enrolment into new studies, other than those directly related to COVID-19, and follow-up of patients on current trials will be curtailed or adapted. Both the US Food and Drug Administration (FDA) and the European Medicines Agency (EMA) have issued guidance on what study sponsors should do if protocol deviations are required to ensure patient safety while preserving study integrity and the quality of the data [18, 19]. Amendments to protocols may involve alternatives to in-person visits for patient evaluations including phone or virtual visits or locations other than hospitals or health centres.

Depending on the extent and the duration of the pandemic, clinical trials that are not specific to COVID-19 prevention, testing or treatment will face increasing difficulties. This will mean that any resulting evidence base will be uncertain, trials may not be powered appropriately if they did not recruit the required sample size, there will likely be more missing data than normal owing either to a loss of follow-up or for example patient notes being held in a locked down building, and clinical measures may be replaced with patient-reported outcome measures. The implications of this situation includes missing real treatment effects for underpowered studies, or erroneously declaring a treatment effective based on a surrogate endpoint.

Research and Development in Hiatus

Different countries (including different states within countries) are taking different approaches to limiting the spread of the virus; at the time of writing, ~ 25% of the world’s population is effectively in lockdown. For example, in the San Francisco Bay area, a ‘shelter in place’ order restricts individuals to their homes, but allows for people involved in ‘health care operations’, including the employees of biotech and pharmaceutical companies, to travel [20]. Government guidance aside, many companies acted early and self-imposed social distancing and remote working on their employees if their roles allowed it; for example, the only research that can take place on University College London campuses is that which is in the immediate national interest, i.e. research on COVID-19 [21]. Pharmaceutical and medical technology companies are also prioritising their research and development towards COVID-19, working on diagnostic tests, vaccines and/or therapies [22]. Given this and that most new technologies are developed onsite in laboratories, COVID-19 will likely impact the development of future technologies. Delays this year in discoveries and initial experiments may not be evident until a decade later given the length of time to get innovations to market.

A further impact of COVID-19 is that COVID-19 studies have inundated many research ethics committees, and these are taking priority over other research projects (personal communication). It is also likely that these committees may be under-resourced if clinically trained members have been redeployed.

Approval and Launch Delays

In the short to medium term, COVID-19 may delay both technology approvals and the launch of products. Just as many people have adjusted to working remotely, regulators and HTA committees will similarly need to adjust if they are to continue to sit. These committees, like research ethics committees, will also be under-resourced as many members are clinicians, public health or allied health professionals. When committees do meet, they will need to be quorate and may require in camera sessions because of confidential discussions regarding price. There has been quick uptake of videoconferencing software, but there are some concerns regarding the security of these platforms [23]. Additionally, it may be that there is less patient participation in these virtual HTA committees, those with certain medical conditions and possibly individuals without computer skills may not be able to participate in the same manner that they would when in a face-to-face meeting.

The FDA and EMA have both provided guidance to sponsors regarding ongoing trials and the initiation of new trials, but it is still too early to understand what these changes will mean when sponsors begin the process of regulatory approval and licencing. One assumes that there will be some leniency: perhaps patient-reported outcome measures will gain favour over clinical outcome measures [24], or the agencies will be more amenable to deviations from published statistical analysis plans and will need to accept alternative statistical analyses [25]. With respect to committee meetings, the FDA are cancelling or postponing all non-essential meetings in April although they have expressed a willingness to using virtual advisory committees [26], while the EMA announced in early March that EMA committees and working parties will be held virtually until the end of April 2020 [27].

Another, more significant, regulatory postponement is the proposal from the European Commission to postpone the enforcement of the Medical Device Regulation (European Union) 2017/745, which was to have been imposed from 26 May, 2020 [28]. The reasoning is that fewer resources are available to implement the regulation, and there is a more urgent need for the industry to focus on tackling COVID-19. Effectively, this means prioritising COVID-19 at the expense of more rigorous requirements on medical devices, including the requirement of more clinical evidence.

HTA agencies are also refocusing their activities to prioritise COVID-19, for example, the National Institute for Health and Care Excellence (NICE) has produced rapid guidelines (N = 12 as of mid-April) and evidence summaries. Notably, NICE “were advised cost was not an issue [when producing guidelines] only what’s best for the service.” (Gillian Leng, NICE Chief Executive, [29]). NICE’s fee-based consultancy service to industry has chosen to offer free scientific fast-track advice for companies developing novel diagnostic, therapeutic and digital health technologies for COVID-19 [30]. With respect to other guidance and guidelines, during the pandemic NICE has decided to publish only work that is either therapeutically critical (this includes cancer medicines, except cancer drugs fund reviews and a small number on non-cancer medicines) or that relates to addressing COVID-19 diagnostic or therapeutic interventions, to avoid distracting the National Health Service (NHS) [31]. Like regulatory agencies, HTA committees may also need to accept alternative analytical approaches where, because of COVID-19, there are missing data [32] or censored data [33]. NICE has recently delayed its timelines for their methods and process review (personal e-mail communication), thereby allowing the UK Department of Health and Social Care and NHS England to prioritise their response to COVID-19.

Even when pharmaceutical companies receive regulatory and market access approvals, there may still be delays in launching technologies. Companies’ planned approaches to launch prior to COVID-19 are unlikely to apply in a post-COVID healthcare system. Priorities and methods of working will have changed, and this may include how companies engage with healthcare professionals (current social distancing rules mean this is not in person), and how healthcare professionals engage with patients. Depending on the extent of the pandemic, the way we deliver healthcare could change; there may be a stronger push to deliver care at home and to use digital technologies.

Health Technology Assessment for COVID-19 Therapies

It would be amiss to discuss the impact of a pandemic on HTA without discussing the assessment of COVID-19 therapies. While NICE COVID-19 guidelines appear to have been issued devoid of formal economic appraisals, it would be unusual for policy makers to adopt treatments and preventative approaches without assessing both effectiveness and cost effectiveness. Different HTA agencies have different levels of oversight, for example, in Australia and New Zealand, the Pharmaceutical Benefits Advisory Committee and Pharmaceutical Management Agency (PHARMAC), respectively, review both pharmaceuticals and vaccines, but in the UK, NICE reviews pharmaceuticals while the Joint Committee on Vaccination and Immunisation (JCVI) assesses vaccines [34]. This introduces the potential for different agencies to apply different standards to the many COVID-19 interventions; indeed, NICE has different reference cases for public health interventions and health technologies.

Methods aside, policy makers need economic evidence on both costs and outcomes. As of early April, there were 366 COVID-19 studies registered worldwide [35]. A review of several registered clinical trials suggests that few appear to be designed to investigate efficacy [36] and our own search of the European Union Clinical Trials Register ( and ( identified no COVID-19 studies that appear to be explicitly collecting resource use, cost or quality-of-life data. Health economists are no strangers to modelling and extrapolating trial data, or making and testing assumptions to undertake HTAs (see [37] for a COVID-19 modelling example); but assumptions should never replace the opportunity to collect actual data, particularly to go beyond clinical outcomes of hospitalisations to consider quality-adjusted life-years (QALYs). Early HTA can inform research and development during the initial stages of clinical research — potentially important with so many competing treatments being trialled — and help address uncertainty [38]. It is likely that such therapies will be fast tracked through any HTA process (and thereby delay other topics), but faster appraisal may mean drugs are approved that are neither clinically nor cost effective, or there is a greater chance of a negative recommendation as the committee considers there are too many uncertainties.

It is also worth positing whether these COVID-19 prevention, testing or treatment strategies will be assessed against the usual cost-effectiveness threshold? Current prevention and testing strategies have not been evaluated to this degree (as far as we are aware), and perhaps the middle of a pandemic is not the best time to debate the value of life. What has become evident is that there are clear opportunity costs of addressing the COVID-19 pandemic, in terms of diverting resources from other diseases with undocumented consequences [39].

Adapting to a New Normal

When we do return to a ‘new normal’, an obvious question to ask is whether healthcare systems will have money to make decisions about whether to adopt health technologies. The majority of investment in COVID-19 has to date been new funding, i.e. not at the expense of the current healthcare budget although arguably at the expense of the wider economy. This and the various stimulus packages that have been announced globally are the result of quantitative easing and/or government borrowing. In the short run, these stimulus packages will allow the economy and healthcare systems to function, but a global recession is highly likely, and consumer and business confidence will take a hit. Venture capital funding may be difficult to secure, which will add challenges for the life sciences sector bringing new innovations to market.

Governments often adopt HTA to support cost containment during economic crises to aid financial sustainability [40]. Therefore, a well-functioning HTA system (as many countries have) will be critical. What is not clear is whether governments will constrain the budgets of HTA agencies, which would be reflected in part in them facing a lower threshold of cost effectiveness. Given the perceived inflexibility across countries of the threshold [41, 42], and the disconnect between adoption decisions and budget impact (for example, NICE does not face the opportunity cost of its decisions, NHS England does [43]) it may be that HTA needs to focus its efforts on ‘technology management’ rather than ‘technology adoption’ and evaluate divesting in inefficient services or low-value healthcare [44]. Alternatively, HTA agencies in response to financial uncertainty may become more risk averse, which could be further magnified given the evidence base they will evaluate may be more uncertain because of the current disruption to clinical trials. It may be that faced with such a situation, HTA agencies and other healthcare funders will rely more heavily on other coverage decision approaches such as risk sharing arrangements or managed access schemes [45]. These innovative market access policies may be accompanied by innovations in pricing arrangements, including outcome-based payments [46], thereby promoting patient access despite the uncertainty in the evidence base and an aversion to risk at times of financial crisis [47].

There are many news articles on how COVID-19 will change the world [48], including that we cannot go back to normal [49]. Undoubtedly this is true. Our healthcare systems are changing rapidly, and our means of undertaking assessments of value will also need to change. HTA is not immune to COVID-19, but it can and will adapt.


  1. 1.

    Liu Y, Gayle AA, Wilder-Smith A, Rocklöv J. The reproductive number of COVID-19 is higher compared to SARS coronavirus. J Travel Med. 2020;27(2):taaa021.

    Article  PubMed  PubMed Central  Google Scholar 

  2. 2.

    Chen Q, Allot A, Lu Z. Keep up with the latest coronavirus research. Nature. 2020;579(7798):193.

    CAS  Article  PubMed  Google Scholar 

  3. 3.

    Lu R, Zhao X, Li J, Niu P, Yang B, Wu H, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet. 2020;395(10224):565–74.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  4. 4.

    Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, et al. Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia. N Engl J Med. 2020 (in press).

  5. 5.

    Wilder-Smith A, Freedman DO. Isolation, quarantine, social distancing and community containment: pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak. J Travel Med. 2020;27(2):taaa020.

  6. 6.

    Wang M, Cao R, Zhang L, Yang X, Liu J, Xu M, et al. Remdesivir and chloroquine effectively inhibit the recently emerged novel coronavirus (2019-nCoV) in vitro. Cell Res. 2020;30(3):269–71.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Fang L, Karakiulakis G, Roth M. Are patients with hypertension and diabetes mellitus at increased risk for COVID-19 infection? Lancet Respir Med. 2020;8(4):e21.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  8. 8.

    Armitage R, Nellums LB. COVID-19 and the consequences of isolating the elderly. Lancet Public Health. 2020.

    Article  PubMed  PubMed Central  Google Scholar 

  9. 9.

    Rundle AG, Park Y, Herbstman JB, Kinsey EW, Wang YC. COVID-19 related school closings and risk of weight gain among children. Obesity (Silver Spring). 2020.

    Article  Google Scholar 

  10. 10.

    Vaughan A. Covid-19 has caused a drop in emissions—but it’s not a climate fix. New Sci. 2020;10–1.

  11. 11.

    Ataguba JE. COVID-19 pandemic, a war to be won: understanding its economic implications for Africa. Appl Health Econ Health Policy. 2020.

    Article  PubMed  PubMed Central  Google Scholar 

  12. 12.

    Adhanom Ghebreyesus T. WHO Director General's remarks at the G20 Extraordinary Leaders’ Summit on COVID-19–26 March 2020. 2020. Accessed 26 Apr 2020.

  13. 13.

    Iacobucci G. Covid-19: all non-urgent elective surgery is suspended for at least three months in England. BMJ. 2020;368:m1106.

    Article  PubMed  Google Scholar 

  14. 14.

    NHS England and NHS Improvement. Letter: next steps on NHS response to COVID-19. 2020. Accessed 26 Apr 2020.

  15. 15.

    Hollander JE, Carr BG. Virtually perfect? Telemedicine for Covid-19. N Engl J Med. 2020.

    Article  PubMed  Google Scholar 

  16. 16.

    Nuffield Department of Population Health. RECOVERY: Randomised Evaluation of COVID-19 Therapy. 2020. Accessed 26 Apr 2020.

  17. 17.

    Thornton J. Clinical trials suspended in UK to prioritise Covid-19 studies and free up staff. BMJ. 2020;368:m1172.

    Article  PubMed  Google Scholar 

  18. 18.

    European Medicines Agency. Guidance on the management of clinical trials during the COVID-19 (Coronavirus) pandemic. 2020. Accessed 26 Apr 2020.

  19. 19.

    US Food and Drug Administration. FDA guidance on conduct of clinical trials of medical products during COVID-19 pandemic. 2020. Accessed 26 Apr 2020.

  20. 20.

    Robbins R. In strictest U.S. coronavirus response so far, six Bay Area counties order ‘shelter in place’. 2020. Accessed 26 Apr 2020.

  21. 21.

    UCL News. Message for students from the Provost and the Registrar about building closures and returning home. 2020. Accessed 26 Apr 2020.

  22. 22.

    ABPI. What are pharmaceutical companies doing to tackle COVID-19? 2020. Accessed 26 Apr 2020.

  23. 23.

    Hern A. Trolls exploit Zoom privacy settings as app gains popularity. The Guardian. 2020. Accessed 26 Apr 2020.

  24. 24.

    Gnanasakthy A, Barrett A, Evans E, D'Alessio D, Romano CD. A review of patient-reported outcomes labeling for oncology drugs approved by the FDA and the EMA (2012–2016). Value Health. 2019;22(2):203–9.

    Article  PubMed  Google Scholar 

  25. 25.

    Renfro LA, Sargent DJ. Statistical controversies in clinical research: basket trials, umbrella trials, and other master protocols: a review and examples. Ann Oncol. 2017;28(1):34–433.

    CAS  Article  PubMed  Google Scholar 

  26. 26.

    Eye on FDA. Impact of COVID-19 on regulatory enforcement and approvals: Part 2. 2020. Accessed 26 Mar 2020.

  27. 27.

    European Medicines Agency. COVID-19: EMA meetings with delegates and experts will be held virtually until end April 2020. 2020. Accessed 26 Apr 2020.

  28. 28.

    European Commission. Medical devices: new regulations (updated 25th March 2020). 2020. Accessed 26 Apr 2020.

  29. 29.

    Toynbee P. Your money or your life? Coronavirus has sparked the latest culture war. The Guardian. 2020. Accessed 26 Apr 2020.

  30. 30.

    National Institute of Health and Care Excellence. Coronavirus (COVID-19): free scientific advice. 2020. Accessed 26 Apr 2020.

  31. 31.

    MAP BioPharma. NICE shifts focus as COVID-19 takes priority. 2020. Accessed 26 Apr 2020.

  32. 32.

    Gomes M, Kenward MG, Grieve R, Carpenter J. Estimating treatment effects under untestable assumptions with nonignorable missing data. Stat Med. 2020;39(11):1658–74.

    Article  PubMed  Google Scholar 

  33. 33.

    Latimer N, White I, Abrams K, Siebert U. Causal inference for long-term survival in randomised trials with treatment switching: should re-censoring be applied when estimating counterfactual survival times? Stat Methods Med Res. 2019;28(8):2475–93.

    CAS  Article  Google Scholar 

  34. 34.

    Christensen H, Al-Janabi H, Levy P, Postma MJ, Bloom DE, Landa P, et al. Economic evaluation of meningococcal vaccines: considerations for the future. Eur J Health Econ. 2020;21(2):297–309.

    Article  Google Scholar 

  35. 35.

    Statista. Number of coronavirus (COVID-19) studies registered worldwide as of April 8, 2020, by region. 2020. Accessed 13 Apr 2020.

  36. 36.

    Lythgoe MP, Middleton P. Ongoing clinical trials for the management of the COVID-19 pandemic. Trends Pharmacol Sci. 2020;S0165–6147(20):30070–5.

    CAS  Article  Google Scholar 

  37. 37.

    Karnon J. A simple decision analysis of a mandatory lockdown response to the COVID-19 pandemic. Appl Health Econ Health Policy. 2020.

    Article  PubMed  PubMed Central  Google Scholar 

  38. 38.

    Ijzerman MJ, Koffijberg H, Fenwick E, Krahn M. Emerging use of early health technology assessment in medical product development: a scoping review of the literature. Pharmacoeconomics. 2017;35(7):727–40.

    Article  Google Scholar 

  39. 39.

    Hatswell AJ. Learnings for health economics from the early stages of the COVID-19 pandemic. Pharmacoecon Open. 2020.

    Article  PubMed  PubMed Central  Google Scholar 

  40. 40.

    Thomson S, Figueras J, Evetovits T, Jowett M, Mladovsky P, Maresso A, et al. Economic crisis, health systems and health in Europe: impact and implications for policy: Copenhagen: World Health Organization, Regional Office for Europe; 2015 (Report No. 033526400X).

  41. 41.

    Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness: the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796–7.

    CAS  Article  PubMed  Google Scholar 

  42. 42.

    Raftery JP. NICE's cost-effectiveness range: should it be lowered? Pharmacoeconomics. 2014;32(7):613–5.

    CAS  Article  PubMed  Google Scholar 

  43. 43.

    Sculpher M, Claxton K, Pearson SD. Developing a value framework: the need to reflect the opportunity costs of funding decisions. Value Health. 2017;20(2):234–9.

    Article  PubMed  Google Scholar 

  44. 44.

    Bryan S, Mitton C, Donaldson C. Breaking the addiction to technology adoption. Health Econ. 2014;23(4):379–83.

    Article  PubMed  Google Scholar 

  45. 45.

    Walker S, Sculpher M, Claxton K, Palmer S. Coverage with evidence development, only in research, risk sharing, or patient access scheme? A framework for coverage decisions. Value Health. 2012;15(3):570–9.

    Article  PubMed  Google Scholar 

  46. 46.

    Vlaanderen FP, Tanke MA, Bloem BR, Faber MJ, Eijkenaar F, Schut FT, et al. Design and effects of outcome-based payment models in healthcare: a systematic review. Eur J Health Econ. 2019;20(2):217–32.

    CAS  Article  PubMed  Google Scholar 

  47. 47.

    Guiso L, Sapienza P, Zingales L. Time varying risk aversion. J Financial Econ. 2018;128(3):403–21.

    Article  Google Scholar 

  48. 48.

    Philp C. How coronavirus will change the world for ever. The Times. 2020. Accessed 26 Apr 2020.

  49. 49.

    Baker P. ‘We can’t go back to normal’: how will coronavirus change the world? The Guardian. 2020. Accessed 26 Apr 2020.

Download references


The authors thank the staff at Perspectum for regulatory insights and Dalia Dawoud of NICE for a useful Twitter conversation.

Author information



Corresponding author

Correspondence to Paula K. Lorgelly.

Ethics declarations


No sources of funding were used to prepare this editorial.

Conflict of interest

Paula K. Lorgelly and Amanda Adler have no conflicts of interest that are directly relevant to the content of this editorial.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lorgelly, P.K., Adler, A. Impact of a Global Pandemic on Health Technology Assessment. Appl Health Econ Health Policy 18, 339–343 (2020).

Download citation