Heterogeneity in malaria exposure and vaccine response: implications for the interpretation of vaccine efficacy trials
- 5.1k Downloads
Phase III trials of the malaria vaccine, RTS, S, are now underway across multiple sites of varying transmission intensity in Africa. Heterogeneity in exposure, vaccine response and waning of efficacy may bias estimates of vaccine efficacy.
Theoretical arguments are used to identify the expected effects of a) heterogeneity in exposure to infectious bites; b) heterogeneity in individual's response to the vaccine; and c) waning efficacy on measures of vaccine efficacy from clinical trials for an infection-blocking vaccine.
Heterogeneity in exposure and vaccine response leads to a smaller proportion of trial participants becoming infected than one would expect in a homogeneous setting. This causes estimates of vaccine efficacy from clinical trials to be underestimated if transmission heterogeneity is ignored, and overestimated if heterogeneity in vaccine response is ignored. Waning of vaccine efficacy can bias estimates of vaccine efficacy in both directions.
Failure to account for heterogeneities in exposure and response, and waning of efficacy in clinical trials can lead to biased estimates of malaria vaccine efficacy. Appropriate methods to reduce these biases need to be used to ensure accurate interpretation and comparability between trial sites of results from the upcoming Phase III clinical trials of RTS, S.
KeywordsMalaria Vaccine Efficacy Malaria Vaccine Entomological Inoculation Rate Vaccine Response
Malaria poses a major public health problem with unacceptably high levels of Plasmodium falciparum-associated morbidity and mortality recorded worldwide . In recent years, dramatic declines in both parasite prevalence and disease incidence have been observed in a number of locations across Africa [2, 3, 4], likely attributable to the increased access to effective first-line therapy plus roll-out of interventions including long-lasting insecticide treated nets. Whilst these may be considered a success, an effective vaccine would be an important addition to the current suite of anti-malaria interventions. The most promising candidate malaria vaccine under development is RTS, S combined with GlaxoSmithKline's AS01 adjuvant.
The principal component of RTS, S is the circumsporozoite antigen, which induces pre-erythrocytic antibodies that prevent sporozoites from infectious mosquito bites from leading to blood-stage malaria. RTS, S is thus an infection-blocking vaccine. Phase II trials of RTS, S/AS have demonstrated significant efficacy against time to first infection (45% (95% CI, 31.4-55.9)  and 65.2% (95% CI, 20.7-84.7)  reduction), clinical malaria (29.9% (95% CI, 11.0-44.8) , 56% (95% CI, 31-72)  and 43.2% (95% CI, -47.1-78.0)  reduction in different trials) and severe malaria (57.7% (95% CI, 16.2-80.6)  reduction). Multi-centre Phase III trials for this vaccine are now underway in 11 sites across Africa.
There are many sources of bias that may arise when measuring an infection-blocking malaria vaccine's efficacy in clinical trials. A significant source of bias that is often overlooked is due to the effects of heterogeneity. Heterogeneity can arise in one of three ways. Firstly, heterogeneity in exposure occurs due to some individuals being bitten more frequently than others. Between-individual variation has been observed in experimental trials in which differential attractiveness to humans sleeping in tents was quantified using mosquito traps . This heterogeneity in biting rate has also been attributed to age due to difference in surface area between adults and children , differences in human sweat components , proximity to larval breeding sites , bed net usage  and differences in house design .
Secondly, there can be heterogeneity in vaccine response, which occurs due to variation in the degree of protection (or take) of the vaccine between individuals. For example if a vaccine is reported to have 90% efficacy against infection, at one extreme this could mean that each infection will be blocked 90% of the time, whilst at the other extreme it could mean that 90% of vaccinated people will be completely protected from infection. Smith et al  and Halloran et al  have investigated this concept and coined the terms all-or-nothing and leaky vaccines. An all-or-nothing vaccine is one which offers complete protection to a subset of the vaccinated population and has no effect on the rest of the population whilst a leaky vaccine is one which offers the same level of partial protection to everyone. In a malaria vaccine trial it is possible that the candidate vaccine will induce a different level of protection in each of the trial participants. The level of protection given to a vaccinated person will be described by their vaccine response, which will depend on the relative immunogenicity of the vaccine and the magnitude of the induced antibody titres. Individual vaccine response may further depend on genetic and nutritional factors  as well as age, past exposure and season .
Finally, for a candidate malaria vaccine offering partial protection from infection, waning of efficacy is also likely to be observed. Understanding how a vaccine's efficacy wanes over time is at least as important as measuring its initial efficacy. Waning of efficacy can be estimated from clinical trials by measuring a vaccine's half-life: the time taken for the initial efficacy to be halved. However, a vaccine's half-life is a crude measure of waning, as the effects of a vaccine may not decay at a constant rate, and thus some people may remain protected for longer than others. This type of heterogeneity is often neglected in the interpretation of trial results.
Mathematical models have been used to investigate the impact of heterogeneity in exposure [18, 19, 20], heterogeneity in vaccine response [20, 21] and waning of efficacy  on malaria transmission. In this paper theoretical arguments are used to understand how these three types of heterogeneity can affect measurement of vaccine efficacy in clinical trials. Examples are motivated by the RTS, S vaccine and hence focus on a pre-erythrocytic vaccine which is assumed to act by partially blocking infection. In the first section the basic methods currently used to estimate vaccine efficacy in Phase II and Phase III trials are described. The effects of the three types of heterogeneity on the estimates of vaccine efficacy from clinical trials are then investigated.
Measurements of vaccine efficacy
For a vaccine with efficacy VE, if the probability of an unvaccinated person becoming infected after an infectious bite is b, then the probability that a vaccinated person becomes infected is (1 - VE) b. This efficacy VE, hereafter referred to as the individual efficacy, can be defined as the proportion of infectious bites on a vaccinated population that are blocked by the vaccine. This proportion can be directly estimated in laboratory based Phase IIa trials where healthy adult volunteers are exposed to bites from infectious mosquitoes and then monitored for blood-stage malaria infection [22, 23].
Malaria infection has a complex life history giving rise to a choice of events to measure . These include prevalence of infection as detected by the presence of parasitaemia, time to first infection, episodes of febrile malaria, episodes of severe malaria or multiple episodes in fixed time periods. Each of these end-points will be relevant in different settings. For example, infection-blocking efficacy would be most important to a traveller to a malaria endemic region, whereas efficacy against severe disease would be most important for a child living in an area of high transmission. Vaccine efficacy against time to first infection and prevalence of infection are focused upon as these are the outcomes directly affected by pre-erythrocytic vaccines, although they can also be expected to have a downstream effect on morbidity and mortality.
Following the notation of Smith et al , the vaccine efficacy against cumulative incidence of infection, also known as risk-based infection-blocking efficacy, is denoted VE r . This gives a measure of the risk of having become infected by the end of a trial for the vaccine group compared to the control group. Note that the cumulative incidence of infection is different to the prevalence of infection as it measures the proportion who have ever become infected and not the proportion infected at a given time. Vaccine efficacy against time to first infection, also known as rate-based infection-blocking efficacy, will be denoted VE f . This gives a measure of the rate at which the vaccine group becomes infected compared to the control group.
Expected values for the observed infected proportion I(T), and person years at risk (PYAR) in a clinical trial with follow-up period T, of a vaccine with individual efficacy VE, in a region with force of infection Λ.
Thus the risk-based efficacy, VE, as measured in a field trial can be estimated from the individual efficacy. This measure approaches 0 as T increases as it is assumed that everyone will become infected if the follow-up is sufficiently long. In addition, for small T we have VE r ≈ VE.
Therefore the rate-based efficacy is equal to the individual efficacy. In particular it is independent of the force of infection Λ and the length of the trial T.
The risk-based definition of efficacy is commonly used for diseases in which natural infection with the causative agent provides near complete protection against a second infection with the same agent, for example measles. However, the high frequency at which people living in endemic regions are challenged with malaria infection makes risk-based infection-blocking efficacy uninformative, as most trial participants are likely to have become infected during a trial. In order to overcome this difficulty, a consensus has formed amongst vaccine trialists to primarily use rate-based measures based on time to first infection [24, 25].
Heterogeneity in transmission
In a site where a malaria intervention is being trialled, the transmission intensity is usually measured using the entomological inoculation rate (EIR). In the analysis of trial results it is often assumed that all participants experience the same homogeneous force of infection. Making this assumption and ignoring the effects of heterogeneity in transmission can bias trial results.
Examples of distributions describing heterogeneity in exposure in order of increasing heterogeneity.
All individuals receive the same number of infectious mosquito bites.
The distribution of infectious bites follows an 80/20 rule as suggested by Woolhouse et al where 20% of people receive 80% of the bites.
The distribution of infectious mosquito bites follows a gamma distribution with parameter 1/4.2 as suggested by Smith et al .
A hypothetical example of extreme heterogeneity as might be observed in a localised epidemic, in this case modelled as 5% of people receiving 95% of infectious bites.
Heterogeneity in vaccine response
Examples of distributions describing vaccine response in order of increasing heterogeneity.
Vaccination gives everyone the same level of partial protection.
Vaccination offers partial protection to some people but no protection to others, as described by Halloran et al .
Vaccination offers a variable level of protection to all vaccinees. The effect of vaccination follows a beta distribution as described by Maire et al .
Vaccination offers full protection to some people but no protection to others.
Figure 1B shows the average infected proportion as a function of the follow up time T for the efficacy distributions listed in Table 3 for a specified average individual efficacy. The all-or-nothing vaccine always protects more people from infection than the leaky vaccine regardless of follow-up time. Thus, the more heterogeneous a vaccine is (i.e. the more it resembles an all-or-nothing vaccine), the more people will be protected from infection. In fact it can be proved (see Additional File 1) that if a vaccine has average individual efficacy VE, then it will always protect at least as many people as would be expected from a leaky vaccine with the same average individual efficacy, and at most as many people as an all-or-nothing vaccine. To understand this, compare a leaky vaccine with an all-or-nothing vaccine. Given long follow-up, everyone in a group given a leaky vaccine will eventually become infected as eventually one of the infectious bites will evade the vaccine response. In contrast, a group given an all-or-nothing vaccine will contain a subgroup that will always remain free from infection. The unprotected subgroup will become infected at a natural rate, but the number of infections in this subgroup will be less than the number of infections in the entire leaky group. Therefore there will be fewer infections in the entire all-or-nothing group than in the leaky group.
How heterogeneity affects estimates of vaccine efficacy
To understand this, consider a population where 20% of the population receive 80% of the infectious mosquito bites as suggested by Woolhouse et al . In the unvaccinated control group, the high-risk 20% will almost certainly become infected whereas only a small proportion of the low-risk 80% will become infected. Now consider the vaccinated group. Despite being vaccinated a large proportion of the high-risk 20% will develop malaria infection, as they will be bitten so frequently that the vaccine will be unable to block all infections. In the low-risk group, only a small proportion will become infected due to the low number of infectious bites and the effect of the vaccine. Thus, heterogeneity in the force of infection makes the infection profiles (who ends up infected) of the vaccine and control groups more similar, and hence a lower efficacy is measured.
Next consider an infection-blocking vaccine whose individual efficacy has been estimated from Phase IIa trials, but whose distribution of responses between individuals is unknown. Figures 2B and 2D show the risk-based and rate-based efficacies that would be observed for each of the response distributions described in Table 3. Note how the risk-based efficacies in Figure 2B decrease with follow-up time. This is because eventually everybody will become infected regardless of vaccination status. The exception to this is the case of an all-or-nothing vaccine where the subgroup which is fully protected will always remain uninfected. In contrast the rate-based efficacies in Figure 2D increase with follow-up time. This is because individuals who receive a high level of protection from the vaccine will remain susceptible for a longer time and significantly increase the total person years at risk used in the rate-based efficacy calculation. Finally, we observe that vaccines that induce more heterogeneous responses between individuals are estimated to be more efficacious than their homogeneous counterparts (Figure 2D), despite both vaccines having the same average individual efficacy. In particular, the upper limit for the observed rate-based efficacy is given by an all-or-nothing vaccine and the lower limit is given by a leaky vaccine. Therefore in a trial of a candidate malaria vaccine, if there is heterogeneity in vaccine response and this is ignored in the analysis, the vaccine efficacy will be overestimated.
Waning vaccine efficacy
RTS, S has been observed to induce long-lasting protection against malaria for up to 45 months [29, 30]. For example in a Phase II trial of children in Mozambique, Alonso et al  recorded a rate-based vaccine efficacy against first clinical episode of malaria of 29.9% (95% CI, 11.0-44.8) in a six-month follow-up period. In an extended follow-up of the Mozambique trial Sacarlal et al  recorded a vaccine efficacy of 16.8% (95% CI, -2.5-32.4) over months 21-33, and an efficacy of 11.8% (95% CI, -20.1-35.2) over months 33-45. These results could either be consistent with RTS, S inducing protection from infection over an extended period but with waning efficacy, or an artefact due to the apparent waning of efficacy due to the effects of heterogeneity.
Kanaan and Farrington  propose two models of waning vaccine efficacy; the selection and deterioration models. In the selection model, waning arises from heterogeneity in the duration of protection, i.e. a vaccinated person is protected for a period of time dependent on the vaccine half-life and then loses all protection. For example a person receiving a vaccine with initial individual efficacy 45% and a half-life of 1 year will have a 50% chance of still being protected after one year. In the deterioration model, waning arises from the gradual decline in the individual efficacy. For example a vaccine with initial individual efficacy of 45% and a half-life of 1 year will have an efficacy of 22.5% one year after it is administered. These two models are with-waning analogues of the all-or-nothing and leaky models. In both cases there can be additional heterogeneity between individuals in the rate of waning, with some individuals remaining protected for longer than others. This would occur if a vaccine's efficacy is dependent on natural boosting through continuous exposure to infection.
The results presented here demonstrate that several sources of heterogeneity can lead to biased estimates of vaccine efficacy if their effects are ignored. In general, heterogeneity in exposure to infectious mosquitoes will result in an underestimate of vaccine efficacy. In contrast, heterogeneity in individuals' response to the vaccine (often termed the take of the vaccine) will result in an overestimate of vaccine efficacy. In addition, waning efficacy of the vaccine will further complicate the observed patterns. Thus simple calculations that ignore these sources of heterogeneity can easily give biased results and it will be difficult to assess the extent to which these are biased upwards or downwards.
Whilst these results are intuitively clear, it is often assumed that randomization will diminish or remove their effect. Clearly randomization should at the least ensure that characteristics such as individual-level attractiveness to mosquitoes are balanced in the trial arms. Moreover, cluster-based designs in which villages or other population units are randomized should ensure a balance in village-level exposure between the arms. However, even if heterogeneity is balanced across trial arms through robust randomization, this will not counter-balance the biases identified here. For exposure-driven heterogeneity, in the control arm those that are highly exposed will almost certainly become infected whilst the low-risk population will avoid infection. Similarly, in the vaccinated arm a large, albeit lower, proportion of the highly exposed population will become infected but as in the control arm, the remainder will likely avoid infection. Because a large proportion of both the control and vaccinated group are unexposed, this will always result in an underestimate of vaccine efficacy.
In contrast, heterogeneity in vaccine response will only affect the vaccine arm of the trial. In this arm of the trial heterogeneity will cause some trial participants to receive a higher level of protection than others, whereas the control arm will be unaffected. The presence of a highly protected subgroup in the vaccine arm of the trial will cause the measurement of the rate-based infection-blocking efficacy to be greater than the individual vaccine efficacy. Thus the individual vaccine efficacy will be overestimated.
Given these heterogeneities, how can their impact on estimates of vaccine efficacy be minimized? The first step is to ensure that trial participants are as homogeneous as possible. For example children in a malaria vaccine trial should be of similar age, live in similar settings and have similar access to healthcare and anti-malaria interventions such as bed nets. This should occur not just through randomization but by ensuring that trials are undertaken in areas of relatively homogeneous transmission. However even with the most carefully selected study cohort there is likely to be residual heterogeneity in exposure and response. Thus analysis methods need to account for these possible biases. In studies of malaria immunity Bejon  and Kinyanjui  have suggested that the effects of heterogeneity be reduced by excluding individuals likely to be unexposed. However, when infection rather than blood-stage disease is the primary outcome this may be problematic given that infection is generally the most reliable marker of exposure. In addition Valim et al  recently proposed a statistical estimator of individual vaccine efficacy that corrects for the effects of heterogeneity in exposure by taking account of multiple exposures. Whilst the authors are not aware of comparable estimators that account for heterogeneity in response, this may in fact not be a major problem for the RTS, S vaccine because in one of the Phase II trials of RTS, S , nearly all of the vaccinated group became infected with P. falciparum at some stage during the monitoring period. This suggests that the current RTS, S vaccine is leaky - although there may still be considerable heterogeneity in this leakiness. Thus further characterization of the heterogeneity in response is needed to ensure that estimates of vaccine efficacy are not substantially biased.
Extended follow-up of clinical trials of RTS, S have observed the apparent waning of vaccine efficacy against clinical malaria, as demonstrated by the coming together of Kaplan Meier plots comparing the infected proportions in vaccine and control groups . This waning could be consistent with either a deterioration model where efficacy is gradually lost, or a selection model where efficacy is maintained for a random period of time dependent on the vaccine half-life, or may just be an artefact of heterogeneity in exposure and vaccine response. In addition there may be heterogeneity in waning where the vaccine has a variable half-life. Early efficacy estimates based on 6 or 12 month follow-up may be biased and this bias is difficult to quantify. For example, 12 month results could be consistent with a vaccine with high initial efficacy and a short half-life, or medium initial efficacy and a longer half-life. Extended follow-up, potentially spanning several years, is therefore required to obtain unbiased estimates.
RTS, S is currently undergoing extensive testing in Phase III clinical trials. These trials will enrol up to 16,000 children and infants across 11 sites in seven different African countries. The results presented here demonstrate that heterogeneity in exposure, response and vaccine waning can bias vaccine efficacy measures in ways that are not easily measurable. This needs to be borne in mind when combining results from the wide range of transmission settings in these Phase III studies.
We would like to thank James Hook for helpful mathematical discussions.
This work was supported by the Bill and Melinda Gates Foundation Vaccine Modelling Initiative (JTG, ACG) and the Medical Research Council (MTW, ACG). CJD is supported by a Wellcome Trust grant (078925).
- 2.Ceesay SJ, Casals-Pascual C, Erskine J, Anya SE, Duah NO, Fulford AJ, Sesay SS, Abubakar I, Dunyo S, Sey O, Palmer A, Fofana M, Corrah T, Bojang KA, Whittle HC, Greenwood BM, Conway DJ: Changes in malaria indices between 1999 and 2007 in The Gambia: a retrospective analysis. The Lancet. 2008, 372: 1545-1554. 10.1016/S0140-6736(08)61654-2.CrossRefGoogle Scholar
- 5.Alonso PL, Sacarlal J, Aponte JJ, Leach A, Macete E, Milman J, Mandomando I, Spiessens B, Guinovart C, Espasa M, Bassat Q, Aide P, Ofori-Anyinam O, Navia MM, Corachan S, Ceuppens M, Dubois M-C, Demoitié M-A, Dubovsky F, Menéndez C, Tornieporth N, Ballou WR, Thompson R, Cohen J: Efficacy of the RTS, S/AS02A vaccine against Plasmodium falciparum infection and disease in young African children: randomised controlled trial. Lancet. 2004, 364: 1411-1420. 10.1016/S0140-6736(04)17223-1.CrossRefPubMedGoogle Scholar
- 6.Abdulla S, Oberholzer R, Juma O, Kubhoja S, Machera F, Membi C, Omari S, Urassa A, Mshinda H, Jumanne A, Salim N, Shomari M, Aebi T, Schellenberg DM, Carter T, Villafana T, Demoitié M-A, Dubois M-C, Leach A, Lievens M, Vekemans J, Cohen J, Ballou WR, Tanner M: Safety and immunogenicity of RTS, S/AS02D malaria vaccine in infants. NEJM. 2008, 359: 2533-2544. 10.1056/NEJMoa0807773.CrossRefPubMedGoogle Scholar
- 7.Bejon P, Lusingu J, Olotu A, Leach A, Lievens M, Vekemans J, Mshamu S, Lang T, Gould J, Dubois M-C, Demoitié M-A, Stallaert J-F, Vansadia P, Carter T, Njuguna P, Awuondo KO, Malabeja A, Abdul O, Gesase S, Mturi N, Drakeley CJ, Savarese B, Villafana T, Ballou WR, Cohen J, Riley EM, Lemnge MM, Marsh K, von Seidlein L: Efficacy of RTS, S/AS01E vaccine against malaria in children 5 to 17 months of age. NEJM. 2008, 359: 2521-2532. 10.1056/NEJMoa0807381.PubMedCentralCrossRefPubMedGoogle Scholar
- 12.Hawley WA, Phillips-Howard PA, ter Kuile FO, Terlouw DJ, Vulule JM, Ombok M, Nahlen BL, Gimnig JE, Kariuki SK, Kolczak MS, Hightower AW: Community-wide effects of permethrin-treated bed nets on child mortality and malaria morbidity in western Kenya. Am J Trop Med Hyg. 2003, 68: 121-127.PubMedGoogle Scholar
- 22.Kester KE, McKinney DA, Tornieporth N, Ockenhouse CF, Heppner DG, Hall T, Krzych U, Delchambre M, Voss G, Dowler MG, Palensky J, Wittes J, Cohen J, Ballou WR: Efficacy of recombinant circumsporozoite protein vaccine regimens against experimental Plasmodium falciparum malaria. J Infect Dis. 2001, 183: 640-647. 10.1086/318534.CrossRefPubMedGoogle Scholar
- 23.Stoute JA, Slaoui M, Heppner DG, Momin P, Kester KE, Desmons P, Wellde BT, Garcon N, Krzych U, Marchand M, Ballou WR, Cohen JD: A preliminary evaluation of a recombinant circumsporozoite protein vaccine against Plasmodium falciparum malaria. NEJM. 1997, 336: 86-91. 10.1056/NEJM199701093360202.CrossRefPubMedGoogle Scholar
- 28.Woolhouse MEJ, Dye C, Etard JF, Smith T, Charlwood JD, Garnett GP, Hagan P, Hii JLK, Ndhlovu PD, Quinnell RJ, Watts CH, Chandiwana SK, Anderson RM: Heterogeneities in the transmission of infectious agents: Implications for the design of control programs. Proc Natl Acad Sci USA. 1997, 94: 338-342. 10.1073/pnas.94.1.338.PubMedCentralCrossRefPubMedGoogle Scholar
- 29.Guinovart C, Aponte JJ, Sacarlal J, Aide P, Leach A, Bassat Q, Macete E, Dobano C, Lievens M, Loucq C, Ballou WR, Cohen J, Alonso PL: Insights into long-lasting protection induced by RTS, S/AS02A malaria vaccine: further results from a phase IIb trial in Mozambican children. PLoS One. 2009, 4: e5165-10.1371/journal.pone.0005165.PubMedCentralCrossRefPubMedGoogle Scholar
- 30.Sacarlal J, Aide P, Aponte JJ, Renom M, Leach A, Mandomando I, Lievens M, Bassat Q, Lafuente S, Macete E, Vekemans J, Guinovart C, Sigaúque B, Silman M, Milman J, Dubois M-C, Demoitié M-A, Thonnard J, Menéndez C, Ballou WR, Cohen J, Alonso PL: Long-term safety and efficacy of the RTS, S/AS02A malaria vaccine in Mozambican children. J Infect Dis. 2009, 200: 329-336. 10.1086/600119.CrossRefPubMedGoogle Scholar
- 33.Kinyanjui SM, Bejon P, Osier FH, Bull PC, Marsh K: What you see is not what you get: implications of the brevity of antibody responses to malaria antigens and transmission heterogeneity in longitudinal studies of malaria immunity. Malar J. 2009, 8: 242-10.1186/1475-2875-8-242.PubMedCentralCrossRefPubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.