Skip to main content

Evidence-Based Policy: Randomised Controlled Trials’ Knowledge Claims to AIDS Policy

  • Chapter
  • First Online:
The Politics of Global AIDS

Part of the book series: Social Aspects of HIV ((SHIV,volume 3))

  • 212 Accesses

Abstract

This chapter considers the way in which the Randomised Controlled Trial (RCT) as a policy-relevant knowledge production practice has influenced Global AIDS policy thinking. It unpacks the issue by looking both at the logic of RCT design and challenges to implementing RCT-based polices outside of the trial context. It is argued that RCT method has been strongly endorsed by the Global AIDS system because of its close links to a biomedical perspective. What remains to be answered, however, is why RCTs have been so extensively used to ground Global AIDS policy decisions given widespread critical analysis of RCT method and its limits to generalisability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    HIV and AIDS investment represents one of the biggest single issues here, with 16.11 billion US dollars being spent in 2011 (UNAIDS 2012) within international development. The nature of HIV interventions, in particular treatment roll-out, requires a gradual increase in this funding over time. Therefore, many donors are looking for cost-effectiveness in interventions to reach the widest beneficiary groups.

  2. 2.

    External validity concerns the extent to which the results of a study or experiment can be generalized to a wider population or a wider set of circumstances.

  3. 3.

    I am providing the first four references here not to take part in the ongoing controversy these articles are presenting on VMMC. I think they are useful as they represent the depth and breath of the debate and literature on this topic.

  4. 4.

    Arguably, in an ideal resource-rich context, this dilemma should not occur. One would also argue that an implicit choice is being made on the assumption that it is impossible to improve resource infra-structure in Africa and therefore saving more lives is targeted by trying to increase the coverage of treatment independent of the other available medical resources. However, this does not deal with the increased need for medical resources due to bringing more people into ART treatment if the predicted decline in costs is achieved from not spending the resources on laboratories.

  5. 5.

    The concept is often described in law as ‘[A] warning that notifies a buyer that the goods he or she is buying are “as is”, or subject to all defects’. Given the content of the policy and its delivery requirements and the way in which trial groups were monitored and participants’ health was cared for, can this qualification really be a caveat or is it not, in fact, an absolute necessity for the policy to work?

  6. 6.

    In the case of VMMC debate, the discussion by Wamai et al. 2015 is interesting for its style of argument. Here, claims to effectiveness are based on the aggregate interpretation of all RCT and observational study results, when taken together. This leads the reader to assume some form of external validity, when in fact none has been demonstrated. This in turn is used to justify general policy prescriptions.

  7. 7.

    The issue here is also about the number of people who participate in these individual trials. While the cumulative number of people participated in 12 trials may appear large, each trial had different numbers of participants. These range from 400 participants in the Ipergay trial in France and Canada, to 2499 participants across 11 study sites in 6 countries (the USA, Ecuador, South Africa, Peru, Brazil and Thailand) in iPrEx. The Bangkok Tenofovir Study included 2413 participants focusing on injecting drug users while Botswana TDF2 study included 1219 sexually active male and female participants. There is the question here whether these numbers can simply be added together to create a total number of participants through which the efficacy of PrEP is demonstrated. Moreover, how individually or collectively do they relate to the larger population targeted by WHO guidelines? While one can imagine an argument that, for example, trial procedures create a commonality of adherence in support of a claim to global efficacy, this argument becomes redundant as such uniform adherence cannot be expected outside the trial context(s) as a longer-term outcome given the diversity of participants and their socio-cultural and political contexts.

  8. 8.

    The FEM-PrEP clinical trial was designed to assess whether a daily dose of the antiretroviral Truvada is safe and effective in preventing HIV infection among women at high risk of HIV exposure. In this Phase III, randomized, placebo-controlled trial, 2120 women were assigned to receive either Truvada or a placebo containing no active drug for approximately 12 months and came in for monthly clinic visits for approximately 14 months (Fem-PrEP 2016).

References

  • Angrist, J. D., & Pischke, J.-S. (2010). The credibility revolution in empirical economics: How better research design is taking the co out of econometrics. The Journal of Economic Perspectives, 24(2), 3–30.

    Article  Google Scholar 

  • Auerbach, J. D., & Hoppe, T. A. (2015). Beyond “getting drugs into bodies”: Social science perspectives on pre-exposure prophylaxis for HIV. Journal of the International AIDS Society, 18(Suppl. 3), 19983.

    Google Scholar 

  • Banarjee, A., & Duflo, E. (2010). Giving credit where it is due. The Journal of Economic Perspectives, 24(3), 61–79.

    Article  Google Scholar 

  • Barrett, C. B., & Carter, M. R. (2010). The power and pitfalls of experiments in development economics: Some non-random reflections. Applied Economic Perspectives and Policy, 32, 515–548.

    Article  Google Scholar 

  • BBC. (2009). Scrap tests ‘to boost HIV care’ 9 December 2009. http://news.bbc.co.uk/1/hi/health/8401681.stm. Accessed 10 Jan 2010.

  • Boyle, G. J., & Hill, G. (2011). Sub-Saharan African randomised clinical trials into male circumcision and HIV transmission: Methodological, ethical and legal concerns. Journal of Law and Medicine, 19(2), 316–334.

    Google Scholar 

  • Buchbinder, S. P., & Liu, A. Y. (2015). CROI 2015: Advances in HIV testing and prevention strategies. Topics in Antiviral Medicine, 23(1), 8–27.

    Google Scholar 

  • Cáceres, C. F., Koechlin, F., Goicochea, P., Sow, P., O’Reilly, K. R., Mayer, K. H., & Godfrey-Faussett, P. (2015). The promises and challenges of pre-exposure prophylaxis as part of the emerging paradigm of combination HIV prevention. Journal of the International AIDS Society, 18(Suppl. 3), 19949.

    Google Scholar 

  • Cartwright, N. D. (2010). Will this policy work for you? Predicting effectiveness better: How philosophy helps. Speech presented at PSA Presidential Address, Montreal, Canada, November 2010.

    Google Scholar 

  • Cartwright, N. (2011). The art medicine: A philosopher’s view of the long road from RCTs to effectiveness. Lancet, 377, 1400–1401.

    Article  Google Scholar 

  • Cartwright, N., & Hardie, J. (2012). Evidence-based policy: A critical guide to doing it better. New York: Oxford University Press.

    Book  Google Scholar 

  • Cohen, J., & Easterly, W. (2009). Introduction: Thinking big versus thinking small. In J. Cohen & W. Easterly (Eds.), What works in development? Thinking big and thinking small. Washington, DC: The Brookings Institution.

    Google Scholar 

  • Dart Trial Team. (2010). Routine versus clinically driven laboratory monitoring of HIV antiretroviral therapy in Africa (DART): A randomized non-inferiority trial. Lancet, 375, 123–131.

    Article  Google Scholar 

  • Deacon, A. (2010). Understanding the mechanisms of economic development. The Journal of Economic Perspectives, 24(3), 3–16.

    Article  Google Scholar 

  • de Camargo, K. R., Jr., de Oliveira Mendonça, A. L., Perrey, C., & Giami, A. (2013). Male circumcision and HIV: A controversy study on facts and values. Global Public Health, 8, 769–783.

    Article  Google Scholar 

  • Harrison, G. W. (2011). Randomisation and its discontents. Journal of African Economies, 20, 626–652.

    Article  Google Scholar 

  • Jain, S. L. (2010). The mortality effect: Counting the dead in the cancer trials. Public Culture, 22(1), 89–117.

    Article  Google Scholar 

  • Keane, M. P. (2010). A structural perspective on the experimentalist school. The Journal of Economic Perspectives, 24(2), 47–58.

    Article  Google Scholar 

  • Kebaabetswe, P. M., Stirratt, M. J., McLellan-Lemal, E., Henderson, F. L., Gray, S. C., Rose, C. E., Williams, T., & Paxton, L. A. (2014). Factors assocaited with adherence and concordance between measurement strategies in an HIV daily oral tenofovir/emtricitibine as pre-exposure prophylaxis (prep) clinical trial, Botswana, 2007–2010. AIDS Behaviour, 19, 758–769.

    Article  Google Scholar 

  • Lambert, H. (2009). Evidentiary truths? The evidence of anthropology through the anthropology of medical evidence. Anthropology Today, 25(1), 16–20.

    Article  Google Scholar 

  • Lock, M., & Nguyen, V.-K. (2010). An anthropology of medicine. London: Wiley-Blackwell.

    Google Scholar 

  • Longino, H. E. (2013). Studying human behavior: How scientists investigate aggression & sexuality. Chicago: The University of Chicago Press.

    Book  Google Scholar 

  • Ludwig, J., Kling, J. R., & Mullainathan, S. (2011). Mechanism experiments and policy evaluations. The Journal of Economic Perspectives, 25(3), 17–38.

    Article  Google Scholar 

  • MRC. (2009). ‘Thousands more could be treated for HIV in Africa if expensive routine lab tests are dropped’ Medical Research Council Press Release MRC59/09. http://www.ctu.mrc.ac.uk/news_and_press_releases/news_archive/dart_trial_results_p… Accessed 15 Jan 2010.

  • Parkhurst, J. O., Chilongozi, D., & Hutchinson, E. (2015). Doubt, defiance, and identity: Understanding resistance to male circumcision for HIV prevention in Malawi. Social Science & Medicine, 135, 15–22.

    Article  Google Scholar 

  • Petryna, A. (2009). When experiments travel: Clinical trials and the global search for human subjects. Princeton: Princeton University Press.

    Book  Google Scholar 

  • Ravallion, M. (2009). Comment. In J. Cohen & W. Easterly (Eds.), What works in development? Thinking big and thinking small. The Brookings Institution.

    Google Scholar 

  • Rodrik, D. (2009). The new development economics: We shall experiment, but how shall we learn? In J. Cohen & W. Easterly (Eds.), What works in development?: Thinking big and thinking small. Washington, DC: The Brookings Institution.

    Google Scholar 

  • Rol, M., & Cartwright, N. (2012). Warranting the use of causal claims: A non-trivial case for interdisciplinarity. Theoria, 74, 189–202.

    Article  Google Scholar 

  • Seckinelgin, H. (2009a). Global social policy and international organizations linking social exclusion to durable inequality. Global Social Policy, 9(2), 205–227.

    Google Scholar 

  • Seckinelgin, H. (2009b). Colonial silences, gender and sexuality: Unpacking international HIV and AIDS policy culture. In J. F. Klot & V.-K. Nguyen (Eds.), The fourth wave: Violence, gender, culture and HIV in the 21st century. Paris: UNESCO.

    Google Scholar 

  • Shaffer, P. (2011). Against excessive rhetoric in impact assessment: Overstating the case for randomised controlled experiments. Journal of Development Studies, 47, 1619–1635.

    Article  Google Scholar 

  • Teele, D. L. (Ed.). (2014). Field experiments and their critics: Essays on the uses and abuses of experimentation in the social sciences. New Haven: Yale University Press.

    Google Scholar 

  • UNAIDS. (2012). 2012 UNAIDS report on the global epidemic. Geneva: UNAIDS. http://www.unaids.org/en/resources/publications/2012/name,76121,en.asp. Accessed 28 Jan 2015.

  • Wamai, R. G., Morris, B. J., Waskett, J. H., Green, E. C., Banerjee, J., Bailey, R. C., Kalusner, J. D., Sokal, D. C., & Hankins, C. A. (2012). Critism of African trials fail to withsthand scrutiny: Male circumcision does prevent HIV infection. Jounal of Law and Medicine, 20(1), 93–123.

    Google Scholar 

  • Wamai, R. G., Morris, B. J., Bailey, R. C., Kalusner, J. D., & Boedicker, M. N. (2015). Male circumcision for protection against HIV infection in sub-Saharn Africa: The evidence in favour justifies the implementation now in progress. Global Public Health, 10(5–6), 639–666.

    Article  Google Scholar 

  • WHO. (2015). The guidelines on when to start antiretroviral therapy and on pre-exposure prophylaxis. http://www.who.int/hiv/pub/guidelines/earlyrelease-arv/en/. Accessed 14 Mar 2016.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Seckinelgin, H. (2017). Evidence-Based Policy: Randomised Controlled Trials’ Knowledge Claims to AIDS Policy. In: The Politics of Global AIDS. Social Aspects of HIV, vol 3. Springer, Cham. https://doi.org/10.1007/978-3-319-46013-0_6

Download citation

Publish with us

Policies and ethics