Do We Need Some Large, Simple Randomized Trials in Medicine?

Abstract

In a randomized clinical trial (RCT), a group of patients, initially assembled through a mixture of deliberation (involving explicit inclusion and exclusion criteria) and serendipity (which patients happen to walk into which doctor’s clinic while the trial is in progress), are divided by some random process into an experimental group (members of which will receive the therapy under test) and a control group (members of which will receive some other treatment – perhaps placebo, perhaps the currently standard treatment for the condition at issue). In a ‘double blind’ trial neither the patient nor the clinician knows to which of the groups a particular patient belongs. The results of double blind randomized controlled trials are almost universally regarded as providing the ‘gold standard’ for evidence in medicine. Fairly extreme claims to this effect can be found in the literature. For example the statistician Tukey wrote (1977, p. 679) “almost the only source of reliable evidence [in medicine] … is that obtained from … carefully conducted randomised trials”. And the clinician Victor Herbert claimed (1977, p. 690) “…the only source of reliable evidence rising to the level of proof about the usefulness of any new therapy is that obtained from well-planned and carefully conducted randomized, and, where possible, coded (double blind) clinical trials. [Other] studies may point in a direction, but cannot be evidence as lawyers use the term evidence to mean something probative … [that is] tending to prove or actually proving”. Finally, the still very influential movement in favour of ‘Evidence Based Medicine’ (EBM) that began at McMaster University in the 1980s was initially often regarded as endorsing the claim that only RCTs provide real scientifically telling evidence.