Background

Pediatricians, pediatric radiologists and neuroradiologists render countless medical opinions on a daily basis. When physicians use their specialized medical knowledge and sophisticated evaluative methods and tools to diagnose child abuse, their opinions shape and may even determine legal decisions in the juvenile, family and criminal courts. These out-of-court evaluations and in-court “expert opinions” frequently help courts decide cases involving abusive head trauma/shaken baby syndrome (AHT/SBS). In these cases, defense attorneys and their retained medical witnesses have increasingly challenged the scientific foundations for abuse diagnoses and this purported “scientific” controversy has been echoed in the medical and legal literature and the popular press.

Daubert and the admissibility of expert evidence

Expert witness testimony is governed by specific evidentiary rules and case law in each state. Although medical expert witnesses are traditionally asked to provide their opinions to “a reasonable degree of medical certainty,” this is confusingly not the legal standard for the admission of expert opinion testimony. The United States Supreme Court set the current admissibility standard for expert evidence in the federal courts in 1993 in Daubert v. Merrell Dow Pharmaceuticals Inc., [1], and to date 30 state courts have adopted the Daubert standard [2]. Even in states that have not adopted Daubert, most state court judges report that Daubert has had a powerful influence on their decisions to admit, exclude or limit expert evidence [3].

In Daubert, the Supreme Court abandoned the nine-decade-old Frye [4] standard, which had permitted judges to admit or exclude scientific evidence based solely on a determination of whether the evidence was generally accepted within the relevant scientific community [1]. According to the Supreme Court, Frye had not survived the adoption of the Federal Rules of Evidence (in the mid-1970s), which governed the admissibility of scientific evidence but did not contain a general acceptance standard. Instead, the Daubert Court decided that judges should serve as gatekeepers to protect the courts from invalid scientific information. Future judges would need to determine whether expert evidence is scientific knowledge [1], which “requires judges to critique scientific evidence and separate the wheat of valid scientific methodology from the chaff of chicanery” [5]. To assist judges with this new task, the Daubert Court developed a non-exhaustive list of scientific criteria: (1) testability, (2) peer review and publication, (3) error rate, and (4) general acceptance [1]. “Thus, Daubert moved judges into the role of gatekeeper, charged with the ‘responsibility of evaluating the scientific validity of the basis for expert testimony,’ and ‘obligated to become familiar with the methods and culture of science’” [6]. In 2000, Federal Rule of Evidence 702 was amended to codify the judge’s gatekeeping role in the federal courts and to clarify “that this gatekeeper function applies to all expert testimony, not just testimony based in science” [7]. Subsequently many states have made similar changes to their evidence rules.

The pediatric healthcare expert’s role

Pediatric healthcare experts who understand the evidentiary standard will be in the best position to explain to the judge and jury: (1) what they know, (2) how they know what they know (i.e. the methodology used in coming to their opinions), (3) how they assure that their opinions are valid (i.e. the science underlying their opinions), and (4) the likelihood that their opinions are wrong. This explanation invariably includes a discussion of the relevant human anatomy, the most efficacious imaging technology (e.g., explaining how the technology works and why the use of a particular imaging technique was in the patient’s best interest, even if other technologies were available), the most current peer-reviewed, evidence-based medical literature (e.g., describing why certain studies, whether retrospective or prospective, employed sound methodology and, consequently, produced valid data and why other research lacks a solid scientific foundation), and the diagnostic process utilized in arriving at the opinion.

At trial, the medical expert explains and defends the decisions that lead to the abuse diagnosis. This testimony is especially important in child abuse cases because often “the only proof available is circumstantial [medical] evidence since abusive actions usually occur within the privacy of the home, the child is either intimidated or too young to testify, and the parents tend to protect each other” [8]. In criminal cases, the state typically offers medical evidence to establish that a child’s injuries were caused by abuse and the defense (almost invariably) responds with medical expert testimony that supports a non-abusive alternative explanation for the child’s injuries [9]. In both criminal and civil cases, the defense attempts “to prove the medical findings are not the result of shaking, but instead the product of some other disease process or circumstance, e.g. the child’s injuries are consistent with an accidental fall” [9]. Given these competing objectives, judges use the rules of evidence to determine which evidence may be presented to the jury (or considered by the court as fact finder in a non-jury trial) [1013]. To the extent that some or all of this evidence is admitted, the fact finder should use similar criteria to assess the weight of the competing medical evidence.

In child abuse cases, these tasks are complicated by the fact that much of the medical evidence offered to support or refute abuse allegations is hard for the average judge or jury to understand—especially when well-credentialed experts present conflicting opinions. Pediatric healthcare specialists can help the courts by clearly and fully explaining the basis for their opinions. These explanations will transcend the clinical diagnostic process in this case (discussed above) to include the relevant scientific concepts and the supporting medical evidence (e.g., explaining the strengths and weaknesses of clinical medical articles, controlled trials, single case studies, opinion articles and letters, and the weight of medical opinion in the appropriate fields). In some cases, courts might also need to understand whether a theory has been (or could be) tested and to evaluate error rates by identifying, explaining and distinguishing types of errors.

How Daubert can help the pediatric healthcare expert

The clear lesson of Daubert is that “experts have to be much more prepared to disclose the scientific underpinnings of their opinions than they were in the past” [1]. Specifically, the pediatric healthcare expert must help the court to place the medical evidence into context, a task emphasized by the Daubert court conclusion that “[w]idespread acceptance can be an important factor in ruling particular evidence admissible, and a known technique which has been able to attract only minimal support within the community … may properly be viewed with skepticism” [2]. Thus, to prepare for cross-examination, the pediatric expert must be ready to discuss the range of alternative diagnoses not account for the injuries in this case. This explanation should incorporate the peer-reviewed scientific literature assessing the statistical strength of relevant radiologic findings with particular diagnoses and the distinction between published research and published commentary. The effective expert will use this information to clearly explain why she excluded the alternative diagnosis.

Because Daubert emphasized peer-review and publication, the expert should also explain to the court that publication alone (even in a peer-reviewed journal) does not validate a particular alternative theory. Judges and juries seldom understand that scientific journals often publish minority or outlier articles not to endorse the view presented but to highlight areas of contention. Although this should be obvious when the journal has also published critique of the minority/outlier view, this editorial practice in medical literature remains foreign and confusing to the courts [1418].

The pediatric expert and the so-called AHT/SBS scientific controversy

Today it is increasingly likely that courts will be influenced by a small but media-savvy group of physician witnesses and legal academics [19] who have drawn public attention to their claims of having “ripped the lid off” a wave of false AHT/SBS convictions. These claims have been repeated and further sensationalized by the mainstream media [20], which generally does a poor job of distinguishing what Dr. Robert W. Block, President of the American Academy of Pediatrics, recently referred to as “the real experts [who] are the physicians who work every day with these cases and have both authored and read voluminous literature that substantiates the existence of abusive head trauma, and are the folks who are the most capable of informing the public about what the issue really is” from those who “create these sham media blasts that cause great confusion” [19]. However, as Justice Stephen Breyer has stated, even when the science seems confusing to the courts “neither the difficulty of the task nor any comparative lack of expertise can excuse the judge from exercising the ‘gatekeeper’ duties that the Federal Rules of evidence impose[;] .... [t]o the contrary, when law and science intersect, those duties often must be exercised with special care” [21, 22].

For example, pediatric healthcare experts should use Daubert criteria when they testify in AHT/SBS cases to help courts evaluate defense medical witnesses’ increasingly frequent claim that the subdural hemorrhages (SDHs) seen on CT/MRI images are caused by sagittal sinus venous thrombosis (SSVT) and not abuse. In these cases, the expert can use Daubert factors such as: (1) general acceptance, (2) peer-reviewed publication, (3) testability/falsifiability, and (4) error rates, to explain the associative but not causative relationship between SSVT and SDHs. Pediatric experts can use a similar approach to help judges and juries properly evaluate other alternative diagnoses such as the re-bleeding theory of SDHs and traumatic brain injuries attributed to short falls [23, 24]. This last example also provides an excellent opportunity for the expert to explain to the court that some scientific-sounding opinions are belied not just by the science but by everyday experience [25]. If short falls routinely produced the forces necessary to fracture infant skulls, emergency rooms would be flooded with infants and children suffering from skull fractures and traumatic head injuries after minor falls. Everyone knows this is not the case. Thus, as one scientific author has astutely commented, “when models do not conform with human experience, then there is something wrong with the model” [24].

The legal effects of the purported AHT/SBS scientific controversy were specifically addressed in a recent article by Dr. Daniel M. Albert published in the Journal of the American Medical Association [26]. Dr. Albert and his co-authors warned that the integrity of the adjudication of child abuse cases is increasingly threatened by “physicians with variable credentials [who] have a willingness to disparage scientifically grounded and accepted testimony, use unique theories of causation, omit pertinent facts or knowledge, use unique or unusual interpretations of medical findings, make false statements, or engage in flagrant misquoting of medical journals” [26]. Defense lawyers in child abuse cases, and the medical witnesses they retain, typically ignore the “evidence-based, peer-reviewed medical literature with 40 years of contributions by pediatricians, neuroradiologists, clinical and forensic pathologists, ophthalmologists, and physiologists clearly supporting the construct of a medical diagnosis of AHT,” in their effort to “emphasize the overlap between AHT and other diseases” [26].

In AHT/SBS cases, it is also common for defense-retained medical witnesses, “[i]nstead of presenting the totality of all medical findings, … [to] isolate each medical finding and its multiple differential diagnoses to confuse the jury” [26]. For example, these witnesses sometimes claim that their opinions are based solely on the images they reviewed. However, the direct and cross-examination of these witnesses invariably includes an interpretation of findings (e.g., possible causes, severity of forces, associated symptoms, specificity for non-accidental trauma) that requires consideration of the totality of the medical findings. Medical witness testimony that isolates a single diagnostic tool (e.g., the radiologic images) or focuses only on the consistent medical findings while ignoring inconsistent findings violates professional ethical norms because “[e]xperts must not put forward untested or unacceptable views. … [and their] [c]onclusions must be reached after considering all the available evidence, not just those aspects which support a particular view” [27]. Because “[o]rganized medicine has a responsibility to ensure that unbiased and evidence-informed opinion is used to explain to a judge and jury the significance of medical findings” [27], all experts “must be prepared to cast aside ideas of loyalty to one party or another and give evidence with the child’s welfare as the primary aim” [27]. When these ethical obligations are communicated to the courts, they should resonate. Not only does the legitimacy of our legal verdicts depend on unbiased and ethical expert opinion testimony, but Federal Rule of Evidence 702 (and its state equivalents) requires that judges carefully scrutinize testimony from experts who “have developed their opinions expressly for the purposes of testifying” [6].

The specific question of whether medical evidence of AHT/SBS meets the Daubert standard has recently been addressed by Dr. Sandeep Narang in his article, “A Daubert Analysis of Abusive Head Trauma/Shaken Baby Syndrome” [28]. Dr. Narang applies Daubert criteria to the medical literature used to support (and critique) the validity of AHT/SBS and to clinical diagnostic practice. Dr. Narang describes his research, which includes “eight systematic reviews, over 15 controlled trials, over 50 comparative cohort studies or prospective case series, and numerous well-designed, retrospective case series/reports, comprising thousands of cases, supporting the diagnosis of AHT,” and his finding that “there is not one clinical study that demonstrates a greater statistical association of either subdural hemorrhages or retinal hemorrhages with accidental trauma over abusive head trauma” and that “almost all of the papers questioning the validity of AHT (save two or three) are non-randomized, retrospective case series/reports, and without comparative control groups . . . or single case reports,” which together support his conclusion that AHT/SBS is a clinically valid medical diagnosis [28]. Dr. Narang also provides medical experts and courts with an exceptionally clear and useful review of the basic statistical tools necessary to assess the accuracy of increasingly common arguments that the scientific underpinnings of AHT/SBS are flawed because they are “predicated upon ‘circular reasoning,’ ‘data gaps,’ and ‘inconsistency of case definition,’ and that ‘as technology and scientific methodology advanced, researchers questioning the basis of SBS reached a critical mass’” [28].

In a forthcoming response to Dr. Narang’s article, law professors Keith A. Findley and David A. Moran (along with Drs. Patrick D. Barnes and Waney Squier) [10] reassert their opinion that there has been a paradigm shift in AHT/SBS diagnosis based on experts “failing to consider the wide range of known or alternative causes or the unique pathophysiology of the infant brain, [resulting in] studies [that] almost certainly overestimate the incidence of abuse” [10]. This argument ignores the vast quantity of medical evidence cited by Dr. Narang and appears to be based instead on two literature reviews published in 2011 by Drs. Barnes and Squier [29, 30].

Given the centrality of the Daubert decision, it is interesting to note that Findley et al. [10] reach the surprising conclusion that Daubert requires an all-or-nothing determination. In his view, Daubert applied to AHT/SBS evidence yields just two possibilities: (1) “[o]ne could exclude both sides of the debate from the courtroom because there is inadequate information to make a conclusive diagnosis” or (2) “experts with differing perspectives can argue it out in the courtroom, leaving it to judges or juries to sort out the intricacies of the infant brain and the complexities of biomechanics” [10]. This assertion is – to put it plainly – wrong. The text of Daubert and two decades of application by the courts directs judges not to adopt an all-or-nothing approach but instead to work with all of the experts, to understand the evidence, to make careful, accurate, evidence-based determinations, and to admit only that portion of the expert opinion evidence that actually has a “grounding in the methods and procedures of science” [1].

Conclusion

Familiarity with the gatekeeping principles of Daubert will allow healthcare experts to better serve both science and law by identifying and synthesizing the most valid scientific information to present to juries at trial. Pediatric healthcare professionals should confer, in advance of trial, with attorneys regarding the Daubert standards to ensure a shared understanding and use of these guiding principles.

In sum, pediatric healthcare experts called to testify in child abuse cases must help judges and juries understand:

  1. 1.

    Relevant human anatomy in basic terms

  2. 2.

    Imaging technologies that show the anatomy and pathology and the advantages and disadvantages of different technologies (e.g., safety, efficacy, availability)

  3. 3.

    The most current peer-reviewed, evidence-based medical literature and the distinction between medical research and commentary/opinion articles

  4. 4.

    The diagnostic processes utilized in arriving at the opinion

  5. 5.

    The range of alternative diagnoses and (when supported by the facts) why these diagnoses are not plausible (the specific problems with the alternative diagnosis and the probability that this diagnosis is correct).