Proficiency testing of skin prick testers as part of a quality assurance system
- 1.2k Downloads
Skin prick test is an important diagnostic procedure in clinical allergy but documentation of the quality is often missing.
We describe a proficiency system to evaluate staff members in relation to the international recommended reproducibility in terms of coefficient of variation (CV < 40 %) and the linearity (coefficient of regression >0.85) based on blinded octuplicate histamine testing using histamine 3, 10, 30 and 100 mg/ml.
Fourteen trained allergy nurses participated in the proficiency testing. More than 95 % of the nurses, generated coefficient of variation less than 40 %, and for around 35 % of testers the CV were below 20 % based on wheal area. Regarding the linearity (coefficient of regression), only two nurses produced tests with a value below 0.85. On the contrary, 79 % of testers demonstrated a coefficient of regression >0.95. Depending on the gentleness of the prick procedure, the inter-nurse variability in wheal area varied more than twofold corresponding to a 10-doubling of histamine concentration. This would never have been detected without using a proficiency testing system.
The described histamine testing provides an objective system for the evaluation of basic skin test quality assessment standards especially for documentation in scientific studies.
KeywordsCoefficient of regression Coefficient of variation Histamine skin prick test Reproducibility Quality assessment
skin prick test
coefficient of variation
coefficient of regression
Skin prick test (SPT) is one of the diagnostic cornerstones in IgE-mediated allergic diseases . It is widely accepted due to the safety, convenience and cost-effectiveness [2, 3]. It is, however, prone to variability that may fundamentally change the readout of the test. Standards for optimal performance of the SPT have been provided [2, 4, 5]. In the daily routine the SPT are normally performed by nurses or technicians. Based on the position as a “gold standard” in allergy diagnosis  it is important to bring the SPT proficiency up to a predefined minimal standard and to be able to document this. As quality assurance is becoming increasingly demanded, it is crucial also to bring a biological test into better alignment with other diagnostic tests where quality assurance is an integrated component of performing the test. A suggested proficiency testing protocol was presented in 2008 by The American Academy of Allergy, Asthma and Immunology (AAAAI) and the American College of Allergy, Asthma and Immunology (ACAAI) joint Update Practice Parameter . In spite of that, a recent paper  calls for standards and consistency of the test due to a described gab between recommendations and daily practice. Especially in publication of clinical studies, proficiency testing data for SPT performance should be reported.
This study describes a quality assurance system to evaluate and to document the reproducibility of skin prick testers. Due to the extensiveness of this system, it is suggested to perform this test yearly or every second year.
All skin test were performed on only one individual (HJM) between 8 am and 4 pm over a period of 2 months with at least 1 day interval. The subject did not suffer from allergy or skin diseases and had not been treated with any substances interfering with the histamine induced skin reaction .
Skin prick test
The testing was performed double-blind using bottles numbered 1–32 which included 8 bottles of four concentrations of histamine hydrochloride (3, 10, 30 and 100 mg/ml) in 50 % glycerol applied in random order. Each test session consisted of 32 individual SPTs with 8 repeats of each of the four histamine concentrations. Negative controls in duplicate were performed with saline. The tests were applied on the forearms spaced 3 cm apart by the “puncture method” using the same type of a 1 mm lancet (device applied at 90° angle with downward pressure) (7). Devices were used once and then discarded . The wheal reactions were read after 15 min, outlined and transferred by tape to paper. The area in mm2 was measured by PC-based planimetry witch previously has shown a documented CV of 2–3 % . Positive skin test was defined as a wheal area ≥7 mm2 [2, 4, 5]. The consistency in producing identical wheal areas was expressed as coefficient of variation (CV) and was calculated for the octuplicate tests for each histamine concentration and testing personal. The linearity (dose–response relationship) was calculated as correlation coefficient in a log area vs log histamine concentration based on all tests per concentration . All nurses employed at the Allergy Clinic, Copenhagen University Hospital Gentofte were included in the proficiency testing. Some nurses were newly employed with limited experience but carefully trained whereas others had more than 20 years of experience.
Fourteen testers completed the proficiency study. The negative controls resulted for most operators in completely negative reactions and for all operators in wheal reactions less than 7 mm2. This “background” was not subtracted from the histamine reactions.
In order to bring SPT into better alignment with areas of medicine where quality data are required, proficiency testing based on specific standards should be requested. Data from 2006 indicate a need as up to 90 % of practicing allergists did not assess the reproducibility of their testing staff’s skills . The European standard for skin prick testing implies a coefficient of variation based on wheal diameter less than 20 % (40 % with wheal area) after histamine control applications and dose–response relationship calculated as correlation coefficient higher than 0.85 . A coefficient of variation of less than 30 % (diameter) has been advised by the 2008 American Academy of Allergy, Asthma and Immunology and the American College of Allergy, Asthma and Immunology Joint Update Practice Parameter . In the present study, the operators nicely fulfilled the requirements as regards reproducibility (CV %) and linearity (R2). In spite of minor deviations the increase in wheal area is constant over the range of histamine concentrations used (Fig. 3), but the operators were not able to produce inter-tester comparable wheal areas. The difference between different operators corresponds to at least a tenfold difference in histamine concentration. This substantial inter-tester variability does not seem to be related to variability in histamine responsiveness nor to the outlining of the wheal, but to the very performance of the SPT i.e., the gentleness of the prick procedure. The quality of the test was not convincingly related to the years of experience of the testers.
In daily clinical practice the skin response is either a “positive” or “negative” categorical assessment, but in scientific studies the results may often be interpreted quantitatively. In the scientific literature documentation of quality assurance standards being fulfilled is often missing . Unless allergen sensitization is read as histamine equivalent reaction  it is important to produce wheal areas of a constant size and the force of the prick procedure seems to be crucial in this aspect. Producing small wheal reactions may imply that weakly sensitized patients may be missed due to a false negative skin test. To accurately interpret results of SPT in these settings, it is important to document a low-level inter-tester variability when performed by multiple operators . The titrated histamine testing gives an easily assessable evaluation of the inter-tester and intra-tester reliability and quality in performing SPT.
Compared to the 2008 American Suggested Proficiency Testing and Quality Assurance Technique for SPT  the method suggested in this paper implies several advantages: (1) all tests are applied on only one individual and thereby ruling out intra-individual recipient differences as being the basis for observed differences between individual operators; (2) planimetry imply a more precise measurement of the wheal than using the mean diameter ; (3) the titrated test offers the possibility of evaluating the linearity (coefficient of correlation).
The histamine proficiency testing provides an objective system for making quality assurance evaluation without exposing allergic patients to unnecessary hazardous and unpleasant testing using allergen extracts. The results of histamine testing may not be directly transferable to testing with allergens, but it does give valid information how staff members performing SPT in reality meet basic quality assurance standards.
In centres not possessing equipment for planimetry, the mean diameter may be used, but we prefer planimetry due to a higher precision. For scientific purposes, SPT proficiency testing represents an objective standard to verify operator qualification and should be integrated in a centre’s standard quality assurance programme.
We are about to initiate a project focusing on self-training to be able to induce wheal areas within a pre-defined range (diameter 7 ± 1 mm; area 28–50 mm2) using histamine 10 mg/ml in order to be able to compare actual allergen induced wheal size between individual operators .
Documenting the quality of skin prick testing is essential especially in scientific studies. We describe an objective proficiency system using histamine testing for documenting basic skin test quality standards. Histamine testing imply not running the risk of inducing severe allergic reaction as might be the case with allergens and by using only one test person we minimize other variables, that might confound the outcome. We suggest performing proficiency testing annually or biannually for quality assurance.
PAH, LSK and HJM designed the investigation and wrote the article. LKP managed data from the area measurements and critically reviewed the article. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Availability of data and materials
All relevant raw data on which this article is based are available from the author.
Ethical approval and consent to participate
According to Danish legislation standard quality assessment only involving staff members does not require ethical approval. In relation to the present manuscript, all tests were performed on one of the authors (HJM).
- 2.Bernstein IL, Li JT, Bernstein DI, et al. Allergy diagnostic testing: an update practice parameter. Ann Allergy Asthma Immunol. 2008;100(Suppl):3.Google Scholar
- 4.Dreborg S. Skin tests used in type I allergy testing. EAACI position paper. Allergy. 1989;10(44):59.Google Scholar
- 5.Dreborg S, Frew A. Allergen standardization and skin tests. EAACI position paper. Allergy. 1993;14(48):49–82.Google Scholar
- 11.Werther RL, Choo S, Lee KJ, et al. Variability in skin prick test results performed by multiple operators depends on the device used. WAO J. 2012;5:200–4.Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.