Inter-rater Reliability of Explicit Indicators of Prescribing Appropriateness
- 61 Downloads
Objective: To assess the inter-rater reliability of 14 explicit indicators of appropriate long-term prescribing.
Method: All available data required for the assessment of 59 long-term prescriptions started during a hospital admission for 25 patients were transcribed from the patients’ medical records. These transcripts were presented in a standardised format and random order to four raters (two doctors and two pharmacists) who used the indicators to judge the appropriateness of each prescription. Debriefing interviews were held with each rater. An a priori level of acceptable agreement between the raters was set at a weighed kappa of 0.70.
Results: There was no apparent difference between pharmacists and doctors for all findings, so data were combined. Two indicators showed poor agreement, three showed moderate agreement, and nine showed substantial or near perfect agreement, exceeding a weighted kappa of 0.70. There was excellent positive agreement as to which prescriptions were judged appropriate by the indicators, but much worse negative agreement as to which prescriptions were judged to be inappropriate. In the interviews, the raters remarked on the difficulty of applying explicit indicators when they routinely made implicit judgements about data in the medical records.
Conclusion: Nine of the indicators achieved the required level of reliability and the negative agreement levels showed that this was the area that required greater improvement in future developments of the indicators. Further work needs to be conducted to investigate ways of the improving instructions on how to make explicit judgements and reducing the need for implicit or subjective assessments.
Key wordsAppropriate prescribing Hospital Indicators In-patient prescribing Prescribing indicators Reliability United Kingdom
Unable to display preview. Download preview PDF.
- 4.Thompson, DF, Heflin, NR. 1987Frequency and appropriateness of drug prescribing for unlabeled uses in pediatric patientsAm J Hosp Pharm46794Google Scholar
- 5.Medical Economics. Physician’s Desk Reference. 58th ed. Montvale, NJ: Medical Economics Co Inc., 2004.Google Scholar
- 6.Joint Formulary Committee. British National Formulary. British Medical Association and Royal Pharmaceutical Society of Great Britain; 2003.Google Scholar
- 13.Javed, N, Tully, MP. 2002Content validity of indicators of the appropriateness of long-term prescribing started during a hospital admissionInt J Pharm Pract10(suppl)R55Google Scholar
- 14.Tully, MP, Cantrill, JA. 2003The validity of explicit indicators of appropriateness of long term prescribingInt J Pharm Pract11(suppl)R49Google Scholar
- 15.Taylor, S, Bogdan, B. 1998Introduction to Qualitative Research Methods A Guide Book and Resource3John Wiley & SonsNew YorkGoogle Scholar
- 16.Dunn, G. 1992Design and analysis of reliability studiesStat Meth Med Res112357Google Scholar
- 22.Berg, M. 1998Medical Work and the computer-based patient record: a sociological perspectiveMeth Inf Med37294301Google Scholar