Development and validation of a patient decision aid for prostate Cancer therapy: from paternalistic towards participative shared decision making
Patient decision aids (PDAs) can support the treatment decision making process and empower patients to take a proactive role in their treatment pathway while using a shared decision-making (SDM) approach making participatory medicine possible. The aim of this study was to develop a PDA for prostate cancer that is accurate and user-friendly.
We followed a user-centered design process consisting of five rounds of semi-structured interviews and usability surveys with topics such as informational/decisional needs of users and requirements for PDAs. Our user-base consisted of 8 urologists, 4 radiation oncologists, 2 oncology nurses, 8 general practitioners, 19 former prostate cancer patients, 4 usability experts and 11 healthy volunteers.
Informational needs for patients centered on three key factors: treatment experience, post-treatment quality of life, and the impact of side effects. Patients and clinicians valued a PDA that presents balanced information on these factors through simple understandable language and visual aids. Usability questionnaires revealed that patients were more satisfied overall with the PDA than clinicians; however, both groups had concerns that the PDA might lengthen consultation times (42 and 41%, respectively). The PDA is accessible on http://beslissamen.nl/.
User-centered design provided valuable insights into PDA requirements but challenges in integrating diverse perspectives as clinicians focus on clinical outcomes while patients also consider quality of life. Nevertheless, it is crucial to involve a broad base of clinical users in order to better understand the decision-making process and to develop a PDA that is accurate, usable, and acceptable.
KeywordsPatient decision aid Prostate cancer Patient education Shared decision-making User-centered design
International Patient Decision Aid Standards
Patient decision aid
System usability scale
Unified theory of acceptance and use of technology
Prostate cancer (PCa) is the second most frequently diagnosed cancer type in males, with a rising global incidence rate and disease burden [1, 2]. Making a treatment decision is often a challenging process for low-risk PCa patients as it involves trade-offs between the diverse side effects of four main treatment options with equal outcomes (radical prostatectomy, brachytherapy, external beam radiotherapy and active surveillance ). Since patients have differing lifestyles, values and educational backgrounds, a treatment acceptable to one patient may not be to another. In preference-sensitive conditions like PCa, patients can benefit from shared decision-making (SDM) which involves reliable communication and collaboration between clinicians and patients to discuss and balance all available treatment options [4, 5, 6]. SDM is rarely used in the field of (radiation) oncology despite the evidence in favor of it [5, 6].
Participating in SDM requires that the patient is well informed about all available treatment options and is able to express his personal values and preferences in consultations with the clinician. However, studies have shown that most patients receive insufficient information during consultations , which can result in suboptimal choices that negatively impact their post-treatment quality of life [8, 9]. Furthermore, PCa patients benefit from a multidisciplinary approach of urologists and radiation oncologists ; specialists from these departments may have limited knowledge of treatments outside their area, leading them to provide unbalanced information. This is supported by evidence that a disproportionately large number of patients with low/intermediate risk PCa undergo surgery even though radiotherapy offers similar survival outcomes [11, 12].
A patient decision aid (PDA) can be a valuable tool in providing information on different treatment options and improving the quality of care as well as reducing unnecessary procedures, complications and costs . Patients who use PDAs are better informed, experience less decisional conflict and report more realistic expectations of treatment outcomes . Yet, their implementation in practice is hampered by several barriers perceived by clinicians, such as a lack of confidence in the PDA, lack of training in using it as an SDM tool, and concerns that it will take too much time to use .
User-centered design has been proposed as a way to make PDAs more suitable for clinical implementation . In contrast to a standard development process in which informational needs assessment and prototype testing are carried out as separate processes, user-centered design is an iterative process; end-users’ feedback shapes not only the content but also the design of the prototypes, resulting in innovations that are likely to be safer, more accurate and easier to use .
The goal of this study was to develop a web-based PDA for PCa patients in the Netherlands based on user-centered design principles. The PDA aims to provide accurate and balanced information about the main treatment options and a means for patients to discover and communicate their preferences with clinicians during the consultation.
Clinicians specializing in all four treatment areas: 4 radiation oncologists, 8 urologists, 2 oncology nurses and 8 general practitioners (GPs).
Nineteen former PCa patients who had fully undergone one of the four treatments.
Four usability evaluators with experience in web design, usability engineering and user experience, selected from the Information and Computer Science Department of Utrecht University. The evaluators had no clinical background.
Eleven healthy volunteers with varying educational backgrounds and familiarity with technology, representing the typically elderly target population of PCa patients .
The Internal Review Board (IRB) of Maastro Clinic reviewed and approved this study, and written informed consent was obtained from all respondents.
In the first four rounds, we performed semi-structured interviews and usability surveys in Dutch with patients and clinicians.
Semi-structured interviews were performed to assess the type and amount of information needed for decision-making. The interviews included the following themes: current information provision, the deliberation and decision-making process, patient preferences, and the potential for decision support.
Each interview lasted between 30 and 60 min and was audio-recorded, transcribed, and returned to the respondents for review. After approval, each transcript was analyzed by means of open coding and axial coding . During open coding, a transcript would be divided into text fragments and each fragment would be assigned one or more keywords based on its content. In the subsequent axial coding, the open codes were grouped according to their theme. The final analysis resulted in a list of the most common themes and factors relevant for patients when seeking information and making treatment decisions.
The respondent was then invited to complete an online 20-item evaluation survey in Dutch based on the unified theory of acceptance and use of technology (UTAUT)  in which they scored the comprehensibility and usability of the prototype on a 5-point Likert scale. The survey ended with five open questions asking the respondents to mention positive and negative features of the current prototype and suggestions for improvement. The feedback was used to make incremental adjustments to the prototype in each round. Although not all users filled in the surveys (entirely), we had enough information to improve the existing prototype.
While previous rounds focused on both PDA content and usability with clinicians and patients who had undergone treatment, in Round 5 we focused purely on testing usability and acceptability with non-clinical respondents.
Four usability experts evaluated Prototype 4 based on three sets of heuristics and guidelines: general heuristics, readability heuristics, and health-specific usability guidelines. General heuristics measured features such as consistency, informative feedback, appropriate use of error messages, and language use [22, 23]. They then used readability heuristics covering topics such as typeface, text size, colors and size and style of icons and buttons . Finally, health-specific usability guidelines were based on evidence-based research on health literacy . Their feedback was consolidated into a list of the main usability problems and recommendations, on the basis of which a revised version of the prototype (Prototype 5) was developed.
Preference testing between final two prototypes
Finally, Prototypes 4 and 5 were tested with two groups of 5 and 6 healthy volunteers, respectively, meant to be representative of the target population of PCa patients in terms of age and education level. Volunteers tested the prototypes by means of a think aloud session with the developers. The System Usability Scale (SUS) questionnaire was used to determine the usability of the PDA . The final PDA was based on the strengths of both prototypes.
Clinicians (four radiation oncologists, two urologists and two oncology nurses) mentioned that patients would require a wide range of information to make a well-informed treatment decision, based on most frequently asked questions, which included: anatomy, treatment options, complications per treatment in the short- and long-term and chances of complete cure for each treatment. Additionally, they considered it important to structure a PDA in such a way that important information cannot be missed, such as presenting the information in a series of windows that must be clicked through. Information provision would ideally consist of simple jargon-free language and diagrams and videos.
Based on this feedback, the first prototype was developed containing the following sections: (i) a patient profile page in which the patient selects their progression risk level (low, medium, or high); (ii) information about each treatment option based on the risk level selected (for instance, a high risk patient would see information about surgery and radiotherapy whereas a low risk patient would see information about all four treatments); (iii) a series of questions to test their understanding of the presented information and a summary of the results; (iv) a series of questions to identify priorities and preferences; (v) a series of questions to identify the least preferable treatment; (vi) a printable summary of the priorities, preferences and answers to the knowledge quiz, and a bar chart displaying the most suitable treatment based on the patient’s responses.
Ten former patients who had undergone radiotherapy were consulted to evaluate prototype 1. The majority (80%) was receptive to using a PDA and felt it would help patients learn more about their condition and ask more focused questions in consultations. The most important factors for decision-making among our respondents was the quality of life after treatment, side effects of the treatment, and the logistical aspects (such as the frequency and duration of hospital visits).
Based on these comments, prototype 2 was created with the addition of: (i) an overview of the pros and cons of all four treatments; (ii) non-clinical questions to the preferences questionnaire.
Based on this input, prototype 3 was developed, in which (i) the profile section was simplified by removing jargon; (ii) videos were added for each treatment procedure; (iii) a statement was added to emphasize that the treatment options all yield similar survival chances.
Eight GPs were interviewed on patients’ decisional needs and to evaluate prototype 3. They observed that patients generally chose aggressive treatments such as surgery hoping to eradicate the tumor completely, without considering the impact of the side effects, and were heavily influenced by experiences of former patients and friends and the opinion of the urologist treating them.
In response to this feedback, the following changes were made in prototype 4: (i) the bar chart showing the treatment recommendation was replaced with an overview of all treatment options and their relative importance to the patient; (ii) questions regarding side effects were clarified to improve understanding.
Usability experts heuristically evaluated prototype 4 and revealed problems regarding navigation, visual presentation and readability. For instance, navigation inconsistencies could lead users to miss information without realizing it. Additionally, they advised against visually distracting elements such as bright colors, background images, and cluttered text with small font sizes. These issues were incorporated into Prototype 5 and both prototypes (4 and 5) were presented to volunteers for testing.
SUS scores for Prototypes 4 and 5 were 79 (standard deviation = 10.09) and 84.6 (standard deviation = 18.4) respectively, however a t-test revealed that the difference was not statistically significant. 78% of volunteers preferred the closed navigation structure of Prototype 5. There was little consensus regarding layout, with an even split in preference between Prototype 4 and 5. Overall, the participants preferred the simpler visuals of Prototype 5.
Final PDA design
Introduction, where a 2-min video introduces the purpose of the PDA and its contents.
Personal treatment options, where patients provide personal information (e.g. name, date of birth, disease characteristics) on which the information provision is risk-stratified. For instance, a low risk patient will see information about brachytherapy (as displayed in Fig. 8A).
A side-by-side comparison of the relevant pros and cons of the applicable treatment options.
A knowledge quiz consisting of 10 true/false questions to help patients assess whether they have understood the provided information sufficiently.
A questionnaire containing 16 questions to clarify a patient’s preferences and priorities regarding treatment experience, quality of life, and uncertainty (Fig. 8B).
Questions relating to treatment experiences to indicate the least desirable option.
A summary of the patient’s preferences and priorities in relation to each treatment option, including the option to print the summary and a selection of questions and notes, which can be used during the next consultation.
Based on IPDAS guidelines and a user-centered design framework, we developed a freely accessible web-based PDA for PCa in Dutch. Clinicians, patients, volunteers and usability experts were consulted to provide feedback on the content of the PDA and evaluate its usability at every stage of development. Patients stressed the importance of specific details of each procedure, such as short- and long-term side effects, post-treatment care and (side-by-side) pros and cons of each treatment. On the other hand, clinicians mentioned the importance of clinically relevant information. Our findings are consistent with previous findings that clinicians and patients evaluate treatment options differently: clinicians tend to focus on clinical outcomes, whereas patients also consider how the treatment will affect their (quality of) life on the short- and long-term . To consolidate these different views, a common platform is needed to make an informed decision based on both perspectives. During the development of our PDA, this meant moving the focus away from clinical aspects of the disease and toward its effect on the patient’s daily life.
The main concern among clinicians was that a PDA would increase the consultation time, which has been cited as one of the major barriers in the implementation of SDM and PDAs [28, 29]. Although our PDA is intended to be used at home by the patient rather than in the clinical setting, thus not directly interfering with consultation times, the aim is to inform patients well enough that they can engage with clinicians to thoroughly discuss their treatment options. Naturally, this may lead to longer consultation times. There is inconclusive evidence on the effect of PDAs on consultation length; some studies found that consultations are on average longer while others found reduced times, with the median change being an increase of 2.6 min . Prior findings also suggest that the initial costs of using a PDA might be offset if it results in the patient being better informed during the consultation, particularly if it results in a reduction in overtreatment . Nevertheless, clinicians’ views about PDAs adding to their workflows remain a valid concern.
One possible solution is to present the PDA output in a format which supports the shared decision talk. For instance, in our PDA the patient’s answers are summarized in a printable tabular format: all relevant treatment options and their side effects are shown with dots representing their relative impact on the patient’s life. For instance, a strong preference for avoiding erection problems is indicated with three dots whereas if the patient is not concerned about long hospital stays this is indicated with one dot. The patient and clinician can see then see his preferences at a glance and zero in on the most important concerns, thus going through the consultation more efficiently.
Another concern expressed by clinicians was that the advanced age of most PCa patients may hamper their use of web-based PDAs. A systematic review of PDA effectiveness in elderly populations concludes that elderly patients who use PDAs display better knowledge and risk perception and lower decisional conflict . The reviewers concede however that little attention has been paid to this topic in the literature and that few PDAs are specifically designed for elderly patients. Moreover, there is little guidance on how to adapt PDAs for an older audience, leading the reviewers to emphasize the importance of proper design and testing. Visual support in the form of diagrams  and animations  is considered particularly beneficial. The involvement of elderly patients under user-centered design may be a crucial step in understanding how to present complex clinical information to an older audience.
Our process brought to light some of the strengths and pitfalls of user-centered design. The iterative model may make it easier for developers to adapt data gathering and testing methods from initial rounds to new treatment information and make incremental changes as required. However, one of the drawbacks is that involving a wide group of stakeholders in an iterative process can make the development process long, complicated and costly. Our development process spanned over two years and involved 58 participants, resulting in > 100 h of interview material and feedback that needed to be processed, analyzed and incorporated in successive rounds. Although it is beneficial to the quality of the content and usability, developers should take into account the resources required to create a high quality PDA.
Additionally, engaging many different users provides a variety of perspectives, but can pose a larger challenge to integrate these diverse views and find a consensus, particularly in the area of usability testing. For instance, some participants found the PDA’s closed navigation essential to guide the user through the process while others felt it was too restrictive. Incorporating these varying perspectives and preferences may not be feasible, so at times developers may need to consult evidence-based guidelines or establish consensus through methods such as focus groups or a Delphi study .
Aside from development, it is crucial to ensure that maintenance is provided both technologically and scientifically. For instance, making tablet-ready applications is becoming a necessity as more users are transitioning from laptops and desktop computers to tablets and smartphones for their daily browsing . Additionally, (prostate) cancer treatment is a rapidly developing field with the emergence of new modalities like proton therapy. It is important to ensure that a PDA stays up-to-date on current developments and new therapies, which requires developers and clinicians to collaborate continuously. Therefore, it may be valuable to establish a governance structure within the hospital for maintaining the PDA and collecting and analyzing data about its effectiveness to be shared with clinicians and the wider medical community to create awareness.
Future work may explore more detailed value clarification methodologies  to identify additional factors that influence the use of PDAs in clinical practice. Additionally, translations to other languages would greatly benefit the non-Dutch patient population inside and outside the Netherlands. Furthermore, a key future step will be the personalization of our PDA by incorporating data from prediction models (www.predictcancer.org) for survival, toxicity or side effects to encourage further personalized shared decision making [6, 37]. Data from individual hospitals could be incorporated as well to tailor the PDA to a specific hospital and create ownership. It is important to note that tools such as these would likely require certification such as CE marking .
Our process and the resulting PDA is currently validated in a clinical trial (NCT03278197, ProDecA, Evaluation of a Web-based Decision Aid Tool for PCa Patients), where the effect of the PDA in clinical practice will be evaluated. We expect to observe improvements in patient knowledge and the SDM process and a decrease in decisional conflict.
In this study we followed a user-centered design process to develop a web-based PDA for PCa patients. The development process spanned five rounds over a period of two years and involved both former PCa patients and healthcare professionals. This process resulted in a PDA that meets the standards of both clinicians and patients by presenting balanced information about the four available treatment options and by providing a platform for patients to explore their personal preferences and priorities.
Authors acknowledge the contribution of students from Fontys University of Applied Sciences in conducting interviews, and of Marianne Voogt and Christof van Nimwegen in usability testing.
PL and AB conceived of the project. EB oversaw data collection. BV, JR, EL, KB, TM and VZ provided input on the prototypes. BV, JR, EL, KB, MO, CR, RF, and AD provided critical feedback of the manuscript. AA wrote the manuscript with contribution from RF. AD supervised the project. All authors read and approved the final manuscript.
Authors acknowledge financial support from the European Program H2020–2015-17 (PREDICT - ITN - n° 766276), Interreg V-A Euregio Meuse-Rhine (“Euradiomics”), and Kankeronderzoekfonds Limburg from the Health Foundation Limburg. These grants funded the infrastructure for the development of the PDA as well as the data collection for its evaluation.
Ethics approval and consent to participate
The Internal Review Board (IRB) of Maastro Clinic reviewed and approved this study and written informed consent was obtained from all participants.
Consent for publication
The authors declare that they have no competing interests.
- 3.Vanneste BG, Van Limbergen EJ, van Lin EN, van Roermund JG, Lambin P. Prostate Cancer radiation therapy: what do clinicians have to know? Biomed Res Int. 2016;1(2016):1–14.Google Scholar
- 5.Stacey D, Légaré F, Lewis K, Barry MJ, Bennett CL, Eden KB, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Libr. 2017;4:1–297.Google Scholar
- 7.Lamers RE, Cuypers M, Husson O, Vries M, Kil PJ, Ruud Bosch J, et al. Patients are dissatisfied with information provision: perceived information provision and quality of life in prostate cancer patients. Psycho-Oncology. 2016;6:633–40.Google Scholar
- 15.Elwyn G, Scholl I, Tietbohl C, Mann M, Edwards AG, Clay C, et al. “Many miles to go…”: a systematic review of the implementation of patient decision support interventions into routine clinical practice. BMC Medical Informatics and Decision Making. 2013;13(2):1.Google Scholar
- 17.Abras C, Maloney-Krichmar D, Preece J. User-centered design. Bainbridge, W Encyclopedia of Human-Computer Interaction Thousand Oaks: Sage Publications. 2004;37(4):445–56.Google Scholar
- 18.Noone A, Howlader N, Krapcho M, Miller D, Brest A, Yu M, et al. SEER Cancer statistics review, 1975–2015. Bethesda: National Cancer Institute; 2018.Google Scholar
- 19.Elwyn G, O’Connor A, Stacey D, Volk R, Edwards AG, Coulter A, et al. International patient decision aids standards (IPDAS) collaboration. Developing a quality criteria framework for patient decision aid: online international Delphi consensus process. Br Med J. 2006;333(7565):417–9.CrossRefGoogle Scholar
- 20.Strauss A, Corbin J. Basics of qualitative research. Los Angeles: Sage publications; 1990.Google Scholar
- 21.Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q. 2003:425–78.Google Scholar
- 23.Nielsen J. Usability engineering. Cambridge: Elsevier; 1994.Google Scholar
- 24.Hodes RJ, Lindberg DA. Making your website senior friendly. Bethesda: National Institute on Aging and the National Library of medicine; 2002.Google Scholar
- 25.Monkman H, Griffith J, Kushniruk AW, editors. Evidence-based heuristics for evaluating demands on eHealth literacy and usability in a Mobile consumer health application. Stud Health Technol Inform. 2015;216:358–62.Google Scholar
- 26.Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry. 1996;189(194):4–7.Google Scholar
- 34.Hsu C-C, Sandford BA. The Delphi technique: making sense of consensus. Practical assessment, research & evaluation, vol. 12; 2007. p. 10):1–8.Google Scholar
- 36.Fagerlin A, Pignone M, Abhyankar P, Col N, Feldman-Stewart D, Gavaruzzi T, et al. Clarifying values: an updated review. BMC medical informatics and decision making. 2013;13(2):S8.Google Scholar
- 38.Guidelines on the qualification and classification of stand alone software used in healthcare within the regulatory framework of medical devices, (2016).Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.