Limited research exists to guide clinical decisions about trialling, selecting, implementing and evaluating eye-gaze control technology. This paper reports on the outcomes of a Delphi study that was conducted to build international stakeholder consensus to inform decision making about trialling and implementing eye-gaze control technology with people with cerebral palsy.
A three-round online Delphi survey was conducted. In Round 1, 126 stakeholders responded to questions identified through an international stakeholder Advisory Panel and systematic reviews. In Round 2, 63 respondents rated the importance of 200 statements generated by in Round 1. In Round 3, 41 respondents rated the importance of the 105 highest ranked statements retained from Round 2.
Stakeholders achieved consensus on 94 of the original 200 statements. These statements related to person factors, support networks, the environment, and technical aspects to consider during assessment, trial, implementation and follow-up. Findings reinforced the importance of an individualised approach and that information gathered from the user, their support network and professionals are central when measuring outcomes. Information required to support an application for funding was obtained.
This Delphi study has identified issues which are unique to eye-gaze control technology and will enhance its implementation with people with cerebral palsy.
Cerebral palsy is an umbrella term that encompasses a group of disorders affecting movement and posture. The primary motor disorder is often accompanied by associated impairments of sensation, cognition, communication, perception, behaviour, and/or by seizure disorder . The type of cerebral palsy and severity of motor involvement play an important role in determining a person’s participation in everyday activities including the ability to speak. For example, population-based studies show that one in two children with cerebral palsy have a speech disorder, and one in three are non-verbal . Speech and motor difficulties may hinder recognition of a child’s cognitive capabilities, potentially leading to inaccurate evaluations of strengths and difficulties . Under-estimating a child’s cognitive ability may limit provision of opportunities for learning and development as family, peers, educators and health professionals may not fully realise or respond appropriately to the child’s developmental profile.
Eye-gaze control technology provides an effective and direct access method to computers and speech generating devices for people with significant physical disabilities, such as cerebral palsy [4, 5], who are able to use purposeful looking behaviours including gaze fixations and gaze transfers [6,7,8,9,10]. This technology holds the potential to unlock people’s capacity to participate in leisure and productivity pursuits, play games, listen to music, use social media, and for environmental control. For individuals with communication difficulties, it can also offer access to specialist software for augmentative and alternative communication (AAC) [8, 10,11,12,13,14,15,16,17]. Eye-gaze control technology involves an infra-red camera, which works in conjunction with specialised software, to monitor and respond to a user’s eye movements . The technology allows a person to move a cursor across as screen and make on-screen selections by deliberately fixing their gaze on a target on a screen.
Although literature is available to guide assistive technology provision  and AAC implementation [20, 21], there is almost none available to support decision-making concerning the use of eye-gaze control technology as an access method. Information is required about “who” would be the most appropriate candidates, “what” technology is most effective, “when” it is best introduced, “how” it should be implemented and outcomes measured . This gap in guidance is highlighted by two recent systematic reviews which aimed to identify the effectiveness of eye-gaze control technology as a method of access, assessment and implementation strategies  and appropriate outcome measures . Single case studies and small group studies, identified in the reviews, have provided preliminary evidence for use of eye-gaze control technology with children to achieve social and communication goals [6, 11, 23, 24], however, the reviews highlighted a pressing need for research to inform clinical practice and support funding for this technology.
Evidence-based practice draws on the best available evidence, clinical expertise and the values and preferences of recipients of health care . Therefore, this Delphi study aimed to build international consensus from key stakeholders to develop evidence- and consumer-informed clinical guidelines for assessment, trial, implementation, funding and outcome measurement of eye-gaze control technology for children, adolescents and adults with cerebral palsy.
The Delphi process followed the principles of the Guidance on Conducting and Reporting DElphi Studies (CREDES) . CREDES was developed to provide guidance to researchers conducting Delphi studies on enhancing the rigour and transparency of reporting and to support reproducibility and usefulness of research. CREDES can be used to guide the design of Delphi studies to enhance methodological rigour (Supplementary file 1). A 3-round, online Delphi process was used to identify, and build consensus on, issues that stakeholders viewed as critical to consider when implementing eye-gaze control technology for people with cerebral palsy. Three rounds are conventionally considered sufficient to enable consensus to be reached , minimise respondent fatigue  and reduce the risk of attrition with further rounds. Three rounds were also feasible within the resources available to the study . In a Delphi study, researchers apply a high degree of methodological rigor to systematically elicit information from respondents [26,27,28,29]. Using an iterative process, researchers seek input from stakeholders across a number of rounds of structured questionnaires until group consensus is achieved. The overall study process is presented in Fig. 1 including the dates for each round.
The Delphi process is anonymous and non-hierarchical so it can elicit open and honest views from disparate groups such as clinicians, researchers and, in particular, people with disability and their support network, without group pressure. The process mitigates against individuals feeling deferential towards clinicians and researchers, or inhibited by the presence of more senior individuals or stronger voices [27,28,29,30,31]. As an iterative process it allows minority views to be carefully considered, rather than discarded early in the process . The process also provides opportunities for participants to alter their opinions with the benefit of further consideration, and informed by the collective ideas of the other participants’ anonymous responses .
An online Delphi process was a particularly suitable methodology for the current topic as it enabled engagement with large, diverse, international groups of participants. Additionally, it was intended to facilitate inclusion of users of eye-gaze control technology and their communication partners (such as parents, partners, families, caregivers and teachers), as well as clinicians, researchers, industry and funders [26, 28, 30,31,32].
Consumer and stakeholder involvement
In this study “consumers” are defined as people with cerebral palsy who are eye-gaze control technology users and their communication partners, such as family members and caregivers. Consumer involvement was embedded in this study from the start; a mother of an adolescent user of eye-gaze control technology was a study investigator. In addition, an international Advisory Panel, comprised of stakeholders from different fields of interest, informed each stage of the study. See Table 1 for additional details of consumer involvement reported according to the Short Form of Guidance for Reporting Involvement of Patients and the Public 2 (GRIPP2-SF) . These are reporting guidelines developed to enhance the quality, transparency and consistency of consumer involvement in research.
Participants and recruitment
Participants were eligible to take part if they were people with cerebral palsy who used eye-gaze control technology, or their family members or caregivers. Other eligible participants were professionals who supported the use of eye-gaze control technology or had been integral in assessing and/or implementing eye-gaze control technology for people with cerebral palsy, specifically, clinicians or technologists, researchers and “others who identified with these inclusion criteria”.
A link to the electronic Delphi survey was embedded in an introductory message circulated amongst the local, national and international electronic networks of the Investigator Team and Advisory Panel, aiming to reach, via a snowball effect, a range of participants across countries and settings. The introduction included a video message from the consumer investigator and her daughter, inviting participation in the study. Participants who consented to participate in the study and met the eligibility criteria were directed to the survey. Respondents who started the survey but indicated they met the “other” category and not a category for inclusion (i.e., a person with cerebral palsy, a family member or caregiver or a professional supporting eye-gaze control technology for people with cerebral palsy) were thanked for their interest and exited from the survey and study. In subsequent rounds, surveys were sent only to people who had completed the previous round.
Participant demographics were gathered in Round 1 of the survey. An email address was obtained from each participant at each round of the survey to facilitate reminders and distribution of subsequent rounds of the survey. The email address was used to link with participant demographics collected in Round 1 to enable description of the unique sub-sample responding to subsequent rounds.
Generation of content for round 1
As we had identified that there was little evidence to guide practice, open-ended questions were used in Round 1 to identify statements which respondents believed should be included in clinical guidelines. The questions were developed with the aim of identifying issues related to all aspects of eye-gaze control technology, spanning identification of the unique contribution and challenges eye-gaze control technology offers as an access method, assessing readiness for eye-gaze control technology, assessment and outcome measurement, effective strategies for implementing eye-gaze control technology, communication partner instruction, costs and funding . Over a series of meetings, the Investigator Team and Advisory Panel identified 17 open-ended questions, organised in seven topic areas (Supplementary file 2) . The questions were written in English and translated and back-translated to enable distribution in English, Swedish, Dutch and French – the languages spoken by the Investigator Team and Advisory Panel.
Survey platform and pilot testing
Research Electronic Data Capture (REDCap - hosted at University of Sydney) was used as the online platform to collect responses. This system provides a secure, web-based application designed to support data capture for research studies.
Pilot testing of each round of a Delphi survey is considered best practice [26, 28, 29]. The draft survey of each round (including study information, items collecting participant characteristics, questions/statements) was therefore developed, tested in its online form and modified iteratively by the Investigator Team and Advisory Panel until agreement was reached that the survey was rigorous, unambiguous and able to elicit meaningful responses. Usability on a variety of web browsers on Mac and Windows-based computers, as well as Android and iOS-based mobile devices  was also checked prior to dissemination of the survey link. The survey was prepared in accordance with accessibility standards for people with visual impairment and limited access.
Responses to round 1 of the Delphi survey
The narrative responses to Round 1 were thematically analysed and the resultant statements, categorised by theme, were disseminated in Round 2.
Rating of the importance of the statements in rounds 2 and 3 of the Delphi survey
Respondents were asked to rate all statements resulting from Round 1 in response to the question: How important is this item to include in clinical guidelines? Statements were rated on a 9-point scale where 1–3 corresponded to low importance, 4–6 represented statements that were considered important but not critical, and statements rated 7–9 were considered to be of critical importance. An alternative response option (labelled: don’t know or prefer not to answer) was also provided. Participants were offered free-text options to expand or comment on any aspect of their responses. A personalised reminder email was sent to non-responders 1 week prior to closing Round 2 to optimise survey return rate. In this round, surveys were offered in English and Swedish, based on the language of the majority of respondents from Round 1.
Any additional statements identified in the free text boxes during Round 2, and which did not duplicate existing content, were analysed thematically and added as new statements under the appropriate theme. Statements rated 7–9 by ≥70% of respondents and 1–3 by < 15% of respondents were considered as reaching consensus, other statements were discarded . The process of identifying consensus statements was completed separately for two groups of participants, all participants together and people with cerebral palsy and their families and caregivers. All statements reaching consensus from both these groups progressed to Round 3. This process ensured that the most important content from people with cerebral palsy and their families and caregivers was included for ongoing consideration. In the third round, surveys were offered in English and Swedish.
The thematic qualitative analysis of narrative responses to Round 1 was performed independently by three investigators (PK, TG, MW) . The investigators triangulated their responses to reach consensus on themes, theme titles and statements contained within each theme to enhance trustworthiness of analyses . To further minimise bias, the thematic analysis was reviewed by the Investigator Team and Advisory Panel and revised in an iterative manner until panel members confirmed consensus . This process was in lieu of member checking with the respondents which we avoided in order to minimise burden, given the already substantial request to complete 3-rounds of Delphi surveys. The resultant statements, categorised by theme, were disseminated in Round 2.
SPSS V.25  was used to generate descriptive statistics of participant characteristics and calculate level of consensus for each statement rated by participants in Rounds 2 and 3.
One hundred and twenty-six participants completed Round 1 of the Delphi survey (Tables 2 and 3). Twenty additional people were exited from the survey after indicating that they did not meet the inclusion criteria for an eligible participant. The total number of potential participants who received invitations to participate is unknown due to the snowball nature of recruitment and, therefore, a response rate could not be calculated for Round 1.
From the 17 questions 1995 codable units were derived. These were discrete responses to survey questions which were then collated into 200 thematically uniform statements. These 200 statements were clustered under eight themes; including: (1) Unique features of eye-gaze control technology as an access method; (2) Initial assessment prior to a trial; (3) Decision making when conducting a trial of eye-gaze control technology; (4) Learning, practise and support requirements when implementing this technology; (5) Evaluation of outcomes and measures to use; (6) Frequency of follow-up and review; (7) Informing funding applications and bodies, and (8) Preparation for possible future access to eye-gaze control technology if it is not currently appropriate. Several issues were common to these eight themes. Table 4 contains these themes, the corresponding statements and the ratings given to each statement in subsequent rounds.
Sixty-two people responded to 200 statements in Round 2, 49.2% response rate (Tables 2 and 3). One hundred and five statements progressed to Round 3 for further consensus building as they were rated 7–9 by ≥70% of respondents and 1–3 by < 15% of respondents. These comprised 86 statements identified when responses of all participants were considered together and a further 19 prioritised by consumers.
All participants together reached consensus on 93 statements and consumers identified one additional priority, to reach a total of 94 statements. Of the 19 statements identified as priorities by consumers in Round 2, nine were rated as priorities by all respondents in Round 3 and were amongst the final 94 statements included in the clinical guidelines. Results for all statements across all three rounds are presented in Table 4.
The Delphi study reported here was completed to address the gap in evidence to guide implementation of eye-gaze control technology with people with cerebral palsy and to inform the content of clinical guidelines for eye-gaze control technology implementation [6,7,8,9,10,11, 22]. Consensus was reached on 94 statements considered important to be included in these clinical guidelines. These statements were categorised in the eight main themes outlined in Table 4 and explored in detail below.
Importantly, the consensus achieved through this international, multiple stakeholder, Delphi process strongly reinforced that important outcomes for eye-gaze control technology users included engagement in play, leisure, recreation and education; enhanced quality of life and social interaction; control over the environment; and promoting communication. This is important evidence to contribute to the justification of funding for use of eye-gaze control technology as a means of accessing a broad range of technology, and potentially making a significant impact to the user and their support network.
Themes identified in the Delphi survey to include in clinical guidelines
Several issues were common to many of the eight themes distilled from the Delphi survey. These have been extracted and presented here to reduce repetition. Optimal seating and positioning were repeatedly identified as important for supporting assessment and trial of eye-gaze control technology and to enable its ongoing use. Skilled occupational therapists and seating specialists are therefore critical members of any team supporting use of eye-gaze control technology.
The importance of clinicians possessing up-to-date knowledge of available technology and current research and development in the field was identified as important to enable matching of technology features to users’ needs. In addition, a thorough understanding of how the technology works, can be adapted to meet a person’s needs, and support their development and progress, was considered integral to successful assessment, trials and ultimately implementation and mastery. Aspects of knowledge identified as critical include how to select set up a device which incorprating calibration, configuration, good connectivity, mounting, tailoring (e.g., compensation for some visual difficulties) and how to upgrade device features.
A multidisciplinary team, with complementary skills and knowledge, working in partnership with users, families and other members of a person’s support network, was commonly identified as a priority across the themes identified in the Delphi survey and is highly consistent with recommendations in the literature [11, 40,41,42,43]. Involvement of skilled health professionals in an ongoing manner to provide education and support to the eye-gaze control technology user, and others involved in supporting them, was considered integral to a responsible assessment, trial of the technology and successful implementation in the different settings in which the technology should be used.
Unique features of eye-gaze control technology as an access method
Eye-gaze control technology can be expensive to purchase and complex and time consuming to implement. Its implementation needs to be tailored to each individual to best teach, support and enable a user to participate and communicate across settings and communication partners. Respondents identified features which are unique to eye-gaze control technology as a way to justify its use as an access method. These included its applicability for people with severe disability who may have no other available method of directly accessing technology, or where eye-gaze control technology increases efficiency and effectiveness of direct access to technology when compared to other indirect access methods, such as switch technology, which requires the user to scan a menu before selecting the intended target. Additional features to be considered about eye-gaze control technology are difficulty using it in outdoor lighting and the need for careful setup and placement of the device.
One in three people with cerebral palsy has a vision difficulty , a consideration in using most means of AAC. Respondents identified that a vision assessment , including evaluation of functional vision abilities , acuity, visual perception and visual motor integration, was required to assist in implementing eye-gaze control technology . Functional vision refers to the use of vision in everyday activities . For those who are not vision specialists, aspects of functional vision can be described using the Visual Function Classification System  and the Eye-Pointing Classification Scale . Notably, respondents clearly indicated that vision difficulties should not necessarily preclude opportunities to trial eye-gaze control technology since the technology has the capacity to be calibrated to accommodate some difficulties with vision.
Cerebral palsy frequently co-occurs with cognitive difficulties with 30–40% of children with cerebral palsy have an intellectual disability. The assessment of cognition can be challenging in people with sever motor impairment who have little or no functional speech, and to date we lack appropriate standardised tools for assessing cognition in this population . Respondents did not identify that understanding of cognitive ability or ability to demonstrate cause and effect were priorities as part of an initial assessment. Respondents reported that people should not be precluded from the opportunity to trial eye-gaze control technology as, for some individuals, eye-gaze control technology may provide the means to explore cause and effect activities for the first time. However, if the purpose of introducing eye-gaze control technology as an access method is to facilitate communication, establishing a profile of cognitive and language ability is important in guiding implementation of the technology and will be a factor to consider when setting goals and managing consumer expectations. Successful AAC users and their support networks attribute success to the cognitive strengths of the user . Equally, children without knowledge that their actions can cause an effect on objects, for example in the context of play, may struggle to engage meaningfully with eye-gaze control technology.
Several factors were considered by respondents to be important when making the decision to carry out a trial of eye-gaze control technology, including the person’s preferences, goals of using the device and the readiness of the team around the person. The literature suggests that people making informed choices about using assistive technology will need opportunities to trial different types of equipment to establish their preferences and to discuss the implications of their options . The risk of device abandonment is likely to reduce when people who use assistive technologies are involved in decision making .
Respondents considered that trials need to be conducted in collaboration with clinicians and other stakeholders and duration of follow up needs to be long enough for the user to have the opportunity to practice and demonstrate skill development and achievement of goals. As a result, no consensus was reached on the exact length of time that is required for a trial as it will vary from individual to individual. Tailoring the length of device trials to an individual’s needs and progress is consistent with a person-centred approach to service delivery .
Respondents identified that goals which were collaboratively developed between the person with cerebral palsy, their support network and clinicians, and which drove a clear plan and identification of roles and responsibilities were a high priority for a successful device trial. Motivating activities for trialing and practising the technology, which were aligned with the person’s goals and interests, were reported to be crucial considerations and underscored a need for clinicians to understand the priorities and interests of the person.
Learning, practise and support
There was strong consensus that practise, through activities or games, was required to ensure effective implementation of eye-gaze control technology. Respondents recommended that practise should take place in regular but short sessions to optimise learning and minimise the potential impact of fatigue on performance. Of particular clinical relevance, is the recommendation that practise should be embedded in the routines of the person learning to use the technology, rather than taking place in specifically arranged practice sessions.
Ongoing education, practise and support, with an individualised plan, were recommended for the user and their support team to ensure they were competent and confident to optimise the outcomes of the eye-gaze control technology. The statements relating to these considerations are aligned with what has been reported in the general assistive technology and AAC literature [53,54,55,56,57,58,59]. Input from skilled professionals was considered a priority for guiding and coordinating device implementation and in tailoring and upgrading the technology for an individual. Timely, technical support and ongoing review of technology implementation, as required or requested by a user and their support network, were identified as integral to the success of eye-gaze control technology. These statements reflect those raised during a Global Research innovation and Education summit on Assistive Technology (GREAT) held in 2017 .
Delphi respondents clearly indicated that the key measure of the outcome of eye-gaze control technology was the individual user’s goal achievement supplemented by observations from other relevant professionals. These goals need to be related to the purposes for which they were using the technology and co-constructed between the person using the technology and their support network. No evidence-based outcome measures were identified as a priority for use. The Investigators and Advisory Panel are concerned that funding agencies may require standardised measures with evidence of reliability and validity to supplement the individualised measures. Examples of such measures include Goal Attainment Scaling (GAS) , Family Impact of Assistive Technology Scale for Augmentative and Alternative Communication (FIAT-AAC)  and Therapy Outcome Measure (TOM-AAC) .
Some respondents reported that outcome measures were not accessible in their language or they were unfamiliar with the measures, indicating a need for further education and efforts to translate existing measures into languages other than English, and to develop new tools that reflect cultural and linguistic diversity.
The way in which eye-gaze control technology is funded varies from country to country, and potentially within countries. A newly published position paper on an international framework for assuring availability and accessibility of assistive technologies supports this assertion . Respondents identified that sufficient evidence needs to be provided to meet local funding criteria along with proof that a support network of health professionals and people within the user’s various environments was available and committed to supporting implementation. While attending to local funders’ criteria, respondents also strongly identified that evidence of effects across a broad range of outcomes should be offered, including participation in leisure and productivity occupations, environmental control and enhanced communication, social interaction and quality of life.
Preparation for possible future access
The Delphi survey sought information on actions which could be taken to develop the skills of a person and their families and caregivers, when initial trials had not been successful, but the team around the person still recognized that re-introduction of eye-gaze control technology at a later date may present new opportunities. Respondents recommended ensuring well supported seating and positioning and developing competencies to optimise the likelihood of success of a future trial. These competences included supporting the development of functional vision skills as well as enhancing communicative competence and confidence of both users and their communication partners through encouraging use of looking behaviors for communication such, as eye-pointing, in low-tech methods of communication and choice making. Different AAC systems and strategies require varying degrees of cognitive skill for successful use. Research with people with traumatic brain injury suggests that using a multimodal approach where the person is supported using low-tech solutions, such as eye-pointing to make choices, in addition to high-tech solutions  can help build communicative competence and confidence.
While the field of assistive technology is multidisciplinary, the majority of respondents were either occupational therapists or speech and language therapists. The findings, therefore, largely reflect the particular perspectives of these health professionals who, nevertheless, are recognised as primary agents for the support of eye-gaze control technology. Fewer people with cerebral palsy completed Rounds 1 and 2 compared to other stakeholder groups, and none completed Round 3, despite the investigators’ active engagement with consumers as part of the investigator team and Advisory Panel to co-design and optimise dissemination of the surveys. The surveys were long, time-consuming and would, undoubtedly, have been taxing to complete. The impact of the limited representation of people with cerebral palsy and their communication partners on the findings of this study is unknown. Future studies will need to diligently attend to creative and accessible means for ensuring consumers’ voices contribute to findings. Although, consumers’ responses to this Delphi study were analysed separately to preference their views, communicating the findings of this study will need to be cognisant of the near-absence of consumer contributions and perspectives. Particular attention will also need to be paid to evaluating the impact of the findings for people with cerebral palsy and their support networks to ensure that knowledge translation strategies can be responsive to their needs for information and guidance about use of eye-gaze control technology.
The Delphi surveys requested information relevant to children, adolescents and adults with cerebral palsy. Although age-group-specific information was not obtained, the respondents supported eye-gaze control technology users across all age ranges and the findings offer guidance for use across the lifespan. Evaluation of our implementation of the findings will seek to identify additional considerations for different age groups and abilities.
Attrition is a feature of Delphi studies due to the multiple rounds . The response rate declined with each round of this study, as expected, although the overall response rate of 33% in Round 3 is about 10 percentage points more than anticipated . We sent personalised links to participants and reminder emails as a strategy to enhance the response rate. The complexity and importance of the topic meant that there were a large number of statements to rate in Rounds 2 and 3, which may have been burdensome and contributed to attrition. The proportion of participants from each stakeholder group did not change appreciably across rounds, with the exception of notably fewer educators and a reduction in numbers of people with cerebral palsy from three in Round 1 to none in Round 3. The relative contribution of the various stakeholder groups to the ratings of statements is therefore likely to be similar across rounds. The impact of attrition and the few contributions from consumers on the final selection of statements is not possible to ascertain.
Participants in this Delphi process achieved consensus for 94 statements across eight domains for eye-gaze control technology implementation: its unique role in meeting the needs of a user; initial assessment; trial; learning, practise and support; follow up; outcome measures; funding considerations and preparation for eye-gaze control technology as a possible future access method. These statements will form the core of evidence- and consensus-informed clinical guidelines - the scope, content and implementation of which will further our knowledge in the field. These guidelines will be crafted in collaboration with an expanded Advisory Panel selected to ensure greater representation of consumers. The guidelines have the potential to evolve as our knowledge advances and evaluation of guidelines implementation informs subsequent iterations. The guidelines will be made freely available and accessible online and will contain specific guidance about implementation and evaluation of eye-gaze control technology for people with cerebral palsy including links to relevant evidence and resources.
Findings from the Delphi process strongly recommended that the clinical guidelines complement and support clinicians and consumers in their quest for finding, assessing and implementing eye-gaze control technology as an access method. The importance of realistic goals and a plan for implementation of eye-gaze control technology, along with provision of education and support for the user and their support network, including their communication partners were emphasised.
The findings may have relevance for other potential users of eye-gaze control technology such as people with Amyotrophic Lateral Sclerosis and Locked-in Syndrome. There are important differences between people with cerebral palsy who have sustained damage to the developing brain and these other, adult onsets, conditions in terms of the mechanism of physical disability, existence of co-morbidities (hearing, vision, epilepsy, cognition) and environmental exposures across the lifespan.
The findings from this Delphi study and the resultant clinical guidelines have the potential to further advance our knowledge of how to best support people with disabilities gain access to technology to enable participation in communication, work, education and leisure pursuits. Future research will focus on the free, online clinical guidelines and complementary resources developed from the findings of this Delphi study. Effective knowledge translation strategies, co-developed with people with cerebral palsy, their families, clinicians, funders and researchers, will be required to support and evaluate uptake of the clinical guidelines to ensure they reach and are implemented by intended stakeholders. The impact of implementing the clinical guidelines on outcomes considered meaningful by people with cerebral palsy and their communication partners is also required. Furthermore, future research to identify the relationships between functional vision and eye-gaze control, and between motor types of cerebral palsy, severity and eye-gaze control will assist clinicians to further tailor eye-gaze control technology implementation to optimise success.
Availability of data and materials
All data analysed for this study are included in Table 4 in this published article.
Augmentative and alternative communication
The Delphi process followed the principles of the guidance on conducting and reporting delphi studies
The Short form of guidance for reporting involvement of patients and the public 2
Research electronic data capture
Global research innovation and education summit on assistive technology
Goal Attainment Scale
Family impact of assistive technology scale for augmentative and alternative communication
Therapy outcome measure augmentative and alternative communication
- GMFCS E&R:
Gross motor function classification system expanded and revised
Manual ability classification system
Communication function classification system
Viking speech scale
Himmelmann K, Hagberg G, Wiklund L, Eek MN, Uvebrant P. Dyskinetic cerebral palsy: a population-based study of children born between 1991 and 1998. Dev Med Child Neurol. 2007;49(4):246–51.
Nordberg A, Miniscalco C, Lohmander A, et al. Speech problems affect more than one in two children with cerebral palsy: Swedish population-based study. Acta Paed. 2013;102(2):161–6.
Stadskleiv, K. Cognitive functioning in children with cerebral palsy. Dev Med Child Neurol 2020; 2: https://doi.org/10.1111/dmcn.14463.
Myrden A, Schudlo L, Weyand S, et al. Trends in communicative access solutions for children with cerebral palsy. J Child Neurol. 2014;29(8):1108–18.
Holmqvist E, Thunberg G, Peny DM. Gaze-controlled communication technology for children with severe multiple disabilities: parents and professionals’ perception of gains, obstacles, and prerequisites. Assist Technol. 2018;30(4):201–8.
Borgestig M, Sandqvist J, Parsons R, et al. Eye gaze performance for children with severe physical impairments using gaze-based assistive technology: a longitudinal study. Assist Technol. 2016;28(2):93–102.
Perfect E, Hoskin E, Noyek S, et al. A systematic review investigating outcome measures and uptake barriers when children and youth with complex disabilities use eye gaze assistive technology. Dev Neurorehabilit. 2019:1–15.
Van Niekerk K, Tönsing K. Eye gaze technology: a south African perspective. Disabil Rehabil Assist Technol. 2015;10(4):340–6.
Karlsson P, Wallen M. Parent perception of two eye-gaze control technology systems in young children with cerebral palsy: pilot study. Stud Health Technol Inform. 2017;242:1095–102.
Bekteshi S, Konings M, Vanmechelen I, Deklerck J, Ortibus E, Aerts J-M, et al. Eye gaze gaming intervention in children with Dyskinetic cerebral palsy: a pilot study of task performance and its relation with dystonia and Choreoathetosis. Dev Neurorehabilit. 2020:1–9.
Borgestig M, Sandqvist J, Ahlsten G, et al. Gaze-based assistive technology in daily activities in children with severe physical impairments: an intervention study. Dev Neurorehabilit. 2016:1–13.
Hornof AJ, Cavender A, editors. EyeDraw: Enabling children with severe motor impairments to draw with their eyes. Proceedings of the SIGCHI conference on Human factors in computing systems; 2005: ACM.
Karlsson P, Bech A, Stone H, et al. Eyes on communication: Trialling eye-gaze control technology in young children with dyskinetic cerebral palsy. Dev Neurorehabilit. 2019;22(2):134–40.
Man DW, Wong M-SL. Evaluation of computer-access solutions for students with quadriplegic athetoid cerebral palsy. Am J Occup Ther. 2007;61(3):355–64.
Vickers S, Istance H, Hyrskykari A. Performing locomotion tasks in immersive computer games with an adapted eye-tracking interface. ACM Trans Accessible Comput (TACCESS). 2013;5(1):2.
Najafi L, Friday M, Robertson Z. Two case studies describing assessment and provision of eye gaze technology for people with severe physical disabilities. J Assist Technol. 2008;2(2):6–12.
Clarke M, Wright J, Griffiths T, et al. A proposed framework for decision-making for assistive communication technology support: many perspectives, but one common goal. J Assist Technol. 2011.
Wilkinson KM, Mitchell T. Eye tracking research to answer questions about augmentative and alternative communication assessment and intervention. Augment Alternat Commun. 2014;30(2):106–19.
de Witte L, Steel E, Gupta S, et al. Assistive technology provision: towards an international framework for assuring availability and accessibility of affordable high-quality assistive technology. Disabil Rehabil Assist Technol. 2018;13(5):467–72.
Light J, McNaughton D. Putting people first: re-thinking the role of technology in augmentative and alternative communication intervention. Augment Alternat Commun. 2013;29(4):299–309.
Mandak K, O’Neill T, Light J, et al. Bridging the gap from values to actions: a family systems framework for family-centered AAC services. Augment Alternat Commun. 2017;33(1):32–41.
Karlsson P, Allsop A, Dee-Price BJ, et al. Eye-gaze control technology for children, adolescents and adults with cerebral palsy with significant physical disability: findings from a systematic review. Dev Neurorehabil. 2017;1:1–9.
Rytterström P, Borgestig M, Hemmingsson H. Teachers’ experiences of using eye gaze-controlled computers for pupils with severe motor impairments and without speech. Eur J Spec Needs Educ. 2016:1–14.
Borgestig M, Rytterström P, Hemmingsson H. Gaze-based assistive technology used in daily life by children with severe physical impairments: parents’ experiences. Dev Neurorehabil. 2017;20(5):301–8.
Sackett DL, Rosenberg WM, Gray JM, et al. Evidence based medicine: what it is and what it isn't; 1996. p. 71–72.
Jünger S, Payne SA, Brine J, et al. Guidance on conducting and REporting DElphi studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31(8):684–706.
Williams PL, Webb C. The Delphi technique: a methodological discussion. J Adv Nurs. 1994;19(1):180–6.
Keeney S, Hasson F, McKenna HP. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001;38(2):195–200.
Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.
Grant S, Hazlewood GS, Peay HL, et al. Practical considerations for using online methods to engage patients in guideline development. Patient Centered Outcomes Res. 2017:1–12.
Izaryk K, Skarakis-Doyle E. Using the Delphi technique to explore complex concepts in speech-language pathology: an illustrative example from children's social communication. Am J Speech-Lang Pathol. 2017;26(4):1225–35.
Toronto C. Considerations when conducting e-Delphi research: a case study. Nurs Res. 2017;25(1):10–5.
Staniszewska S, Brett J, Simera I, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Res Involv Engagem. 2017;3(1):13.
Kearney A, Williamson P, Young B, et al. Priorities for methodological research on patient and public involvement in clinical trials: a modified Delphi process. Health Expect. 2017;20(6):1401–10.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res in Psychol. 2006;3(2):77–101.
SPSS v.25. Statistical Package Social Science, SPSS for Windows; 2018.
Palisano RJ, Rosenbaum P, Bartlett D, et al. Content validity of the expanded and revised gross motor function classification system. Dev Med Child Neurol. 2008;50(10):744–50.
Eliasson A-C, Krumlinde-Sundholm L, Rösblad B, et al. The manual ability classification system (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability. Dev Med Child Neurol. 2006;48(07):549–54.
Hidecker MJC, Paneth N, Rosenbaum PL, et al. Developing and validating the communication function classification system for individuals with cerebral palsy. Dev Med Child Neurol. 2011;53(8):704–10.
Pennington L, Virella D, Mjøen T, da Graça Andrada M, Murray J, Colver A, Himmelmann K, Rackauskaite G, Greitane A, Prasauskiene A, Andersen G. Development of The Viking Speech Scale to classify the speech of children with cerebral palsy. Res Dev Disabil 2013;34(10):3202-10.
Kent-Walsh J, Murza KA, Malani MD, et al. Effects of communication partner instruction on the communication of individuals using AAC: a meta-analysis. Augment Alternat Commun. 2015;31(4):271–84.
Bailey RL, Parette HP Jr, Stoner JB, et al. Family members’ perceptions of augmentative and alternative communication device use. Lang Speech Hear Serv Sch. 2006;37(1):50–60.
de Jonge D, Layton N, Vicary F, et al. Motivations and incentives: Exploring assistive technology service delivery from the perspectives of multiple stakeholders. In: Proceedings of New Frontiers in Assistive Technol Conf (RESNA 2015): Univ South Qld; 2015.
Delacy MJ, Reid SM, Group ACPR. Profile of associated impairments at age 5 years in Australia by cerebral palsy subtype and gross motor function classification system level for birth years 1996 to 2005. Dev Med Child Neurol. 2016;58:50–6.
Deramore Denver B, Froude E, Rosenbaum P, Wilkes-Gillan S, Imms C. Measurement of visual ability in children with cerebral palsy: a systematic review. Devl Med Child Neurol. 2016;58(10):1016–29.
Colenbrander A. Assessment of functional vision and its rehabilitation. Acta Ophthalmol. 2010;88(2):163–73.
Dufresne D, Dagenais L, Shevell MI, et al. Spectrum of visual disorders in a population-based cerebral palsy cohort. Pediatr Neurol. 2014;50(4):324–8.
Deramore Denver B, Adolfsson M, Froude E, Rosenbaum P, Imms C. Methods for conceptualising ‘visual ability’as a measurable construct in children with cerebral palsy. BMC Med Res Methodol. 2017;17(1):46.
Baranello G, Signorini S, Tinelli F, Guzzetta A, Pagliano E, Rossi A, et al. Visual function classification system for children with cerebral palsy: development and validation. Dev Med Child Neurol. 2020;62(1):104–10.
Clarke M, Cooper R, Aberbach G, Woghiren A, Sargent J, Griffiths T, et al. Eye-pointing classification in non-speaking children with severe cerebral palsy. 2019. Available from: http://www.ucl.ac.uk/gaze
Lund SK, Light J. Long-term outcomes for individuals who use augmentative and alternative communication: part III–contributing factors. Augment Alternat Commun. 2007;23(4):323–35.
Boise L, White D. The family's role in person-centered care: practice considerations. J Psychosoc Nurs Ment Health Serv. 2004;42(5):12–20.
Cook AM, Polgar JM. Cook and Hussey’s assistive technologies-E-book: principles and practice: Elsevier Health Sciences; 2013.
Kent-Walsh J, Mcnaughton D. Communication partner instruction in AAC: present practices and future directions. Augment Alternat Commun. 2005;21(3):195–204.
Binger C, Ball L, Dietz A, et al. Personnel roles in the AAC assessment process. Augment Alternat Commun. 2012;28(4):278–88.
Enderby P. Introducing the therapy outcome measure for AAC services in the context of a review of other measures. Disabil Rehabil Assist Technol. 2014;9(1):33–40.
Soto G, Mu Ller E, Hunt P, et al. Professional skills for serving students who use AAC in general education classrooms: a team perspective. Lang Speech Hear Serv Sch. 2001;32(1):51–6.
Andrich R, Mathiassen N-E, Hoogerwerf E-J, et al. Service delivery systems for assistive technology in Europe: an AAATE/EASTIN position paper. Technol Disabil. 2013;25(3):127–46.
Zabala J. The SETT Framework: critical areas to consider when making informed assistive technology decisions. 1995.
Desmond D, Layton N, Bentley J, et al. Assistive technology and people: a position paper from the first global research, innovation and education on assistive technology (GREAT) summit. Disabil Rehabil Assist Technol. 2018;13(5):437–44.
Kiresuk TJ, Smith A, Cardillo JE. Goal attainment scaling: applications, theory, and measurement: Psychol Press; 2014.
Ryan SE, Renzoni AM. Family Impact Scale of Assistive Technology Scale for AAC (FIATS-AAC). 2010. [Measurement instrument].
Murphy BR, Boa S, Enderby P. Testing the reliability and validity of the therapy outcome measure for AAC. Scotland: NHS education for Scotland; 2014. [Measurement instrument].
Wallace SE. AAC use by people with TBI: affects of cognitive impairments. Perspect Augment Alternat Commun. 2010;19(3):79–86.
Nulty DD. The adequacy of response rates to online and paper surveys: what can be done? Ass Eval in Higher Educ. 2008;33(3):301–14.
We wish to express our thanks to all participants in the Delphi process for their time and support in making this research possible. We also would like to thank the wonderful Advisory Panel (Mrs Shelley Haysom-Brown, Mrs. Nicky Arthur, Mrs. Karyn Muscat, Ms. Kayla Chapman, Mr. Andreas Larsson, Mrs. Eva Holmqvist, Ms. Belinda Deramore Denver and Mrs. Sandra Masayko) - their experience and input was invaluable.
This study was generously supported by the Roger Montgomery Family Fund and Perpetual Limited.
Ethics approval and consent to participate
Ethics approval to conduct the study was obtained from Human Research Ethics Committees of Cerebral Palsy Alliance (Approval number 2018_02_03) and Australian Catholic University (2018-94R). Informed consent was obtained from all participants. To participate in the surveys the participants had to actively click on a button, within the secure online survey platform, to confirm their consent upon reading the Participant Information and Consent Form. The Participant Information and Consent Form described the study’s purpose, the importance of participants’ contribution, what to expect (number and timing of rounds), how responses would be used, confidentiality of responses, the contents of the survey, and estimated completion time.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Karlsson, P., Griffiths, T., Clarke, M.T. et al. Stakeholder consensus for decision making in eye-gaze control technology for children, adolescents and adults with cerebral palsy service provision: findings from a Delphi study. BMC Neurol 21, 63 (2021). https://doi.org/10.1186/s12883-021-02077-z
- Eye-gaze control technology
- Cerebral palsy
- Clinical decision-making
- Assistive technology
- Augmentative and alternative communication