Psychometric evaluation of the child oral impacts on daily performances (C-OIDP) for use in Turkish primary school children: a cross sectional validation study

Abstract

Background

As patient-reported outcome, the Child Oral Impacts on Daily Performances (C-OIDP) has been commonly used for assessing children’s oral health needs in order to facilitate oral health service planning. It was translated and cross-culturally adapted into Turkish in 2008. Since then, there is no study to assess its psychometric properties in Turkish child population. This cross–sectional study aimed to investigate the psychometric properties and factor structure of the Turkish version of the C-OIDP for use in Turkish primary school children.

Methods

The Turkish translated version was tested on a convenience sample of primary school children aged 11 to 12 years attending two public schools in Istanbul. Data were collected by clinical examinations, face-to-face interviews and self-completed questionnaires. The internal consistency, test–retest reliability, construct validity using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), criterion related validity (concurrent and discriminant) were evaluated.

Results

A total of 208 children were subjected to the tested the C-OIDP. Overall, 93.7% of them reported at least one oral impact in the last 3 months. The most frequently affected performances were “eating” (72.1%) and “cleaning mouth”, while the performance with the lowest impact was “studying” (13%). The internal consistency and reproducibility of the C-OIDP were acceptable, with a Cronbach’s alpha of 0.73 and an intra-class correlation coefficient of 0.83. The EFA yielded a two-factor model termed “functional limitation” and “psychosocial limitation”. CFA identified the two- factor model which fit the data better than the previously proposed three-factor model, namely physical, psychological and social health. Having malocclusion, the presence of gum disease, reported history of oral problems in the mouth, dissatisfaction with oral health, bad self-rated oral health and having a problem-oriented pattern of dental attendance were found to be the most important factors related to worse oral health- related quality of life, supporting its criterion–related validity.

Conclusion

This study provided preliminary evidence the psychometric properties of the C-OIDP index among Turkish school children aged 11–12 years. It may be applied to evaluate the oral health impact on quality of life in this population.

Peer Review reports

Background

Oral diseases and conditions, especially untreated dental caries and associated oral problems affect not only children’s oral functioning but also their general health, family life, social functioning, psychological well-being, and quality of life [1]. Oral health is recognized as being multifaceted and fundamental to overall health and quality of life. It is known that the combined use of oral health–related quality of life measures (OHRQoL), clinical and behavioural indicators in the assessments of populations’ oral health needs provides a more holistic approach for planning oral health services and setting policies which aim to promote children’s their oral health and well-being. Normative methods of assessing dental needs does not reflect non clinical aspects of oral health including its functional and psychosocial aspects. To overcome this shortcoming, OHRQoL measures have been developed to examine the perceived need for dental care and the impact of oral disorders and conditions on individual’s daily life [2, 3].

Unfortunately, there is no practical and validated OHRQoL measure that provides an opportunity to evaluate oral health needs based on their impact and severity on daily performance in the Turkish child and adolescent population [4, 5]. As a socio-dental indicator, the Child Oral Impacts on Daily Performances (C-OIDP) has been commonly used to assess children’s oral health needs in population surveys as well as in clinical studies because of being easier and short [6,7,8,9]. This scale was developed and tested in Thai children aged 11–12 years [9] and it was then translated and validated for use in many countries [10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]. This composite socio-dental indicator is based on the framework of consequences of oral impact which presents a modified version of both the International Classification of Impairments, Disabilities and Handicaps of the World Health Organization and Locker’s model and it focuses on three different levels (the impairment, the intermediate level-pain, discomfort, functional limitation and dissatisfaction with appearance, and the ultimate impacts) in the assessment of oral health consequences [9, 27]. In 2008, this scale was translated and cross-culturally adapted into Turkish through close collaboration with the developers of the C-OIDP at University College London [28]. Until now, no validation study of the translated Turkish version has been conducted in a clinical or population-based sample in Turkish children and adolescents. Before using this measure, its validation should be evaluated in target population [6, 8]. Cultural adaptation process affects the instrument’s content and construct validity at a conceptual level across different cultures. So far, there are a relatively small number of studies examining whether the C-OIDP is unidimensional or multidimensional construct [13, 20, 26, 29], although many psychometric studies have been conducted to validate of this measure in different countries. Due to the widespread international use of the OIDP, measurement invariance that is an important aspect of construct validity representing the same construct across groups within and between populations has to be evaluated in the cross-cultural studies [29, 30].

Therefore, the objectives of this study were to (1) examine the psychometric properties of the Turkish version of the C-OIDP for use in Turkish primary school children and (2) assess its construct validity using both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).

Methods

Participants

The Turkish C-OIDP was tested in a convenience sample of children aged 11 to 12 years attending two public schools located in Fatih Province of Istanbul City during the period March–April 2014. Two public schools where the school oral health promotion program were performed by the Dental Public Health Department of Istanbul University, were selected. One school was in a deprived area and the other in a semi-deprived area. A pilot study involving 52 children was carried out prior to the main study. The sample size was calculated based on a confidence level of 95%, a 5% error and an estimated prevalence of oral impact (87% of children reporting any negative oral health effect) as observed during pilot study. The required sample size was determined to be 174 children. In order to allow a 10% non-response rate, at least 191 subjects should be invited. A total of 232 schoolchildren aged 11–12 years were identified by class lists. Two hundred nineteen parents signed informed consent form for their children participation for this study. Among their children who were included in the study if they were willing to participate in this study, were free from chronic illnesses and disabilities and were present on the day of the survey.

Procedures

The study protocol was approved by the Ethics Committee of the Faculty of Medicine, the University of Istanbul (register number: 2013/1821). Parent information packs, including the consent form, the information sheet about the study and a brief socio-demographic questionnaire about themselves (e.g., age, education level, health insurance status, monthly family income and number of children in the family) were sent to all parents.

Data were collected through a clinical examination and a structured questionnaires in children. A structured interview schedule consisted of the C-OIDP, self-rated oral and general health, satisfaction with oral health, perceived oral treatment needs, oral health behaviors and socio-demographic information. The first part of the scale was conducted in a small groups of 5 children under the supervison of the the principal investigator (KP). Children selected their perceived oral health problems in last 3 months from a list of 17 oral health problems in the classroom. Children completed individually this oral list, subjective measures to assess general and oral health, their socio-demographic and behavioral characteristics. Then, they completed the second part which assessed oral impacts on 8 daily performances in face-to-face interviews conducted by the principal investigator (KP). If children reported an impact on any performance, the frequency and severity of each reported oral impact were scored. Finally, children with impacts were asked to identify the oral conditions they perceived as causes of their impacts.

Measures

The C-OIDP index was developed by Gherunpong et al. [9] to assess the oral impacts on eight daily performances: eating food (e.g.,meal, ice-cream); speaking clearly, cleaning your mouth (e.g.,rinsing your mouth, brushing your teeth);relaxing (including sleeping); maintaining your usual emotional state without being irritable; smiling, laughing and showing teeth without embarrassment; carrying out your schoolwork (e.g., going to school, learning in class, doing homework); and contact with people (e.g.,going out with friend, going to a friend’s house). Its first section consisted of self-reported questionnaire on 17 oral health-related problems experienced in the past 3 month that were marked by children. The frequency and severity of each impact were scored on a 3 point Likert scale (Frequency scores: 1- being once or twice a month, 2- three or more times a month, or once or twice a week, and 3- three or more times a week; severity scores: 1- little effect, 2 - moderate effect and 3 - severe effect). Each performance score was obtained by multiplying the frequence score by the severity score. The overall C- ODIP score was is calculated as the sum of the 8 performance scores (ranging from 0 to 72) multiplied by 100 and divided by 72 [9].

Turkish adaptation process of the C-OIDP

As part of the graduate thesis of Seda Can, the process of translation and cultural adaptation of the C-OIDP into Turkish was carried out in close collaboration with the team developed the original C-OIDP (UCL, London, UK) [28]. After obtaining permission from the developers, this process was performed according to international accepted guidelines [31, 32]. As shown in Fig. 1., this included the following steps:

  • Step 1: The C-OIDP was translated from English into Turkish by three dentists and two translators without medical background, whose first language is Turkish.

  • Step 2: In the first reconciliation meeting between the forward translators and the Turkish research team, the translated versions of the C-OIDP were reviewed and compared in order to identify any discrepancies, to quarantee cultural sensitivity and to select appropriate wording. The reconciled forward Turkish version was created following discussion and consensus.

  • Step 3- It was back- translated to English by two independent native English-speaking professional translators.

  • Step 4- In the second meeting, the expert committee composed of research team (three paediatric dentists one of who specialized in OHRQoL assessement) and four translators who examined the source and back-translated questionnaires to achieve semantic, idiomatic, experiential, and conceptual equivalence. The final back-translated version was reached by consensus. The summary report on the difficulties encountered and the making required changes during translation and adaptation process and the translated materials were then sent to the original developers of the C-OIDP at University College London for comparison. A prefinal version of C-OIDP created according to the comments made by original developers and expert panel members.

  • Step 5- This prefinal version was then pilot-tested on a convenience sample of 11 children by a resaercher in order to check the application time, applicability and understanding of its questions as well as to simplify its wording. At the end of this step, the reconciled forward Turkish version was obtained according to the comments recorded by children and expert panel. It was then sent to the original developers of the C-OIDP at University College London for approval.

Fig. 1
figure1

Flow chart describing the psychometric testing and the cross-cultural adaptation

During this process, some words and items were modified according to the comments made by the expert panel and discrepancies in translated questionnaire were resolved. There were minor translation discrepancies in the list of oral health problems. In the list of oral health problems, ‘calculus’ was translated as ‘dental calculus’, because this compound words is commonly used in our country and ‘oral ulcers’ was replaced as ‘sores in the mouth’ in Turkish version because this is more understandable to children. The first question of the second part ‘In the past three months, has any of them caused you any difficulty in (performance)?’ was translated into ‘In the past three months, has any of them caused you any problem in (performance)?. The second question about the severity of the effect was translated as ‘degree of the problem’. In the C-OIDP record form, ‘speaking clearly’ was translated as ‘understandable speaking’ to eliminate its misunderstanding.

Face and content validity were examined by the experts involved in the pilot test to assess the clarity, understandability and simplicity of the items as well as clarity of directions, appropriateness of response categories. According to the expert panel’s judgment and the pretest results, no modifications were made to apply the final Turkish version of the index. Original response options for frequecy and severity of oral impact on daily performance were kept. At this stage, it was also decided not to use the pictures [25].

Clinical examinations

Following completion of the test-retest study, the children were also clinically examined at school by the same investigator (KP) to assess their dental condition following procedures and diagnostic criteria recommended by the World Health Organization [33]. In this stage, the examiner did not give any information about oral health to the children to prevent changes in their oral health perceptions [8, 10].

The mean number of decayed, missing or filled teeth in the primary plus permanent dentition (dmft + DMFT) was calculated. Students were categorized into those who were caries free (dmft + DMFT = 0) and those with caries experience (DMFT+dmft ≥1) [29, 34]. The gingival index (GI) was used to evaluate the extent of gum disease. Children were categorized into those who had healthy gingiva (GI ≤1) and those with gingivitis (GI > 1) [16]. Malocclusion was assessed according to the Angle’s classification and children were divided into two groups: children with normal occlusion and children with with Angle’s Class I, II, and III malocclusions [35].

Socio-demographic, behavioural and subjective variables

The following socio-demographic variables were used in the study: child’s gender (male vs female), mother’s age (years) and education level (≤ 8 years vs > 8 years) [36], health insurance status (uninsured vs insured), monthly family income (Turkish Lira, TL), and number of children in the family.

The following four questions were included in this survey: satisfaction with oral health (answer ranging from “not at all” to “very satisfied”) [10, 14], perceived dental treatment need (“yes”, “no”) [9, 13, 17], self-rated oral and general health (answer ranging from excellent to poor) [11].

The measure of self- reported oral health behaviors included 4 questions: toothbrushing frequency (≥ twice a day vs ≤ once a day) [37]; use of dental floss (use vs don’t use) [38]; dental attendance patterns (regular dental check-up vs symptom-oriented) [39]; and daily between meals frequency of sugar intake (< three a day vs ≥ three a day) [37].

Data analysis

The types of validity and reliability used to evaluate the psychometric properties of the Turkish C-OIDP were summarized in Fig. 1. Reliability testing referred to internal consistency and test-retest reliability [40]. The internal consistency of the Turkish C-OIDP was assessed by Cronbach’s alpha, interitem, and item-total correlation coefficients. A Cronbach’s alpha coefficient of a scale above 0.70 and item-total correlation coefficients > 0.20 were regarded as acceptable. An item was considered for removal if its deletion resulted in a > 0.10 increase in the Cronbach’s alpha coefficient. Test-retest reliability was assessed by calculating the intraclass correlation coefficient (ICC) using the two-way random effects model for the C-OIDP score, using the data from the 52 children who were reinterviewed by the same investigator 1 week after the first interview.

The required sample size for test retest reliability was calculated based on the assumptions that the lowest acceptable ICC was 0.8 and the target ICC was 0.9, with a level of significance of 0.05 and a statistical power of 0.80. A minimum sample size of 46 children was needed [41]. Allowing for 10% of losses during follow-up, the sample size was increased to 52 participants.

To establish concurrent validity, the Turkish C-OIDP score was compared between the different groups of subjective oral and general health measures. The underlying hypothesis was that children with favourable perceptions of their oral health were more likely to report lower C-OIDP scores.

Discriminant validity was evaluated by comparing C-OIDP scores of groups that differ regarding the clinical oral health status. The underlying hypothesis was that children with dental diseases would report higher C-OIDP scores (indicating worse OHRQoL) than children free of dental diseases.

The construct validity of the C-OIDP was explored using both EFA and CFA. EFA was performed to identify the underlying dimensions of the C-OIDP. To assess the factorability of the data, Bartlett’s test of sphericity and the Kaiser- Meyer- Olkin (KMO) measure of sampling adequacy were used. Eigenvalues > 1.0, inspection of scree plot, variance > 10% and communality ≥0.30 for each item were used to determine the optimal number of factors [42].

The new structure was then confirmed and compared with existing C-OIDP models by CFA using the following goodness-of-fit indices: Chi-square degree of freedom (Chi-square/df < 5), Comparative Fit Index (CFI > 0.90), Goodness-of-Fit statistic (GFI > 0.90), Normed-fit index (NFI > 0.90), Standardised Root Mean Square Residual (SRMR< 0.08) and Root Mean Square Error of Approximation (RMSEA< 0.10) [43].

To compare directly different models, the Akaike information criterion (AIC), Bayesian information Criterion (BIC) and expected crossvalidation index (ECVI) were used. Within a set of models for the same data, models with the lowest AIC, BIC and ECVI values were regarded as the best fitting model [44, 45].

As the C-OIDP score was not normally distributed, Mann Whitney U test and Spearman rank correlation coefficient were used to analyze the data. To determine the significant predictors of children’s OHRQoL, a backward stepwise multiple linear regression was performed with the overall C-OIDP score as the dependent variable. Socio-demographic characteristics, clinical indices, oral health behaviors, subjective measures were used as independent variables. Variables with P < 0.10 in bivariate analyses were entered into the model. For all variables, standardized β coefficients were calculated. In all statistical analyses, the significance level was set to P < 0.05. Statistical analysis was performed using IBM SPSS Statistics version 19 for Windows (SPSS Inc., Chicago, IL, USA) and LISREL 9.30 student edition.

Results

Sample characteristics

A total of 208 children were subjected to the tested the C-OIDP. A total of 219 children were invited to participate in the validation study, nine children were absent on the clinical examination day and two children refused to participate during the clinical examination (response rate = 95%). There were 55.3% girls and 44.7% boys, with mean age of 11.95 (SD = 0.21). Mean age of mothers was 37.90 (SD = 7.64), 41.3% had formal school education, and 92.3% had health insurance. The mean monthly family income was TL 1497.16 ± 700.65 (or $ US 794).

The mean DMFT was 2.70 (SD = 1.49). 68.8% of children had gingivitis of varying severity, 8.7% had maloclusion, 30.8% visited dentists regularly for check-ups, 54.3% brushed their teeth ≥ twice a day, 18.8% consumed sugar-added products three or more times between meals, and 19.7% used dental floss.

The mean C-OIDP score was 13.11 (SD = 8.71). The most prevalent perceived oral problem was sensitive teeth (48.1%) followed by toothache (45.2%) (Table 1).

Table 1 Prevalence of perceived oral problems in the study population (n = 208)

Overall, 93.7% of the sample reported at least one oral impact in the last 3 months. The performances with the highest frequencies impacts were “eating” (72.1%), “cleaning mouth” (58.7%), and “smiling” (57.7%), while the performance with the lowest impact was “studying” (13%) (Table 2).

Table 2 Prevalence of oral impacts on daily performances in the study population (n = 208)

Reliability

In terms of internal reliability, the inter-item correlation coefficients among the 8 items of C-OIDP ranged between 0.15 and 0.50 (Table 3). The C-OIDP showed an acceptable reliability (Cronbach’s alpha = 0.72). Alpha value decreased when any item was deleted. Considering item-total correlations, all items were above 0.20 (Table 4). Finally, in terms of test–retest reliability, the ICC was 0.83.

Table 3 Correlation coefficients between items
Table 4 Standardised Cronbach’s alpha, item-total correlation and alpha with deleted items

Concurrent validity

In relation to concurrent validity (Table 5), children with higher C-OIDP scores were less likely to be satisfied with their mouth (P < 0.001). C-OIDP scores increased when children reported bad self-rated oral and general health (P < 0.001 in both cases). Furthermore, children who perceived a need for dental treatment had higher C-OIDP scores than those who did not have perceived need (P < 0.001).

Table 5 Findings for concurrent and discriminate validity of the C –OIDP

Discriminant validity

With regard to the discriminant validity, children with caries (P < 0.001), gingivitis (P < 0.05) and malocclusion (P < 0.001) had higher C-OIDP scores than their counterparts (Table 5).

As seen in Table 5, no significant associations were found between the C-OIDP and socio-demographic variables except for mother’s educational level (P < 0.01) and number of children in the family (P < 0.01). Regular dental attendance pattern, using dental floss, and less frequent sugar intake between meals were associated with lower C–OIDP scores.

The final regression model explained 33.1% of the variance of the overall C-OIDP score (adjusted R2 = 0.331, P < 0.001). The following factors were identified as predictive of decreased OHRQoL: having malocclusion, the presence of gum disease, having any oral problems, dissatisfaction with oral health, bad self-rated oral health and problem-oriented use of dental services (Table 6).

Table 6 Predictors of the overall C-OIDP score in stepwise multiple linear regression analysis

Factorial validity

The KMO was 0.794 and Barlett’s test of sphericity was significant (Chi-square = 267.804, df = 28;P < 0.001) indicating that the data were adequate for the factor analysis. The EFA with varimax rotation yielded a 2-factor solution that accounted for 48.417% of the total variance. The eigenvalue for the first factor was 2.164, explaining 27.056% of the variance and the eigenvalue for the second factor was 1.709, explaining 21.361% of the variance. In addition, an examination of the scree plot confirmed a two-factor structure [35]. Factor 1, named ‘ functional limitation’, consisted of 4 items (eating, understandable speaking speaking, cleaning mouth and smiling; Cronbach’s alpha = 0.67) with factor loading ranging from 0.416 to 0.824. Factor 2 comprised 4 items (sleeping, emotional status, studying and contact with people; Cronbach’s alpha = 0.51) with loadings ranging from 0.558 to 0.748 and was named ‘psychosocial limitation’ (data not shown).

The goodness-of-fit results are demonstrated in Table 7. All models did not indicate the adequate fit to the given data in terms of non-significant chi-square and RMSEA, but CFI, GFI, SRMR, and Chi-square/df were acceptable. For the one-factor model, all fit indices were acceptable except the NFI value which was slightly lower than the cutoff value of 0.90.

Table 7 Summary of fit indices of the one- factor model compared to the existing models

The results of confirmatory factor analysis for all models showed that Chi-square values were statistically significant but RMSEA values were slightly higher than the recommended level. Comparison of CFA on the existing C-OIDP models (three-factor model and one-factor model) and the new two-factor structure in the same sample indicated that the two- and three - factor models yielded acceptable fit indices, with the two -factor model performing slightly better than the three-factor model. Considering the AIC, BIC and ECVI values, the factor structure found in this study provided the best results among the evaluated models [44, 45].

Discussion

To our best knowledge, this is the first study to assess the psychometric properties of the C-OIDP in a convenience sample of primary school children. Until now, no national oral health survey on the prevalence of oral health impacts of Turkish children using a validated OHRQoL has been conducted in Turkey. Therefore, we choose to use the C-OIDP in this study as it is designed to be incorparated into oral health needs assessment [7,8,9]. Using this scale in population surveys could help professionals for planning and evaluating oral health promotion activities and oral health services for the community [7,8,9]. The validity and reliability of measure should be confirmed before quality of life is used as an outcome [46].

The Turkish C-OIDP showed acceptable internal consistency and test-retest reliability. The Cronbach’s alpha was higher than the values reported from previous studies conducted in France [10], England [11], Brazil [12], Peru [13], Spain [14], Italy [15], Chile [18], South India [20] and Moroccan [21]. The ICC was similar to the validation studies in Chile [18], France [10] and South India [20].

The face-to-face interview format was preferred for data collection, because more than half of students aged 11–12 years had difficulty responding to the questions in the second part of the C-OIDP in the pretesting of the Turkish C-OIDP. Similar approach was used in many validation studies [10,11,12,13, 15, 16, 18, 20, 22, 29] conducted in similar age groups.

As used in previous studies [10,11,12,13,14, 16,17,18,19,20,21,22,23,24, 47], we chose to use the weighted OIDP scores in this study, because this scoring method was found to be a better predictor than the unweighted scores (frequence and severity scores) for DMFT [48].

Only four validation studies examined the factor structure of the C-OIDP [13, 20, 22, 28], three used EFA only [13, 20, 26], one used both EFA and CFA [29]. Studies using only EFA [13, 29] suggested a three-factor model consisting of physical, psychological and social health components, whereas Agrawal et al. [20] and Amilani et al. [26] proposed a two factor model which represented the physical and psychosocial health components. Our study followed a similar approach that was used by Mtaya et al. [29] to identify the factor structure of the C-OIDP. We conducted firstly an EFA. The results of the EFA were then tested using CFA on the same sample to obtain an estimate of goodness of fit and to compare the extracted model to the previous model identified in the literature [29]. In our study, a two-dimensional structure was identified with EFA. The first factor reflected the impact of oral conditions on functional limitations while the second factor consisted of items reflecting the psychosocial aspects of OHRQoL. The similar two-factor structure as in Agrawal et al.’s study [20] and Amilani et al.’s study [26] were found. The findings of this study agree with previous studies [13, 20, 29], reporting that the C-OIDP has a multidimensional structure which represent in the theoretical model of oral health consequences [27]. In the study of Mtaya et al. [29], CFA indicated better fit for a three-factor solution than the two- and one-factor model of the C-OIDP. We compared a two-factor solution obtained from the EFA to a three-factor structure [29]. CFA identified the new two- factor model which fit the data better than the previously proposed three-factor model [29]. Our findings based on EFA and CFA suggest that C-OIDP is a multidimentional measure covering functional and psychosocial dimensions. These two dimensions represents the ultimate impacts of oral health consequences. This study provides insight into the underlying factor structure of the total score version of the C-OIDP [49].

Differences in factor structure between studies may be attributed to sampling differences, having various functions and meanings of the C-OIDP items in different cultures, and use of different scoring versions [26, 30, 49] Further study is required to generalise and confirm the two factor structure of the C-OIDP in a large, nationally representative sample of Turkish children.

The prevalence of oral impacts observed in this study is much greater than what was reported in earlier studies in Brazil [12], Thailand [47], France [10], Israel [19]. The most prevalent oral problem reported was sensitive teeth followed by toothache, which were similar to previous studies conducted in Brazil [12], Sudan [16], Italy [15], Israel [19], Malaysia [17], North India [24], and Moroccan [21]. In agreement with most studies [11, 12, 14, 15, 17, 18, 20,21,22, 29], we found that the performances with the highest frequencies impacts were eating, cleaning mouth and smiling; while the performances with the lowest impact were “studying” and relaxing. This is not surprising, because impacts on functional limitations and psychological well being were more prevalant than impact on social well-being social during children’s transition to adolescence [47, 50]. Similarly, some studies reported that social contact [11, 15, 17,18,19], emotional stability [14, 29] and speaking [19, 22] were the least frequently reported impacts. These differences in self- reported oral impacts may be related to childrens’ perception about health and ilness which are affected by their stage of development and social context in which they live [47, 51].

Knowledge in existing validation studies is limited, especially in terms of behavioral and socio-demographic predictors of impaired OHRQoL. In previous validation studies using multivariate analysis methods, socio-economic status, child’s age and gender, district of residence, area of residence and type of school were found be important predictors of impaired OHRQoL [15, 16, 20, 29]. In the bivariate analysis, children whose mothers had lower educational level and more children had worse OHRQoL. This may be explained by the fact that these mothers face a number of barriers to accessing oral health care for children and they have lower health literacy, resulting in worse oral health knowledge and their children’s oral health status [5].

Consistent with previous studies used bivariate analysis method, we found that use of dental floss, regular dental check-up [29], and consumption of sugars between meals [16, 29], were associated with worse OHRQoL. So far, only one study reported that the fruit intake frequency and mouthwash were significant behavioral predictors of OHRQoL [15]. In contrast to this study, we found that only routine dental attendance was an important factor of improved OHRQoL.

Consistent with previous studies, we found that perceived need for dental treatment [9,10,11,12,13,14,15, 18, 24], dissatisfaction with oral health [9, 11, 12, 14, 24, 29], having oral problems [9, 12, 14, 19, 21, 29], poor perceptions of self-rated general health [12, 29] and oral health [11,12,13, 16,17,18, 24, 29] were associated with worse OHRQoL in the bivariate analysis. However, subsequent multivariate analysis showed that SROH, satisfaction with oral health and self- reported oral problems were important subjective factors of OHRQoL. Our findings are consistent with Castro et al. [34], who reported that self-reported oral health problems explained more of the variation in OHRQoL than clinical normative measures.

In some studies, the clinical indices were used in combination with the C-OIDP index [10, 15, 16, 19, 20, 29]. Bivariate analysis revealed that presence of malocclusion, gum disease and dental caries were significantly associated with children’s OHRQoL. Only malocclusion was found to be a significant predictor of impaired OHRQoL of Turkish children in the multivariate analysis, which is consistent with previous studies employing multivariable analysis [15, 20].

This study has some limitations and strengths that must be taken into account when interpreting its results. This study provided initial support for the reliability and validity of the Turkish C-OIDP in a convenience sample of primary school children aged 11–12 years from two public schools in Istanbul. Thus, our findings could not be generalized to the population of interest. This study was conducted on students at two primary public schools, one of that located in a deprived area but others in a semi-deprived area. This could lead to bias because children from families living in poverty and deprivation are more likely to have oral diseases, resulting in reduced children’s and parents’ quality of life [1]. Future representative population-based studies are needed to understand the impacts of family socio-economic status and school-related factors on children’s OHRQoL. Due to cross-sectional design, this study did not verify any cause-effect relationship among the assessed variables and any changes in scores over time. Population-based cohort studies and further validation study in children of different age groups are needed. Future study using the Item Response Theory may provide additional information to the Classical Test Theory and allow performance assessment of individual items [8, 49]. Additional research aiming to compare psychometrically different administration modes of the Turkish C-OIDP index may be useful for selection the effective data collection mode in future epidemiological studies of child populations as well as in clinical settings [52, 53]. We did not use the intensity and extent of impacts as an alternative method of reporting the severity of oral impacts. Future studies using this scoring method may provide useful information on the extent and severity of oral health conditions in the target population when planning and evaluating oral health programmes and services [54]. Additional study using the condition-specific specific C- OIDP may provide an oppurtunity to discrimate between groups with different levels of normative treatment needs in children when planning oral heath services [55].

The CFA and EFA conducted on the same data set in this study. This approach are accepted as less informative [56]. Therefore, further research using CFA is necessary to investigate whether the factor structure can be replicated in the new dataset. The factorial structure of the OIDP in the total score version was examined in this study. Future study on understanding the cross-cultural differences in factor loadings and the impacts of use different scoring methods may provide additional insight into the interpretation of the OIDP factor structure [30, 49].

The main strengths of this study are that multivariate analysis was used to analyze the factors of OHRQoL and the factor structure of the C-OIDP was evaluated through both EFA and CFA methods. This study may provide a compherensive evaluation of the clinical, behavioural, socio-demographic and subjective factors that influence OHRQoL. Furthermore, the findings from this study revealed additional insights into the factor structure of the C-OIDP in the total score version.

Conclusions

This study provided preliminary evidence concerning validity and reliability of the Turkish C-OIDP among primary school children aged 11–12 years. Future studies should be conducted to evaluate its psychometric properties in a population based studies among children and adolescents. Using this scale may provide the opportunity for oral health professionals to identify subgroups of children at risk of poor oral health when conducting national oral health survey as well as for comparing similarities and differences in oral impacts among children in different countries.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

C-OIDP:

Child Oral Impacts on Daily Performances Index

EFA:

Exploratory factor analysis

CFA:

Confirmatory factor analysis

OHRQoL:

Oral health quality of life measures

dmft + DMFT:

The mean number of decayed, missing or filled teeth in the primary plus permanent dentition

GI:

The gingival index

TL:

Turkish Lira

ICC:

The intraclass correlation coefficient

KMO:

The Kaiser- Meyer- Olkin measure

Chi-square:

Chi-square degree of freedom

CFI:

Comparative Fit Index

GFI:

Goodness-of-Fit statistic

NFI:

Normed-fit index

SRMR:

Standardised Root Mean Square Residual

RMSEA:

Root Mean Square Error of Approximation

AIC:

Akaike information criterion

BIC:

Bayesian information Criterion

ECVI:

Expected crossvalidation index

References

  1. 1.

    Peres MA, Macpherson LMD, Weyant RJ, Daly B, Venturelli R, Mathur MR, et al. Oral diseases: a global public health challenge. Lancet. 2019;394(10194):249–60.

    PubMed  Google Scholar 

  2. 2.

    Glick M, Monteiro da Silva O, Seeberger GK, Xu T, Pucca G, Williams DM, et al. FDI vision 2020: shaping the future of oral health. Int Dent J. 2012;62(6):278–91.

    PubMed  Google Scholar 

  3. 3.

    FDI World Dental Federation. FDI policy statement on oral health and quality of life: adopted by the FDI general assembly: 24 September 2015, Bangkok, Thailand. Int Dent J. 2016;66(1):11–2.

    Google Scholar 

  4. 4.

    Gökalp SG, Doğan BG, Tekçiçek MT, Berberoğlu A, Unlüer S. National survey of oral health status of children and adults in Turkey. Community Dent Health. 2010;27(1):12–7 PMID: 20426255.

    PubMed  Google Scholar 

  5. 5.

    Topaloglu-Ak A, Eden E, Frencken JE. Managing dental caries in children in Turkey-a discussion paper. BMC Oral Health. 2009;9:32.

    PubMed  PubMed Central  Google Scholar 

  6. 6.

    Genderson MW, Sischo L, Markowitz K, Fine D, Broder HL. An overview of children's oral health-related quality of life assessment: from scale development to measuring outcomes. Caries Res. 2013;47(Suppl 1):13–21.

    PubMed  PubMed Central  Google Scholar 

  7. 7.

    Gherunpong S, Sheiham A, Tsakos G. A sociodental approach to assessing children's oral health needs: integrating an oral health-related quality of life (OHRQoL) measure into oral health service planning. Bull World Health Organ. 2006;84(1):36–42.

    PubMed  PubMed Central  Google Scholar 

  8. 8.

    Gilchrist F, Rodd H, Deery C, Marshman Z. Assessment of the quality of measures of child oral health-related quality of life. BMC Oral Health. 2014;14:40.

    PubMed  PubMed Central  Google Scholar 

  9. 9.

    Gherunpong S, Tsakos G, Sheiham A. Developing and evaluating an oral health-related quality of life index for children; the CHILD-OIDP. Community Dent Health. 2004;21(2):161–9.

    PubMed  Google Scholar 

  10. 10.

    Tubert-Jeannin S, Pegon-Machat E, Gremeau-Richard C, Lecuyer MM, Tsakos G. Validation of a French version of the child-OIDP index. Eur J Oral Sci. 2005;113(5):355–62.

    PubMed  Google Scholar 

  11. 11.

    Yusuf H, Gherunpong S, Sheiham A, Tsakos G. Validation of an English version of the child-OIDP index, an oral health-related quality of life measure for children. Health Qual Life Outcomes. 2006;4:38.

    PubMed  PubMed Central  Google Scholar 

  12. 12.

    Castro RA, Cortes MI, Leão AT, Portela MC, Souza IP, Tsakos G, et al. Child-OIDP index in Brazil: cross-cultural adaptation and validation. Health Qual Life Outcomes. 2008;6:68.

    PubMed  PubMed Central  Google Scholar 

  13. 13.

    Bernabé E, Sheiham A, Tsakos G. A comprehensive evaluation of the validity of child-OIDP: further evidence from Peru. Community Dent Oral Epidemiol. 2008;36:317–25.

    PubMed  Google Scholar 

  14. 14.

    Cortés-Martinicorena FJ, Rosel-Gallardo E, Artazcoz-Osés J, Bravo M, Tsakos G. Adaptation and validation for Spain of the child-Oral impact on daily performance (C-OIDP) for use with adolescents. Med Oral Patol Oral Cir Bucal. 2010;15(1):e106–11.

    PubMed  Google Scholar 

  15. 15.

    Bianco A, Fortunato L, Nobile CG, Pavia M. Prevalence and determinants of oral impacts on daily performance: results from a survey among school children in Italy. Eur J Pub Health. 2010;20(5):595–600.

    Google Scholar 

  16. 16.

    Nurelhuda NM, Ahmed MF, Trovik TA, Åstrøm AN. Evaluation of oral health-related quality of life among Sudanese schoolchildren using child-OIDP inventory. Health Qual Life Outcomes. 2010;8:152.

    PubMed  PubMed Central  Google Scholar 

  17. 17.

    Yusof ZY, Jaafar N. A Malay version of the child Oral impacts on daily performances (child-OIDP) index: assessing validity and reliability. Health Qual Life Outcomes. 2012;10:63.

    PubMed  PubMed Central  Google Scholar 

  18. 18.

    Vera C, Moreno X, Rivera D. Adaptation and validation of child Oral impact on daily performance index in 11-14-year-old Chilean school children. J Oral Res. 2013;2(3):119–24.

    Google Scholar 

  19. 19.

    Kushnir D, Natapov L, Ram D, Shapira J, Gabai A, Zusman SP. Validation of a Hebrew version of the child-OIDP index, an Oral health-related quality of life measure for children. Oral Health Prev Dent. 2013;11(4):323–30.

    PubMed  Google Scholar 

  20. 20.

    Agrawal N, Pushpanjali K, Garg AK. The cross cultural adaptation and validity of the child-OIDP scale among school children in Karnataka, South India. Community Dent Health. 2013;30(2):124–6.

    PubMed  Google Scholar 

  21. 21.

    Lazrak L, Bourzgui F, Serhier Z, Diouny S, Othmani MB. Cross cultural translation and adaptation of the Moroccan version of the child-oral impacts on daily performance 11–14 oral health-related quality of life. J Int Oral Health. 2017;9:236–41.

    Google Scholar 

  22. 22.

    Bjelovic L, Eric J, Stojanovic N, Krunic J, Cicmil S, Kanjevac T. Validation of the child oral impact on daily performance index among schoolchildren in Bosnia and Herzegovina: a pilot study. Med Pregl. 2017;70(1–2):12–7.

    Google Scholar 

  23. 23.

    Saujanya K, Marja-Liisa L, Manoj H, Jari P, Vuokko A. Adaptation and validation of a Nepali version of the child-Oral impacts on daily performances index (C-OIDP). Community Dent Health. 2018;35(2):119–26.

    PubMed  Google Scholar 

  24. 24.

    Dhawan P, Singh A, Agarwal A, Aeran H. Psychometric properties of Hindi version of child oral impact on daily performances (C-OIDP) index amongst school children in North India. J Oral Biol Craniofac Res. 2019;9(1):10–3.

    PubMed  Google Scholar 

  25. 25.

    Nasia AA, Arumrahayu W, Rosalien R, Maharani A, Adiatman M. Child-oral impacts on Daily Performances index in Indonesia: Cross-cultural adaptation and initial validation. MJPHM. 2019;19:68–77.

    Google Scholar 

  26. 26.

    Amilani U, Jayasekara P, Perera IR, Carter HE, Senanayake S, Kularatna S. Oral impact on daily performance (OIDP) scale for use in Sri Lankan adolescents: a cross sectional modification and validation study. BMC Oral Health. 2020;20:16.

    PubMed  PubMed Central  Google Scholar 

  27. 27.

    Locker D. Measuring oral health: a conceptual framework. Community Dent Health. 1988;5:3–18.

    PubMed  Google Scholar 

  28. 28.

    Can S, Topaloğlu-Ak A, Eden E. Turkish adaptation of an index in foreign language: child Oral impact on daily performance. J Ege Univ School Dentistry. 2009;30(2):97–103.

    Google Scholar 

  29. 29.

    Mtaya M, Astrøm AN, Tsakos G. Applicability of an abbreviated version of the child-OIDP inventory among primary schoolchildren in Tanzania. Health Qual Life Outcomes. 2007;5:40.

    PubMed  PubMed Central  Google Scholar 

  30. 30.

    Åstrøm AN, Mtaya M. Factorial structure and cross-cultural invariance of the Oral impacts on daily performances. Eur J Oral Sci. 2009;117(3):293–9.

    PubMed  Google Scholar 

  31. 31.

    Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.

    PubMed  Google Scholar 

  32. 32.

    Acquadro C, Conway K, Giroudet C, Mear I. Linguistic validation manual for patient- reported outcomes (PRO) instruments. Lyon: Mapi Research Institute; 2004.

    Google Scholar 

  33. 33.

    World Health Organization. Oral Health Surveys. Basic Methods. 4th ed. Geneva: World Health Organization; 1997.

    Google Scholar 

  34. 34.

    Castro Rde A, Portela MC, Leão AT, de Vasconcellos MT. Oral health-related quality of life of 11- and 12-year-old public school children in Rio de Janeiro. Community Dent Oral Epidemiol. 2011;39(4):336–44.

    PubMed  Google Scholar 

  35. 35.

    Angle EH. Classification of malocclusion. Dental Cosmos. 1889;41:248–64.

    Google Scholar 

  36. 36.

    Ministry of National Education- Republic of Turkey. Education in Turkey. BackgroundReport.2005.https://www.oecd.org/education/school/39642601.pdf.Accesssed 22 Feb 2017.

  37. 37.

    Public Health England (PHE). Delivering better oral health: an evidence-based toolkit for prevention. 3rd ed. London: PHE; 2014.

    Google Scholar 

  38. 38.

    Honkala S, Honkala E, Al-Sahli N. Do life- or school-satisfaction and self-esteem indicators explain the oral hygiene habits of schoolchildren? Community Dent Oral Epidemiol. 2007;35(5):337–47.

    PubMed  Google Scholar 

  39. 39.

    Montero J, Albaladejo A, Zalba JI. Influence of the usual motivation for dental attendance on dental status and oral health related quality of life. Med Oral Patol Oral Cir Bucal. 2014;19(3):e225–31. 24121918.

    PubMed  Google Scholar 

  40. 40.

    Streiner DL, Norman G. Health measurement scales: a practical guide to their development and use. New York: Oxford University Press; 1991.

    Google Scholar 

  41. 41.

    Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17(1):101–10.

    PubMed  Google Scholar 

  42. 42.

    Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. PARE. 2005;10(7):1–9.

    Google Scholar 

  43. 43.

    Hooper D, Coughlan J, Mullen MR. Structural equation modelling: guidelines for determining model fit. EJBRM. 2008;6(1):53–60.

    Google Scholar 

  44. 44.

    Brown TA. Confirmatory factor analysis for applied research. New York (NY): Guilford Press; 2006.

    Google Scholar 

  45. 45.

    Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res. 2006;99(6):323–38.

    Google Scholar 

  46. 46.

    Lam CLK. Subjective quality of life measures – general principles and concepts. In: Preedy VR, Watson RR, editors. Handbook of Disease Burdens and Quality of Life Measures. New York: Springer; 2010. p. 382–99.

  47. 47.

    Gherunpong S, Tsakos G, Sheiham A. The prevalence and severity of oral impacts on daily performances in Thai primary school children. Health Qual Life Outcomes. 2004;2:57.

    PubMed  PubMed Central  Google Scholar 

  48. 48.

    Adulyanon A, Sheiham A. Oral impacts on daily performances. In: Slade GD, editor. Measuring Oral health and quarlity of life. Chapel Hill: University of North Carolina; 1997. p. 151–60.

    Google Scholar 

  49. 49.

    Pilotto LM, Scalco GP, Abegg C, Celeste RK. Factor analysis of two versions of the Oral impacts on daily performance scale. Eur J Oral Sci. 2016;124(3):272–8.

    PubMed  Google Scholar 

  50. 50.

    Forrest CB, Bevans KB, Riley AW, Crespo R, Louis TA. Health and school outcomes during Children’s transition into adolescence. J Adolesc Health. 2013;52(2):186–94.

    PubMed  Google Scholar 

  51. 51.

    Fink R. Issues and problems in measuring children's health status in community health research. Soc Sci Med. 1989;29(6):715–9.

    PubMed  Google Scholar 

  52. 52.

    Rosel E, Tsakos G, Bernabé E, Sheiham A, Bravo M. Assessing the level of agreement between the self- and interview-administered child-OIDP. Community Dent Oral Epidemiol. 2010;38(4):340–7.

    PubMed  Google Scholar 

  53. 53.

    Tsakos G, Bernabé E, O'Brien K, Sheiham A, de Oliveira C. Comparison of the self-administered and interviewer-administered modes of the child-OIDP. Health Qual Life Outcomes. 2008;6:40.

    PubMed  PubMed Central  Google Scholar 

  54. 54.

    Bernabé E, Tsakos G, Sheiham A. Intensity and extent of oral impacts on daily performances by type of self-perceived oral problems. Eur J Oral Sci. 2007;115(2):111–6.

    PubMed  Google Scholar 

  55. 55.

    Mbawalla HS, Mtaya M, Masalu JR, Brudvik P, Astrom AN. Discriminative ability of the generic and condition-specific child-Oral impacts on daily performances (child-OIDP) by the Limpopo-Arusha school health (LASH) project: a cross-sectional study. BMC Pediatr. 2011;11:45.

    PubMed  PubMed Central  Google Scholar 

  56. 56.

    Hurley AE, Scandura TA, Schriesheim CA, Brannick MT, Seers A, Vandenberg RJ, et al. Exploratory and confirmatory factor analysis: guidelines, issues, and alternatives. J Organiz Behav. 1997;18:667–83.

    Google Scholar 

Download references

Acknowledgements

We thank all of the children and their mothers for their interest and participation in this study.

Funding

The authors received no specific funding for this work.

Author information

Affiliations

Authors

Contributions

KP conceptualized and designed the study, acquired, performed the clinical examination, interpreted the data, drafted the manuscript, and wrote the paper. GB and EE contributed to the study management and the critical review of the paper. OU was responsible for the statistical analysis. ATA made substantial contributions to review and edit of the manuscript. All authors read and approved the manuscript.

Corresponding author

Correspondence to Kadriye Peker.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained from the Ethics Committee of the Faculty of Medicine, the University of Istanbul. All parents signed an informed consent form.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Peker, K., Eden, E., Ak, A.T. et al. Psychometric evaluation of the child oral impacts on daily performances (C-OIDP) for use in Turkish primary school children: a cross sectional validation study. BMC Oral Health 20, 173 (2020). https://doi.org/10.1186/s12903-020-01162-y

Download citation

Keywords

  • Primary school children
  • C-OIDP
  • Psychometric evaluation
  • Factor structure