Preventing the onset of major depression based on the level and profile of risk of primary care attendees: protocol of a cluster randomised trial (the predictD-CCRT study)
- 6.6k Downloads
The ‘predictD algorithm’ provides an estimate of the level and profile of risk of the onset of major depression in primary care attendees. This gives us the opportunity to develop interventions to prevent depression in a personalized way. We aim to evaluate the effectiveness, cost-effectiveness and cost-utility of a new intervention, personalized and implemented by family physicians (FPs), to prevent the onset of episodes of major depression.
This is a multicenter randomized controlled trial (RCT), with cluster assignment by health center and two parallel arms. Two interventions will be applied by FPs, usual care versus the new intervention predictD-CCRT. The latter has four components: a training workshop for FPs; communicating the level and profile of risk of depression; building up a tailored bio-psycho-family-social intervention by FPs to prevent depression; offering a booklet to prevent depression; and activating and empowering patients. We will recruit a systematic random sample of 3286 non-depressed adult patients (1643 in each trial arm), nested in 140 FPs and 70 health centers from 7 Spanish cities. All patients will be evaluated at baseline, 6, 12 and 18 months. The level and profile of risk of depression will be communicated to patients by the FPs in the intervention practices at baseline, 6 and 12 months. Our primary outcome will be the cumulative incidence of major depression (measured by CIDI each 6 months) over 18 months of follow-up. Secondary outcomes will be health-related quality of life (SF-12 and EuroQol), and measurements of cost-effectiveness and cost-utility. The inferences will be made at patient level. We shall undertake an intention-to-treat effectiveness analysis and will handle missing data using multiple imputations. We will perform multi-level logistic regressions and will adjust for the probability of the onset of major depression at 12 months measured at baseline as well as for unbalanced variables if appropriate. The economic evaluation will be approached from two perspectives, societal and health system.
To our knowledge, this will be the first RCT of universal primary prevention for depression in adults and the first to test a personalized intervention implemented by FPs. We discuss possible biases as well as other limitations.
ClinicalTrials.gov identifier: NCT01151982
KeywordsDepression Primary prevention Primary health care Randomized controlled trial
Randomized controlled trial
Composite international diagnostic interview
Number needed to treat
Client Service Receipt Inventory
Quality adjusted life years
Incremental cost-effectiveness ratios
Incremental cost-utility ratios
Generalized linear models
Cost effectiveness acceptability curves.
Depression as a public health problem
In the European community, major depression is the most common single mental disorder, with a 12 month prevalence of 4% , reaching 7% in USA ; and in European primary care attendees increasing to 13.9% in woman and 8.5% in men , or 14% in Spain . A systematic review of 24 cost-of-illness studies of depression has reported that depression has substantial economic consequences for society . For example, in 2004 the total annual cost of depression in Europe was estimated to be €118 billion, or €253 per inhabitant . Major depression is projected to rank as the greatest contributor to illness burden by 2030 in high-income countries  due to its high prevalence, high impact on functioning, and early age of onset . Most suicides are committed by people with depression , and the mortality rate of depressed patients exceeds 1.65 times that of the general population . Despite effective treatments for depression, curative interventions can only reduce the disease burden of depression by 20%, because not all cases are recognized as such, and when recognized not all will receive appropriate treatment or adhere to the given treatment . From a public health point of view, besides improving the whole process of depression care , we need comprehensive approaches to depression prevention .
Risk strategies and primary prevention of depression
Primary prevention aims to reduce the incidence of new episodes of depression. When preventive measures are applied to the general population, regardless of their risk factors, primary prevention is called “universal prevention”. All randomized controlled trials (RCT) of universal prevention of depression have been conducted in children and/or adolescentes [14, 15]. If primary prevention strategies are applied to people who have risk factors for depression, then it is called “selective prevention”. Here RCT have been undertaken in children and adolescents [16, 17], elderly people [18, 19], and in adults with specific risks for depression: stroke , postpartum [21, 22, 23], cancer , diabetes , macular degeneration , patients with complex medically illnesses , caregivers of relatives with dementia , or social risk patients , among others. A particular group of people at risk of depression are those with depressive symptoms, which do not meet DSM-IV diagnostic criteria for major depression. Primary prevention in this group of 105 people who are "subclinically depressed" is referred to “indicated prevention” [30, 31, 32].
The ‘predictD’ algorithm
In recent years, our research group has developed and validated a risk algorithm (“the predictD algorithm”) to predict the onset of episodes of major depression in primary care attendees, in Europe  and Spain . The Spanish algorithm obtained good calibration and discriminative validation [C-index = 0.82 (0.79-0.84)]. From 39 known risk factors of depression, 12 were included in the Spanish prediction model: six were patient characteristics or past events (sex, age, sex*age interaction, education, childhood physical abuse, and lifetime depression) and six were current status (SF-12 physical score, SF-12 mental score, dissatisfaction with unpaid work, number of serious problems in very close persons, dissatisfaction with living together at home, and taking medication for stress, anxiety or depression). The calculator of the likelihood of becoming depressed at 12 months is accessible at http://www.rediapp.org/predict.php. The "predictD algorithm" provides, in addition to the quantification of the overall risk of depression, knowledge of those risk factors influencing a given patient and that could guide a possible preventive intervention. This could allow us, as in cardiovascular disease, to develop interventions tailored in both intensity (level of risk) and specificity (profile of risk). This type of primary prevention might be called “personalized prevention” [35, 36].
Effectiveness of primary prevention in depression
There are at least 5 systematic reviews or meta-analyses [37, 38, 39, 40, 41] of effectiveness of primary prevention in depression in children and/or adolescents. A systematic review on Australian school-based prevention for anxiety and depression  included 24 RCT of 9 intervention programs (Friends, moodGYM, Aussie Optimism, etc.). Six were universal interventions, two indicated programs and one was a treatment program. Most were associated with short-term improvements or symptom reduction at follow-up. A meta-analysis (13–4 RCT)  of school-based cognitive-behavior interventions to prevent depression (all interventions were delivered at the group level) found that they were effective for reducing depressive symptoms at 1 and 3 months (with statistical significance), but at 6 and 12 months the differences were not significant. A meta-regression of other meta-analyses  (47 RCT and 32 prevention programs) found larger effects for programs targeting high-risk individuals, samples with more females, samples with older adolescents, programs with a shorter duration and with homework assignments, and programs delivered by mental health professional interventionists versus teachers. Another systematic review  (42 RCT, relating to 28 individual school-based programs) also found that indicated programs were most effective, and teacher program leaders less effective. The most recent Cochrane meta-analysis  (15–10 RCT) concluded that the risk of having a depressive disorder post-intervention was reduced at 3, 9 and 12 months; although there was significant heterogeneity. The persistence of the findings suggests that this is real and not a placebo effect.
A recent meta-analysis (20 RCT)  focusing on prevention of postpartum depression, reported a Relative Risk of 0.68 (95% CI: 0.66-0.93). Promising interventions included the provision of intensive, professionally-based postpartum home visits, telephone-based peer support, and interpersonal psychotherapy. A meta-analysis  of psychosocial preventive interventions to reduce depressive symptoms in low socio-economic-status women (14 RCT) found an overall effect size of 0.31(95% CI:0.17-0.45). A meta-analysis (4 RCT)  identified a significant effect (Odds Ratio:0.64; 95% CI:0.42-0.98) of psychotherapy for preventing depression after stroke, but there is no evidence of efficacy of antidepressants in preventing depression (10 pharmaceuticals RCT) .
On the other hand, there are 4 meta-analyses [44, 45, 46, 47] that mixed different types of populations. The first  evaluated 7 RCT of psychological treatments for patients with subthreshold depression. The relative risk of developing a major depressive disorder in subjects who received the intervention was 0.70 (95% CI: 0.47-1.03). The second , combining 6 RCT that used cognitive-behavioral training called “coping with depression” to prevent depression, found an Incidence Rate Ratio (IRR) of 0.62 (95% CI: 0.43-0.91). The third  (19 RCT and 21 comparisons) included different types of prevention (universal:2, selective:11 and indicated:8), age (adolescents: 9 and adults:12), interventions (cognitive-behavioral:15, interpersonal:3 and others:3), format (groups:18 and individual:3), target group (postpartum:7, school:6 and other:8), and type of prevention (universal:2, selective:11 and indicated:8). The combined IRR was 0.78 (95% CI: 0.65-0.93). A fourth meta-analysis  adding 11 further RCT to the previous meta-analysis  reported an IRR of 0.74 (95% CI: 0.65-0.85).
Data suggest that interventions to prevent depression are effective, although this effect seems small or moderate and there are a number of limitations: 1) a lack of evidence on longer term follow-up; 2) many RCT had samples of insufficient size to find significant differences for the incidence of new depression cases; 3) data suggest that universal prevention has a lower effect than selective and indicated prevention, although this affirmation is only applicable for school-based interventions, since no RCT has applied universal prevention in adults; and 4) there are no conclusive data on the superiority of any one intervention. On the other hand, cost-effectiveness studies on prevention of depression are scarce [48, 49, 50], so further investigations are needed to decide on the general implementation of primary prevention programs for depression [51, 52].
Most primary prevention of cardiovascular diseases is performed in primary care and the community, while specialists (cardiologists, endocrinologists, nutritionists, etc.) play a role more focused on complicated and serious cases. This is also the case in depression. The target for primary prevention of depression is the healthy person and thus it is reasonable that primary prevention of depression is carried out in primary care and the community. However, few RCT of primary prevention of depression are conducted in primary care [28, 29, 32], and all the interventions were implemented by specialists in mental health (therapists, psychologists, psychiatric nurses, etc.).
We aim to conduct a cluster randomized trial in primary care with a new intervention to prevent the onset of major depression, based on the level and profile of risk of depression (personalized prevention), involving adult patients at low, moderate and high risk as measured by a risk algorithm (universal prevention) and implemented by family physicians (FPs). We will recruit a sample of non- depressed primary care patients that is large enough to detect a significant reduction in the incidence of new episodes of depression over 18 months. Our main outcome will be the effectiveness of this new intervention, but we will also assess its cost-effectiveness and cost-utility.
The main objective is to measure the effectiveness of a new intervention for primary prevention of major depression based on the level and profile of risk of primary care attendees. Among the secondary objectives are to evaluate the cost-effectiveness and cost-utility of the intervention versus usual care.
A multicenter randomized controlled trial, with cluster assignment by health center and two parallel arms. Two interventions will be applied: usual care in the control group and a new intervention for primary prevention of major depression based on the level and risk profile of patients. These interventions will be applied by the FPs. The main outcome is the cumulative incidence of major depression during the follow-up, with evaluations at baseline, 6, 12 and 18 months. Inferences will be made at the patient level.
The predictD-CCRT study is in compliance with the Helsinki Declaration. The predictD-CCRT study has been approved by the relevant ethics committees in each participating Spanish city: Ethics Committee on Human Research of the University of Granada, Ethics and Research Committee of Primary Health District of Malaga, Ethics Committee for Clinical Research of Sant Joan de Deu Foundation (Barcelona) (PIC CEIC-62-09), Ethics Committee for Clinical Research of Aragon (CEICA) (CP06/05/2009), Ethics Committee for Health Research of the Jaen Hospital, Ethics Committee for Clinical Research of Euskadi (CEIC-E) (03/2009), Ethics Committee for Clinical Research of the Rio Hortega Hospital of Valladolid (04/2009).
Health Centers in seven Spanish cities will participate: Malaga, Jaen and Granada in southern Spain; Valladolid in western Spain; Saragossa and Bilbao in northern Spain; and Barcelona in eastern Spain. Each health center covers a population of 15,000 to 30,000 inhabitants from a geographically defined area. The FPs in each health center work as a group, with extensive primary care teams. The Spanish National Health Service provides free medical cover to over 95% of the population. Patients can visit their doctors as often as they want without having to pay for it, even when they do so for preventive reasons. Each patient is assigned to only one FP, who has gatekeeper functions.
Sample selection of participants and exclusion criteria
From a possible total of 220 health centers in the 7 participating cities, those that do not have electronic clinical charts or have had them for less than 2 years or plan to change them in the next 18 months will be excluded. All others will be invited to participate. From those centers that agree to participate, a random sample of 10 health centers per city, 70 health centers in total, will be selected. These will then be randomized by an independent person from the research group at the coordinating center of the study (Malaga), using closed and opaque envelopes.
In each participating health center we will exclude those FPs who are unfamiliar with using the clinical chart or are planning to change their place of work in the next 18 months. We shall then invite all remaining FPs to participate and from those who agree, randomly select two per center (before randomization of centers) using closed and opaque envelopes selected by an independent person from the research group. This will mean 140 FPs will participate in the trial.
Exclusion criteria of the predictD-CCRT study
Do not have electronic clinical charts or have had them for less than 2 years
Plan to change their electronic clinical charts in the next 18 months
No consent to participate in the study
Unfamiliar with using the clinical chart
Planning to change their place of work in the next 18 months
No consent to participate in the study
Age under 18 or over 75 years
Inability to understand or speak Spanish
Severe mental disorder (psychosis, bipolar, personality disorder…)
The patient is scheduled to be out of the city more than four months during the 18 months of follow-up
Persons (representatives) who attend the surgery on behalf of the person who has the appointment
Diagnosed with major depression by the CIDI*
No consent to participate in the study
The randomization and allocation to the arms will be carried out according to the health center; that is, all FPs and patients from one health center will be included in the same arm. If the same health center has FPs in both the control and the intervention groups, the likelihood of the FPs in the control group becoming contaminated by the intervention group is high, since Spanish health centers generally work as a team. We aim to evaluate a new intervention for primary prevention of major depression, which in principle will be delivered at patient level by the FP; however, due to the nature of the intervention some components could be delivered at community level, so the contamination between patients in the control and intervention groups in the same health center is likely. Therefore we have decided on cluster randomization to avoid this possibility in patients and FPs.
The randomization of the 70 health centers to allocate them to the control or intervention groups will be done stratifying by city. Thus, we will have 35 health centers assigned to the control group and 35 to the intervention group, 5 and 5 respectively for each one of the seven cities participating in our study. The randomization will be undertaken centrally, from the coordinating center in Malaga, by an independent person outside the research group using closed and opaque envelopes.
In trials that evaluate psychosocial interventions it is not possible for professionals who provide the new intervention or for patients who receive it to be blind to it . However, in our trial those who assess outcomes (interviewers) will be different and independent from those who provide the intervention (FPs). Moreover, the interviewers will be not informed of the patient’s status in the control or intervention group. Those who perform statistical analyses will also be blind to the intervention and control codes.
The sample size was calculated assuming that the cumulative incidence of depression in the control group will be 12%  while the incidence in the intervention group will be 5 points below that 12%. The Type I error of the chosen contrast was 5% and the power 80%. The sample size obtained assuming a simple random sample would be 430 people in each group. As we will undertake a cluster randomization (by health center), and decided to have 35 health centers in the control group and 35 in the intervention group (48 patients in each health center), we obtained an effect design of 3.82, with the assumption that the intraclass correlation coefficient of the health center is 0.06 . Thus we need a sample size of 1643 patients in each trial arm, making a global sample of 3286 patients, 140 family doctors and 70 health centers. These calculations assume that the distribution of 2 FPs per health center and 24 patients per FP will be very homogeneous (coefficients of variation of cluster sizes <0.15). We also expect to increase the sample of patients recruited by FPs from 24 to 26–27, since about 10% of potential patients will have a diagnosis of major depression on CIDI at baseline and will need to be excluded.
All patients enrolled in the trial will be evaluated at baseline, 6, 12 and 18 months. Interviewers trained and independent from the FPs providing usual care or the new intervention will administer the CIDI and the other questionnaires. FPs participating in the trial will complete a self-administered questionnaire at baseline.
Our primary outcome will be the cumulative incidence of major depression during 18 months of follow-up. We will use the section of depression of the CIDI [54, 55], developed and validated by the WHO . The CIDI is a fully structured diagnostic interview that provides current diagnoses according to DSM-IV categories. We will use it to estimate the onset of major depression in each prior 6-month period (0–6, 6–12, and 12–18 months). Interviewing in this way, at baseline, 6, 12 and 18 months, we will obtain the most accurate picture of the cumulative incidence of major depression.
As secondary outcomes we will use measurements of health-related quality of life using the 12-item Short Form (SF-12) [57, 58] and the EuroQol [59, 60, 61] with evaluations at baseline, 6, 12 and 18 months. Furthermore, we will make estimates of cost-effectiveness and cost-utility (see Economic evaluation below).
Socio-demographic characteristics: province, sex, age, marital status (married/living with partner, separated, widowed, divorced or single), employment status (employed, unemployed/looking for a job, retired, unable to work, looking after family or home, in full-time education, and other), educational level (beyond secondary education, secondary education, primary education and incomplete primary education/illiterate), owner-occupier of an accommodation (owner, mortgage, rented, and other), living alone or with others .
Anxiety disorders using the anxiety section of the Primary Care Evaluation of Mental Disorders (PRIME-MD) . The Spanish version of the PRIME-MD can classify patients who test positive for panic attack, generalized anxiety disorder and other anxiety disorders . We will use a dichotomous anxiety variable to indicate when any of the three diagnoses of anxiety are present in a given patient.
Controls, demands and rewards for unpaid work, using an adapted 7 item version of the job content instrument . From the sum of the seven items, the variable is categorized in 3 (satisfied, dissatisfied and very dissatisfied).This questionnaire has previously shown good validity and reliability in Spain .
Satisfied with living together at home (5-Likert response options).
A lifetime screen for depression based on the first two questions of the CIDI .
Childhood experiences of physical abuse (5-Likert response options) .
Presence of serious physical, psychological or substance misuse problems, or any serious disability, in persons who are close friends or relations of participants. These questions can be used as 4 different items (yes/no) or as an ordinal variable (summation of the 4 questions).
Whether the participant’s mother committed suicide (yes/no) .
Perception of safety inside and outside the home using a question from the Health Surveys for England with 5-Likert response options .
Experiences of discrimination on the grounds of sex, age, ethnicity, appearance, disability, sexual orientation, and others using 7 questions (yes/no) from a European study . The answers to these seven items can also be joined in an ordinal variable.
Taking medication for anxiety, depression or stress in the previous 6 months (yes/no).
Probability of the onset of major depression at 12 months, obtained from the equation “predictD-Spain”, which has been previously validated  and is derived from a combination of some of the above variables.
Family physician variables
The FP variables will be collected through a self-administered questionnaire at baseline:
Age and gender.
Job characteristics: urban or rural clinic, type of contract (fixed or temporary/substitute), months working at the current Health Center, list size and mean time per visit.
Training: year medical degree, time working as FP (in months), postgraduate training (3 or 4 years) in family medicine (yes/no), accreditation as a FP tutor (yes/no), experience in training FPs [resident 1st year assigned (yes/no), and/or resident 3rd or 4th year assigned (yes/no)], and membership of Spanish Health & Communication group (yes/no).
Satisfaction with management of patients with mental health disorders in primary care: degree of comfort in the use of antidepressants (5-Likert response options), satisfaction with communication and care shared with the mental health team (secondary care) (5-Likert response options), satisfaction with the role of primary care nurse in mental health disorders (5-Likert response options) and satisfaction with the role of primary care social worker in mental health disorders (5-Likert response options or “I do not have social worker in my health center”).
Profile of professional practice: A three-dimensional questionnaire about professional satisfaction (4 items), workload perception (4 items), and biomedical vs. psychosocial orientation (4 items) validated in Spain .
Health center variables
From administrative records we will collect at baseline the following variables: inhabitants of the health center area (Basic Zone Area), size of the population where the health center is located, number of professionals (also by type of professionals) in the health center, population/professional ratios, and time of functioning as health center.
In line with recommendations by Groenwold , we will perform effectiveness analyses in the following ways: analysis with covariate adjustment and 2) intention-to-treat analysis by multiple imputations with covariate adjustment. We will conduct all analyses using Stata, release 12.1 .
We will use multiple imputations by chained equations  by means of the ‘ICE’ program . We will choose a number of imputations to limit the loss in power (no more than 1%) for testing the association of interest . We will undertake a sensitivity analysis to check the changes in the estimates and variances with progressive increases in the number of imputations . We will explore the plausibility of the missing at random assumption and will include in the imputation models any covariate of interest that is predictive of missingness . When we have to impute a covariate, we will also include the outcome variable in the imputation model. Standard errors will be calculated using Rubin’s rules  which take account of the variability in results between the imputed datasets, reflecting the uncertainty associated with the missing values.
We will perform multi-level logistic regressions with the cumulative incidence of depression at 18 months as the dependent variable. To test the hierarchical data structure we will use the likelihood-ratio test of the null model with health center as a random factor versus usual logistic regression. Then we will check the likelihood-ratio test of the null model with health center and FP as random factors versus the null model with only health center. We will also calculate the intraclass correlation coefficients for health center and FP.
We will include in the models the group variable (control and intervention) and will adjust for the probability of the onset of major depression at 12 months measured at baseline . Where appropriate we will adjust for unbalanced variables at baseline not included in the equation to predict the onset of major depression . We also will retain in the model the variable city because of an a priori assumption of clustering effect within city, although it has few categories (n = 7) that could be considered as random factors . From the final model we will obtain the adjusted odds ratio (OR) of the group variable and the adjusted number needed to treat, [Io = cumulative incidence in control group], to prevent a case of major depression.
Inverse probability weighting
For each patient the probability of remaining in the follow-up at 18 months will be obtained through a logistic regression model (multilevel if appropriate) with the variable ‘remaining in the follow-up’ (yes/no) as dependent variable and a set of predictor variables measured at baseline. For the effectiveness analyses with complete cases we will apply the inverse probability weighting to the final model to adjust for a possible attrition bias due to participants lost during the follow-up [84, 85], implemented through the ‘GLLAMM’ program .
The Economic Evaluation will be presented from two perspectives: 1) a Societal Perspective, including the costs of all types of health services (direct costs) and the costs that stem from production losses (indirect costs); and 2) Health System (including only direct costs). Although NICE  recommends just performing economic evaluations from the Health System perspective, we will present both due to the major impact that depression has on productivity [6, 88, 89]. The time frame of this study will be 18 months. Therefore, we will discount both costs and effects at 3.5% following NICE recommendations . All costs will be expressed in euros (€) for the reference year 2012.
We will use a modified version of the Client Service Receipt Inventory (CSRI)  to collect information about use of health care resources, use of psychotropic drugs (antidepressants, anxiolytics and hypnotic-sedatives) and lost productivity.
Direct health costs will be calculated by multiplying the number of health service units (consultations, hospital days, etc.) by their standard cost price. This unit cost will be retrieved from ‘Oblikue dataset’ (http://www.oblikue.com/). Cost of medication will be calculated by multiplying cost price per daily dose, multiplied by the number of prescription days recommended, as recalled by the patient. Information about medication costs will be obtained from the Spanish Pharmaceutical Vademecum (http://www.vademecum.es/). Indirect costs consist of the costs of absenteeism from paid work. Costs of work loss will be calculated by multiplying the days on sick leave by the minimum daily wage in Spain according to the human capital approach.
Intervention costs will include only the printed leaflet. However, we will also identify primary care visits related directly to the predictD-CCRT intervention.
The difference in the cumulative incidence of depression at 18 months will be measured as stated in the paragraph described above (‘main outcome’). Quality Adjusted Life Years. (QALYs) will be measured using the EuroQol-5D. Spanish tariffs will be used to estimate the utility of health states described by the patients [91, 92]. QALYs will be calculated by multiplying the utility by the amount of time a patient spent in a particular health state. Linear interpolation will be used for transitions between health states. QALYs will be assessed at baseline, 6, 12 and 18 months.
Cost effectiveness and cost-utility analysis
As in the effectiveness analyses, we will take two approaches to the cost-effectiveness and cost-utility analyses: 1) a complete case analysis with covariate adjustment and 2) an analysis after multiple imputations with covariate adjustment. For the first strategy we will apply the inverse probability weighting to the final model. We will calculate incremental cost-effectiveness ratios (ICER), which are calculated as incremental cost (mean cost for intervention group minus mean cost for control group) divided by incremental effectiveness (mean effect for intervention group minus mean effect for control group) . Incremental cost-utility ratios (ICUR) will be calculated in the same way. The only difference is that the effect will be the difference in QALYs. The incremental costs and incremental health effects will be modeled by generalized linear models (GLM). The modified Parks test will be used in order to select the appropriate family. In order to identify the correct link function we will compare model performance of all permutations of candidate link and variance function using different diagnostic tests such as the Pregibon Link test, the Hosmer-Lemoshow test and the Copas test . We will check the intraclass correlation coefficients and the likelihood-ratio tests with health center, FP and both as we said before. If the clustering effect is relevant, we will use robust standard errors for the cluster indicated.
Quantification of uncertainty
To estimate the uncertainty around the ICER and ICUR, we will calculate 95% confidence intervals around the mean cost differences using the non-parametric confidence interval. Bootstrapping with 5000 replications will be performed on each imputed dataset [93, 94].
Generation of cost-effectiveness planes and cost-effectiveness acceptability curves
Bootstrapped cost effect pairs will then be plotted on cost effectiveness planes and used to estimate cost effectiveness acceptability curves (CEACs). In the cost-effectiveness planes the ‘x’ axis represents the difference in effects and the ‘y’ axis the difference in costs. CEACs show the probability that a treatment is cost effective at a specific ceiling ratio, which is the amount of money society is willing to pay to gain one extra unit of effect. Willingness to pay values will range from 0€ to 100,000€ .
A number of sensitivity analyses will be conducted in order to assess the robustness of the results. Among others, these analyses will include: modification of the unit cost of different values such as primary care physician visits or nurse practitioner; modification of discount rates (from 0% to 6% as NICE recommends); modification of the cost for absenteeism (using the mean salary instead of the minimum); and modification of the cost including loss of productivity by presenteeism.
Training workshop for family physicians in the intervention group
A qualitative research study conducted prior to this RCT  found that FPs were resistant to informing their patients about their risk of depression, and also raised doubts about the validity of the predictD risk algorithm. FPs said they had little training on prevention of depression, and expressed uncertainties about what they should advise their patients. They were also fearful about the possible distress that could result in patients being informed of their risk for depression and commented on the lack of time for these preventive activities. Accordingly, the FPs will receive a 10–15 hour training workshop during working hours in the new intervention. This will enable them: 1) to interpret and make a specific and global evaluation of the risk for depression for each patient; 2) to transmit this information to the patient in an understandable and comprehensible way, without causing alarm; 3) to undertake active listening to patients about their beliefs, expectations and impact on information transmitted; 4) to provide tailored advice for each patient depending on his/her set of modifiable risk factors for depression; 5) to be able to integrate and personalize advice to give each patient based on his/her health history, previous doctor-patient relationship and bio-psycho-family-social circumstances; 6) to support those patients excessively worried by the information given. In the workshop we will use role-playing and video comments in groups in order to discuss and practice with FPs how to deal with different situations. The educational units, that we will use, are shown in Additional file 1: Annex 1. Previously, we will “train the trainers” to ensure that the training of the FPs will be performed to a minimum standard of quality and in standardized manner in each of the cities participating in the study.
Communicating the level and risk profile of depression
How patients are informed about their risk of becoming ill (cardiovascular events, hip fractures…) determines the outcome of prevention efforts [98, 99]. In the same qualitative study as mentioned above, we found that primary care patients are pleased to be informed of their risk for depression . Communicating with patients about their level and risk profile for depression is very new as until now there have been no validated risk algorithms to predict its onset [33, 34]. This is also “the starting component”, which will activate the other components of the intervention. Each FP will receive (at baseline, 6 and 12 months) a report with the information on risk from each of 24 patients not depressed at baseline (belonging to their usual patient list) who will be randomly selected and will provide informed consent to participate in the study. This report will include the likelihood of becoming depressed at 12 months and the patients’ responses to each of the risk factors included in the predictD-Spain equation . An example of a report of a patient who has 24.4% of becoming depressed at 12 months is shown in Figure 1.
If a patient has a moderate or high risk level (2nd or 3rd tertile), the FP will arrange an appointment with the patient aiming to communicate his/her risk of depression. If a patient has a low risk (1st tertile), the FP will have the option to report by telephone or face to face depending on the patient’s preferences. If a visit is scheduled, this will last approximately 10 minutes. This process of transmitting risk information will be held at baseline, 6 and 12 months. Reports will not include information about major depression diagnosis by CIDI at 6 and 12 months; although we will recommend that FPs screen for depression if the risk of depression was moderate or high at 6 and 12 months. FPs will write down on the problem list (clinical chart) the label “predictD” in order to remind them on opening their clinical charts that patients are included in the program predictD to prevent depression. This will help to ensure that when patients see their FPs, regardless of the reason for the consultation, doctors will take into account the information on their risk of depression if applicable.
Building up a tailored bio-psycho-family-social intervention to prevent depression by family physiciansUnlike psychosocial interventions developed to date to prevent depression, our intervention will be provided by FPs. With this approach we intend to draw on and integrate those usual components of primary care that could converge in the prevention of depression:
Previous knowledge and doctor-patient relationship: Family physician’s commitment to the patient has no defined end point. This continuity of the relationship and attention over time helps FPs to acquire a comprehensive understanding of the health problems, illness behavior, coping style, cultural background, and family and social context of their patients. Moreover, most patients will develop trusting relationship with their FPs. Patients will feel free to expose personal aspects of their lives in order to receive help, and FPs will need less time to know and understand particular aspects of any situation.
Establishment of a basic psychotherapeutic relationship: Many patients already consider FPs to be their primary source of mental care , although many FPs are not aware of this. Patients expressed this idea when asked about who would be the most appropriate person to communicate their risk of depression . An interview in which a FP tries to communicate adequately to the patient his/her level and risk profile of depression will encourage the patient to express his/her concerns about the circumstances and problems that, in his/her opinion, could precipitate depression. FPs will then actively listen and offer an emphatic response, gathering additional and relevant information where needed and giving any advice if appropriate. The patient and the FP could agree to schedule a new visit to continue talking about preventing depression, but the only mandatory visits that FPs will arrange are those to report the risk of depression at baseline, 6 and 12 months. These are not psychiatric interviews or formal psychotherapeutic interventions, but may give the opportunity for the patient to feel heard and understood from a cognitive and emotional standpoint . It is also intended to help the patient to be activated and empowered.
Family-oriented practice: FPs often bring a family orientation to bear in their clinical practice . It has been reported that there are up to 5 levels of family-centered medical care in primary care . We believe that the FP in our study are at the third level: FPs take an active interest in the feelings and concerns of the family in an empathic way. Family-oriented practice should be understood from the system theory, so that a change in any element of the family system could prevent depression in the patient. For example, a FP could help to improve the quality of life of a person who has the responsibility of caring for a relative with Alzheimer’s Disease and this may prevent depression . This is feasible because in Spain members of the same family usually share the same FP. Primary care patients think it is useful to involve the family and consider the family resources and the possibility of involving other family members in coping with the risk of depression .
Social prescribing and community referral by FPs: Many social and personal problems cannot be dealt with effectively by the FP and require community resources . The social dimension of the practice of primary care is the least accepted by FPs  and little is known about the effect on health of social prescribing and community referral by the FP. However, we will encourage FPs in the intervention group to become familiar with the community resources in their area. We will advise them on using centers. Moreover, we will advise them on using social prescribing in patients deemed appropriate with the aim of preventing depression. Primary care patients suggested participation in informal support groups to help them restructure their lives .
Management of physical problems: some physical problems are considered risk factors for depression, such as serious diseases (cancer, heart attack, stroke, …) [20, 24], disabling illness (blindness, deafness, arthritis, …)  and/or chronic health problems (diabetes, chronic pain, …) . Moreover, in our predictD studies [33, 34] poor physical quality of life was an important predictor of depression, and FPs will receive this information in the patient’s reports. Therefore, appropriate management of physical problems could also help prevent depression.
Offering a booklet to prevent depression
At the first intervention visit, at baseline, FPs will give patients a brief booklet (a diptych) with advice for preventing depression (Additional file 1: Annex 2).This booklet is based on the recommendations on health promotion and preventive activities of the " Spanish Family and Community Medicine Society", in its section on mental health (PAPPS) . At the end of this booklet reference is made to three websites with information for patients and relatives about depression, anxiety and insomnia .
Activating and empowering patients
People have favorable attitudes and beliefs about prevention of depression that do not conflict with evidence-based programs [100, 108]. Activating and empowering patients to act on this knowledge might lead to an increased perception of self-efficacy, which is the gateway to changing attitudes and behavior to prevent depression. Primary care patients are in favor of receiving information about their risk for depression from their FP but seeking solutions themselves, with or without the help of the FP . We will encourage FPs to invite patients to make suggestions during the interview on strategies, attitudes and behaviors they are already using to prevent depression. FPs will then positively reinforce those that in their opinion are the most appropriate to prevent depression for each patient.
Explanatory model for the prevention of depression in primary care
Differences between interventions to prevent the onset of depression evaluated so far in adults and the new intervention in primary care
Type of prevention
Selective or indicated1
Psychosocial (cognitive-behavioral, interpersonal…) or psychoeducational
Biopsychosocial (primary care orientation) and based on level and risk profile of becoming depressed (personalized)
Type of intervention
Formal (fixed rules)
Not formal (tailored rules)
Same number of sessions for all patients
Minimum of three interviews but no maximum
Same components for all patients
Number of components involved tailored
Who implements the intervention?
Therapists or specialists in mental health (psychologist, psychiatric nurse…)
Quality control of the intervention
In order to control the satisfaction and adherence to the intervention we will undertake two quality controls. The first one will be from a subjective focus. After each interview to inform patients about their risk of depression, the FPs will have to answer four questions: Have I written the label “predictD” in the clinical chart? (yes/no); what is my level of satisfaction with this interview to report the risk of depression? (5-Likert response options); would I change anything in this interview? (open answer); and observations (open answer). All patients will be asked about their overall satisfaction with their doctor (5-Likert response options); and only patients receiving the intervention will respond to the question “What is your level of satisfaction with the last interview in which your doctor informed you about your risk of depression?” (5-Likert-5 response options or “I was not informed”). The second is from an objective focus: we will review the clinical charts to confirm that FPs have included the label “predictD” on the problem list and we will also collect the number and content of visits related to the intervention.
Side effects of the intervention
It is possible that some patients will react with fear or worry when receiving information about their level and risk profile of depression, especially apprehensive patients or those that already have a high level of anxiety. If a patient does not want to receive this information he/she will not sign the consent and therefore will be excluded from the study. This will be valid for each evaluation point. As stated in component 5 of the intervention, we will train FPs to support those patients excessively worried by the information given. FPs are obliged to report any side effect that occurs during the intervention. We will also evaluate the impact of the predictD-CCRT intervention on anxiety symptoms through measurements of the PRIME-MD [63, 64] at each evaluation point of the follow-up.
The intervention for the control group
Patients in the control group will receive “usual care”; that is, the kind of care that FPs usually provide when they are unaware of the risk profile for depression in the patients. This means explicitly that the patients and FPs in the control groups will not be informed about the risk profile at any point. FPs in the control group will not receive the training workshop.
FPs who do not meet exclusion criteria will be asked to sign an informed consent form before health centers are allocated to the control or intervention group. Once the health centers are randomly assigned to the control or intervention groups, selected patients who do not meet exclusion criteria in the health centers of the control group will be asked for consent to follow-up and in the intervention group to receive the intervention and to follow-up. In each health center a research assistant will ask participants to sign informed consent forms. In brief, participants in the intervention group will be informed about the purpose of the trial, the expected duration of their participation, trial procedures, foreseeable risks or inconveniences, expected benefits, whom to contact for further information, their rights as participants, and that their participation is voluntary and that they may refuse to participate or withdraw from the trial at any time, without penalty or loss of benefits. Since the identity of patients will not be known at the time when randomization of health centers is to be carried out, it will not be possible to seek their consent in advance of randomization. Nevertheless, FPs will provide consent to participate in the trial; moreover, none of them will be involved as a researcher in this study, so there should not in theory be a conflict of interest. In view of the fact that so far there is no evidence that the new intervention being evaluated in this study is effective, and given that it is generally the responsibility of FPs to put the medical interests of their patients above all other considerations, this may be an appropriate choice .
Strengths and limitations
To our knowledge, this is the first RCT of universal primary prevention for depression in adults and the first to test a personalized intervention implemented by FPs. We will recruit a large sample of patients and will continue the follow-up for 18 months. We will use a structured interview (CIDI) to exclude patients with major depression at baseline and to assess the cumulative incidence of major depression during follow-up. However, our study also has several limitations.
The cluster randomization by health center will minimize possible contamination bias. However, some degree of contamination could happen, since health centers of both control and intervention arms are located in the same city. This bias will be against the hypothesis of the study. The cluster randomization might produce a good balance between groups (health center); however, this does not guarantee a good balance at other levels  (FPs and patients). We will check at baseline the imbalance at the three levels and will adjust for it when appropriate. This and the adjustment at baseline for the likelihood of becoming depressed at 12 months will reduce our confounding bias.
As mentioned before, because we evaluate a psychosocial intervention, it is not possible for the FPs who provide it and patients that receive it to be blind , so FPs and patients can change their behavior because they feel observed and included in the intervention group (Hawthorne bias). FPs of the control group could also change their behavior, but it is less likely in patients from this group because they will only give their informed consent for the follow-up.
If many health centers and FPs refuse to participate, we could encounter a selection bias as the FPs who choose to participate may have a different profile (psychosocial orientation, different training and work satisfaction, etc.) to those who do not. This could limit external validity  and, from a pragmatic standpoint, the new intervention would be less effective when applied as a general program. Similar biases could occur if a large proportion of patients refuse to participate. It is not easy to obtain information from those physicians and patients who refuse to participate, so it will be difficult to ascertain the direction of this possible selection bias. As stated above, for the analyses with complete cases we will use the inverse probability weighting [84, 85] to adjust for a possible attrition bias due to participants lost during the follow-up. We will use multiple imputations to minimize attrition bias and maintain statistical power [78, 111].
The results obtained will be applicable to primary care attendees and cannot necessarily be generalized to other settings such as the general population. Nevertheless, primary care is an ideal setting for prevention and attendees are generally (because of health and social problems) at greater risk of depression than the general population.
If the predictD-CCRT intervention proves effective, it will be difficult to determine which of the 5 components are active or expendable, and how each interacts with the others. We will conduct a number of secondary analyses that could provide clues to the most relevant component, but more studies (quantitative and qualitative) specifically directed toward that goal will be needed.
All these authors are research members of the Spanish Network of Primary Care Research (redIAPP), which is financed by the Institute of Health Carlos III (ISCIII): JAB, SCC, PMP, MK, CMP, MIBR, ARB, DNC, JMAR, ARM and JDL from “the Mental-Health, Services and Primary Care (SAMSERAP) Malaga group”; CMA, ERS and PMG from “the Castilla-Leon group”; ASB, AF, DP, JM, and LSC from “the Mental Health (SJD) Barcelona group”; JMA, MCG, and MEC from “the Bizkaya group”; and CMF, PLF and FZ from “the Aragon group”.
The authors thank the Primary Care District of Malaga, particularly Maximiliano Vilaseca, for their support. We also thank the Institute of Health Carlos III (ISCIII), the Andalusian Public Foundation for Health and Biomedicine Research in Malaga (FIMABIS) and the Spanish Network of Primary Care Research (redIAPP) for their economic and logistical support.
This work was supported by grants from the Spanish Ministry of Health, the Institute of Health Carlos III (ISCIII) and the European Regional Development Fund (ERDF) [grant references: PS09/02272, PS09/02147, PS09/01095, PS09/00849 and PS09/00461]; the Andalusian Council of Health [grant reference: PI-0569-2010]; the Spanish Network of Primary Care Research “redIAPP” (RD06/0018), the “Aragón group” (RD06/0018/0020), the “Bizkaya group” (RD06/0018/0018), the Castilla-León Group (RD06/0018/0027), the Mental Health (SJD) Barcelona Group (RD06/0018/0017) and the Mental-Health, Services and Primary Care (SAMSERAP) Málaga group” (RD06/0018/0039).
- 1.The ESEMeD⁄MHEDEA 2000 Investigators: Prevalence of mental disorders in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand. 2004, 109 (Suppl. 420): 21-27.Google Scholar
- 3.King M, Nazareth I, Levy G, Walker C, Morris R, Weich S, Bellón JA, Moreno B, Svab I, Rotar D, Rifel J, Maaroos HI, Aluoja A, Kalda R, Neeleman J, Geerlings MI, Xavier M, de Almeida MC, Correa B, Torres-González F: Prevalence of common mental disorders in general practice attendees across Europe. Br J Psychiatry. 2008, 192: 362-367. 10.1192/bjp.bp.107.039966.PubMedGoogle Scholar
- 7.Mathers CD, Loncar D: Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med. 2006, 3: 442-10.1371/journal.pmed.0030442.Google Scholar
- 9.Marquet RL, Bartelds AIM, Kerkhof AJFM, Schellevis FG, Van der Zee J: The epidemiology of suicide and attempted suicide in Dutch general practice 1983–2003. BMC Fam Pract. 2005, 6: 1-7. 10.1186/1471-2296-6-1.Google Scholar
- 13.Prevention of depression and suicide. Consensus paper. Edited by: Wahlbeck K, Mäkinen M. 2008, Luxembourg: European CommunitiesGoogle Scholar
- 14.Pössel P, Baldus C, Horn AB, Groen G, Hautzinger M: Influence of general self-efficacy on the effects of a school-based universal primary prevention program of depressive symptoms in adolescents: a randomized controlled follow-up study. J Child Psychol Psychiatry. 2005, 46: 982-994. 10.1111/j.1469-7610.2004.00395.x.PubMedGoogle Scholar
- 16.Clarke GN, Hornbrook M, Lynch F, Polen M, Gale J, Beardslee W, O’Connor E, Seeley J: A randomized trial of a group cognitive intervention for preventing depression in adolescent offspring of depressed parents. Arch Gen Psychiatry. 2001, 58: 1127-1134. 10.1001/archpsyc.58.12.1127.PubMedGoogle Scholar
- 19.van’t Veer-Tazelaar PJ, van Marwijk HWJ, van Oppen P, Hein PJ, van Hout HPJ, van der Horst HE, Cuijpers P, Smit F, Beekman ATF: Stepped-care prevention of anxiety depression in late life: a randomized controlled trial. Arch Gen Psychiatry. 2009, 66 (3): 297-304. 10.1001/archgenpsychiatry.2008.555.PubMedGoogle Scholar
- 20.Hackett ML, Anderson CS, House AO, Halteh C: Interventions for preventing depression after stroke. Cochrane Database Syst Rev. 2008, CD003689-3Google Scholar
- 21.Dennis CL: Psychosocial and psychological interventions for prevention of postnatal depression: systematic review. BMJ. 2005, 3031 (7507): 15-Google Scholar
- 22.Howard LM, Hoffbrand S, Henshaw C, Boath L, Bradley E: Antidepressant prevention of postnatal depression. Cochrane Database Syst Rev. 2005, CD004363-2Google Scholar
- 28.Mittelman MS, Brodaty H, Wallen AS, Burns A: A 3 Country Randomized Controlled Trial of a Psychosocial Intervention for Caregivers Combined with Pharmacological Treatment for Patients with Alzheimer’s Disease: Effects on Caregiver Depression. Am J Geriatr Psychiatry. 2008, 16 (11): 893-904. 10.1097/JGP.0b013e3181898095.PubMedPubMedCentralGoogle Scholar
- 30.Wells K, Sherbourne C, Duan N, Unützer J, Miranda J, Schoenbaum M, Ettner SL, Meredith LS, Rubenstein L: Quality improvement for depression in primary care: Do patients with subthreshold depression benefit in the long run?. Am J Psychiatry. 2005, 162: 1149-1157. 10.1176/appi.ajp.162.6.1149.PubMedGoogle Scholar
- 33.King M, Nazareth I, Levy G, Walker C, Royston P, Weich S, Bellón JA, Moreno-Küstner B, Svab I, Rotar D, Rifel J, Maaroos HI, Aluoja A, Kalda R, Neeleman J, Geerlings MI, Xavier M, Carraça I, Gonçalves-Pereira M, Vicente B, Saldivia S, Melipillan R, Torres-Gonzalez F, Nazareth I: Development and validation of a risk prediction algorithm for episodes of major depression in European general practice attendees: the PREDICT study. Arch Gen Psychiatry. 2008, 65 (12): 1368-1376. 10.1001/archpsyc.65.12.1368.PubMedGoogle Scholar
- 34.Bellón JA, Luna JD, King M, Moreno-Küstner B, Nazareth I, Montón-Franco C, GildeGómez-Barragán MJ, Sánchez-Celaya M, Díaz-Barreiros MÁ, Vicens C, Cervilla JA, Svab I, Maaroos HI, Xavier M, Geerlings MI, Saldivia S, Gutiérrez B, Motrico E, Martínez-Cañavate MT, Oliván-Blázquez B, Sánchez-Artiaga MS, March S, del Mar M-GM, Vázquez-Medrano A, Moreno-Peral P, Torres-González F: Predicting the onset of major depression in primary care: international validation of a risk prediction algorithm from Spain. Psychol Med. 2011, 41 (10): 2075-2088. 10.1017/S0033291711000468.PubMedGoogle Scholar
- 36.Golubnitschaja O, Costigliola V, EPMA: General Report & Recommendations in Predictive, Preventive and Personalized Medicine 2012: White Paper of the European Association for Predictive, Preventive and Personalized Medicine. EPMA J. 2012, 3: 14-10.1186/1878-5085-3-14. http://www.epmajournal.com/content/3/14,PubMedPubMedCentralGoogle Scholar
- 38.Kavanagh J, Oliver S, Lorenc T, Caird J, Tucker H, Harden A, Greaves A, Thomas J, Oakley A: School-based cognitive-behavioural interventions: A systematic review of effects and inequalities. Health Sociol Rev. 2009, 18: 61-78. 10.5172/hesr.18.1.61.Google Scholar
- 41.Merry SN, Hetrick SE, Cox GR, Brudevold-Iversen T, Bir JJ, McDowell H: Psychological and educational interventions for preventing depression in children and adolescents. Cochrane Database Syst Rev. 2011, Art. No.: CD003380-12Google Scholar
- 42.Dennis CL, Dowswell T: Psychosocial and psychological interventions for preventing postpartum depression. Cochrane Database Syst Rev. 2013, CD001134-2Google Scholar
- 49.Van’t Veer-Tazelaar P, Smit F, van Hout H, van Oppen P, van der Horst J, Beekman A, van Marwijk H: Cost-effectiveness of a stepped care intervention to prevent depression and anxiety in late life: randomised trial. Br J Psychiatry. 2010, 196 (4): 319-325. 10.1192/bjp.bp.109.069617.PubMedGoogle Scholar
- 50.Mihalopoulos C, Vos T, Pirkis J, Smit F, Carter R: Do indicated preventive interventions for depression represent good value for money?. Aust NZ J Psychiatr. 2011, 45 (1): 36-44. 10.3109/00048674.2010.501024.Google Scholar
- 52.Reinolds CF: Prevention of depressive disorders: a brave new world. Depress Anxiety. 2009, 26: 1062-1065. 10.1002/da.20644.Google Scholar
- 54.Robins LN, Wing JK, Wittchen HU, Helzer JE, Babor T, Burke J, Farmer A, Jablenski A, Pickens R, Regier DA, Sartorius N, Towle LH: The Composite International Diagnostic Interview. An epidemiologic instrument for use in conjunction with different diagnostic systems and in different cultures. Arch Gen Psychiatry. 1988, 45: 1069-1077. 10.1001/archpsyc.1988.01800360017003.PubMedGoogle Scholar
- 55.Rubio-Stipec M, Bravo M, Canino G: The Composite International Diagnostic Interview (CIDI): an epidemiologic instrument suitable for using in conjunction with different diagnostic systems in different cultures [Article in Spanish]. Acta Psiquiatr Psicol Am Lat. 1991, 37: 191-204.PubMedGoogle Scholar
- 56.World Health Organization (WHO): Composite International Diagnostic Instrument (CIDI). Version 2.1. 1997, Geneva: World Health OrganizationGoogle Scholar
- 58.Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, Bullinger M, Kaasa S, Leplege A, Prieto L, Sullivan M: Cross-validation of item selection and scoring for the SF-12 Health Survey in nine countries: results from the IQOLA Project. International Quality of Life Assessment. J Clin Epidemiol. 1998, 51: 1171-1178. 10.1016/S0895-4356(98)00109-7.PubMedGoogle Scholar
- 59.The EuroQol Group: EuroQol–a new facility for the measurement of health-related quality of life. Health Policy. 1990, 16 (3): 199-208.Google Scholar
- 61.Badia X, Roset M, Montserrat S, Herdman M, Segura A: The Spanish version of EuroQol: a description and its applications. European Quality of Life scale. [Article in Spanish]. Med Clin (Barc). 1999, 112 (Suppl 1): 79-85.Google Scholar
- 62.Bellón JA, Moreno B, Torres-González F, Montón-Franco C, GildeGómez-Barragán MJ, Sánchez-Celaya M, Díaz-Barreiros MA, Vicens C, Luna JD, Cervilla JA, Gutierrez B, Martínez-Cañavate MT, Olivan-Blázquez B, Vázquez-Medrano A, Sánchez-Artiaga MS, March S, Motrico E, Ruiz-García VM, Brangier-Wainberg PR, Muñoz-García MD, Nazareth I, King M, predict D group: Predicting the onset and persistence of episodes of depression in primary health care. The predictD-Spain study: methodology. BMC Pub Health. 2008, 8: 256-10.1186/1471-2458-8-256.Google Scholar
- 64.Baca E, Saiz J, Agüera L, Caballero L, Fernández-Liria A, Ramos J, Gil A, Madrigal M, Porras A: Validation of the Spanish version of PRIME-MD: a procedure for diagnosing mental disorders in primary care. [Article in Spanish]. Actas Españolas de Psiquiátricas. 1999, 27: 375-383.Google Scholar
- 65.Karasek R, Theorell T: Healthy work stress, productivity and the reconstruction of working life. 1990, New York: Basic BooksGoogle Scholar
- 69.Sproston K, Primatesta P: Health Survey for England. Volume 1: The health of children and young people. 2003, London: The Stationery OfficeGoogle Scholar
- 71.King M, Weich S, Torres F, Svab I, Maaroos H, Neeleman J, Xavier M, Morris R, Walker C, Bellon JA, Moreno B, Rotar D, Rifel J, Aluoja A, Kalda R, Geerlings MI, Carraca I, Caldas de Almeida M, Vicente B, Saldivia S, Rioseco P, Nazareth I: Prediction of depression in European general practice attendees: the PREDICT study. BMC Public Health. 2006, 6 (1): 6-10.1186/1471-2458-6-6.PubMedPubMedCentralGoogle Scholar
- 73.Francis LJ, Brown LB, Philipchalk R: The development of an abbreviated form of the Revised Eysenck Personality Questionnaire (EPQR-A): Its use among students in England, Canada, the U.S.A and Australia. Pers Indiv Differ. 1992, 1: 443-449.Google Scholar
- 74.Forrest S, Lewis CA, Shevlin M: Examining the factor structure and differential functioning of the Eysenck Personality Questionnaire Revised-Abbreviated. Pers Indiv Differ. 2000, 29: 579-588. 10.1016/S0191-8869(99)00220-2.Google Scholar
- 75.Sandin B, Valiente RM, Chorot P, Olmedo M, Santed MA: Spanish versión of the Eysenck Personality Questionnaire-Revised (EPQR-A) (I): Exploratory factor analysis [Article in Spanish]. Revista de Psicopatología y Psicología Clínica. 2002, 7 (3): 195-205.Google Scholar
- 77.Corporation STATA: Stata Statistical Software, Release 12. 2011, Texas: College StatationGoogle Scholar
- 78.White IR, Royston P, Wood AM: Multiple imputation using chained equations: Issues and guidance for practice. Statist Med. 2011, 30: 377-399. 10.1002/sim.4067.Google Scholar
- 79.Royston P: Multiple imputation of missing values: update of ice. Stata J. 2005, 5: 527-536.Google Scholar
- 81.Rubin D: Multiple imputation for nonresponse in surveys. 1987, New York: WileyGoogle Scholar
- 83.Snijders TAB, Bosker RJ: Multilevel Analysis. An Introduction to Basic and Advanced Multilevel Modelling. 1999, London: Sage PublicationsGoogle Scholar
- 85.Bellón JA, Luna JD, Moreno B, Montón-Franco C, Gildegómez-Barragán MJ, Sánchez-Celaya M, Díaz-Barreiros MA, Vicens C, Motrico E, Martínez-Cañavate MT, Olivan-Blázquez B, Vázquez-Medrano A, Sánchez-Artiaga MS, March S, Muñoz-García MD, Moreno-Peral P, Nazareth I, King M, Torres-González F: Psychosocial and sociodemographic predictors of attrition in a longitudinal study of major depression in primary care : the predictD-Spain study. J Epidemiol Community Health. 2010, 64: 874-884. 10.1136/jech.2008.085290.PubMedGoogle Scholar
- 86.Rabe-Hesketh S, Skrondal A: Multilevel and Longitudinal Modeling Using Stata. Volumen II: Categorical Responses, Counts, and Survival. 2012, College Station, Texas: STATA Press, 3Google Scholar
- 87.National Institute for Health and Clinical Excellence: Guide to the Methods of Technology Appraisal. 2008, London: NICE, Update: http://www.nice.org.uk/media/955/4F/Clarification_to_section_5.6_of_the_Guide_to_Methods_of_Technology_Appraisals.pdf Google Scholar
- 88.Steward WF, Ricci JA, Chee E, Hahn SR, Morganstein D: Cost of lost productive work time among US workers with depression. JAMA. 2003, 289: 3135-3144. 10.1001/jama.289.23.3135.Google Scholar
- 90.Knapp M, PSSRU and Centre for Economics of Mental Health IoP, University of Kent: Economic Evaluation of Mental Health Care. 1995, UK: Ashgate Publishing GroupGoogle Scholar
- 93.Glick HA, Doshi JA, Sonnad SS, Polsky D: Economic evaluation in clinical trials. 2007, Oxford: Oxford University PressGoogle Scholar
- 94.Efron B: Missing data, imputation, and the bootstrap. J Am Stat Assoc. 1994, 89: 463-475. 10.1080/01621459.1994.10476768.Google Scholar
- 96.Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: MRCGoogle Scholar
- 97.Moreno-Peral P, Bellón JA, Motrico E, Moreno-Küstner B, Oliván-Blázquez B, Fernández A, Fernández-Alonso C, Rüntel A, Rodríguez-Bayón A, Ballesta-Rodríguez MI, Payo-Gordón J, Amezcua M: Primary prevention in depression: How to inform primary care attendees about their risk level and risk profile of major depression?. Eur Psychiatry. 2010, 25 (Suppl.1): 922-Google Scholar
- 100.Jorm AF, Christensen H, Griffiths KM: The public's ability to recognize mental disorders and their beliefs about treatment: changes in Australia over 8 years. Aust NZ J Psychiatr. 2006, 40: 36-41. 10.1080/j.1440-1614.2006.01738.x.Google Scholar
- 101.Stuart MR, Lieberman JA: The fifteen minute hour: Applied psychotherapy for the primary care physician. 1993, Westport: Praeger Publishers, 2Google Scholar
- 102.McDaniel S, Campbell TL, Hepworth J, Lorenz A, Satcher D: Family-Oriented Primary Care. A manual for medical provider. 2004, New York: Springer-Verlag, 2Google Scholar
- 107.Library of Clinical Practice Guidelines of the National Health System, guiasalud.es: http://portal.guiasalud.es/web/guest/informacion-pacientes,
- 109.Hayes RJ, Moulton LH: Cluster Randomized Trials. 2009, NewYork: Chapman & Hall/CRCGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/13/171/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.