The protocol for the Families First Edmonton trial (FFE): a randomized community-based trial to compare four service integration approaches for families with low-income
- 1.2k Downloads
Families with low incomes experience an array of health and social challenges that compromise their resilience and lead to negative family outcomes. Along with financial constraints, there are barriers associated with mental and physical health, poorer education and language. In addition, vulnerable populations experience many services as markedly unhelpful. This combination of family and service barriers results in reduced opportunities for effective, primary-level services and an increased use of more expensive secondary-level services (e.g., emergency room visits, child apprehensions, police involvement). A systematic review of effective interventions demonstrated that promotion of physical and mental health using existing service was critically important.
The Families First Edmonton Trial (FFE) tests four service integration approaches to increase use of available health and social services for families with low-income. It is a randomized, two-factor, single-blind, longitudinal effectiveness trial where low-income families (1168) were randomly assigned to receive either (1) Family Healthy Lifestyle plus Family Recreation service integration (Comprehensive), (2) Family Healthy Lifestyle service integration, (3) Family Recreation service integration, or (4) existing services. To be eligible families needed to be receiving one of five government income assistance programs. The trial was conducted in the City of Edmonton between January 2006 and August 2011. The families were followed for a total of three years of which interventional services were received for between 18 and 24 months. The primary outcome is the number of family linkages to health and social services as measured by a customized survey tool “Family Services Inventory”. Secondary outcomes include type and satisfaction with services, cost of services, family member health, and family functioning. Where possible, the measures for secondary outcomes were selected because of their standardization, the presence of published norming data, and their utility as comparators to other studies of low-income families. As an effectiveness trial, community and government partners participated in all committees through a mutually agreed upon governance model and helped manage and problem solve with researchers.
Modifications were made to the FFE trial based on the pragmatics of community-based trials.
Trial registration number
KeywordsLow-income families Service integration Healthy families Recreation Pragmatic trial
Community-university partnership for the study of children, youth, and families
Epidemiology coordinating and research centre
- EQ VAS
EQ visual analogue scale
Families first edmonton trial
Family services inventory
Governments of Canada strategic reference models
National longitudinal study of children and youth
Randomized controlled trial
Request for proposal
When the bough breaks.
A pervasive challenge faced by Canadian health and social service providers is to promote health for vulnerable populations in a proactive and cost-effective manner. Indeed, families with low incomes continue to experience an array of health and social barriers that compromise their resilience, leading to negative family outcomes, and inhibiting access to available services. The relation between low income and poor health is well known. In a recent systemic review, researchers found higher rates of mental health problems among children with low socioeconomic status . The Canadian infant mortality rate is two-thirds higher in low-income neighbourhoods than in the highest income neighbourhoods . Low-income Canadian children are more likely than their higher-income peers to suffer from ill health and mental illness , to be hospitalized , to have lower levels of cognitive scores and educational attainment , to have compromised memory and self-regulation , and to experience major behavioural problems [6, 7, 8, 9, 10, 11, 12, 13, 14, 15]. Living with a low income compromises parental health and ability to parent, threatens family resilience, and jeopardizes family-community relations [16, 17]. The health of low-income parents influences their ability to attain and maintain employment [18, 19, 20, 21, 22, 23]. In addition, the constraint in public expenditure and commensurate movement away from universal services , which began in the 1990s, continues to affect those living with low incomes the most.
Low-income and the social determinants of health
Based on decades of inquiry, the World Health Organization , the Public Health Agency of Canada , and the Canadian Medical Association  have agreed that health and well-being are largely shaped by social and economic contextual factors, which are collectively referred to as the “social determinants of health.” Contextual factors such as low educational attainment and low-wage precarious employment negatively influence the health of low-income families and their members by limiting their capacity to (a) increase their income and (b) obtain and use health and social services.
Despite growth in the Canadian economy during the mid 2000s, which resulted in an increase in jobs and a decline in unemployment rates , the incidence of low income among Canadian families remains essentially unchanged [29, 30]. Further, in Canada, having work does not preclude having a low income. For instance, in two-parent families with one earner, 23% have low incomes . In female-headed single-parent families where the mother is employed, 43% are living on low incomes . In Edmonton, the site of the study, 18.5% of families and 26.5% of children have low income . Provincially, decision-makers are interested in providing services to low-income families that are both beneficial and cost effective  (e.g. Alberta’s Social policy framework  and the Results-based Budgeting initiative ).
Moving social assistance recipients from welfare to employment was a main goal of the 1990s social policy reform across Canada. In these programs low-income recipients of social assistance are required to get jobs or engage in employability programs [37, 38, 39, 40]. Evaluative studies of welfare-to-work initiatives in Canada and the U.S. [21, 22, 41, 42, 43, 44] suggest that policy efforts to move parents from social assistance to employment have been successful [22, 42, 44, 45] but do little to ameliorate the negative health consequences of living on a low income. That is, welfare-to-work programs seem to influence parents’ health and children’s development only when increased parental employment is accompanied by increases to family income [17, 22, 41, 44]. There are two ways to increase income in working families: increase income from employment and provide income supplements, such as the Self-Sufficiency Project [42, 44]. The majority of parents who move from social assistance to employment plus income supplement continue to have family incomes below low-income cut-offs. Furthermore, their income tends to decline when supplements end [42, 44, 46]. Finally, the evidence is mixed on the effects of welfare-to-work programs on children [17, 22, 41, 44, 47].
Evaluation studies of welfare-to-work continue  but controversy remains [49, 50, 51] because of the many unintended consequences of these programs. Insights from recent studies reveal that single low-income parents face significant day-to-day challenges when integrating work and family demands, such as arranging child care . Further, the transition from welfare to work emphasises economic issues (lack of health benefits) that are a root cause of welfare dependency .
Obtaining health and social services
Since welfare-to-work initiatives, with or without income supplements, do not impact health in low-income families in a sustainable way, there is a need for interventions that are directly guided by the goal of enhancing health. The benefits of participating in health and social programs are well documented [46, 54, 55, 56, 57, 58]. A consistent relation exists between family socioeconomic status and engagement/retention rate of families in health, social, educational, leisure, and cultural activities [7, 8, 59, 60, 61].
Barriers to the use of community-based health and recreation services cause low-income families to use primary health prevention and promotion services, including community resources and recreation, less often than other income groups [46, 62, 63, 64, 65]. For these families, personal barriers include (a) financial constraints, (b) under or unemployment, (c) mental and physical health problems, and (d) challenges to quality of life, such as communication difficulties associated with poor education and language barriers [66, 67, 68, 69, 70]. Families that overcome personal barriers often face barriers at the system level that include: fragmentation; narrowness of mandate; power differential created by provider expertise; and difficulty in access because of location, language, and hours of availability. Such service barriers lead to suboptimal outcomes and use of more expensive downstream societal resources.
In summary, low-income families face barriers to increasing their income and to obtaining a broad range of health and social services, thus negatively influencing their health and social outcomes. The evidence reviewed indicates that increasing access to service may be a direct and sustainable way to improve health and social outcomes in low-income families. An important goal for Canadian society must be to develop service-delivery policies and practices that reduce barriers to linkages between services and families in need, while being cost effective. This study focused on service integration approaches that actively link low-income families to healthy family lifestyle (e.g., health services, child care/schools, social supports) and to recreation.
Families first Edmonton trial
In the Families First Edmonton (FFE) trial, we randomized 1168 low-income families into four service integration approaches to test proactive linkages between low-income families and services existing in their communities.
Family healthy lifestyle and family recreation as service integration approaches
FFE was initiated after findings from When the Bough Breaks (WTBB), an award-winning Canadian study , were published. That study showed that that providing low-income families on social assistance with proactive comprehensive care (health promotion, employment retraining, and recreation activities for children) compared to allowing families be self-directed in finding these services, resulted in 15% more exits from social assistance within 1 year and substantial savings to society in terms of social assistance pay-outs.
Primary health care is the first element of continuing health and is designed to connect families to community services concerned with the broad determinants of health, including health services, education, and social support [71, 72]. It is accessible, continuous, comprehensive, and coordinated, and is provided as closely as possible to where people live or work. Primary health care delivered through in-house family support has been shown to enhance both parents’ [13, 73, 74] and children’s well-being [73, 75, 76, 77, 78]. Social support accounts for a significant proportion of low-income family adaptation [79, 80]. It is likely that parental involvement with childcare and schools leads to a richer family social support network [81, 82, 83]. More importantly, it has also been found that children whose families are linked to their schools have better academic achievement .
Regarding recreation, children who are active and engage in positive recreational opportunities benefit in physical well-being, psychosocial health (e.g., less anti-social behaviour), and resilience [13, 14, 84, 85, 86, 87, 88, 89]. The lack of skill development programs for low-income children imposes short- and long-term negative consequences . Children’s participation in recreation is also linked to positive impacts on family relationships [69, 90] and parental adjustments that are related to positive child development outcomes [74, 84, 91].
The FFE investigation tested the findings and probed the conditions and generalizability of WTBB for current social assistance environments. FFE differs from WTBB in many ways. First, an analytic framework that describes the outcomes and intervening variables founded the research questions and plan for data analysis. Second, the primary health care and recreational service integration approaches and supporting practices were described in detail and closely audited to enable transfer of the successful service integration approach. Third, the sample aimed to be more inclusive to allow for examination of a broad socio-economic profile of low-income families, thus allowing researchers to address the question of who benefits the most and under what circumstances, questions typically neglected in this type of research . WTBB included only single-parent families (98.1% female-headed) on social assistance. FFE included both single- and two-parent families. WTBB was conducted prior to the implementation of mandatory welfare-to-work initiatives. In Alberta, welfare-to-work initiatives require low-income families who receive income support to engage in employment or employment-related activities in exchange for income support once their youngest child is 12 months of age. Further, the sample from WTBB was predominately Euro-Canadian. FFE recruited participant families in an area where 54% of Edmonton’s Aboriginal population and 39% of Edmonton’s visible minorities reside, thus allowing for analysis based on these characteristics. Families who do not speak English were given the opportunity to participate. Fourth, the role of family functioning was explored as an intervening variable between the service delivery models and the primary outcome (family linkage to services) and to secondary outcomes (costs and health). Fifth, the service delivery models in WTBB were implemented for one year. In FFE, the models will be implemented for up to two years with follow-up for three years. This design facilitated examination of short-, intermediate-, and longer-term outcomes. Sixth, the service delivery models of FFE were designed by service delivery professional and researchers to be simple, transparent, easily tracked, and sustainable. Thus FFE was designed to generate the types of knowledge that will be essential if FFE interventions are to be adapted and implemented elsewhere.
Principles of service integration practice
A systematic review of effective interventions for school-aged children, 29 reviews of 1102 intervention studies , drove the selection of practice principles for service integration practices within the content areas of Family Healthy Lifestyle and Family Recreation. The studied interventions encompassed a variety of program orientations including promoting physical and mental health, enhancing educational outcomes, fostering positive emotional adjustments, and preventing problem behaviours, suicide, and child abuse. Analysis showed that successful programs have seven characteristics. First, they were holistic and integrated. The complexity of the life of the child, parent, and family is addressed. Intervention strategies that target diverse areas (e.g., mental and physical health, safety, education, recreation, and youth employment) are needed. Second, successful programs resulted from collaborations that are multi-level and multi-sectoral. Third, successful programs were capacity building. They provide opportunities to build skill, rather than focusing exclusively on eliminating undesirable problems and behaviours. Fourth, successful programs were client-centred. For example, culturally appropriate services are offered and transportation barriers are addressed. Fifth, successful programs were community-based in what is available and situated in families’ neighbourhoods. Sixth, successful programs were long term, engaging at-risk children and youth long enough to show effects and enabling relationships between staff and participants to develop. Seventh, successful programs were well staffed with supportive personnel who are culturally similar to the population served. As a result, the practice principles selected to be embedded in the service integration content areas of Family Healthy Lifestyle and Family Recreation included family-centredness, cultural sensitivity, capacity building and reflection.
Aim of the study
This study focused on evaluating service integration approaches directed at increasing linkages between low-income families and services existing in their communities. The primary research question was:
What are the effects of three community-based service-integration approaches (Family Healthy Lifestyle, Family Recreation and Comprehensive), as compared to a control model (Existing Services), on the number of linkages that families initiate and maintain with established health and social services?
What are the relative effects of different service integration approaches on specific characteristics of family linkages to established service (e.g., type of service, satisfaction with), and how do the frequency and type of involvement change over time?
What are the costs to service systems of each of the service-integration approach over time?
What are the physical and psychosocial health outcomes of family members, over time, associated with each of these service integration approaches?
What is the intervening role of family functioning (family problem solving, communication, parenting, connections to community) between each of the four service integration approaches and linkage to services, cost, and health outcomes for family members, and how does this role change over time?
To what extent does sociodemographic profile (e.g., ethnicity, immigrant status, education, occupation, family type, level of income, sources of income, security of housing, number of children) influence the relation between each of the four service integration approaches and linkage to service, cost, and health outcomes, and how does this influence change over time?
We hypothesized that low-income families who receive community-based service-integration (i.e., Family Healthy Lifestyle, Family Recreation and/or Comprehensive) would initially increase linkages to services, and that costs to service systems would decrease as improvements to physical and psychosocial health of family members are realized over time.
FFE is a randomized, single-blind, longitudinal effectiveness trial with a 2 by 2 factorial design with three integration groups and a control group. The study was conducted in the City of Edmonton between January 2006 and August 2011. The study employed a multi-prong strategy to recruitment. Eligible families were invited to the study through five source programs for low-income families. In addition, posters and invitation packages were available at community agencies and through service workers. Information about the study was presented at community events where eligible families could inquire for more information. All families who received the source programs during the recruitment period were invited to participate in the study. Families were randomized after baseline data collection using a 1:1:1:1 allocation ratio. Those who were assigned to the intervention groups received between 18 and 24 months of service integration intervention. All families were followed by researchers for a total of three years with a minimum of ten interviews for data collection: two at baseline, and two at year 1, year 2, and year 3, respectively.
Eligibility criteria for participants
The study focused on low-income families residing in City of Edmonton. To be eligible families needed to be receiving one of the five government assistance programs: (1) Income Support (“social assistance”), (2) Alberta Child Health Benefit, (3) City of Edmonton’s Leisure Access program, (4) Alberta Adult Health Benefit, and (5) Capital Regional Housing. All these programs provide either financial assistance or access to affordable housing and recreation for low-income individuals or families in the city area. In addition, potentially eligible families would have at least one child younger than 12 years of age living in the household. Families were allowed to define themselves: thus, the definition of family is not confined to traditional dual-parent family or biological-parent family but includes others such as single-parent families, adoptive families, and grandparent led families.
At recruitment, the study had three main exclusion criteria: (1) unwilling to commit to the full length of the study, (2) unwilling to provide researchers access to the focus child, or (3) non-English speaking families for whom researchers were unable to locate a relevant interpreter. After families were recruited, they were free to withdraw from the study at any time without penalty, with the understanding being that the intervention to which they were assigned was terminated. Although the study focused on low-income status, families with sufficient improvement in household income were not excluded from the study, due to recognition of income fluctuation in some vulnerable populations. After recruitment, families were no longer eligible to participate if they moved outside of the study area, the City of Edmonton.
Details of the intervention
FFE community partners funded the practice content areas. The amount of direct service was constrained by two things: 1) the desire to evaluate the effect of a small intervention on the use of existing service and 2) the realities of the funders’ budget. For these reasons, Family Recreation was funded for 1.4 hours per month per participant family, Family Healthy Lifestyle was funded for 3.5 hours per month, and Comprehensive was funded for 4.6 hours per month.
The practice content areas (recreation and family healthy lifestyle), practice principles (family-centredness, cultural sensitivity, capacity building, and reflection) and hours of direct service were essential elements of logic model development followed by request for proposals (RFP). The logic model elements formed the basis of an FFE RFP from interested community agencies.
Existing service providers in Edmonton were invited to submit a proposal for delivery of the FFE interventions. Evaluation of the proposals for service delivery led to the selection of a service delivery partnership of four community agencies called Families Matter. The Families Matter partners included: YMCA of Edmonton, Multicultural Health Brokers Co-operative, KARA Family Resource Centre, and Bent Arrow Traditional Healing Society. To achieve practice rigor Families Matter relied on: hiring practices that target selected front-line provider education and experience; in-service training directed at developing knowledge and behaviours believed to match the practice principles and content area selected; and supervision approaches.
Community-based intervention, when delivered in a research project, risks losing intervention fidelity for at least two reasons: (a) use of general practice principles and very broadly identified content area within which to practice, and (b) intervention drift . In addition, there is a culturally based reluctance by service providers to submit to rigorous oversight of community developed practices.
For these reasons, action research methods were used to record and monitor the delivery of the service integration approaches. An administrative database was jointly developed to include qualitative and quantitative methods of recording practice to be used to calculate dose and to audit practices. In addition, the administrative and supervisory staff of Families Matter met weekly with the researchers to review and internalize the elements of the FFE service delivery logic model, which built the relationship and internalized the need for intervention fidelity. Similarly, a researcher spent half a day each week with the supervisors and family workers, focussing on trouble-shooting the practices associated with recording the practices in the data base and on the need for fidelity to the three service integration groups. Families Matter also assigned family workers and supervisors to only one service integration approach in order to support intervention fidelity. Lastly, focus groups and individual interviews were held, with supervisors and family workers, over the course of the 18 months of service delivery in order to specify the practices used in service integration. At the end of the project, a Service Integration Tool Kit was published .
The study aimed to determine which of the interventions impact accessibility in the most efficient and effective manner. Where possible, the measures were selected because of their standardization, the presence of published norming data, and their utility as comparators to other studies of low-income families.
The primary outcome, family linkage to health and social services, was measured using an innovative tool, “Family Services Inventory” (FSI). This tool was developed by a health economist, in consultation with FFE researchers. The FSI adopts a societal perspective and measures public and private consequences for families. The FSI was developed to maximize precision while minimizing patient burden and recall bias. A FSI toolkit comprised in-service training materials for data collectors, a user manual, a codebook, and a calendar (a memory aid to reduce recall bias). Annual data capture of resource use during the prior month was conducted in face-to-face interviews. Due to variations in scheduling interviews, resource use is normalized to the observation period (time between first and second visit). Characteristics of services and data allowing for costing of services were also collected in the FSI.
Outcomes, measures, and instruments
€ Primary Outcomes €
Linkages between low-income families and established services in their communities
Average number of times the family linked to services
Family Services Inventory (FSI)
Quality of life
Preference based measures
Visual Analogue Scale (EQ VAS) Australian Quality of Life (AQoL)
€ Secondary Outcomes €
Characteristics of linkages between families and services
Type of service, satisfaction
Costs to service systems
Costs of services linked to
Adult physical health
General health status
Single general health item from National Longitudinal Survey of Children and Youth (NLSCY), EQ-5D
Adult psychosocial health
Somatization, obsessive-compulsive, interpersonal sensitivity, depression, anxiety, hostility, phobic anxiety, paranoid ideation, psychoticism, self-esteem
Symptom Checklist (SCL-90-R), Self-Esteem Inventory
Linkages to community
(a) Perceived social functions and provisions obtained from relationships with others; (b) social and civic participation; (c) barriers to participation; (d) neighbourliness
(a) Social Provision Scale; (b) items from the Health and Participation survey; (c) Left Out survey; (d) items from NLSCY
Child physical health
General health status, chronic conditions, injuries, nutrition, sleep pattern, risk behavior
40 items from NLSCY
Child psychosocial health
Socio-emotional development, personality, behavioral problems, attitudes, mental health
Behavioral Assessment System for Children (BASC)
Spelling, Arithmetic, Reading, Receptive Vocabulary
Wide Range Achievement Test; Peabody Pictorial Vocabulary III
(a) Problem solving & communication skills, (b) parenting,
McMaster Family Assessment device
Ethnicity, immigration status, education, occupation, family type, level of income, source of income, security of housing, number of children, neighbourhood
Items from NLSCY
Data collection and management
Data were collected at baseline, prior to randomization, and then every 12 months for three years. One adult respondent per family was selected based on familiarity with the children. A focus child was randomly selected (using computer-generated randomized lists stratified by number of eligible children) amongst the children within the household at screening. When appropriate, children’s data were collected from the focus child. During data collection phase, follow-up data collections were conducted annually for all families. Research assistants who had established rapport with families since first contact arranged each data collection. Data collectors, blind to the group assignment, collected data during home visits. FFE researchers adopted a professional human resource model with a data collection supervisor who oversaw 29 data collectors and 36 interpreters. We adopted this model because (a) a number of our instruments are standardized measures requiring psychometric assessment skills, and (b) it enhanced our ability to attract and retain a staff with adequate credentials and experience. Most of our data collectors had completed or were working toward their Master’s degrees in a variety of health and social science fields. Data collectors were required to work evening and weekends, to be responsive to the schedules of the families, and all were rigorously trained on the data collection process, crisis management, and cultural sensitivity. A detailed manual of operations was available to the research assistants and data collectors at the coordinating office. Due to the volume of the data collected and to avoid fatigue of the primary participants, each data collection point consisted of two visits approximately 28 days apart. The 28 days lapse also allowed for a prospective collection of the services accessed by the family.
All data were collected using standardized case report forms by trained data collectors and then faxed to the Epidemiology Coordinating and Research (EPICORE) Centre -- a clinical trials and health services research centre within University of Alberta, for data entry. EPICORE was responsible for data storage and quality assurance with the help of the data collection team. The database was coded in Microsoft Visual FoxPro V7.0. The use of free text fields and open-ended questions were eliminated from the forms, wherever possible. Simple (e.g., aberrant values, missing values) and complex verification rules were applied. Study subjects were identified by a unique study number assigned at time of enrolment. The study participants’ personal information was not included in the database. Confidential contact information and documents containing the link between the primary parent’s and focus child’s names and the assigned study number were stored in locked file cabinets at the FFE coordinating office. Sixty randomly sampled from the first 200 baseline data files (all forms in part 1 and 2) were audited. The transcription error rate was less than 1% (5 errors were identified).
The random allocation sequence was computer generated using R version 2.8.1 software.
We used permuted blocks of 8 and 12, stratified by type of income (Income Support receipts versus other source programs) and age of the focus child (0 to 3.9, 4 to 6.9, 7 to 9.9, 10 to 12.9 years).
Allocation to experimental group and implementation
The intervention assignments were concealed on serially numbered, opaque, sealed envelopes. After the baseline data collection was completed, research assistants phoned the families and then opened randomization envelopes that were pre-stratified according to low-income status (i.e., receiving income supports vs. other source programs) and age of the Focus Child. Families were informed of their group assignment at that time. Research assistants explained the next steps to families. For those allotted to the intervention groups, their contact information was passed onto the service delivery workers. Research assistants explained to families that researchers would be in contact again for follow-ups, but families could contact them before then if they were moving or had any concerns about the study.
The data collectors and the investigators were blinded from the group assignments. The families, the service delivery workers and the research assistants were not blind to the group assignments at any point in the trial. Investigators were unblinded when the datasets were cleaned (January 2012).
Projecting a moderate (f = 0.25) and even a small (f = 0.10) intervention effect size (mean divided by standard deviation), given an alpha of 0.05 and a 25% attrition rate, the study proposed an initial sample size of 300 families per group to detect any significant difference between the four groups (power was 0.99 and 0.72, respectively). The study randomized approximately 290 families to each group. The overall alpha value was not controlled for multiple comparisons. No interim analyses were planned.
Most analyses will follow the intent-to-treat principle. The last-observation-carried-forward method will be used to impute missing data to maintain the integrity of the data set. Data will be analyzed using Stata MP 13.0 and SPSS 21.
The data will be analyzed using linear regression including terms for the healthy family lifestyle and family recreation service-integration approaches, their interaction and, where appropriate, time (a repeated measure). If the distribution of the primary outcome is right-skewed and cannot be transformed to a normal distribution, Poisson regression will be used. Estimates and corresponding 95% confidence intervals will be reported. The income group (Income Support vs. other source program) and the age of the focus child corresponding to strata variables in randomization will be included in the model.
Analysis of the FSI and quality of life data will be guided by the Canadian guidelines for the economic evaluation of health technologies , which comprises a five-part analysis. Part 1 will focus on identifying and describing the differences in use of social and health system services. Part 2 will result in the translation of these differences into dollar values, including the valuation of the intervention. Part 3 will focus on identifying and measuring the differences in quality of life for the children, parents and families. Part 4 will integrate the costing and quality of life information into a formal cost-utility analysis. Beginning with a budget impact analysis, Part 5 will examine the implications of the findings from an administrative and policy perspective.
Additional variables to be considered in exploratory analyses include ethnicity, immigrant status, education, occupation, family type (e.g., single-parent families), level of income, sources of income (e.g., part-time), security of housing, number of children, region of the city. Residual, leverage, and influence diagnostics will be examined. For secondary outcomes, the four groups will be analyzed using appropriate modelling, such as linear regression, when the data are normal and logistic regression when the data are dichotomous. To study relations between family functioning and interventions over time, latent growth curve analysis will be used . This method provides a comprehensive framework for studying latent variables over time by combining the strengths of structural equation modelling. This approach will enable modelling of the interaction among key variables, with the statistical techniques associated with longitudinal data analysis, which will allow us to study how these variables and their relations change over time. To exploit the power of latent growth curve analysis we will first develop and test theoretically derived and empirically based models designed to link variables using structural equation modelling methods at one point in time. Once we have developed and tested our initial models, we will extend our analyses by adding a growth parameter to each model so we can evaluate change over many periods in time. This combination of modelling variables within and between time periods has the potential to increase our understanding of variation while expanding the scope and value of the study.
This study protocol was approved by a special interdisciplinary ethics committee, led by the Faculty of Education, University of Alberta, Edmonton, Canada and Director (file number Pro00000144) of the then newly formed Human Research Protections Office. Ethical review for subsequent changes in the protocol, which are described below, were reviewed and approved. Although this is a community-based randomized controlled trial (RCT), partners do not have access to the original data and researchers do not receive any salary or other compensation during the trial.
Interested families contacted the community-based research office to learn about the study and ask questions. Families in which English was a second language were offered the option of an interpreter during all interactions (e.g., on the phone setting up appointments, during the times the study was explained, during data collection). At the first home visit, each family was given written information about the study, which the data collector reviewed verbally. Written informed consent was obtained prior to study entry and data collection. Families were given an honorarium at each data collection period ($25 in early data collection periods and $30 at the final data collection period).
Modifications were made based on the pragmatics of community-based trials.
The investigators intended to recruit families in six months with three main eligibility criteria. It was planned that families must (a) have received one of the two source provincial programs, either Income Support or Alberta Child Health Benefits, continuously for the past six months, (b) reside in the central and North-east quadrants of the City of Edmonton, and (c) have at least one child younger than 12 years of age. The number of families in the sampling frame that met the original criteria was estimated to be about 5000. In fact, within six months of recruitment it was apparent that the target would not be reached. The actual response rate using these eligibility criteria was about 10%.
The research team reviewed the recruitment process and eligibility criteria, and concluded: (1) all currently eligible families had already been invited; (2) the original eligibility criteria excluded many low-income families who were not currently on the two pre-identified source programs. Many immigrants or those on federally funded aboriginal treaty programs were not entitled to or were unaware of the two provincial programs. In addition, some eligible families were opting not to apply for these programs.
To increase the recruitment number and to ensure a representative sample of low-income families, the eligibility criteria were relaxed and extended: (1) the requirement that families had to have been receiving the source program for at least 6 months was waived; (2) source programs were added and (3) recruitment was expanded from central and northeast to the whole City of Edmonton (pop. ≈ 800,000).
Duration of intervention and follow-up data collection schedule
As a result of expanding the recruitment period to 24 months, those enrolled during the last 6 months of recruitment only received up to 18 months of services rather than 24 months. Originally FFE was planned to be a five-year research project with eight visits for eight data collection points (baseline, 6 mos., 12 mos., 18 mos., 24 mos., 36 mos., 48 mos., 60 mos.). To increase the accuracy of the service utilization data, the research team adopted a prospective approach resulting in having two visits for each data point (16 home visits). To contain costs, the FFE Steering Committee in consultation with the research team approved dropping four data points: 6 mos., 18 mos., 48 mos., and 60 mos. That is, the FFE trial collected data from each family once a year for three years but data collection activity was spread over five years (accounting for the expanded recruitment period).
Of the families who were contacted and expressed interests in the study, 1282 families were successfully screened and met recruitment criteria. Because some families withdrew and contact with others was lost, only 1168 families were randomized into the four groups.
Losses and exclusions after randomization
Losses and exclusions
Reasons for withdrawal
Reasons for withdraw (count)
Not interest in
Too busy/No time
Move out of study area
Problems with research
Problems with randomized design
Problems with services allotted
Kids not interests in
Too much time past since last contact
Randomized controlled trials are rare in community-based intervention research and demand an interdisciplinary team that includes researchers with strong content knowledge, methodological skills, and collaborative nature. FFE managed by the Community-University Partnership for the Study of Children, Youth, and Families (CUP), an umbrella organization co-owned by academic, government, and community leaders. In July, 2000, CUP was formed to promote reciprocal, sustained, and mutually beneficial interactions among researchers, practitioners, and policymakers in research, education, and knowledge mobilization. JD, LS, MM, JB, DW all played leadership roles in CUP on and off campus. For more information, please visit http://www.cup.ualberta.ca or http://www.familiesfirstedmonton.ualberta.ca/.
The FFE trial was conceived, planned, implemented and disseminated by the FFE Partnership consisting of 12 community/government organizations and a core set of researchers from a 15 member interdisciplinary research team. It is designed to provide clear evidence for health and social policymakers about the influence of alternate service-delivery models and practices on enhancing and sustaining low-income family linkages to available services.
The funding for the study was received through peer-reviewed funding agencies (Canadian Institutes of Health Research, Canadian Health Services Research Foundation, Alberta Heritage Foundation for Medical Research), government support (Alberta Employment and Immigration, City of Edmonton) and community foundations (Edmonton Community Foundation, Stollery Charitable Foundation, United Way of Edmonton Capital Region) and private funders (an anonymous donor who had no role in the study design and will play no role in the interpretation of data or writing of manuscripts arising from the data).
The authors would like to acknowledge and thank all research staff, Families Matter partners and service intervention staff, interpreters from the Multicultural Health Brokers, EPICORE, and our community and government partners.
Last, we want to thank the families for participating. Their time and effort were greatly appreciated.
- 2.Canadian Institute of Child Health (CICH): The health of Canada’s children: A CICH profile. 2000, Ottawa: Canadian Institute of Child Health, 3Google Scholar
- 8.Ross DO, Roberts PW: Income and child well-being: a new perspective on the poverty debate. 1999, Ottawa: Canadian Council on Social DevelopmentGoogle Scholar
- 9.Willms JD: Vulnerable children: findings from Canada’s national longitudinal survey of children & youth. 2002, Edmonton, Canada: University of AlbertaGoogle Scholar
- 10.David P. Ross, Mark Kelly, Katherine Scott: Child poverty: what are the consequences?. 1996, Kanata: Canadian Council on Social DevelopmentGoogle Scholar
- 11.Brooks-Gunn Jeanne, Greg J.Duncan, Pia Rebello Britto: Are socioeconomic gradients for children similar to those for adults? achievement and health of children in the united states. Developmental health and the wealth of nations: social, biological, and educational dynamics. Edited by: Daniel P. Keating, Clyde Hertzman. 1999, New York: Guilford Press, 94-124.Google Scholar
- 15.Alberta Health and Wellness, Office of the Chief Medical Officer: Let’s talk about the early years: early childhood development. [http://www.health.alberta.ca/documents/CMOH-Lets-Talk-Early-Years-2011.pdf]
- 16.Luthar SS: Poverty and Children’s adjustment. Developmental clinical psychology and psychiatry. 1999, Thousand Oaks, CA: SAGE PublicationsGoogle Scholar
- 17.Zaslow M, Moore KA, Tout K, Scarpa J, Vandivere S: How are children faring under health reform?. Welfare reform: The next Act. Volume 32. Edited by: Weil A, Finegold K. 2002, Washington, DC: The Urban Institute, 79-101.Google Scholar
- 18.Browne G, Byrne C, Roberts J, Schuster M, Ewart B, Gafni A, Watt S, Ashford Y, Jamieson E: Resilience and vulnerability in mothers and children receiving social assistance: prevalence, correlates, and expenditures. Clin Excellence Nurse Pract. 1997, 1 (5): 312-323.Google Scholar
- 21.Michalopoulos C, Schwartz C, Adams-Ciardullo D: What works best for whom: Impacts of 20 welfare-to-work programs by subgroup. 2000, New York: Manpower Demonstration Research CorporationGoogle Scholar
- 22.Morris PA, Huston AC, Duncan GJ, Crosby DA, Bos JM: How welfare and work policies affect children: A synthesis of research. 2001, New York; NY: Manpower Demonstration Research CorporationGoogle Scholar
- 23.Sweeney EP: Recent studies indicate that many parents who are current or former welfare recipients have disabilities or other medical conditions. 2000, Washington, DC: Center on Budget and Policy PrioritiesGoogle Scholar
- 25.World Health Organization: The determinants of health. [http://www.who.int/hia/evidence/doh/en/]
- 26.Public Health Agency of Canada: What determines health?. [http://www.phac-aspc.gc.ca/ph-sp/determinants/index-eng.php]
- 27.Canadian Medical Association: Health care in Canada: what makes Us sick?. [http://www.cma.ca/advocacy/what-makes-us-sick]
- 28.Statistics Canada: Perspectives on labour and income: trends in employment and wages, 2002 to 2007. [http://www.statcan.gc.ca/pub/75-001-x/2008109/article/10694-eng.htm]
- 29.Statistics Canada: Income of Canadian families, 2001 census. [http://www5.statcan.gc.ca/bsolc/olc-cel/olc-cel?catno=96F0030XIE2001014&lang=eng]
- 30.National Council of Welfare: Poverty profile 1999. [http://publications.gc.ca/collections/collection_2011/cnb-ncw/H67-1-4-1999-eng.pdf]
- 31.Sauvé R: The current state of Canadian family finances – 2011–12. 2012, Ottawa: Vanier Institute of the FamilyGoogle Scholar
- 32.The Vanier Institute of the Family: Profiling Canada’s families II. 2000, Ottawa, Canada: Vanier Institute of the FamilyGoogle Scholar
- 33.Capital Health: Annual report of the medical officer of health: How healthy are we? 2003. 2003, Edmonton: Capital HealthGoogle Scholar
- 34.Government of Alberta: Guide to services for lower-income Albertans. 2004, Edmonton, Canada: Government of AlbertaGoogle Scholar
- 35.Government A: Alberta’s social policy framework. 2013, Edmonton, Canada: Alberta GovernmentGoogle Scholar
- 36.Alberta Treasury Board and Finance: Results-based budgeting. [http://www.finance.alberta.ca/business/budget/results-based-budgeting/index.html]
- 37.Beauvais C, Jenson J: Two policy paradigms: family responsibility and investing in children. 1998, Ottawa: Canadian Policy Research NetworksGoogle Scholar
- 38.Gorlick C, Brethour G: Welfare-To-work programs: A national inventory. 1998, Ottawa, Canada: Canadian Council on Social DevelopmentGoogle Scholar
- 39.Shillington ER, Dennis D, Drummond A, Krahn H: Social assistance and paid employment in Alberta, 1993–1996. 1998, Edmonton, Alta: University of Alberta, Population Research LaboratoryGoogle Scholar
- 40.Vosko L: Workfare temporaries: workfare and the rise of the temporary employment relationship in ontari. Citizens or consumers?: social policy in a market society. Edited by: Antony WA, Broad D. 1999, Halifax, NS: Fernwood, 184-204.Google Scholar
- 42.Ford R, Gyarmati D, Foley K, Tattrie D, Jimenez L: Can work incentives Pay for themselves? final report on the self-sufficiency project for welfare applicants. 2003, Ottawa: Social REsearch Demonstration CorportationGoogle Scholar
- 43.Bloom D, Michalopoulos C: Manpower demonstration RC: How welfare and work policies affect employment and income: A synthesis of research. 2001, New York, NY: Manpower Demonstration Research CorporationGoogle Scholar
- 44.Michalopoulos C, Social Research and DC: Making work Pay: final report on the self-sufficiency project for long-term welfare recipients. 2002, Ottawa, Canada: Social Research and Demonstration CorporationGoogle Scholar
- 48.Gibson M, Thomson H, Banas K, Bambra C, Fenton C, Bond L: Welfare to work interventions and their effects on health and well-being of lone parents and their children. Cochrane Database of Syst Rev. 2012, CD009820-doi:10.1002/14651858.CD009820, 5Google Scholar
- 55.Browne G, Scarpa J, Ewart B, Schuster M, Edwardh J, Boily L: Investments in comprehensive programming: services for children and single parent mothers on welfare Pay for themselves within One year. Our children’s future: child care policy in Canada. Edited by: Cleveland G, Krashinsky M. 2000, Toronto: University of Toronto Press, c2001, 334-346.Google Scholar
- 61.Steele L, Dewa C, Lee K: Socioeconomic status and self-reported barriers to mental health service Use. Can J Psychiatr. 2007, 52 (3): 201-206.Google Scholar
- 63.Offord DR, Boyle MH, Szatmari P, Rae-Grant NI, Links PS, Cadman DT, Byles JA, Crawford JW, Blum HM, Byrne C: Ontario child health study. II. Six-month prevalence of disorder and rates of service utilization. Arch Gen Psychiatry. 1987, 44 (9): 832-836. 10.1001/archpsyc.1987.01800210084013.CrossRefPubMedGoogle Scholar
- 64.Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, Wittchen HU, Kendler KS: Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the united states. Results from the national comorbidity survey. Arch Gen Psychiatry. 1994, 51 (1): 8-19. 10.1001/archpsyc.1994.03950010008002.CrossRefPubMedGoogle Scholar
- 69.Browne G, Roberts J, Gafni A, Haldane S, Thomas I, Schuster M, Underwood J, Watt S, Rennick K, Ewart B: Benefiting all beneficiaries of social assistance: the 2-year effects and expense of subsidized versus nonsubsidized quality child care and recreation. Natl Acad Pract Forum. 1999, 1 (2): 131-142.Google Scholar
- 70.Organization for Economic Cooperation and Development (OECD): Strategic governance and policy-making: Building policy coherence. 2000, Paris, France: Organization for Economic Cooperation and DevelopmentGoogle Scholar
- 71.World Health Organization: The world health report: health in the 21st century: A vision for All. 1998, Geneva: World Health OrganizationGoogle Scholar
- 72.World Health Organization: Primary HealthCare: report of the international conference on primary health care. 1978, Alam-Alta: World Health OrganizationGoogle Scholar
- 74.Silver EJ, Ireys HT, Bauman LJ, Stein REK: Psychological outcomes of a support intervention in mothers of children with ongoing health conditions: the parent-to-parent network. J Community Psychol. 1997, 25 (3): 249-264. 10.1002/(SICI)1520-6629(199705)25:3<249::AID-JCOP3>3.0.CO;2-R.CrossRefGoogle Scholar
- 75.Witt PA, Crompton JL: Recreation programs that work for at risk youth: The challenge of shaping the future. 1996, State College, Pa: Venture Publishing, IncorporatedGoogle Scholar
- 77.Olds D, Henderson CR, Cole R, Eckenrode J, Kitzman H, Luckey D, Pettitt L, Sidora K, Morris P, Powers J: Long-term effects of nurse home visitation on children’s criminal and antisocial behavior: 15-year follow-up of a randomized controlled trial. JAMA. 1998, 280 (14): 1238-1244. 10.1001/jama.280.14.1238.CrossRefPubMedGoogle Scholar
- 79.Dunst CJ, Trivette CM, Deal AG: Supporting & strengthening families: methods, strategies and practices. 1994, Northampton, MA : Brookline BooksGoogle Scholar
- 80.Drummond J, Kysela GM, McDonald L, Alexander J, Fleming D: Risk and resiliency in two samples of Canadian families. Health Can Soc. 1996, 4 (1): 117-151.Google Scholar
- 81.Comer JP: School power: implications of an intervention project. 1995, New York: Free PressGoogle Scholar
- 82.Marx E, Wooley S, Northrop D: Health Is academic: A guide to coordinated school health programs. 1998, Columbia University: Teachers College Press, Teachers CollegeGoogle Scholar
- 84.Offord D, Jones M: Skill development: a community intervention program for the prevention of anti-social behavior. Childhood psychopathology and developmen. Edited by: Earls F, Guze SB, Barrett JE. 1983, New York, NY: Raven, 165-188.Google Scholar
- 85.McKay SL, Reid IS, Tremblay MS, Pelletier R: The impact of recreation on youth in transition to adulthood: a focus on youth at risk. Youth in transition: perspectives on research and policy. Edited by: Galaway B, Hudson J. 1996, Toronto, Canada: Thompson Educational Publishing, 234-292.Google Scholar
- 87.Offord D, Hanna E, Hoult L: Recreation and the development of children and youth: a discussion paper. Paper, [http://lin.ca/sites/default/files/attachments/child.htm]Google Scholar
- 93.Browne G, Byrne C, Roberts J, Gafni A, Majumdar B, Kertyzia J: Convergence - Why Ontario should develop community-based models of integrated service for school-aged children. A discussion paper. 2001, Hamilton, Ont: he System-Linked Research Unit on Health and Social Service Utilization, McMaster UniversityGoogle Scholar
- 97.Families First Edmonton: Families first Edmonton service delivery toolkit. 2010, Edmonton: Families First EdmontonGoogle Scholar
- 98.Canadian Agency for Drugs and Technologies in Health: Guidelines for the economic evaluation of health technologies. 2006, Ottawa: Canadian Agency for Drugs and Technologies in Health, 3Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/14/223/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.