Factors relating to participation in follow-up to the 45 and up study in Aboriginal and non-Aboriginal individuals
This study aimed to characterise the factors relating to participation in a postal follow-up study in Aboriginal and non-Aboriginal individuals, given the need to quantify potential biases from loss to follow-up and the lack of evidence regarding postal surveys among Aboriginal people.
The first 100,000 participants from the Sax Institute’s 45 and Up Study, a large scale cohort study, were posted a follow-up questionnaire gathering general demographic, health and risk factor data, emphasising Social, Economic and Environmental Factors (“The SEEF Study”). For each variable of interest, percentages of those invited who went on to participate in follow-up were tabulated separately for Aboriginal and non-Aboriginal participants and age- and sex-adjusted participation rate ratios (aPRR) were calculated.
Of the 692 Aboriginal and 97,178 non-Aboriginal invitees to the study, 314 Aboriginal (45 %) and 59,175 non-Aboriginal (61 %) individuals responded. While Aboriginal people were less likely to respond than non-Aboriginal people (aPRR 0.72, 95 % CI 0.66–0.78), factors related to response were similar. Follow-up study participants were more likely than non-participants to have university versus no educational qualifications (1.6, 1.3–2.0 [Aboriginal]; 1.5, 1.5–1.5 [non-Aboriginal]) and an annual income of ≥70,000 versus < $20,000 (1.6, 1.3–2.0; 1.2, 1.2–1.3 [χ 2 = 7.7; p = 0.001]). Current smokers (0.55, 0.42–0.72; 0.76, 0.74–0.77 [χ 2 = 7.14; p = 0.03]), those reporting poor self-rated health (0.68, 0.47–0.99; 0.65, 0.61–0.69), poor quality of life (0.63, 0.41–0.97; 0.61, 0.57–0.66) and very high psychological distress (0.71, 0.68–0.75 [non-Aboriginal]) were less likely than other cohort members to respond.
Relatively large numbers of Aboriginal and non-Aboriginal individuals participated in the first 45 and Up Study follow-up suggesting that postal surveys can be used to follow Aboriginal participants in cohort studies. Despite somewhat greater loss to follow-up in Aboriginal people (after considering socio-demographic and health characteristics), factors related to follow-up participation were similar in both groups: greater loss was observed in those experiencing disadvantage, ill-health and health risk, with implications for interpretation of future findings. Aboriginal low income earners and current regular smokers had a particularly elevated likelihood of non-participation compared to non-Aboriginal people. These findings highlight the importance of identifying and addressing barriers to participation among hard-to-reach population groups.
KeywordsAboriginal people Cohort study Loss-to-follow up Participation rates Socio-demographic factors Health behaviours
Accessibility Remoteness Index of Australia Plus
body mass index
Index of Relative Socio-economic Disadvantage
New South Wales
participation rate ratio
World Health Organisation
Prospective cohort studies have demonstrated their importance in providing reliable data on estimates of incidence and the relative risk of various outcomes in populations of interest. Despite their well-established use in epidemiology and population health, it is recognised that major differences in the characteristics of the participants who were initially studied at baseline from those who are followed-up can lead to bias [1, 2]. A sound quantitative understanding of patterns of non-response is important for interpreting longitudinal data from cohort studies, including whether such non-response is likely to materially affect findings.
It is well known that although postal surveys are a useful, convenient and cost-effective method of conducting longitudinal follow-up studies, particularly among geographically dispersed population groups , this method is prone to non-response . Therefore, it is important to quantify participant characteristics associated with non-response in postal follow-up surveys in order to aid in interpretation of study findings and guide future studies. Willingness to participate in health research surveys among the general Australian population has recently been examined by Glass and colleagues (2015) ; they reported greater willingness among women versus men, older versus younger people and those with a long-term disease or disability. However, few studies to date have examined characteristics of participants lost to follow-up.
Loss to follow-up is likely to vary by population level characteristics. A systematic literature review of attrition between waves in longitudinal studies in the elderly due to reasons other than death reported that in general, people in worse health were less likely to be re-contactable . The review also found that very few longitudinal studies actually report the risk factors for attrition. Among those that have reported such findings, social factors such as contact with friends/family and level of social support have not been examined as often as the basic socio-demographic factors such as education, income and marital status.
It has also often been reported that recruitment and retention of ethnic minorities in research studies is a challenge [7, 8, 9]. In Australia, due to the history of how Aboriginal health research had been previously conducted, including issues relating to ethical conduct, Aboriginal people are justified in viewing research studies negatively [10, 11]. It has also been widely speculated that retaining Aboriginal people in cohort studies, particularly through postal surveys is difficult given the highly mobile nature of the Aboriginal population in Australia . Previous longitudinal studies have reported higher attrition rates among Aboriginal participants compared to non-Aboriginal participants [13, 14, 15]. However, to date there have been no studies that have examined the characteristics of responders versus non-responders in Aboriginal people and whether these differ between Aboriginal and non-Aboriginal people. Therefore, the aim of this study was to examine the socio-demographic and health-related characteristics of Aboriginal and non-Aboriginal participants in an initial postal follow-up of the 45 and Up study.
The Sax Institute’s 45 and Up Study is a large scale longitudinal cohort study of men and women aged 45 years and older from the general population of New South Wales (NSW), Australia that has been designed to provide reliable evidence to inform policy to support healthy ageing. Further information about the study is available at http://www.45andup.org.au/ .
Details of participant recruitment and data collection have been reported previously . Briefly, individuals aged 45 years and over were randomly selected from the Medicare Australia database (the national universal health insurance scheme), with a two-fold oversampling of rural areas and individuals aged 80 years and over. Participants entered the study by completing a baseline postal questionnaire which was distributed between 1 February 2006 to 31 December 2008 and providing written consent to follow their long term health, through repeat questionnaires and linkage to health records. A total of 267,153 people were recruited to the study over this time; the study had an overall 18 % response rate .
Aboriginal status was self-identified in the baseline questionnaire in response to the question: ‘Are you of Aboriginal or Torres Strait Islander Origin? With the following tick box options: 1) No 2) Yes, Aboriginal and 3) Yes, Torres Strait Islander; participants were able to select both Aboriginal and Torres Strait Islander. Of the total participants, 1949 people identified as being of Aboriginal and/or Torres Strait Islander origin. The study’s baseline questionnaire included a range of questions related to socio-demographic factors, physical and psychological health, behavioural risk factors, social support and past and present medical history. Baseline characteristics of Aboriginal and non-Aboriginal participants have been reported previously .
The initial follow-up to the 45 and Up study was undertaken from September-November 2010 where the first ~100,000 participants to join the 45 and Up Study were posted a questionnaire gathering general demographic, health and risk factor data, emphasising Social, Economic and Environmental Factors (as part of “The SEEF Study”). Participants who had requested not be contacted further, had already been contacted for other sub-studies or were deceased (ascertained through linkages to death registries) were not eligible for the follow-up study. A total of 99,927 participants of the 45 and Up study were invited to participate in the follow-up survey.
Ethics, consent and permissions
The 45 and Up and SEEF studies as a whole have received ethical approval from the Human Research Ethics Committees of the University of New South Wales (reference 10186) and the University of Sydney (Ref No. 10-2009/12187), respectively. Ethical approval for the current study has been granted by the Aboriginal Health and Medical Research Council of New South Wales (912/13). All participants of this study provided written informed consent.
All variables used in this study were derived from the self-reported 45 and Up baseline questionnaire apart from the Accessibility Remoteness Index of Australia Plus (ARIA+) score and the Index of Relative Socio-economic Disadvantage (IRSD) which were derived for each participant’s postcode of residence at the time of original recruitment as recorded by Medicare Australia. Australian Standard Geographical Classification (ASGC) Remoteness areas, based on enhanced measures of remoteness (ARIA+) developed by the National Key Centre for Social Applications of Geographic Information Systems, categorises areas as ‘major cities’, ‘inner regional’, ‘outer regional’, ‘remote’ and ‘very remote.’ The ARIA+ index values are based on road distance from a locality to the closest service centre . IRSD is one of the four indexes in the Socio-Economic Indexes for Areas (SEIFA) and is primarily based on disadvantage and the variable is derived from census variables such as low income, low educational attainment, unemployment and dwellings without motor vehicles . Socio-demographic information included age, sex, formal educational qualification, marital status, household annual pre-tax income, employment status, ARIA+ score and IRSD. Participants were grouped into quintiles of the IRSD score. Those in quintile 1 were the most disadvantaged and those in quintile 5 were the least disadvantaged .
Lifestyle and health risk factor variables included those relating to smoking, alcohol and body mass index (BMI), screen time, hours spent sitting, physical activity and diet. Self-reported weight and height measurements were used to calculate BMI, as weight in kilograms divided by the square of their height in metres (kg/m2). BMI was categorized according to the World Health Organization (WHO) criteria as underweight (BMI < 18.5 kg/m2), healthy weight (18.5–24.99 kg/m2), overweight (25.0–29.99 kg/m2) and obese (BMI ≥ 30 kg/m2) . Participants’ overall level of physical activity was classified according to their responses to questions on the number of weekly sessions (of any duration) of moderate and vigorous physical activity and episodes of walking for longer than 10 min, using items from the validated Active Australia questionnaire . A weighted weekly average number of sessions were calculated for each participant by adding the total number of sessions, with vigorous activity sessions receiving twice the weighting of moderate activity or walking sessions. Physical activity was classified as either ‘sufficient’ (150 min of physical activity in 5 or more sessions a week) or ‘insufficient’ (greater than 1 but less than or equal to 149 min), based on the guidelines from the Australian Institute of Health and Welfare . Sedentary time was assessed based on ‘screen time’ which was the number of hours spent per day watching television or using the computer and ‘sitting time’ which was the number of hours per day spent sitting. Fruit (including fruit juice) and vegetable (including both raw and cooked vegetables) intake was assessed as servings per day and classified as adequate (≥2 servings of fruit and ≥ 5 servings of vegetables per day) or inadequate (less than these amounts) according to the National Health and Medical Research Council guidelines .
Self-rated health and quality of life were based on the question, “In general, how would you rate your: Overall health? Quality of life?” followed by options of excellent, very good, good, fair and poor. In order to determine the level of social support provided by close contacts, participants were asked “How many people outside your home, but within 1 h of travel, do you feel you can depend on or you feel very close to?” Based on the responses the social support variable was categorised as follows: none, 1–3 people, 4–6 people and 7 or more people. Psychological distress was measured using the Kessler-10 score ; a scale based on 10 items used to measure non-specific psychological distress. Logical imputations were performed for missing values where there is a valid value for a similar but more severe item. For example, when the value “how often did you feel: depressed” is missing, then the value for “how often did you feel: so depressed that nothing could cheer you up” is imputed to the less severe item. The average of all non-missing items is imputed for up to one missing item, and then the final score is calculated; a higher score indicated a higher level of psychological distress. Final scores were only calculated for those participants that had a response for all ten questions after imputation as described above. Kessler-10 scores were classified into 4 groups: low psychological distress (score 10–15), moderate psychological distress (score 16–21), high psychological distress (score 22–29) and very high psychological distress (score 30 or higher) .
Past history of and current treatment for certain medical conditions were assessed based on the participant’s response to the questions ‘Has the doctor ever told you that you have…’ and ‘In the last month have you been treated for…”, respectively, followed by a list of conditions that the participant could select. Categories of multiple morbidity were as follows: 0, 1–2 conditions, 3–4 conditions, 5 or more conditions.
Individuals who reported needing assistance with daily tasks because of long-term illness or disability were considered to have a major disability. Functional capacity was assessed using the Medical Outcomes Study Physical Functioning Scale ; a lower physical functioning score indicates more severe functional limitation . The questions on the physical functioning scale asked whether participants are limited in their ability to perform vigorous and moderate physical activities and tasks such as: lifting shopping, climbing stairs, walking, bending, kneeling or stooping and bathing or dressing. A score is calculated where there are up to 5 missing items . Functional limitation scores were classified into 5 groups: no limitation (score of 100), minor limitation (score 95–99), mild limitation (score 86–94), moderate limitation (60–84) and severe limitation (score 0–59).
For each variable of interest, frequencies and percentages (expressed as a percentage of those invited to the study) were tabulated separately for Aboriginal and non-Aboriginal participants. Generalised linear models with a binomial distribution and a log link function (binomial regression) (proc genmod in SAS, v9.4) adjusted for age and sex was used to determine participation rate ratios (PRR) with participation in the follow-up (yes/no) as the outcome. To examine the mediating role of education and income, models were further adjusted for formal educational qualifications and household annual income level. Analyses were conducted separately in Aboriginal and in non-Aboriginal participants. Effect measure modification of the association between participation and each specific factor by Aboriginal status was assessed using likelihood-ratio tests which compare the age and sex adjusted model with and without the interaction term . All statistical analyses were undertaken using SAS software version 9.4 (SAS Institute Inc, Cary, NC, USA).
Overall response to the invitation to participate in the follow-up study
Response rate to the follow-up survey according to socio-demographic factors at baseline (Fig. 2)
Response rate to the follow-up survey according to health behaviours at baseline (Fig. 3)
Response rate to the follow-up survey according to psychosocial factors at baseline (Fig. 4)
Response rate to the follow-up survey according to medical history and current treatments for selected conditions at baseline (Figs. 5 and 6)
Relatively large numbers of Aboriginal and non-Aboriginal people participated in the first follow-up to the 45 and Up Study. Individuals who responded to the follow-up survey were more likely than non-responders to have tertiary qualifications, earning a higher income and residing in less disadvantaged areas. Individuals who reported being regular smokers at baseline and participants with poor self-rated health/quality of life, high levels of psychological distress and those with fewer social contacts at baseline were significantly less likely to participate in the follow-up survey. Those participants who were being treated for medical conditions at baseline were less likely to respond to the follow-up survey compared to those who were not. Overall, Aboriginal people were less likely to respond to the follow-up study compared to non-Aboriginal people, particularly those participants earning a low income and participants who reported being regular smokers at baseline.
Our finding that almost half of the Aboriginal invitees to the follow-up study participated in the postal survey is encouraging and provides evidence to show that postal surveys can be used to undertake follow-up studies among Aboriginal people. A study, recently published by Marin and colleagues, on obtaining a representative sample for the South Australian Aboriginal population-based health survey  reported a 57.7 % response rate; that study used a variety of recruitment strategies and face-to-face interviews for data collection. Reasons for non-participation included: refusals (19.4 %), unavailable for interview (19.5 %), illness/incapability to undertake interview or having moved house since first contact (3.3 %). Previous longitudinal studies that have compared attrition rates among Aboriginal versus non-Aboriginal participants have also shown greater attrition among Aboriginal participants [13, 14, 15]. For example, in the Household, Income and Labour Dynamics (HILDA) survey it has been reported that the attrition rate of Aboriginal participants from Wave 1 to Wave 2 was significantly greater compared to non-Aboriginal participants (20 % versus 13 %) ; loss to follow-up among Aboriginal people was mostly due to difficulties encountered in contacting the household. In the current study, even after taking into account socio-demographic factors, remoteness of residence, smoking status and number of medical conditions, Aboriginal people were still less likely to participate in the follow-up survey which suggests that other factors not captured in this study (such as cultural differences and opinions on health research) may be related to the lower participation rate.
In the current study, we found that although the response rates were lower among Aboriginal people, the socio-demographic and health-related correlates of participation in follow-up were similar between Aboriginal and non-Aboriginal people. Although studies to examine such associations have not been undertaken in Aboriginal population groups, in Australia or internationally, a Danish study has also suggested that although barriers to participation were relevant to the general population, ethnic minorities may be more exposed to those barriers compared to the general population .
The finding that responders of follow-up studies are more socio-economically advantaged compared to non-responders has been shown in a number of previous studies [30, 31, 32]. It has been previously suggested that higher education is related to a greater understanding and interest in research studies . Increased participation rates in follow-up studies and in health surveys in general among those socially advantaged may also be associated with higher levels of health literacy. In the current study, a statistically significant interaction with Aboriginal status was found in the association between annual household income and participation in the follow-up survey. This suggests that cohort retention among Aboriginal people who are on a low income may be more difficult compared to non-Aboriginal people.
It is well known that people with a greater level of health risk factors such as tobacco smoking, drug and alcohol abuse are less likely to participate in research studies and also more likely to be lost to follow-up in longitudinal studies [34, 35]. Accordingly, in this study, amongst all the health behaviours examined, we found current smoking to be significantly associated with non-participation in the follow-up study; particularly among the Aboriginal cohort. In general, it is possible that current smokers have a lower interest in aspects of health, including health research compared to non-smokers.
The 'healthy cohort effect' is a well-known concept that has been reported in a number of previous studies [34, 36, 37]; the findings of this study also suggest that the individuals in the cohort retained in the follow-up study are in general physically and mentally healthier. Indeed, participants with a lower self-rated health and quality of life and increased levels of psychological distress were 30–40 % less likely to respond to the follow-up survey. In relation to this finding, we also report that responders to the follow-up survey were significantly less likely to have ever been diagnosed with chronic diseases such as diabetes and stroke, less likely to be currently undergoing medical treatments and less likely to have physical functional limitations. It can be speculated that the reasons for attrition among those suffering from chronic disease and disability could include: difficulty in being contacted due to hospitalisation; difficulty in completing the questionnaire; a need to prioritise things other than participating in research; and feeling disengaged due to mental health problems.
Participation in the follow up survey among those people who had less social support (fewer social contacts or single/not-partnered marital status) was significantly lower compared to those with greater social support. Although the exact reasons for this findings is unclear from this study, previous research has also shown associations between greater social support and positive health behaviours such as participating in cardiovascular disease risk screening .
The role of formal educational qualifications and income level as mediating factors was also examined. The association between socio-demographic factors and health with participation in the follow-up survey persisted in the fully adjusted model among both Aboriginal and non-Aboriginal participants. However, a number of the associations were found to be attenuated in the fully adjusted model, suggesting that lower levels of formal education and income level are contributing to a small proportion of the observed associations.
This is one of the few studies to date to have examined the factors associated with participation in follow up surveys, particularly among Aboriginal people. However, one of the main limitations of the current study is that the reasons for non-response to the follow up study is not known, which would have provided greater information to understand patterns of non-response. It is also important to note that due to the relatively small sample size in the Aboriginal group compared to the non-Aboriginal group, some of the associations observed may be prone to error and should be interpreted with caution, particularly where the number of participants in the follow-up survey in the specific category was less than ten .
The findings of this study are important for future analyses and interpretation of longitudinal data from Aboriginal and non-Aboriginal participants in the 45 and Up cohort, as well as follow-up studies more broadly. Importantly, the results show that follow-up studies among Aboriginal participants can be undertaken through postal surveys. Although loss to follow-up was greater among Aboriginal people (even after taking into account age, sex, annual household income, remoteness of residence, smoking status and number of medical conditions), the factors related to non-participation in the follow-up survey were similar between Aboriginal and non-Aboriginal people which included: disadvantage, ill-health and health risk factors. Aboriginal participants on a low annual household income and those who were current regular smokers had a greater likelihood of non-participation compared to non-Aboriginal participants. In future studies, it is important to identify the barriers to participation among hard-to-reach population groups and devise strategies to minimise attrition.
Consent for publication
Availability of data and materials
Due to ethical restrictions, the authors are unable to make the raw data set used for this manuscript publicly available. Readers can visit the 45 and Up study website (https://www.saxinstitute.org.au/our-work/45-up-study/) for more information about how to request the raw data, or they can contact either Sandra Eades (Sandra.Eades@bakeridi.edu.au) or Professor Emily Banks (Emily.Banks@anu.edu.au).
This research was completed using data collected through the 45 and Up Study (https://www.saxinstitute.org.au/our-work/45-up-study/). The 45 and Up Study is managed by the Sax Institute in collaboration with major partner Cancer Council NSW; and partners: the National Heart Foundation of Australia (NSW Division); NSW Ministry of Health; beyondblue; NSW Government Family & Community Services – Carers, Ageing and Disability Inclusion; and the Australian Red Cross Blood Service. We thank the many thousands of Aboriginal and non-Aboriginal people participating in the 45 and Up Study. The authors would like to acknowledge the guidance and support provided for this study from the Aboriginal Health and Medical Research Council of New South Wales, in particular the staff in the Ethics Committee.
The authors of this manuscript have nothing to declare.
Funding support for this work has been received from the National Health and Medical Research Council (NHMRC) (Recipient: Adrian Bauman; Grant number 402810 and Recipient: Sandra Eades; Grant number 1013418). This work has also been supported by an NHMRC Centre for Research Excellence in Aboriginal Health and Wellbeing (Recipient: Sandra Eades). This work was also supported in part by the Victorian Government’s OIS Program.
- 3.Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009; Mr000008.Google Scholar
- 4.Armstrong B, White E, Saracci R. Principles of exposure measurement in epidemiology. In: Kelsey J, Marmot M, Stolley P, Vessey M, editors. Monographs in Epidemiology and Biostatistics. New York: Oxford University Press; 1995. p. 294–321.Google Scholar
- 11.Humphery K. Discussion Paper No. 2. Indigenous Health & ‘Western Research’. Melbourne: VicHealth Koori Health Research & Community Development Unit; 2000.Google Scholar
- 12.Hunter B, Smith D. Surveying mobile populations: Lessons from recent longitudinal surveys of Indigenous Australians. Canberra, ACT: Centre for Aboriginal Economic Policy Research: The Australian National University 2000 Document No.; 203/2000.Google Scholar
- 13.Watson N, Wooden M. Sample attrition in the HILDA survey. Australian J Lab Econ. 2004;7:293–308.Google Scholar
- 18.AIHW. Rural, Regional and Remote Health: A guide to remoteness classification. Canberra: AIHW; 2004.Google Scholar
- 19.ABS. An Introduction to Socio-Economic Indexesed. Canberra: Australian Bureau of Statistics; 2006.Google Scholar
- 20.WHO. Report of a WHO Consultation. Geneva: WHO Technical Report Series no. 894; 2000.Google Scholar
- 21.AIHW. The active Australia survey: a guide and manual for implementation, analysis and reporting. Canberra: Australian Institute for Health and Welfare; 2003.Google Scholar
- 22.NHMRC. Dietary Guidelines for Australian Adults. Canberra: National Health and Medical Research Council; 2003.Google Scholar
- 23.ABS. Information Paper: Use of the Kessler Psychological Distress Scale in ABS Health Surveysed. Canberra: Australian Bureau of Statistics; 2001.Google Scholar
- 25.Hays R, Sherbourne D, Mazel R. User’s manual for the medical outcomes study (MOS) core: measures of health-related quality of lifeed. Santa Monica: RAND; 1995.Google Scholar
- 26.Stewart A, Kamberg C. Measuring functioning and well-being: the Medical Outcomes Study Approached. Durham: Duke University Press; 1992.Google Scholar
- 27.Harrell F. Regression modelling strategies - with applications to linear models, logistic and ordinal regression, and survival analysis. 2nd ed. New York: Springer; 2001.Google Scholar
- 28.Marin T, Taylor A, Grande E, Avery J, Tucker G, Morey K. Culturally appropriate methodology in obtaining a representative sample of South Australian Aboriginal adults for a cross-sectional population health study: challenges and resolutions. BMC Research Notes. 2015;8:200.CrossRefPubMedPubMedCentralGoogle Scholar
- 29.Ahlmark N, Algren MH, Holmberg T, Norredam ML, Nielsen SS, Blom AB, et al. Survey nonresponse among ethnic minorities in a national health survey - a mixed-method study of participation, barriers, and potentials. Ethn Health. 2014;20:1–22.Google Scholar
- 34.Goldberg M, Chastang JF, Leclerc A, Zins M, Bonenfant S, Bugel I, et al. Socioeconomic, demographic, occupational, and health factors associated with participation in a long-term epidemiologic survey: a prospective study of the French GAZEL cohort and its target population. Am J Epidemiol. 2001;154:373–84.CrossRefPubMedGoogle Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.