Skip to main content
  • Research article
  • Open access
  • Published:

Motivations for (non)participation in population-based health studies among the elderly – comparison of participants and nonparticipants of a prospective study on influenza vaccination

Abstract

Background

Participation in epidemiological studies has strongly declined in recent years. We examined the reasons for (non)participation in population-based health studies among participants and nonparticipants of a prospective study on influenza vaccination among the elderly.

Methods

Males and females between 65 and 80 years of age (N = 5582) were randomly selected from the residents’ registration office in Hannover, Germany, and were invited to participate in a study featuring vaccination with a seasonal adjuvanted influenza vaccine (Fluad™, Novartis) including five follow-up visits (day 0, 1/3, 7, 21, 70 with respect to vaccination). A 24-item nonresponder questionnaire, including 10 items on reasons for participating in a hypothetical health study, was mailed to 1500 randomly selected nonparticipants. The same 10 items were included in the end-of-study questionnaire administered to the participants in the vaccination study (n = 200). Logistic regression analysis with backward elimination was used to identify the reasons most strongly associated with nonparticipation.

Results

Five hundred thirty-one (35%) nonparticipants and 200 participants (100%) returned the respective questionnaires. Nonparticipation was associated with a lower interest in obtaining personal health information (OR = 3.32) and a preference for less invasive (OR = 3.01) and less time-demanding (OR = 2.19) studies. Responses to other items, e.g. regarding altruistic motives, monetary compensation, general interest of the study, or study approval through ethics committee and data security authority, did not differ between participants and nonparticipants.

Conclusions

Participation rates in health studies among elderly individuals could potentially be improved by reducing interventions and time demand, for instance by implementing methods of self-sampling and remote data collection.

Trial registration

No. 1100359 (ClinicalTrials.gov, date of registration: 09.02.2015).

Peer Review reports

Background

Participation in epidemiological studies has declined dramatically over the last few decades [1]. Any attempts to improve response rates and to reduce the resulting biases require an understanding of the reasons for (non)participation. A large body of research has examined various reasons for (non)participation in epidemiological studies [2, 3]. Most of the studies focused either on participants or nonparticipants, or compared the two groups only in terms of sociodemographic or health/disease differences such as sex, age, education level and presence of comorbidities [4, 5]. Apart from a comparison of sociodemographic factors between participants and nonparticipants, a direct comparison of motivations in these two groups leading to a decision to participate in a health-related study has not been made. In addition, very little is known about the reasons for (non)participation in health research among elderly individuals. Especially this population group possesses potentially important factors affecting willingness and/or ability to participate in health studies, such as overall increased morbidity with reduced physical mobility and time competition from other health-related or medical obligations. A few studies examined the reasons for (non)participation among elderly individuals in the context of specific topics. For example, Townsley et al. examined attitudes towards participation in clinical trials among 94 elderly cancer patients and found that recommendations from a cancer physician and personal benefit in form of better treatment were the most frequently reported reasons for participation [6]. Allsup and Gosney collected information on various reasons for nonparticipation in a randomized controlled trial on influenza vaccination among the 1173 elderly nonparticipants; the most frequently reported reasons were “unwillingness to participate in a research project” (53%), “concerns about side effects” (34%) and “do not require the vaccine” (32%) [7]. Costa et al. investigated motivations for participating in a trial on an avian influenza vaccine among 364 healthy adult participants [8]; the most important motivation for participating was an altruistic reason, where 43% reported “collaboration with science”. An altruistic reason for participating in a prospective study on Alzheimer’s disease was reported by half of the elderly study participants [9]. All of the above mentioned studies examined various reasons either among participants or among nonparticipants, but none of these studies compared, in parallel, the reasons stated by participants and nonparticipants of the same study.

While overall participation rates are dropping, epidemiological studies have been intensifying the depth of phenotyping, for instance by broadening the spectrum of medical examinations and by collecting biological samples such as saliva, blood, stool, or microbiological swabs for the establishment of biobanks for detailed molecular assessments [1]. Studies collecting less invasive biospecimens such as saliva may not influence the willingness to participate. However, less is known about studies that apply more invasive biospecimen collection associated with various risks of complications and more complex and intensified data collection protocols.

From September 2015 to May 2016, we conducted a population-based, prospective cohort study among individuals ≥65 years of age (n = 200), which featured vaccination with a seasonal influenza vaccine and collection of serial blood samples on days 0, 1/3, 7, 21 and 70. Applying a 10-item self-administered questionnaire on various reasons for participating in a hypothetical health study to both participants and nonparticipants of this study, we aimed to identify key factors leading to (non)participation of elderly individuals in health research.

Methods

Sampling and study design

Females and males between 65 and 80 years of age (N = 5582) were randomly selected by the residents’ registration office in Hannover, Germany. Invitations were sent by mail to participate in a prospective cohort study on influenza vaccination spanning the time period from September 2015 to May 2016. A travel reimbursement of 30 € was offered for participation. Individuals who agreed to participate were invited to the study center located in the Clinical Research Center (CRC) Hannover. The participants underwent medical examinations, including measurements of height, weight, and blood pressure, collection of a blood sample (75 ml) and subsequent influenza vaccination with an inactivated, trivalent, adjuvanted (MF59) vaccine (Fluad™, Novartis Vaccines and Diagnostics S.r.l., Rosia, Italy) licensed in Germany for use in individuals ≥65 years. Serial blood samples were collected on days 0, 1/3, 7, 21 and 70 after vaccination. A detailed description of the study protocol is provided elsewhere [10].

Questionnaire on reasons for participating in health research

A 10-item self-administered paper-based questionnaire about reasons for participation in a hypothetical health study was administered to all participants in the vaccination study and randomly selected nonparticipants (see Additional file 1). All 10 items used the Likert scale with the five categories “very important”, “important”, “so-so”, “not important” and “not at all important”. In addition, there was one open-ended question. The questionnaire addressed the following reasons for (non)participation: altruistic motives [2 items], personal benefit (monetary and nonmonetary [2 items]), possible risks due to medical procedures such as blood samples [1 item], time demand [1 item], ethical and data security issues [2 items], participation in a study with an interesting topic [1 item], and seriousness of the study [1 item].

Nonresponder survey

The nonparticipant group comprised individuals (1) who had notified us of their nonparticipation by returning a form included in the letter with the initial study invitation or (2) who did not respond to the initial study invitation. We conducted a nonresponder survey among 1500 (48% and 52% of male and females, respectively) randomly selected nonparticipants by sending them a 24-item questionnaire by mail, which included information on presence and frequency of upper and lower respiratory tract infections, gastrointestinal infections, presence of chronic diseases such as myocardial infarction, diabetes mellitus, cancer, stroke, history of influenza vaccinations, height and weight, self-perceived health status, education level, and the above-mentioned 10-item questionnaire on reasons for participating in health research.

Statistical analyses

The chi-square test was used to examine the significance of differences in the reasons for participating between participants and nonparticipants of the study. Furthermore, multivariable logistic regression analysis was used to identify the reasons significantly associated with nonparticipation. The outcome variable in a logistic regression model consisted of two categories: participants and nonparticipants of the influenza vaccination study. We modeled the probability of being a nonparticipant. Theoretically, the probability of being a participant can also be modeled, therefore, we used the term “(non)participation” that can be interpreted in both directions, i.e. reasons of participation or nonparticipation. All 10 items on reasons for participating and the variables sex, age (continuous variable), diabetes, cancer, myocardial infarction, self-perceived health status, and history of previous influenza vaccination were included in the model. The backward stepwise selection procedure based on the Wald test with a significance level of 0.1 for removal of the independent variables was applied [11]. We also performed a sensitivity analysis by excluding those nonparticipants whose main reason for not participating in the influenza vaccination study was that they had already received the vaccine for that season. Venn diagrams were used to address the question whether the three reasons most strongly associated with (non)participation were a characteristic common of specific subgroups of nonparticipants (and participants) or whether they were randomly distributed. Statistical analyses were carried out with IBM SPSS Statistics, version 20 (IBM Corporation, Armonk, NY, USA). Figures were made with the R Foundation for Statistical Computing (version 3.2.3); packages “ggplot2” and “VennDiagram” were used for Fig. 1 and Fig. 2, respectively.

Fig. 1
figure 1

Reasons for participating in health research among participants and nonparticipants of the influenza vaccination study. * Chi-square test

Fig. 2
figure 2

Venn diagrams of the relationships across the three reasons mostly associated with (non)participation in a hypothetical health study among participants (a) and nonparticipants (b) of the influenza vaccination study. The data are based on the number of individuals who responded with “very important” or “important” to the questions on time demand and medical interventions, and “not important” or “not at all important” to the question on receiving health information (see Fig. 1, Table 2). Abbreviations: imp. = important; unimp. = unimportant

Results

Of the 5582 invited individuals, 223 agreed to participate in the influenza vaccination study, resulting in an initial response rate of 4.0%. After screening for the exclusion criteria, 181 individuals were eligible to participate, corresponding to a final participation rate of 3.2% (181/5582). In addition, we included 19 individuals from a convenience sample (mostly spouses of study participants). Thus, the final study population consisted of 200 individuals, all of whom completed the end-of-study questionnaire. Of the 1500 nonparticipants, 531 (35%) returned the nonresponder questionnaire.

Differences between participants and nonparticipants

There were significant differences between the participants and nonparticipants of the study in terms of diabetes mellitus and self-perceived health status (Table 1); participants differed from nonparticipants by less self-reported diabetes mellitus (X 2 = 7.10, df = 1, n = 716, p = 0.008) and a better self-perceived health status (X 2 = 24.64, df = 4, n = 680, p < 0.0001). There were no significant differences in terms of sex, age, self-reported myocardial infarction, cancer, and history of previous influenza vaccination (Table 1).

Table 1 Comparison of the participants and nonparticipants of the influenza vaccination study in terms of demographic and health-related variables, %

Reasons for nonparticipation in the influenza vaccination study

The reported reasons for not participating in the study were “I have already been vaccinated” (55%), “I was not convinced of aim and purpose of the study” (9.7%), “no specific reason” (8.8%), “due to lack of time” (8.0%), “for health reasons” (7.4%), “no interest” (6.3%), “too many blood draws” (3.2%), “for employment-related reasons” (1.1%), and “language problems” (0.84%).

Reasons for (non)participation in health research

In a univariable analysis we found six reasons significantly different between the participants and nonparticipants (Fig. 1). For example, around 20% of the nonparticipants reported that “The study should contain few medical interventions such as taking blood sample” compared to only 8.8% of the participants. Around 16% of the nonparticipants stated that “The study should not take up too much of my time” compared to only 8.7% of the participants. In a multivariable analysis five reasons remained in the model after backward elimination (Table 2). The strongest association was observed for the item “I receive information about my health”; individuals, who reported “not important” on this item, were more likely not to participate. In addition, individuals who reported importance with “Few medical interventions such as blood collection” and “The study should not take up too much of my time” were more likely to be nonparticipants. Also, females, individuals with self-reported diabetes and with poor/fair self-perceived health status were more likely not to participate (Table 2). The final model with the remaining items explained 24% of the variance (Nagelkerke’s pseudo R2: 0.24). In the sensitivity analysis (in which individuals were excluded who had stated prior vaccination as the reason for not participating) the effects of the three items mentioned above increased (Table 2, sixth column). In addition, two items “Review and approval by the data security authorities” and “A contribution to society” were significantly associated with being a nonparticipant (Table 2, sixth column).

Table 2 Effect of motivations to participate in health research on nonparticipation in the influenza vaccination study among elderly individuals (results of multivariable logistic regression analyses)

The Venn diagrams in Fig. 2 show the numbers of participants and nonparticipants who answered “very important” or “important” to the questions relating to time demand and medical interventions, and “not important” and “not at all important” to the question relating to health information. In both groups there was an association between the questions on time demand and medical interventions, in that 58% of all participants and 52% of all nonparticipants who gave importance to one also did so to the other. On the other hand, there were no participants and only 4% nonparticipants who, in addition, stated that information on personal health would not be an important reason for participation.

Discussion

To the best of our knowledge, this is the first study which, by applying a questionnaire in parallel to both participants and nonparticipants, aimed to identify reasons for (non)participation in health research among participants and nonparticipants of a population-based health-related study among the elderly. Previous research examined the reasons either in qualitative studies with small groups of individuals [12,13,14] or were of a descriptive nature by recording the reasons either only among participants [8] or nonparticipants [7, 15]. In contrast to those studies, we used an analytical approach by applying multivariate techniques with automatic selection to identify the most important reasons for (non)participation. In contrast to other studies, the participants and nonparticipants of our influenza vaccination study did not differ much in terms of basic sociodemographic and health-related characteristics such as age, Body Mass Index, self-reported myocardial infarction and cancer. However, multivariable analyses showed that the risk of nonparticipation increased significantly among females, those with diabetes, and a poorer self-perceived health status, indicating a possible selection bias.

The identified reasons for (non)participation in health research were the combination of various reasons and can be summarized into three groups: a) reasons associated with personal benefit (e.g. receiving information about personal health status), b) reasons associated with invasiveness of the study instruments (e.g. blood draws), and c) reasons associated with time demand by the study. In addition, altruistic motives and data security issues were significantly associated with (non)participation, but only in the sensitivity analysis. The latter analysis excluded the nonparticipants whose main reason for not participating in the influenza vaccination study was that they had already received the vaccine for that season. The remaining nonparticipants may be considered “true” nonparticipants and the two items identified in the sensitivity analysis (altruistic motives and data security issues) should therefore also be taken into account.

Personal benefit in form of monetary and nonmonetary advantage has been observed in many studies and is used as an incentive to increase response rates [16]. Receiving information on personal health was found to be a driving reason for participation in genomic studies among elderly individuals in Switzerland [17]. Benefits from participation in a health study should be clearly communicated to potential study participants to increase the response rates, e.g. through addressing them adequately in the consent forms. In line with our finding on time demand by the study, Gaertner et al. observed that “no time” was among the top five reasons for nonparticipation reported in a health survey among elderly nonparticipants in Berlin, Germany [15]. Alternative methods of data collection that reduce the time demands by a study should be considered, such as home visits, self-collection of biosamples, or web-based data collection. However, web-based data collection might not be feasible in the current elderly population. This might change considerably in the future, as a result of aging of computer/internet users and increasing acceptance of electronic media among senior citizens.

There was considerable overlap between the subgroups who considered low time demand and low number of medical interventions important (see Fig. 2). This observation makes sense from the point of view of human behavior, as “impatient” personality traits or perceived or real high demands on an individual’s time may likely affect the responses to these two questions similarly. On the other hand, there was only a very small percentage of nonparticipants who, in addition, did not find receiving health information a motivating factor. Thus, we did not identify a specific subgroup of individuals with particularly adverse attitudes toward participating in health research.

A monetary incentive turned out to not be a determinant of (non)participation. This is in line with results from our other population-based studies in urban Northern Germany, i.e. a resource-rich setting. In a pilot study in Pretest 2 of the German National Cohort, a monetary incentive was not associated with participants’ willingness to participate in future studies [18]. Likewise, in a study on serial home-collection of anterior nasal swabs for S. aureus surveillance, a monetary incentive did not increase participants’ compliance with the study protocol [19]. These findings are important for cost-efficient planning of future studies in populations such as ours, but may not be transferable to research settings in resource-poor countries.

The response rate to the influenza vaccination study was very low. Therefore, new strategies are required to recruit adequate numbers of study participants for studies where representativeness of the general population is important. Sampling based on the residents’ registry alone turned out to be an inefficient way to recruit a study population representative of the general aging population. Although we oversampled older age groups to achieve representativeness in terms of age, it is difficult to control for other parameters. For example, we missed frail individuals living in nursing homes. Thus, one needs to consider other sampling approaches in addition to the traditional register-based sampling, such as recruitment in nursing or residential care homes for elderly individuals, family physicians’ offices, or other places with a high accumulation of senior citizens, such as senior citizens’ associations or community support structures for the elderly. A recent systematic review showed that response rates were higher among population-based studies which apply face-to-face interviews, provide home visits for examinations, or had a less intensive study protocol [20]. We did not address the first two aspects in our present study, but it appears plausible that, in addition to offering a stream-lined study protocol with few interventions, providing home visits could further increase participation rates in health-related studies among elderly individuals.

Limitations of the study

This study has two potential limitations. First, only one third of the nonparticipants returned the nonresponder questionnaire. This subsample may be biased in terms of selected sociodemographic characteristics and may thus not be representative of the general population. For instance, we failed to obtain information about nonparticipants who could not complete and/or mail the questionnaire due to frailty or dementia. Second, the 10-item questionnaire was administered to the participants of the vaccination study at the last follow-up visit. Experiences made while participating in the study may have affected their attitudes toward health research and participation in health-related studies.

Conclusions

We identified a low interest in obtaining personal health information and a preference for less intrusive and time demanding studies as major determinants of nonparticipation in health-related studies among the elderly. These findings may aid in adapting study protocols to improve participation rates for future population-based health studies, particularly among the elderly.

Abbreviations

AOR:

Adjusted odds ratio

BMI:

Body mass index

CI:

Confidence interval

CRC:

Clinical research centre

imp:

Important

unimp:

Unimportant

References

  1. Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163:197–203.

    Article  PubMed  Google Scholar 

  2. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.

    Article  PubMed  Google Scholar 

  3. Hartge P. Participation in population studies. Epidemiology. 2006;17:252–4.

    Article  PubMed  Google Scholar 

  4. Nummela O, Sulander T, Helakorpi S, Haapola I, Uutela A, Heinonen H, et al. Register-based data indicated nonparticipation bias in a health study among aging people. J Clin Epidemiol. 2011;64:1418–25.

    Article  PubMed  Google Scholar 

  5. Vind AB, Andersen HE, Pedersen KD, Jorgensen T, Schwarz P. Baseline and follow-up characteristics of participants and nonparticipants in a randomized clinical trial of multifactorial fall prevention in Denmark. J Am Geriatr Soc. 2009;57:1844–9.

    Article  PubMed  Google Scholar 

  6. Townsley CA, Chan KK, Pond GR, Marquez C, Siu LL, Straus SE. Understanding the attitudes of the elderly towards enrolment into cancer clinical trials. BMC Cancer. 2006;6:34.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Allsup SJ, Gosney MA. Difficulties of recruitment for a randomized controlled trial involving influenza vaccination in healthy older people. Gerontology. 2002;48:170–3.

    Article  PubMed  Google Scholar 

  8. Costas L, Bayas JM, Serrano B, Lafuente S, Munoz MA. Motivations for participating in a clinical trial on an avian influenza vaccine. Trials. 2012;13:28.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Neugroschl J, Sano M, Luo X, Sewell M. Why They Stay: Understanding Research Participant Retention in Studies of Aging, Cognitive Impairment and Dementia. J Gerontol Geriatr Res. 2014;3(4):1000170.

  10. Akmatov M, Riese P, May M, Jentsch L, Ahmed M, Werner D, et al. Establishment of a cohort for deep phenotyping the host response to influenza vaccination among elderly individuals recruited from the general population. Submitted to Human Vaccines and Immunotherapeutics. 2016.

  11. Hosmer D, Lemeshow S. Applied logistic regression. 2 edition. New York: John Wiley & Sons, Inc.; 2000.

  12. Elskamp AB, Hartholt KA, Patka P, van Beeck EF, van der Cammen TJ. Why older people refuse to participate in falls prevention trials: a qualitative study. Exp Gerontol. 2012;47:342–5.

    Article  PubMed  Google Scholar 

  13. Attwood S, Morton KL, Mitchell J, Van EM, Sutton S. Reasons for non-participation in a primary care-based physical activity trial: a qualitative study. BMJ Open. 2016;6:e011577.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Newington L, Metcalfe A. Factors influencing recruitment to research: qualitative study of the experiences and perceptions of research teams. BMC Med Res Methodol. 2014;14:10.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Gaertner B, Seitz I, Fuchs J, Busch MA, Holzhausen M, Martus P, et al. Baseline participation in a health examination survey of the population 65 years and older: who is missed and why? BMC Geriatr. 2016;16:21.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Edwards P, Roberts I, Clarke M, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3:MR000008.

    Google Scholar 

  17. Mahlmann L, Rocke C, Brand A, Hafen E, Vayena E. Attitudes towards personal genomics among older Swiss adults: an exploratory study. Appl Transl Genom. 2016;8:9–15.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Schweitzer A, Akmatov MK, Kindler F, Kemmling Y, Kreienbrock L, Krause G, et al. The impact of distance and duration of travel on participation rates and participants’ satisfaction: results from a pilot study at one study centre in pretest 2 of the German national cohort. BMJ Open. 2015;5:e007461.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Akmatov MK, Mehraj J, Gatzemeier A, Strompl J, Witte W, Krause G, et al. Serial home-based self-collection of anterior nasal swabs to detect staphylococcus aureus carriage in a randomized population-based study in Germany. Int J Infect Dis. 2014;25:4–10.

    Article  PubMed  Google Scholar 

  20. van Zon SK, Scholtens S, Reijneveld SA, Smidt N, Bültmann U. Active recruitment and limited participant-load related to high participation in large population-based biobank studies. J Clin Epidemiol. 2016;78:52–62.

Download references

Acknowledgments

We thank the study teams at the Clinical Research Center Hannover and Hannover Unified Biobank for their contributions to conducting the vaccination study. We thank Dr. Aparna Schweitzer (German Center for Neurodegenerative Diseases, Bonn) for valuable input and Sabrina Wieghold and Cornelia Senske (Helmholtz Centre for Infection Research, Braunschweig) and Kevin Pessler for support with recruiting the study participants.

Funding

This work was supported by iMed – the Helmholtz Association’s Cross-Programme Initiative on Personalized Medicine.

Availability of data and materials

The data used in the study are available from the corresponding author.

Authors’ contributions

MKA conceived this specific project, participated in planning the influenza vaccination study, was responsible for recruiting the study participants and for conducting the nonresponder survey, performed the statistical analyses and wrote the first draft of the manuscript. LJ participated in literature research, recruitment of study participants, and data collection. PR participated in planning the influenza vaccination study. MWA, DW and AR participated in recruitment of study participants and data collection. MM and CS participated in study planning and data collection. BP participated in planning the vaccination study and recruiting participants. IB, JP, NK, and TI participated in planning and conduct of the influenza vaccination study. CAG is a principal investigator of the project, he planned the influenza vaccination study and edited the manuscript. FP is a principal investigator of the trial, he planned the influenza vaccination study, co-wrote the manuscript, had access to all data and takes full responsibility for their integrity. All authors critically reviewed the manuscript and approved the final version of the manuscript.

Competing interests

The authors declare that they have no competing interests relating to the conduct of this study or the publication of this manuscript.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The study was approved by the Ethics Committee of Hannover Medical School, Germany (No. 6775). All participants provided informed consent before entering the study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Manas K. Akmatov.

Additional file

Additional file 1:

Questionnaire on reasons to participate in health research. (PDF 125 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Akmatov, M.K., Jentsch, L., Riese, P. et al. Motivations for (non)participation in population-based health studies among the elderly – comparison of participants and nonparticipants of a prospective study on influenza vaccination. BMC Med Res Methodol 17, 18 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12874-017-0302-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12874-017-0302-z

Keywords