Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Design and implementation of a massive open online course on enhancing the recruitment of minorities in clinical trials – Faster Together

BMC Medical Research Methodology volume 21, Article number: 44 (2021) Cite this article

Abstract

Background

Racial and ethnic minorities are often underrepresented in clinical trials, threatening the generalizability of trial results. Several factors may contribute to underrepresentation of minorities in clinical trials, including lack of training for researchers and staff on the importance of diversity in clinical trials and effective strategies for recruiting and retaining minority populations.

Methods

Applying community engaged research principles, we developed a massive open online course (MOOC) to help research team members develop knowledge and skills to enhance the recruitment of minorities in clinical trials. A transdisciplinary working group, consisting of clinical researchers, community engagement specialists, minority clinical trial recruitment and retention educators and specialists, and knowledge management information scientists, was formed to develop an evidence-based curriculum. Feedback from the Recruitment Innovation Center Community Advisory Board was incorporated to help finalize the curriculum. The course was implemented in Coursera, an online learning platform offering MOOCs. A bootstrap paired sample t-test was used to compare pre- and post-assessments of knowledge, attitudes, and intentions as it relates to minority recruitment.

Results

The final course, entitled Faster Together, was divided into eight 1-h modules. Each module included video presentations, reading assignments, and quizzes. After 10 months, 382 individuals enrolled in the course, 105 participants completed the pre-test, and 14 participants completed the post-test. Participants’ knowledge scores were higher with an increase in the mean number of correct answers from 15.4 (95% CI:12.1–18.7) on the pre-test to 18.7 (95% CI:17.42–20.2) on the post-test. All post-test respondents (n = 14) indicated that the course improved their professional knowledge, and 71.4% of respondents indicated that they were very likely to make changes to their recruitment practices.

Conclusions

Faster Together, a massive open online course, is an acceptable, accessible approach to educating research teams on minority recruitment in clinical trials. Preliminary evidence indicates the course increased knowledge on how to recruit minorities into clinical trials and could promote change in their recruitment practices.

Peer Review reports

Background

Establishing diversity in clinical trials remains a research priority due to the challenges in recruiting and retaining racial and ethnic minorities [1,2,3,4,5]. Failure to achieve adequate diversity in research participation makes it difficult to understand population differences in the efficacy of treatments, address health disparities, and provide personalized, evidence-based medicine. Federal initiatives have been developed to address underrepresentation of minorities in clinical trials. For example, the 1993 National Institutes of Health (NIH) Revitalization Act [6] required the inclusion of women and minorities in clinical research studies receiving NIH funding. More recently, the U.S. Food and Drug Administration issued a draft guidance document to help sponsors increase accrual of underrepresented groups in clinical trials [7]. Yet, studies continue to demonstrate disparities in the recruitment of racial and ethnic minorities [3,4,5, 8, 9].

Underrepresentation of racial and ethnic minorities in clinical trials has been attributed to several different factors. Examples include distrust of researchers and clinicians, lack of culturally-appropriate educational materials about clinical trials, language barriers, immigration status concerns, and lack of knowledge about clinical trials [10,11,12,13,14]. Many of the strategies that have been proposed to increase minority participation in research aim at reducing the barriers to participation [15,16,17]. Recent findings, however, suggest that researchers and their teams may inadvertently contribute to underrepresentation through lack of knowledge about the importance of diversity in research participation and of skills to engage underrepresented groups. For example, Niranjan et al. [18] found that stakeholders, including principal investigators, research staff, referring clinicians, and cancer center leaders, from five U.S. cancer centers affiliated with the consortium for Enhancing Minority Participation in Clinical Trials (EMPaCT) were not receiving training on recruitment and retention of minority groups [18]. This highlights the need for comprehensive training to help researchers appreciate participant diversity and engage underrepresented minorities and marginalized communities in clinical trials.

The Recruitment Innovation Center (RIC) was funded in 2016 by the NIH to develop and foster evidence-based recruitment and retention practices for the Trials Innovation Network (TIN), a collaborative initiative aiming to optimize the infrastructure of clinical trials at a national level [19]. Addressing barriers to recruitment and retention in minority and underrepresented groups advances the overall RIC goals of improved clinical trials quality, increased and diversified trial enrollment, and improved national health outcomes. We developed a massive open online course (MOOC) aimed at providing training for research team members to develop skills and knowledge about the recruitment of minorities in clinical trials. Here, we describe our course development process and report the enrollment and course evaluation data in the 10-month period after the course was released.

Methods

Course development

A transdisciplinary working group was established to develop the course. The team included clinical researchers, community engagement specialists, minority clinical trial recruitment and retention educators and specialists, and knowledge management information scientists. To guide the curriculum development process, a review of the literature was conducted to identify: 1) knowledge and skills needed to effectively recruit and retain minorities in clinical trials; and 2) existing training programs and resources to help enhance recruitment and retention of minorities in clinical trials (Additional file 1). The search was not limited by study type. The results were summarized using a narrative format. See additional file 1 for a description of the methods and results from the literature review.

The working group applied their skills and expertise to the development of the course. The team was experienced with developing and testing innovative recruitment strategies that consider methods for gathering authentic community feedback [20], evidence-based guides for culturally-tailored recruitment materials and messaging, and community-informed recruitment plans [21]. The team also was experienced with cancer trial recruitment training for primary care providers [22, 23], community leaders and research staff and quality improvement in recruitment and retention [24]. Additionally, the group had conducted previous research on factors influencing decisions by minorities to participate in research [25], how trust is critical for engagement in research and health care [26], what different populations value in return for their research participation [27], and how the use of community engagement principles and approaches can enhance clinical trial recruitment and retention [28].

The curriculum was influenced by previous training developed by the instructors. Examples include the Meharry-Vanderbilt Community Engaged Research Core “Art of Recruitment” module which was originally created in 2014 and subsequently adapted and tailored for specific trials [29], the curricula developed by the Education Network to Advance Cancer Clinical Trials (ENACCT) to train cancer clinical trial research staff on improving recruitment and retention practices, especially for minority groups [24, 30], and train-the-trainer programs with community leaders to increase cancer clinical trial participation among minority groups [30,31,32,33,34,35].

The team worked to make sure that the learning materials were up-to-date and supported by research evidence. This was done by reviewing the literature to guide the development of the curriculum, providing documentation of references in the videos where appropriate, and creating compilations of cited references for each learning module for learners to download and review. One of the unique aspects of the course is how it demonstrates the importance of plain language when communicating with patients and potential participants about clinical trials [36]. For example, the course materials were targeted at a fifth to eighth grade reading level to provide a model for how clinical research team members should communicate with potential participants about clinical trials while ensuring the applicability of its content to a diverse group of clinical research team members, including those who do not have a formal advanced education. Additionally, adult learning theory was applied in developing the training, including offering a learning experience that was relevant, self-directed, and problem based [37].

The transdisciplinary working group worked together with videographers to implement the course in Coursera, an online learning platform offering massive open online courses (MOOCs). After implementing a draft version of the course in Coursera, members of the RIC Community Advisory Board (CAB) were asked to provide feedback on the course through online meetings held in December 2018. A key component of the RIC, the 12-member CAB is a racially, ethnically and geographically diverse group, which includes members with experience partnering with academic researchers to engage diverse community members as research participants and research partners. CAB members represent a variety of community-based organizations including health, social service, faith and advocacy and include patients, caregivers, and past clinical trial participants.

The CAB members were given an overview and demonstration of the course, with representative examples of videos, reading assignments, and quizzes provided from Module 1. Discussion questions included if the slides shown in the videos and language were clear, if any visual part of the training hampered the learning experience, if the exercises and quizzes were adequate, and if there was any component they strongly disliked. Notes were taken during the meetings to record the CAB members’ feedback.

Overall, the feedback from the CAB was positive. One recommendation was to modify the suggested answers to the Module 1 in-video quiz questions which addressed how to respond to potential participants’ research concerns and mistrust in researchers and the process due to past research abuses. Specifically, the suggestion was to include language validating the concerns of the potential research participants. The CAB also suggested adding language after the section on historical research abuses in Module 1 to help reassure course participants that steps are being taken to prevent abuses from happening again and providing more examples of why participation in research matters. Modifications to the course were made in response to the feedback received.

The course was titled, “Faster Together, Enhancing the Recruitment of Minorities in Clinical Trials,” and launched on April 1, 2019 in Coursera [38]. Minor changes were made to the reading assignments after the course release date based on feedback from the learners to help clarify the assignments and also to incorporate new references identified after the course release date. The changes that were made did not impact the ability to answer the knowledge assessment used in the course evaluation study. See the results section of the manuscript for a full description of the course.

Course evaluation study

Design, setting, and participants

All participants who enrolled in the course from the course release date, April 1, 2019, through January 31, 2020, were eligible to participate in the course evaluation study described here. Course learners who completed the pre-test were sent an invitation to complete the post-test 1 week later with instructions to begin the survey after completing the course. Responders who completed the post-test by May 17, 2019, had an opportunity to enter a drawing to win one of two $100 Amazon gift cards.

The course was promoted through different mechanisms, including through an online forum for people interested in or having self-described expertise in recruitment, a Trial Innovation Network Collaboration webinar, Medical Library Association poster presentation, and the online Recruitment Innovation Center toolkit. The course was also shared with individual multi-site clinical trials through the Recruitment Innovation Center. Individuals who enrolled in the Coursera course were given brief information about the study and a link to the pre-test through the first reading assignment in the course.

Variables and data sources/measures

Pre- and post-test surveys were created using REDCap, a secure online platform for creating and maintaining surveys and databases [39]. The pre-test included basic demographic questions (e.g., race/ethnicity, sex, age, occupation, etc.) and a knowledge assessment consisting of 28 items in multiple choice and true/false formats addressing topics covered in the course (Additional file 2). The pre-test additionally included 10 items addressing participants’ attitudes and intentions regarding recruitment using a 5-point Likert scale based on agreement (Additional file 2) [24].

The post-test included the same knowledge assessment questions and items addressing attitudes and intentions towards minority recruitment as the pre-test. Additionally, participants were asked to indicate whether course participation increased their professional knowledge of the subject (yes/no) and rate how likely they were to make changes in their clinical trial recruitment and retention practices due to course participation using a 4-point Likert scale based on likelihood. Adapted from the ENACCT Pilot Education Program (Additional file 2) [24], 8-items queried participants’ feedback on their training experience.

Data were also collected from the Coursera Course Summary Dashboard [40] on the number of unique visitors to the course website, the number of participants who enrolled in the course, the number of participants who started an item in the course, and the number of participants who completed the course.

Study size

The sample size was determined by the responders to the course and the pre- and post-test questionnaires.

Data collection

This paper reports data collected through the pre- and post-tests and course enrollment from the Coursera Course Summary Dashboard [40] during the period of course release (April 1, 2019) through January 31, 2020. The pre- and post-tests were expected to require between 15 and 20 min to complete. Participants indicated their willingness to complete the survey by providing written assent.

Statistical methods

Frequencies and percentages were used to describe the demographic variables. Because of the small sample size, a paired-sample t-test and Bootstrap confidence intervals were used in 2000 samples to compare pre- and post-assessments of knowledge, attitudes, and intentions as it relates to minority recruitment. Missing data were excluded. Measures of acceptability and satisfaction were summarized using counts and frequencies. There is no allowance for multiplicity. SPSS version 25 was used for all statistical analyses.

Results

Course description and features

The intended audience for the online Coursera course Faster Together, Enhancing the Recruitment of Minorities in Clinical Trials is individuals currently involved in or seeking to be involved in clinical trial recruitment, including community educators, patient navigators, and research team members. The goal of the course is to provide training and support for researchers and their teams to engage communities not usually approached for research studies as one step toward expanding representation of racial and ethnic minorities in clinical trials. Individuals can enroll in the course at any time and complete the assignments at their own pace. There is no fee to enroll in the course and access the learning materials; however, learners have the option to pay to receive a Coursera course certificate after completing the training. For course completion, learners must achieve a passing score on all graded assignments.

The course is divided into 8 modules: 1) understanding the need to increase minority recruitment in clinical trials; 2) key principles of community engagement; 3) reaching out into the community: effective communication; 4) educating potential research participants; 5) outreach with community healthcare providers; 6) effective screening, education, and decision support; 7) managing an effective, person-centered consent process; 8) person-centered retention. The modules address competencies related to the recruitment of minority populations into research studies and consist of video presentations, reading assignments, and quizzes (Additional file 3). The estimated completion time is approximately 1-h per module, of which the total video duration is 24 min or less per module (Additional file 3).

The primary didactic content is provided through the video lectures, which feature the course instructors discussing the material, with key points emphasized through text and images, as appropriate (Fig. 1). The course instructors include a community engagement specialist, Executive Director of Community Engagement, clinical trials education specialist, and Vice President of Health Equity- all of whom have extensive years of experience in recruiting underrepresented populations into research. The course instructor videos are supplemented by excerpts of interviews with minority research participants discussing their concerns about participating in clinical research studies. To give learners an opportunity to practice their skills, video scenarios, showing hypothetical interactions between potential participants and research team members, were filmed with actors and inserted in the videos. Learners are asked how they would respond to the different scenarios using an open response format and can view a suggested correct answer after entering a response.

Fig. 1
figure 1

Screenshot of a video from Module 1

Full size image

The course includes several unique features to adhere to adult learning principles and foster participatory learning. The reading assignments were designed to supplement the video presentations and include information about freely available toolkits and resources to help research team members create and implement strategies to help increase recruitment and retention of minorities. The module quizzes, which consisted of multiple choice, true/false, and reflective questions, were designed to facilitate the learners’ ability to self-assess their understanding of the learning objectives. The module quizzes are auto-graded, and feedback is provided immediately after learners submit a quiz to stimulate learning. In contrast to the pre- and post-tests, learners can retake the module quizzes until they feel they have completely learned the material. Learners are also asked to complete an action planning tool at the end of each module to help them plan steps they could take to help increase recruitment of minorities in clinical trials at their own institutions. The action planning tool is an optional activity. The modules also included a slide version of the videos and list of references for learners to download from Coursera. The course and its materials can be accessed at http://www.coursera.org/learn/recruitment-minorities-clinical-trials.

Course effectiveness and reception

From course launch on April 1, 2019 through January 31, 2020, 3382 individuals visited the course website, 382 individuals enrolled in the course, 224 learners started an item in the course, and 46 learners completed the course.

One hundred five participants completed the pre-test, and 14 participants completed both the pre- and post-tests (Fig. 2). Baseline characteristics of those who participated in the evaluation study are summarized in Table 1. Of those who completed the pre-test, most respondents were female (85.7%), United States residents (83.7%), and White (55.2%). The median age was 35 years (Interquartile Range [IQR]: 28–47 years).

Fig. 2
figure 2

Flowchart of participants in the course evaluation study

Full size image
Table 1 Characteristics of respondents to the pre- and post-tests
Full size table

The median number of correctly answered pre-test knowledge assessment items for all participants (N = 105), participants who completed the pre-test but not the post-test (n = 91), and participants who completed both the pre- and post-tests (n = 14) was 17.0 items (IQR 13.0–19.0; N = 105), 17.0 items (IQR: 13.0–19.0; n = 91), and 16.0 items (IQR: 12.8–19.0; n = 14), respectively. Changes in knowledge, attitudes, and intentions were assessed using data from participants who completed both the pre- and post-tests (n = 14). Participants’ knowledge scores were higher with an increase in the mean number of correct answers from 15.4 (95% CI:12.1–18.7) out of 28 items (55%) on the pre-test to 18.7 (95% CI:17.42–20.2) out of 28 items (66.8%) on the post-test. According to the Bootstrap test, the mean number of correct answers for the pre-test was not within the confidence interval for the post-test (Table 2). The variation of pre- to post- change across the individual knowledge assessment questions is shown in Additional file 4. Performance on individual knowledge assessment questions, reported as the percentage of participants responding correctly, was higher for 21 of the 28 items on the post-test than the pre-test (Additional file 4). Attitudes and intentions for minority recruitment changed very little if at all pre- to post-test. According to the Bootstrap test, the mean scores for attitude and intentions towards minority recruitment on the pre-test were within the confidence interval of the post-test scores (Table 2).

Table 2 Comparison of the mean in knowledge, attitudes, and intentions pre-post using paired samples t-test
Full size table

All respondents indicated that participating in the course improved their professional knowledge of the subject (14/14; 100%) and that they were either ‘very likely’ (10/14; 71.4%) or ‘somewhat likely’ (4/14; 28.6%) to make changes in their clinical trial recruitment and retention practices as a result of participating in the educational activity. Participants displayed high levels of satisfaction with the learning materials and the course format (Table 3).

Table 3 Participant feedback on the course
Full size table

Discussion

Faster Together is the first reported massive open online course for research team members aimed at improving knowledge and skills to enhance the recruitment of racial and ethnic minorities in clinical trials. Through use of the Coursera platform, the course has the potential to reach a broad audience by offering training in an online, asynchronous learning format. Responses to the course feedback questions indicate learners were satisfied with the course content and format, perceived the course as useful, and were likely to make changes to their recruitment practices as a result of participating in the course. Our evaluation indicates that the course increased participants’ knowledge of the minority recruitment and retention and that learners are motivated to work towards increasing minority recruitment in clinical trials. Although we observed an increase in recruitment and retention knowledge after the course, the intent of this project was to demonstrate the feasibility and acceptability of a MOOC for improving clinical trial recruitment. We did not observe a statistically significant impact of course participation on attitudes and behavioral intentions towards minority recruitment, which may have been the result of ceiling level effects. The overall findings demonstrate that the course has the potential to increase awareness on the importance of and strategies to increase diversity in clinical trials among research teams.

To the best of our knowledge, the course that we developed is the first freely available MOOC on minority recruitment and retention in clinical trials. Through the review of the literature that we conducted to guide the course development process, we saw that there was a lack of comprehensive training available on recruitment of minorities in clinical trials. While we identified several resources that could help research team members, individuals may not be aware that they are available or know how to find them. Participation in the course we developed helps learners gain knowledge and awareness about the importance of including minorities in clinical trials and become familiar with freely available tools and resources that could help them with minority recruitment.

Typical of other MOOCs, the completion rate of individuals who enrolled in the course was low [41,42,43]. The time commitment required for course completion (approximately 11 h) may be a barrier for many individuals. Offering continuing education credits may help bolster course enrollment and completion. Additional strategies to explore include incorporating either the full course or a subset of the modules as part of required training for research team members.

Limitations of our study include that the pre- and post-tests were not required; therefore, the data does not represent all those who enrolled in and completed the course. While participants were instructed to complete the post-test after finishing the course, they were not asked to show evidence of course completion, such as through submission of a Coursera completion certificate. We chose not to require learners to submit a completion certificate because doing so would have required participants to pay a fee. The knowledge assessment questionnaire was not pre-tested prior to administration in the study; therefore, it is possible that some of the questionnaire items may have been confusing to participants, which could have masked the detection of a greater impact on test performance. We had a small sample which reflected our inability to assess differences in the characteristics of those completing the pre- and post-tests. This may have also contributed to the small impact on knowledge gained and lack of impact on attitudes and intentions observed in our study. Furthermore, there is possible respondent bias, in which participants viewed research positively, leading to potential ceiling effects in our evaluation. We did not assess reasons for why participants did not complete the post-test.

While we assessed changes in knowledge, attitudes and intentions about recruitment after completion of the course, we did not assess the impact of completion of individual modules or measure whether behavior and other outcomes, including minority enrollment in clinical trials, were ultimately altered as a result of participation in the course. We also did not assess whether the changes in knowledge gained after completing the course were long-lasting, which would have required re-administering the knowledge questionnaire several weeks after participants had completed the course.

Conclusions

There is an urgent need for the research community to ensure that racial and ethnic minorities are adequately represented in clinical research studies. New treatments must be tested in the populations that will need them in order to understand whether there are differences in safety and efficacy. Including diverse populations in research will enable researchers to assess how factors, such as age, sex, race, and lifestyle impact treatment response.

The Faster Together massive open online course helps address a need for comprehensive training on ways to enhance the recruitment and retention of minorities in clinical trials as one step towards ending inequitable representation in research. Future work is needed to explore ways to increase course enrollment and completion within the clinical research community. Additionally, formal assessments should be conducted to determine whether completion of the training course is associated with improvements in accrual of racial and ethnic minorities in clinical trials.

Availability of data and materials

The datasets used during the current study are available from the corresponding author on reasonable request.

Abbreviations

CAB:

Community Advisory Board

ENACCT:

Education Network to Advance Cancer Clinical Trials

EMPaCT:

Enhancing Minority Participation in Clinical Trials

IRB:

Institutional Review Board

IQR:

Interquartile Range

MOOC:

Massive open online course

NIH:

National Institutes of Health

RIC:

Recruitment Innovation Center

TIN:

Trials Innovation Network

References

  1. U.S. Food and Drug Administration. FDA encourages more participation, diversity in clinical trials. 2018. https://www.fda.gov/consumers/consumer-updates/fda-encourages-more-participation-diversity-clinical-trials. Accessed 29 April 2020

    Google Scholar 

  2. Geller SE, Koch AR, Roesch P, Filut A, Hallgren E, Carnes M. The more things change, the more they stay the same: a study to evaluate compliance with inclusion and assessment of women and minorities in randomized controlled trials. Acad Med. 2018;93:630–5.

    Article  Google Scholar 

  3. Nazha B, Mishra M, Pentz R, Owonikoko TK. Enrollment of racial minorities in clinical trials: old problem assumes new urgency in the age of immunotherapy. Am Soc Clin Oncol Educ Book. 2019;39:3–10.

    Article  Google Scholar 

  4. Loree JM, Anand S, Dasari A, Unger JM, Gothwal A, Ellis LM, et al. Disparity of race reporting and representation in clinical trials leading to Cancer drug approvals from 2008 to 2018. JAMA Oncol. 2019;5(10):e191870.

    Article  Google Scholar 

  5. U.S. Food and Drug Administration. Drug trial snapshots summary report. 2019. https://www.fda.gov/media/135337/download. Accessed 26 Feb 2020.

    Google Scholar 

  6. National Institutes of Health. National Institutes of Health Revitalization Act of 1993. 1993. https://orwh.od.nih.gov/sites/orwh/files/docs/NIH-Revitalization-Act-1993.pdf. Accessed 28 April 2020.

    Google Scholar 

  7. U.S. Food and Drug Administration. Enhancing the diversity of clinical trial populations — Eligibility criteria, enrollment practices, and trial designs guidance for industry. 2019. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/enhancing-diversity-clinical-trial-populations-eligibility-criteria-enrollment-practices-and-trial. Accessed 21 Feb 2020.

    Google Scholar 

  8. Non-European populations still underrepresented in genomic testing samples: dearth of African-American, Latino, and other non-European groups contributes to healthcare, research disparities. Am J Med Genet A. 2017;173:296–7. https://0-doi-org.brum.beds.ac.uk/10.1002/ajmg.a.38149.

  9. Diversifying clinical trials. Nat Med. 2018;24:1779. https://0-doi-org.brum.beds.ac.uk/10.1038/s41591-018-0303-4.

  10. Ford JG, Howerton MW, Lai GY, Gary TL, Bolen S, Gibbons MC, et al. Barriers to recruiting underrepresented populations to cancer clinical trials: a systematic review. Cancer. 2008;112:228–42.

    Article  Google Scholar 

  11. Schmotzer GL. Barriers and facilitators to participation of minorities in clinical trials. Ethn Dis. 2012;22:226–30.

    PubMed  Google Scholar 

  12. Rivers D, August EM, Sehovic I, Lee Green B, Quinn GP. A systematic review of the factors influencing African Americans' participation in cancer clinical trials. Contemp Clin Trials. 2013;35:13–32.

    Article  Google Scholar 

  13. Davis TC, Arnold CL, Mills G, Miele L. A qualitative study exploring barriers and facilitators of enrolling underrepresented populations in clinical trials and biobanking. Front Cell Dev Biol. 2019;7:74.

    Article  Google Scholar 

  14. Cunningham-Erves J, Barajas C, Mayo-Gamble TL, McAfee CR, Hull PC, Sanderson M, et al. Formative research to design a culturally-appropriate, cancer clinical trial education program to increase participation of African American and Latino communities. BMC Public Health. 2020. https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-020-08939-4.

  15. Clark LT, Watkins L, Piña IL, Elmer M, Akinboboye O, Gorham M, et al. Increasing diversity in clinical trials: overcoming critical barriers. Curr Probl Cardiol. 2019;44:148–72.

    Article  Google Scholar 

  16. Vuong I, Wright J, Nolan MB, Eggen A, Bailey E, Strickland R, et al. Overcoming barriers: evidence-based strategies to increase enrollment of underrepresented populations in cancer therapeutic clinical trials-a narrative review. J Cancer Educ. 2019. https://0-doi-org.brum.beds.ac.uk/10.1007/s13187-019-01650-y.

  17. Heller C, Balls-Berry JE, Nery JD, Erwin PJ, Littleton D, Kim M, et al. Strategies addressing barriers to clinical trial enrollment of underrepresented populations: a systematic review. Contemp Clin Trials. 2014;39:169–82.

    Article  Google Scholar 

  18. Niranjan SJ, Durant RW, Wenzel JA, Cook ED, Fouad MN, Vickers SM, et al. Training needs of clinical and research professionals to optimize minority recruitment and retention in cancer clinical trials. J Cancer Educ. 2019;34:26–34.

    Article  Google Scholar 

  19. Bernard GR, Harris PA, Pulley JM, Benjamin DK, Michael J, Ford DE, et al. A collaborative, academic approach to optimizing the national clinical research infrastructure: the first year of the trial innovation network. J Clin Transl Sci. 2018;2:187–92.

    Article  Google Scholar 

  20. Joosten YA, Israel TL, Williams NA, Boone LR, Schlundt DG, Mouton CP, et al. Community engagement studios: a structured approach to obtaining meaningful input from stakeholders to inform research. Acad Med. 2015;90:1646–50.

    Article  Google Scholar 

  21. Erves JC, Mayo-Gamble TL, Malin-Fair A, Boyer A, Joosten Y, Vaughn YC, et al. Needs, priorities, and recommendations for engaging underrepresented populations in clinical research: a community perspective. J Community Health. 2017;42:472–80.

    Article  Google Scholar 

  22. Bylund CL, Michaels M, Weiss ES, Patel S, D'Agostino TA, Binz-Scharf MC, et al. The impact of an online training program about Cancer clinical trials on primary care Physicians' knowledge, attitudes and beliefs, and behavior. J Cancer Educ. 2020. https://0-doi-org.brum.beds.ac.uk/10.1007/s13187-020-01731-3.

  23. Michaels M, D'Agostino TA, Blakeney N, Weiss ES, Binz-Scharf MC, Golant M, et al. Impact of primary care provider knowledge, attitudes, and beliefs about cancer clinical trials: implications for referral, education and advocacy. J Cancer Educ. 2015;30:152–7.

    Article  Google Scholar 

  24. Michaels M, Weiss ES, Guidry JA, Blakeney N, Swords L, Gibbs B, et al. The promise of community-based advocacy and education efforts for increasing cancer clinical trials accrual. J Cancer Educ. 2012;27:67–74.

    Article  Google Scholar 

  25. Kripalani S. Association of health literacy and numeracy with interest in research participation. J Gen Intern Med. 2019;34:544–51.

    Article  Google Scholar 

  26. Wilkins CH. Effective engagement requires trust and being trustworthy. Med Care. 2018;56:S6–s8.

    Article  Google Scholar 

  27. Wilkins CH, Mapes BM, Jerome RN, Villalta-Gil V, Pulley JM, Harris PA. Understanding What Information Is Valued By Research Participants, And Why. Health Aff (Millwood). 2019;38:399–407.

    Article  Google Scholar 

  28. Johnson DA, Joosten YA, Wilkins CH, Shibao CA. Case study: community engagement and clinical trial success: outreach to African American women. Clin Transl Sci. 2015;8:388–90.

    Article  Google Scholar 

  29. The art of recruitment. Vanderbilt Institute for Clinical and Translational Research. https://victr.vumc.org/training-modules/. Accessed 21 Feb 2020.

  30. Michaels M, Blakeney N, Langford AT, Ford ME. Five principles for effective cancer clinical trial education within the community setting. J Cancer Educ. 2015;30:197–203.

    Article  Google Scholar 

  31. Blakeney NC, Michaels M, Britton A, Swords L, Bitow N, Gibbs B, et al. Optimizing health care systems recruitment and retention practices for medically underserved populations: Impact of ENACCT cancer clinical trial staff training. Cancer Epidemiol Biomarkers Prev. 2010;19(Suppl 1):A42.

    Google Scholar 

  32. Blakeney N, Michaels M, Green M, Richmond A, Long D, Robinson WS, et al. Collaborative development of clinical trials education programs for African-American community-based organizations. J Cancer Educ. 2015;30:400–6.

    Article  Google Scholar 

  33. Green MA, Michaels M, Blakeney N, Odulana AA, Isler MR, Richmond A, et al. Evaluating a community-partnered cancer clinical trials pilot intervention with African American communities. J Cancer Educ. 2015;30:158–66.

    Article  Google Scholar 

  34. Ma GX, Tan Y, Blakeney NC, Seals BF, Ma XS, Zhai S, et al. The impact of a community-based clinical trial educational intervention among underrepresented Chinese Americans. Cancer Epidemiol Biomark Prev. 2014;23:424–32.

    Article  Google Scholar 

  35. Green MA, Michaels M, Blakeney N, Richmond A, Long D, Robinson W, et al. Community bridges to cancer clinical trials: Evaluating community education modules. Cancer Epidemiol Biomark Prev. 2010;19(Suppl 1):B20.

    Google Scholar 

  36. Centers for Disease Control and Prevention. Simply Put, A guide for creating easy-to-understand materials. 2009. https://www.cdc.gov/healthliteracy/pdf/simply_put.pdf. Accessed 8 May 2020.

    Google Scholar 

  37. Adult learning theories. Teaching Excellence in Adult Literacy. 2011. https://lincs.ed.gov/sites/default/files/11_%20TEAL_Adult_Learning_Theory.pdf. Accessed 26 March 2020.

    Google Scholar 

  38. Faster together, enhancing the recruitment of minorities in clinical trials. 2020. https://www.coursera.org/learn/recruitment-minorities-clinical-trials. .

  39. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81.

    Article  Google Scholar 

  40. Course summary dashboard. Coursera. 2020. https://partner.coursera.help/hc/en-us/articles/360020832771?flash_digest=c21b7addbb20b852cd8f3e7d66ba4eb880c23b17. Accessed 21 Feb 2020.

    Google Scholar 

  41. Onah DFO, Sinclair J, Boyatt R. Dropout rates of massive open online courses: behavioural patterns. EDULEARN14 proceedings 1: 5825–5834. < https://warwick.ac.uk/fac/sci/dcs/people/research/csrmaj/daniel_onah_edulearn14.pdf> (2014). Accessed 29 April 2020.

  42. Sarabia-Cobo CM, Torres-Manrique B, Ortego-Mate MC, Salvadores-Fuentes P, Sáenz-Jalón M. Continuing education in patient safety: massive open online courses as a new training tool. J Contin Educ Nurs. 2015;46:439–47.

    Article  Google Scholar 

  43. Goldberg LR, Bell E, King C, O'Mara C, McInerney F, Robinson A, et al. Relationship between participants' level of education and engagement in their completion of the understanding dementia massive open online course. BMC Med Educ. 2015;15:60.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge Earl B. Britt, Jr. and Jabári I. Ichimura from the Meharry-Vanderbilt Alliance and Helen Naylor, Mallory Blasingame, and Taneya Koonce from the Center for Knowledge Management for their contributions to the development of the course. We would also like to acknowledge ArtMagic Labs, particularly Casey Culver, John Martinez, and Robert Eva, for their work in filming and editing the videos for the course. We would like to thank the research participants and actors who allowed us to include their videos footage in the course and the RIC CAB.

Funding

This work was supported by the National Center for Advancing Translational Sciences, National Institutes of Health (NCATS/NIH), under the award number U24TR001579. Support for the REDCap database was provided through NCATS/NIH UL1 TR000445. NCATS/NIH played no role in the planning and conceptualization of the manuscript, did not participate in the writing of the manuscript, and played no role in the decision to submit the manuscript.

Author information

Authors and Affiliations

  1. Center for Knowledge Management, Strategy and Innovation, Vanderbilt University Medical Center, 3401 West End, Suite 304, Nashville, TN, 37203, USA

    Sheila V. Kusnoor, Marcia I. Epelbaum, Patricia Lee, Elizabeth T. Frakes & Nunzia B. Giuse

  2. Meharry-Vanderbilt Alliance, Vanderbilt University Medical Center, Nashville, TN, USA

    Victoria Villalta-Gil, Sarah C. Stallings & Consuelo H. Wilkins

  3. Health Action and Access Consulting, Boston, MA, USA

    Margo Michaels

  4. Boston University School of Public Health, Boston, MA, USA

    Margo Michaels

  5. Department of Medical Education and Administration, Vanderbilt University School of Medicine, Nashville, TN, USA

    Yvonne Joosten

  6. Vanderbilt Institute for Medicine and Public Health, Vanderbilt University Medical Center, Nashville, TN, USA

    Yvonne Joosten & Tiffany L. Israel

  7. Department of Internal Medicine, Meharry Medical College, Nashville, TN, USA

    Jennifer Cunningham-Erves & Consuelo H. Wilkins

  8. Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA

    Stephanie A. Mayers, Paul A. Harris & Consuelo H. Wilkins

  9. Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA

    Nunzia B. Giuse & Paul A. Harris

  10. Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA

    Consuelo H. Wilkins

  11. Vice President for the Office of Health Equity, Vanderbilt University Medical Center, Nashville, TN, USA

    Consuelo H. Wilkins

Authors
  1. Sheila V. Kusnoor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victoria Villalta-Gil
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Margo Michaels
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yvonne Joosten
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tiffany L. Israel
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marcia I. Epelbaum
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Patricia Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Elizabeth T. Frakes
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jennifer Cunningham-Erves
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Stephanie A. Mayers
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Sarah C. Stallings
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Nunzia B. Giuse
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Paul A. Harris
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Consuelo H. Wilkins
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors (S.V.K., V.V.-G., M.M., Y.J., T.L.I., M.I.E., P.L., E.T.F., J.C.-E., S.A.M., S.C.S., N.B.G., P.A.H., and C.H.W.) contributed to writing the manuscript. C.H.W., V.V.-G., and S.V.K. designed the research. All authors (S.V.K., V.V.-G., M.M., Y.J., T.L.I., M.I.E., P.L., E.T.F., J.C.-E., S.A.M., S.C.S., N.B.G., P.A.H., and C.H.W.) performed the research. J.C.-E., S.V.K., V.V.-G., and S.C.S. analyzed the data. All authors (S.V.K., V.V.-G., M.M., Y.J., T.L.I., M.I.E., P.L., E.T.F., J.C.-E., S.A.M., S.C.S., N.B.G., P.A.H., and C.H.W.) read and approved the final manuscript.

Corresponding author

Correspondence to Sheila V. Kusnoor.

Ethics declarations

Ethics approval and consent to participate

Approval by the Institutional Review Board (IRB) at Vanderbilt University was obtained prior to conducting any study procedures (IRB #182186 and #190633). The course evaluation study was classified as exempt under the Revised Common Rule; therefore, obtaining informed consent was not required by the ethics committee. Participants indicated their willingness to complete the survey by providing written assent.

Consent for publication

Consent for publication was obtained from the individual pictured in Fig. 1.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Methods and results of literature review on knowledge needed to enhance minority recruitment and existing training programs and resources on minority recruitment.

Additional file 2.

Questionnaire items addressing knowledge, attitudes and intentions, and feedback on the course.

Additional file 3.

Course overview: core competencies, learning objectives, and assignments.

Additional file 4.

Percentage of participants who completed both the pre- and post-tests (N = 14), who responded correctly to individual items on the knowledge assessment.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kusnoor, S.V., Villalta-Gil, V., Michaels, M. et al. Design and implementation of a massive open online course on enhancing the recruitment of minorities in clinical trials – Faster Together. BMC Med Res Methodol 21, 44 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12874-021-01240-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12874-021-01240-x

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us