This study was conducted by staff from Abt Associates, which administers CLEAR. The review of this study was conducted by ICF Incorporated, which also administers CLEAR and is trained in applying the CLEAR causal evidence guidelines.
Highlights
- The study's objective was to examine the impact of Pathways to Healthcare (PTH) on earnings and education outcomes.
- This study used a randomized controlled trial to assign individuals to PTH or the control group. Using administrative data and statistical models, the authors compared earnings and credential attainment outcomes of participants and non-participants at the three year follow-up.
- The study found that a significantly greater proportion of the treatment group earned credentials requiring one or more years of college compared to the control group.
- This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to Pathways to Healthcare (PTH), and not to other factors.
Intervention Examined
Features of the Intervention
Pima Community College (PCC) and Pima County One Stop in Tucson, Arizona were awarded a 5-year Health Profession Opportunity Grant (HPOG) to launch and implement the Pathways to Healthcare (PTH) program from 2010 to 2016. The program was designed to help low-income, low-skilled adults access and complete training specific to gaining employment in the healthcare sector. The program mapped PCC’s 16 existing occupational training programs into five pathways allowing students to obtain stackable credentials. The program provided advising services and financial support through scholarships for participants. It included two short-term bridge programs to improve students' basic skills prior to program enrollment. There were also workshops and professional development activities to help students find jobs after program completion. PTH eligibility included being a resident of Pima County, having an income at or below 70% of the Lower Living Standard Income Level (around $27,700), being eligible to work, and having an interest in pursuing a healthcare-related career. Program services and courses were offered at PCC’s Center for Training and Development and across the community college’s six campuses.
Features of the Study
This study was part of the multi-program Pathways for Advancing Careers and Education (PACE) evaluation. The study used a randomized controlled trial to examine the impact of PTH. Of the 1,217 participants who enrolled in the study between February 2012 and January 2014, 609 were randomly assigned to PTH (treatment group) and 608 were assigned to the control group. Control group members could not receive PTH services but could choose to participate in other employment services within the community. The study sample was mostly female (83%), unemployed (66%), and receiving public assistance (76%). About half of the sample was under the age of 35 (53%), Hispanic (56%), and making less than $15,000 per year (49%). About a third of eligible applicants had a high school diploma only (34%) and 43% had some college experience. The treatment and control groups were not significantly different on any of these characteristics.
The study used administrative data from PCC and the National Directory of New Hires to analyze credential attainment and changes in earnings. The authors used statistical models to compare outcomes of the treatment and control group members at the three year follow-up.
Findings
Education and skills gain
- The study found that a significantly greater proportion of the treatment group earned credentials requiring one or more years of college compared to the control group (18.4% versus 11.3%).
Earnings and wages
- However, the study did not find a significant difference in earnings in quarters 12 and 13 following random assignment.
Considerations for Interpreting the Findings
While PTH was largely implemented as designed, only 56% of treatment group members enrolled in occupational training and only 23% received supportive services related to employment. The authors used an intent-to-treat analysis, which means the study evaluates the effect of being offered enrollment in PTH rather than the effect of enrolling in the program. This means that the outcomes of treatment group members were included in the analysis whether they actually enrolled in the program or not. In addition, the p-values reported in the study are based on one-tailed tests; CLEAR’s standard is to use a two-tailed test.
Causal Evidence Rating
Additional Sources
Topic Area
Research Guidelines
Review Protocol: Living Systematic Annual Search and Review Protocol
Review Guidelines: Causal Evidence Guidelines