Find a more granular breakdown of impact analysis results beneath the basic initiative details and outcomes. By default, the tab labeled Initiative Impact should be selected. Start by reviewing the initiative's impact by student group.
When reviewing these drill-down insights, it's important to understand that the matching process does not ensure that students are matched within these groups. This means that the number of analyzed participants indicated to the right of each student group shows how many students were successfully matched for analysis with any other comparison student (not necessarily another student within that group). Performing matching at the student group level would result in a lower match rate and longer analysis run time.
The possible student groups include:
- Academic Level: A student's academic classification as undergraduate or graduate.
- Completed Terms: A student's number of completed terms at your institution.
- Course Modality: Indicates a student's course modality if the student is enrolled in all online courses.
- Ethnicity: Indicates whether or not a student is of Hispanic or Latino descent.
- Full-time vs. Part-time: A student's enrollment status as full-time or part-time.
- Gender: A student's self-identified gender.
- Prediction Percentile: Indicates which quartile of the student population a student's persistence prediction falls in. If 30% of the student population has Very Low persistence predictions, the lowest 25% will fall into the bottom quartile.
- Race: A student's race.
- STEM Major: Indicates whether a student's desired degree is designated as a STEM program as defined by the federal government.
- Student Type: Indicates whether a student is enrolling as a first time in college student, as part of a dual credit program, as a transfer or transient student, or as a readmitted student.
The actual student groups you see will vary depending on the data provided by your institution.
These student groups may look familiar, as they match filter options in Illume Students. For each listed student group, see the number of analyzed students who met the group criteria during the analyzed terms. For example, an undergraduate student successfully matched and included in analysis who was enrolled full-time as a STEM major would be included in the Undergraduate, Full-time, and STEM student groups.
Find the number of analyzed students and p-value to the right of each student group.
If the p-value for any group exceeds 0.05, the group name will be crossed out. This indicates that the analysis results for this student group are not statistically significant. While it is advisable to apply more stringent p-values for group comparisons, we use the p-value threshold of 0.05 to surface these insights into segment-level impact results.
The persistence lift for each student group is also shown. This is the lift in persistence observed between the analyzed participants and comparison students who meet the student group criteria (e.g. the persistence difference between part-time students who participated and part-time students who did not participate). This is calculated the same way as the overall lift in persistence calculation. Refer to How is persistence lift calculated? for details about this calculation.
By default, you will see the overall impact for each student group over all analyzed terms. Switch to any individual term to view the impact for each student group during that term only.