Impact allows you to quickly analyze the effectiveness of student success initiatives at your institution. Measure your initiatives’ efficacy using prediction-based propensity score matching (PPSM), a statistically rigorous method for evaluating initiative impact that is dependent on Civitas Learning’s rich data set for your institution. Variables that are predictive of success at your institution are used to identify a comparable group of students who did not participate in an initiative but look similar to those who did, by matching on similar likelihoods to persist and to participate in a given initiative. This process reduces selection bias and accurately measures efficacy without the burdens of randomized control trials.
After impact analysis is run, see a breakdown of initiative effectiveness by term and across student groups. Use these insights to target initiatives toward students who are most likely to benefit and to inform the design of new initiatives. Export these results to report across the institution or to perform additional analysis.
Use Impact to turn the DIAL at your institution—optimize data to maximize insight to inform action and continue learning:
- Upload existing data about students who participated in an initiative without the burden of performing analysis using limited institutional resources.
- Discover insights about the lift in persistence rates for initiative participants, with the ability to see the impact for unique student groups.
- Take action on these insights by promoting the initiatives showing the greatest persistence lift and considering the findings in future initiative design.
- Continue learning how to reach the right students with the initiatives that are most effective.
Use Impact to:
- Perform quick, statistically rigorous analysis of initiatives that have been in place at your institution for at least one previous term. Impact can analyze initiatives that were offered up to four years ago if the student data exists in what has been provided by your institution.
- Submit and validate student data to make sure that analysis is relying on the appropriate data set.
- See details for each analyzed initiative, including the lift in persistence rate for participants.
- Observe additional drill-down results, such as the impact of an initiative on the persistence rate during a specific term or for a specific student group.
- Review matching details to verify the similarity of the matched participants and comparison group students used in the analysis.
- Reference the results of all analyzed initiatives submitted by all users at your institution.