LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong

Page created by Timothy Tucker
 
CONTINUE READING
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
LEARNING TOGETHER AND THE
                          STUDENT EXPERIENCE:
                             Institutions Embracing Data to Help More
                                Students Start, Stay & Finish Strong

                                            Mark David Milliron
CIVITAS LEARNING® COPYRIGHT © 2018    mark.milliron@civitaslearning.com
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
ISSUES DRIVING CHANGE
• Success Indicators
  ✓ Completion, on-time completion, transfer,
    equity gaps, STEM, career success, thriving

• Enrollment
• Affordability
• Initiative Fatigue
• Resource Optimization
• Personalization
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
DATA IMPACT MATRIX
                      A THEORY OF WORK

          INTELLECTUALLY               STUDENT
             CURIOUS                   SUCCESS
                                     SCIENTISTS
            Late Signal              Strong Signal
INSIGHT

           STATUS QUO                BEST PRACTICISM

          No/Wrong Signal              Weak Signal

                            ACTION
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
THE OPPORTUNITY FOR GREATER IMPACT
         ONBOARDING                                  GET ON PATH                                        STAY ON PATH
         Successful Transition from                  Developing an Educational                          Ongoing Ed Plan and
         Admission to Enrollment                     Plan for Success                                   Retention Management

                                        STUDENT JOURNEY

               Up to 40%                                 42%                                                        16%
               of students fail to enroll                of students are leaving                                    of students leave with enough
                                                         within their first 3 terms                                 credits, but no credential

                                            Average excess credits
                                27          earned without clear
                                            path progression

                                                                                                               $$$                Tuition revenue lost
                                                                                                                                  due to attrition

                        $16K                Average additional
                                            debt for every year
                                            at a two-year college
CIVITAS LEARNING® COPYRIGHT © 2018                                   CCA, Time is the Enemy | Harvard University, SDP Summer Melt | CCRC, Early Momentum Metrics
LEARNING TOGETHER AND THE STUDENT EXPERIENCE: Institutions Embracing Data to Help More Students Start, Stay & Finish Strong
CIVITAS LEARNING – DATA TO POWER OUTCOMES

   40% OF ACTIVE U.S. STUDENTS

      7MENROLLED
                                     20M 200M ~2K
                                     STUDENT
                                                 COURSE      PREDICTIVE
                                               ENROLLMENTS    MODELS
        STUDENTS                     RECORDS

CIVITAS LEARNING® COPYRIGHT © 2018
STRATEGIES TO ACHIEVE OUTCOMES
   Student Inquiry                      Persistence & Graduation                            Career

MILESTONE
DECISIONS                                                    SCHEDULE     CAREERS
                     MAJORS
                                            COURSES
                                 SECTIONS

                                                                                    PRECISION
                                                                                    OUTCOMES
                                                                                    •   ENROLLMENT
                                                                                    •   EQUITY
                                                                                    •   PERSISTENCE
                                                                                    •   COMPLETION
OPPORTUNITIES                                                                       •   WORKFORCE
 TO ENGAGE &                                 COURSE                                 •   PLACEMENT

   SUPPORT             SUCCESS               ENCOURAGEMENT
                     COACHING
                                               RESOURCES &
                                                 PROGRAMS
                  MINDSET
                  NUDGING
                                                                     POLICY
                                                                EVALUATION
BRINGING THE WORK TOGETHER

         Personalized                                                 Precision
         Pathways                                                     Engagement

                                              Student Success
                                              Intelligence Platform

CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
PERSONALIZED INSIGHTS DRIVE ACTION
                                ACROSS THE STUDENT LIFECYCLE

                  PERSONALIZED PATHWAYS                    O U T C O M E S PRECISION ENGAGEMENT

               TIMELY, RELEVANT INSIGHTS – EMERGING TRENDS, STUDENT-LEVEL SCORES

   SIGNAL
INTELLIGENCE

               INSTITUTION-SPECIFIC APPROACH – 2000+ PREDICTIVE MODELS IN PRODUCTION

 PREDICTIVE
  MODELS

               DEPTH OF DATA – 95% OF PREDICTIVE POWER COMES FROM DERIVATIVES
                 ENGAGEMENT                              ACADEMIC                               LIFE & LOGISTICS
                   ●   LMS activity streak                ●   Modality features                   ●   Degree program alignment scores
                   ●   LMS relative-to-section average    ●   GPA consistency                     ●   Credits withdrawal patterns
                                                          ●   Terms attempted/completed ratio     ●   Financial aid change variables
DERIVATIVES

               BREADTH OF DATA – CROSS-SYSTEM & CROSS-INITIATIVE

CIVITAS
    DATALEARNING® COPYRIGHT © 2017 | CONFIDENTIAL
                       SIS              LMS          FINANCIAL AID       CRM          ADMISSIONS       TUTORING
BRINGING THE WORK TOGETHER

         Personalized                                                 Precision
         Pathways                                                     Engagement

                                              Student Success
                                              Intelligence Platform

CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
OVERVIEW: ILLUME COURSES

     Exemplar Signals across the Civitas:

                   YELLOW FLAG SIGNAL
                   Course where even students with a C who persist may be at risk of not graduating.

                   CHALLENGE SIGNAL (GATEKEEPER/GATEWAY)
                   A significantly above average percentage of students earn Ds, Fs or withdraw and
                   have a lower likelihood of graduating compared to students who earn As, Bs or Cs.

                   QUALIFIER SIGNAL
                   Only an A improves a student’s likelihood of graduating, where typically an A, B or C all
                   improve graduation likelihood. In addition, students who earn a B are at least 15% less
                   likely to graduate than those who earn an A.

                   LATE HURDLE SIGNAL
                   Students most commonly take this course three or more years into their career,
                   and student performance is significantly more predictive than other courses
                   taken in the same year.
17
CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
OVERVIEW: GRADE SIGNALS GRADE SIGNALS

                    YELLOW FLAG SIGNAL
                    Students who earn “C” in an early term courses tend to persist but not
                    graduate when compared to other courses taken in the same year.

      In this English Composition
      and Rhetoric Course,
      students that receive a C are
      94.4% likely to persist, but
      are only 52% likely to
      graduate, compared to an
      average graduation rate
      of 70%.

      The graduation rate of
      students with a grade better
      than a C is 80%.
CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
Civitas Learning® Copyright ©2018
Civitas Learning® Copyright ©2018
Civitas Learning® Copyright ©2018
IMPACT ON STUDENT OUTCOMES

                                     11.1       percentage
                                                points

                                                             PERSISTENCE
                                     on average and up to

                                     19.0       percentage
                                                points
                                     with most challenged

                                              7.62
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
COLLEGE SCHEDULER IMPACT ON PERSISTENCE

                                     +   4.1pp                +   4.8pp
                                          AVERAGE FOR
                                       SPRING 15-16 TERMS           AVERAGE FOR
                                                                  FALL 15-16 TERMS
                                                                                        1.7pp
                                                                                        +
                                                                                               AVERAGE FOR

    +   2.4pp
          AVERAGE FOR
                                                                                            SPRING 15-16 TERMS

        FALL 15-16 TERMS

                                                   +512                                           3X
                        +120
                                                 ADDITIONAL                  +745               GREATER
                                                  STUDENTS                 ADDITIONAL
                      ADDITIONAL                                                               FOR STEM
                                                                            STUDENTS           STUDENTS
                       STUDENTS

CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
20% increase
                                     in retention

                                     53% more degrees
                                     & credentials awarded

                                     35% more graduates

CIVITAS LEARNING® COPYRIGHT © 2017
BRINGING THE WORK TOGETHER

        Personalized                                                    Precision
        Pathways                                                        Engagement

                                                Student Success
                                                Intelligence Platform

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
COMMUNITY INSIGHT 2
      GAINING DEEPER UNDERSTANDING OF HIGH GPA DEPARTURES

                                                                 98% of institutions in
                                                                 this study are losing
                                                                 more students above
                                                                 2.0 GPA than below it.

                                                                 This benchmark is based on a data set
                                                                 of 4 million students from 62 institutions.

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
CAMPAIGN: HIGH GPA, LOW-MODERATE
                          PERSISTENCE
     Outreach Goal                              Sample Email: We’re Proud of You!
     • Come to advising, persistence            Hi ,
                                                I wanted to send you a note to see how your
     Students Targeted                          semester is going. College can be challenging
                                                this time of year and even the most successful
     • Undergraduate, GPA 3.0-4.0 w/            students can struggle. Common challenges for
         low persistence likelihood             students include job commitments, family
                                                responsibilities, financial pressures,
                                                transportation issues, or a combination of these
     Outreach Owner                             and other issues. Do any of these sound familiar
                                                to you?
     • Illume Working Group pulls               If you are experiencing any of these issues, or
         student list, creates case for         other things, I am here to help!
         advisors                               I am proud of your progress and excited to
                                                support your continued success.
     Strategy                                   Sincerely,
     • Sent before spring midterms              

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
CAMPAIGN: NEAR-COMPLETERS & THE FINISH LINE
   Outreach Goal
   • Catalyze completion among
     students more than 75% of way
   Students Targeted
   • Students who had accumulated 75%
     of credits on ANY degree path,
     segmented by persistence
     likelihood
   Outreach Owner
   • Student success team
   Strategy
   • Identify optimal student group,
     segment outreach by persistence
     quartile – top/email, middle/calls,
     lowest/face to face

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
31% increase in
                                                    graduates in one
                                                    year

                                                    38% increase in
                                                    credentials
                                                    awarded

CIVITAS LEARNING® COPYRIGHT © 2017 | CONFIDENTIAL
COMMUNITY
   INSIGHTS
   REPORT
   ISSUE 4

                                 FOCUSING ON THE FINISH LINE
                                       COMING SOON
           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
COMMUNITY INSIGHT 1
                                      ONE-MORE COURSE INSIGHT
                                                                    Persistence may be increased with
                                                                    increased course load for some students.
                                                                    •   One more course
                                                                        Largest increase (14.91 pp) for community
                                                                        college students taking one course per
                                                                        term versus two

                                                                    •   Continued, but declining, value
                                                                        with each increase
                                                                        Adding even one more course will not
                                                                        be a reality for all students
  Differences in persistence rates between number of sections
  (courses) attempted, according to institution type.
 This benchmark is based on data across 57 institutions             •   Education is not one-size-fits-all
  (34 community colleges and 23 4-year institutions).                   Need to make realistic recommendations
                                                                        to help all students

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
CHICAGO REGIONAL WORKSHOP

                                     THE PROGRAM

                                                      Target Audience:
                                                      Students in good standing, enrolled in
                                                      fewer than six hours for Spring 2018

                                                      Goal:
                                                      Students enroll in just one more class,
                                                      which may put them over the 5.14 credit
                                                      hour tipping point indicated as a “top
                                                      perseverance indicator” by Illume
                                               UNIFIED DATA LAYER

                                                      Messaging:
                                                      Taking one more class will help you achieve
                                                      your goal faster

CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION
CHICAGO REGIONAL WORKSHOP

                                           OUTCOME

                                        2,036 emails
                                           1,053 opens
                                           (52% open rate)

                                       199 students added
                                             courses
                                           UNIFIED DATA LAYER

                                                     289

         Overall 1 percentage point lift in the percent of students taking 7 or
                more credit hours Spring ‘18 compared to Spring ’17.
CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION
COMMUNITY INSIGHT 1

                                            PARTNER INSIGHT

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
Measure the impact of
programs, policy changes
& interventions
•   Identify comparable control groups
•   Leverage prediction-based
    propensity score matching
•   Measure true intervention efficacy
•   Meets What Works Clearinghouse
    guidelines

CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
Sam Jones

 Hi Sam…wanted to let you
 know that the Writing                 Hi Sam,     The Writing Center
 Center is a big part of doing
 well in your major. The               Welcome to the university. Congratulations again on your
 majority of students using
                                       scholarship!HiWe’re
                                                     Sam –so   happy
                                                             Here       to have you as a student. It was gre
                                                                   is your
 the writing center are
                                       meeting you   at our advising
                                                  reminder  that theresession
                                                                        is a   last week.
 achieving A’s in their                             meet-up tomorrow at 7pm
 courses. Come see what’s                           for new students at the students – the real rock stars h
                                       Did you know     our most successful
 available and how we can                           Writing Center. 10 new
                                       – visit the Writing Center an average of 6 times the first semester
 support you! The Writing                           students are planning to
                                       their junior attend.
                                                    year. Let’s
                                                            Are make
                                                                you in?sure you’re a rock star too! I can arra
 Center is located in Goodall
                                       for you to meet up with another student to show you around the
 Hall Room 223.
                                       center. Let’s talk.

                                       Matt Champion, Advisor
There is a meet-up at the
Writing Center for new
students at 7pm on Thursday.
Can you commit to going?

Maybe

Would you like a reminder on
Wednesday?

Yes

   Civitas Learning® Copyright ©2018
BRINGING THE WORK TOGETHER

         Personalized                                                 Precision
         Pathways                                                     Engagement

                                              Student Success
                                              Intelligence Platform

CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
A CLEAR PATH – FROM START TO FINISH
    Start Strong
                                                    SCHEDULING
      ●    Easily manage critical
           onboarding tasks
      ●    Develop a deeper sense                                PLANNING
           of belonging through
           personalized engagement

    Stay on the Path
    to Success
      ●    Follow course a roadmap,
           track progress, understand
           requirements, and evaluate
           potential plan changes             ONBOARDING &
      ●    Align degree and career,                STUDENT
           gain insight to job demand          ENGAGEMENT

      ●    Quickly find the best-fit
           schedule and enroll for
           classes

CIVITAS LEARNING®    COPYRIGHT
           Civitas Learning®    © 2018©2018
                             Copyright
THE CIVITAS: A COMMUNITY LEARNING TOGETHER

                 RESOURCES & RESEARCH                                    COMMUNITY OF PRACTICE
              Tools & guidance to start stronger                    Networking & opportunities to learn from
                    & learn faster together                         other Civitas Partners & industry experts

                                                       The           ● National         ● Annual Summit:
      ● Webinars on            ● Civitas Learning                                         250+ Partner attendees
                                                      Civitas          Advisory
        tactics &                Space              Representing       Board (NAB): ● Regional
        learnings                                   300+ Partners      Dr. Vince Tinto,
                               ● Community                             Dr. Linda Baer,    Workshops:
      ● Nudge hub                Insights Reports                        Dr. Davis Jenkins       Throughout US
                                                                                                 each year
      ● Playbooks              ● Podcasts on                         ● Mission-
                                                                                              ● Research
                                 trends & tactics                      aligned
      ● User guides                                                                             Partnerships
                                                                       Investors:
                               ● Additional                              Lumina Foundation,
                                 support services                        ReThink, Valhalla

           CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
UNITE AT

                                     April 2nd – 4th
                                     civitaslearning.com/summit

CIVITAS LEARNING® COPYRIGHT © 2018
You can also read