Effectively Using Data to Drive Your Effort
Kim McCombs-Thornton, PhD North Carolina Partnership for Children
Institute for Emerging Issues February 6, 2018 2/13/18
Blue Ribbon Commission In this time of greater competition for resources, it is more important than ever that both public and private investments demand results based on outcomes, backed by rigorous use of data and evaluation. And given the demographic shifts underway, we must pay particular attention to closing gaps in development outcomes across groups in our state.
2
2/13/18
Overview • Role of Data • Criteria for Data • Where to Find Data • Local Spotlight: Cabarrus County • Using the Data
3
2/13/18
What sparks your call to action?
DATA 4
38%
of NC 4th graders were proficient in reading in 2015 Source: Na+onal Assessment of Educa+onal Progress (NAEP), 2015
Percent of NC 4th Graders Proficient in Reading
100%
80%
60%
40%
23%
23%
20%
0%
African American
State Average 38%
LaBno
Source: Na+onal Assessment of Educa+onal Progress (NAEP), 2015
51%
White
Only 1 in 4
NC 4th graders eligible for School Lunch Program were proficient in reading
Source: Na+onal Assessment of Educa+onal Progress (NAEP), 2015
Your Response to Each?
Your Task? To select data point to serve as a call to action
9
2/13/18
Selected Indicators Should • Create a sense of urgency • Effectively communicate • Be relevant for desired change • Reflect the population level • Come from a reputable source • Be collected over time and in a systematic way • Use an unbiased measure • Be available • Preferably - be available for subgroups (race/ethnicity, gender, age, etc.) Contributing Source: Pillsbury, Theory of Aligned Contributions, An Emerging Theory of Change Primer, 2009
Where to Find Data Data that already exists Secondary
Data that you collect Primary
Secondary Data Federal Government Sponsored Population Level Examples: Census NaBonal Center for EducaBon StaBsBcs Centers for Disease Control and PrevenBon (CDC) HHS for Head Start data, child welfare
Secondary Data Federal Government Sponsored Nationally Representative Samples and Surveys Examples: The NaBon’s Report Card (NaBonal Assessment of EducaBonal Progress) InsBtute of EducaBon Sciences (IES) Early Childhood Longitudinal Survey (ECLS) Behavioral Risk Factor Surveillance System (BRFSS)
Secondary Data State Government Sponsored Population Level Examples: NC Department of Public InstrucBon NC Division of Child Development & Early EducaBon NC State Center for Health StaBsBcs NC Office of State Budget and Management
Samples and Surveys Examples: NC State Center for Health StaBsBcs NC Division of Medical Assistance
Secondary Data Local Agencies and Organizations Population Level and Special Samples Examples: School District Smart Start Local Partnership Local Health Department United Way
Secondary Data Foundations, Nonprofits, and Universities Population Level and Special Samples Examples: Kids Count (Annie E Casey) County Health Rankings (RWJF) BEST NC’s EducaBon Facts and Figures NC Budget and Tax Center
Local Spotlight Cabarrus County Ann Benfield Executive Director Cabarrus Partnership for Children
17
2/13/18
Local Spotlight Cabarrus County Data Walk • Where does Cabarrus seem to be doing well? • What areas have greatest room for improvement? • As you were reviewing the data, what other information would you have liked to see? • How did you respond to the different formats (tables, graphs, colors, etc.)? 18
2/13/18
Primary Data Special Populations or Programmatic Level Use Valid and Reliable Measures when Possible Make a Data Collection Plan • What, Who, How, When, Ethics
Make Analysis Plan
Convening Pre-Work Planning Makes the Difference • Select data to share • Develop objectives for first meeting • Who to invite and how to invite
Convening Pre-Work Planning Makes the Difference • Weave objectives into meeting agenda and invitation • Who will facilitate • Give invitees pre-work to spark thinking and prime them to come ready to participate
Community Agreement Establish a written commitment signed by key partners Agency executives Indicator(s) we are working on Target dates What each will do 22
2/13/18
Feedback Loops Plan for regular data review How often? Who will review? Are you on track? Are changes needed? Designate a data champion
Role of Data Call to action North star Cause for celebration!
Want to Know More? Check out Smart Start fabrik ONE Leaders Collaborative Toolkit https://fabrik-one.smartstart.org
Questions?
26
2/13/18