Logic Models to Support Program Design, Implementation and Evaluation

Transcription

1 Logic Models to Support Program Design, Implementation and Evaluation Katrina Bledsoe, Joshua Cox Leslie Goodyear, & Sheila Rodriguez Education Development Center Tuesday, April 15 th 1:00-2:00 pm 1

2 What s the Value in Having a Logic Model? Think of the logic model as a kind of road map by which you can help articulate what your program is trying to achieve. The logic model helps you envision where the program can and should go next. Logic models are helpful for your programs and sites to track implementation and envision long-term sustainability. 2

3 Workshop Goals To introduce logic models as an effective tool for program and policy design, implementation, and evaluation To review the elements of a logic model Discuss the role and value of logic models for your program. 3

4 Agenda Welcome and Overview Introduction to Case What is a Logic Model? Elements of a Logic Model Next Steps & Closing 4

5 Case Examples College Readiness Program Activity I: What are the goals of the program or policy? What do we want to know about it? 5

6 What Is a Logic Model? Where are you going? How will you get there? What will tell you you ve arrived? 6

7 What Is a Logic Model? Framework for: PLANNING IMPLEMENTATION MONITORING EVALUATION Simplified picture of program/policy (theory of action) Graphic and explicit representation of relationships, assumptions, and rationale 7

8 What Is a Logic Model? A logic model is NOT: A fully developed plan for a program or policy An evaluation method 8

9 What Is a Logic Model? Problem Statement Impact Long-term Outcomes Short-term Outcomes Outputs Strategies and Activities Inputs/Res ources Assumptions Context 9

10 What Is a Logic Model? Simplest form: INPUTS STRATEGIES/ACTIVITIES OUTPUTS OUTCOMES Inputs(Resources): What is invested in the program (money, people, time, space, etc.) Strategies/Activities: The things the program does. Outputs: The who, what, when and where of what happened in the activities. Outcomes: The change that resulted from implementing the activities. (short- and long-term outcomes) 10

11 What Is a Logic Model? Simplest form: INPUTS STRATEGIES/ACTIVITIES OUTPUTS OUTCOMES 11

12 What Is a Logic Model? Getting Rid of the HEADACHE Inputs (Resources) Strategies/Activiti es Outputs Outcomes Water A hot compress Aspirin A Quiet Room Drink the Water Put hot compress on Take the Aspirin Sit in a Quiet Room Hydrated Feel more relaxed Your headache went away You are able to go back to work or go back to what you were doing. You are happy 12

13 What Is a Logic Model? Activity II: Try it yourself (College Ready Case) Inputs/Resources Strategies/Activiti es Outputs Outcomes 13

14 What Is a Logic Model? Case: College Ready Program Inputs/Resources Strategies/Activiti es Outputs Outcomes Staff Volunteer mentors School space and resources Teacher time Course for parents Mentoring students Guidance meetings Student meetings Number of parents that attended. Number of students mentored. Number of student meetings. Parent involvement increases College applications increases College acceptance increases College attendance increases 14

15 Elements of a Logic Model Problem Statement Resources (inputs) Strategies and Activities Outputs Short-Term Outcomes Long-Term Outcomes Impact Assumptions Context 15

16 Elements of a Logic Model: Problem Statement Problem Statement: The problem or challenge you face that the program is to address. Questions to ask in defining the problem: What is the problem? Why is it a problem? For whom is it a problem? What do we already know about the problem? (through previous work, research, etc.) 16

17 Elements of a Logic Model: Problem Statement Problem Statement: The problem or challenge you face that the program is designed to address. Case: College Ready Case Low income students college going rates are very low Low income students have more limited opportunities There are higher rates of unemployment for low income workers Low income workers earn less wages throughout their lifetime than their middle class counterparts. 17

18 Elements of a Logic Model: Outcomes Outcomes: What difference does it make? 18

19 Elements of a Logic Model: Outcomes Outcomes: What difference does it make? Short-term Long-term Impact 19

20 Elements of a Logic Model: Outcomes Outcomes: What difference does it make? Short-term Long-term Impact Most immediate and measurable results for the intended participants that can be attributed to the strategies and activities 20

21 Elements of a Logic Model: Outcomes Outcomes: What difference does it make? Short-term Long-term Impact Most immediate and measurable results for the intended participants that can be attributed to the strategies and activities More distant results that are anticipated as a result of the collection of strategies and activities 21

22 Elements of a Logic Model: Outcomes Outcomes: What difference does it make? Short-term Long-term Impact Most immediate and measurable results for the intended participants that can be attributed to the strategies and activities More distant results that are anticipated as a result of the collection of strategies and activities Hoped-for outcomes of long-term implementation of strategies and activities, dependent on conditions beyond scope of program 22

23 Elements of a Logic Model: Outcomes Outcomes: What difference does it make? College Ready Case Short-term Long-term Impact Increased contact with parents/guardians Improved attendance Improved academic performance Increased % of students graduating from post-secondary 23

24 Elements of a Logic Model: Outcomes Outcomes Checklist Important Reasonable Realistic 24

25 Questions! 25

26 Elements of the Logic Model: Outputs Outputs: Are the direct products of program activities and may include types, levels and targets of services to be delivered by the program. Examples: delivery of workshops, the number of student meetings, parent meetings etc. 26

27 Elements of a Logic Model: Strategies and Activities Strategies and Activities: What you propose to do to address the problem. Activities, services, events, products designed to address the problem Taken together, they are intended to lead to certain outcomes. 27

28 Elements of a Logic Model: Strategies and Activities Strategies and Activities: What you propose to do to address the problem. Activities Sequence Strategy Develop workshop materials for student readiness program Deliver student readiness workshops College Ready Case 1 st Student and parent education 2 nd Student and parent education Recruit community mentors 1 st Mentorship development And so forth 28

29 Elements of a Logic Model: Resources Resources (inputs): The material and intangible contributions that are or could reasonably be expected to be available to address the problem. Money, materials, and equipment (material/tangible) Time, space, people, partnerships (intangible) Resources are inputs that allow us to create the strategies and activities that are designed to respond to the stated problem. 29

30 Elements of a Logic Model: Resources Resources (inputs): The material and intangible contributions that are or could reasonably be expected to be available to address the problem. Intangible resources (College Ready Case) Community mentors Local university space for parent meetings Volunteer college admissions directors for application workshop Student volunteers for childcare at parent meetings 30

31 Elements of a Logic Model: Assumptions Assumptions: Beliefs or ideas we have about the program and people involved, and the way we think it will work. Make explicit all implicit assumptions Assumptions can be internal and external Ask: What do we know and what are we assuming? 31

32 Elements of a Logic Model: Assumptions Assumptions: Beliefs or ideas we have about the program and people involved, and the way we think it will work. Internal Assumptions External Assumptions Example: Blended Learning Case All students in the program want to go to college Attending college is valuable and will lead to a better life; Offering workshops to both parents and students will increase college applications Participating in the program will increase the college going rate 32

33 Elements of a Logic Model: Context Context: The set of circumstances, environments, policies or facts that surround a particular event, situation, etc. Articulate factors that might affect how a program operates Factors include but are not limited to, history, culture, climate, social strata, region, and political circumstances. 33

34 Elements of a Logic Model: Context Context: The set of circumstances, environments, policies or facts that surround a particular event, situation, etc. Context (College Ready Case) History: Previous college readiness programs (if any) Environment: Low socio-economic status community Policies: Free and Reduced Lunch status Culture: College Preparation is a family affair 34

35 Next Steps & Closing Your next steps: Build a draft logic model for a program or policy, based on the elements described here Consult with colleagues/stakeholders to generate elements like the problems, assumptions, strategies Identify who will shepherd this process Test logic model out with key constituents Determine how logic model will be used and what process will be to make it a living document 35

36 Next Steps & Closing Your next steps What is one thing you learned or will take back to your colleagues? 36

37 Next Steps and Closing Some last thoughts Logic models are a tool for program design, implementation, and evaluation. The process of developing the logic model is important: engage stakeholders in developing logic model. Logic models should be living documents, and returned to frequently. Logic models are useful for evaluation, but best when developed at program design phase. 37

38 Questions! 38

39 Thank You! For any questions about this workshop, contact: Katrina Bledsoe, Education Development Center, Joshua Cox, Education Development Center, Leslie Goodyear, Education Development Center, Sheila Rodriguez, Education Development Center, 39