Communicating Program Impact- Using Research Outcomes to Promote Community Buy-in Locally

Transcription

1 Communicating Program Impact- Using Research Outcomes to Promote Community Buy-in Locally Presented by : SebrinaDoyle and Stephanie Bradley EPISCenter April 24 th, 2012

2 One size fits all messages don t always work

3 Figuring out the Who, What, Where, and Howof Communication

4 WHOdo you need to communicate with?

5 A note on stakeholders A person, group, or organization that has direct or indirect stake in an organization because it can affect or be affected bythe organization's actions, objectives, and policies. Source:

6 Who are the stakeholders for your program/organization? 6

7 Source:

8 Whatdo you need to communicate?

9 Numbers are Powerful!

10 Program Outcomes: Academic (attendance, grades) Social (bullying, peer relationships) Behavioral (antisocial behavior, risky behavior) ATOD use/abuse (timing of onset, use, risk for abuse) Family Relationships (parent-child, sibling) Mental health

11 Other metrics that can be used for measurement: Time- Initial investment of time in training # of hours spent implementing program Money- Amount of funds required for start-up Amount of funds required for maintenance Cost/Benefit- Amount of time/money saved by running the program

12 Wheredo you get the information?

13 Data Toolkit Program Logic Model External Local and State Data Sources (EpiQMS, PAYS) External National Data Sources (CDC, Kids Count) WSIPP Economic Research National Program Results Agency/Local Data

14 Logic Model Basics What is it? Describes howandwhy the program produces changes in the targeted outcomes Why is it important? Provides theoretical backbone Guides quality implementation Guides quality evaluation

15 Essential Features of a Logic Model A General Example Program Components, Activities, Features How? Targets Short Term Outcomes What? Long Term Outcomes Lessons Group Activities Role-Playing Self-reflection Risk Factors: Poor family relationships Academic disengagement Lack of study skills Poor social skills Isolation Increased knowledge Increased skills Improved attitudes Better communication Increased norms knowledge Recognizing emotions Increased belief in self Increased school success Better relationships Decreased substance use Better mental health Homework Projects Skill Practice Individual Therapy Group Therapy Protective Factors: Attachment to school Prosocial activities Positive relationships Emotion regulation Norms knowledge

16 Program Outcomes for BBBSA * From the Blueprints for Violence Prevention Website After an eighteen month period, BBBSA youth: were 46% less likely than control youth to initiate drug use. were 27% less likely to initiate alcohol usethan control youth. were almost one-third less likely than control youth to hit someone. were better than control youth in academic behavior, attitudes, and performance. were more likely to have higher quality relationships with their parentsor guardians than control youth. were more likely to have higher quality relationships with their peersat the end of the study period than did control youth.

17 Program Outcomes for MTFC * From the Blueprints for Violence Prevention Website Program youth compared to control group youth: Spent 60% fewer days incarcerated at 12 month follow-up; Had significantly fewer subsequent arrests; Ran awayfrom their programs, on average, three time less often; Had significantly less hard drug use in the follow-up period; Had quicker community placement from more restrictive settings (e.g., hospital, detention); and Had better school attendance and homework completion at 24 months follow-up.

18 Cost/Benefit Ratios

19 The Economic Return on PCCD s Investment in Research-based Programs: A cost-benefit assessment of delinquency prevention in Pennsylvania. 2008, p.5.

20 From the PA Epidemiological Report Construct ALCOHOL TOBACCO ILLICIT DRUGS Alcoholic Liver Disease Death Mortality Rate Lung Cancer Death Drug Death Rate Percent Fatal Motor Vehicle Rate Percent Persons 12+ Crashes Involving Alcohol Emphysema Death Meeting DSM-IV Fatal Motor Vehicle Death Rate Rate Criteria for Illicit Drug Involving Alcohol Abuse/Dependence Percent Drinking Drivers of Total Drivers in Fatal Crashes Crime Other Consequences Consumption DUI Arrest Rate Self-reported DUI (youth only) Public Drunkenness Conviction Rate Underage Purchase of Alcohol/Tobacco Conviction rate DUI Conviction Rate Percent Persons 12+ Meeting DSM-IV Criteria for Alcohol Abuse/Dependence Treatment Admissions (%) for Alcohol Use Current Use (youth only) Binge Drinking Lifetime Use (youth only) Heavy Drinking (adults only) Alcohol Sales Current Use Lifetime Use (youth only) Daily Smokers (adults only) Smoking During Pregnancy Drug Possession Conviction Rate Illegal Alcohol/Drug Sales Conviction Rate Treatment Admissions (%) for Illicit Drug Use Current Use Lifetime Use (youth only)

21 Two examples: EpiQMS PAYS

22 Map Example from EPIQMS

23 Table Example from EPIQMS

24 Binge Alcohol Use in Past Month by Persons aged by PA SubstateRegion SAMHSA, Office of Applied Studies, National Survey on Drug Use and Health, 2006, 2007, and 2008.

25 A Few Bridges Who: What: Where: Funding agency Potential Volunteers Community Cost-benefit Time Commitment/ program effects Risk & protective factors WSIPP Economic Report Program Developer Website EpiQMS, PAYS

26 HOWdo you communicate the information?

27 Hands on time

28 Report out & brainstorm for others