The Minority AIDS Initiative Program Evaluation for Prevention Contract (PEP-C) Presenter: Dr. Phillip Graham

Transcription

1 The Minority AIDS Initiative Program Evaluation for Prevention Contract (PEP-C) Presenter: Dr. Phillip Graham 1

2 Program Evaluation for Prevention Contract (PEP-C) Tasks National cross-site evaluations of four SAMHSA/CSAP grant initiatives Partnerships For Success (PFS) Strategic Prevention Framework State Incentive Grants (SPF SIG) Minority AIDS Initiative (MAI) STOP Act Grants (one-year retrospective study) 2

3 Introducing the SAMHSA Team Contracting Officer s Representative (COR) in charge of PEP-C: Sara Azimi-Bolourian, Ph.D., Public Health Analyst, SAMHSA/CSAP Alternate Contracting Officer s Representative (ACOR) for PEP-C: Thomas Clarke, Ph.D., Social Science Analyst, SAMHSA/CSAP 3

4 Program Evaluation for Prevention Contract (PEP-C) Leadership Project Director: Phillip W. Graham, Dr.PH Director of the Drugs, Violence, and Delinquency Prevention Research Program in the Center for Justice, Safety, and Resilience, RTI International Deputy Project Director: Elvira Elek, Ph.D. (Social Psychology) Research public health analyst, RTI International 5

5 PEP-C s MAI National Cross-Site Evaluation Team Name & Degree Role on the Team Affiliation Nilufer Isvan Ph.D. in Sociology Mindy Herman Stahl Ph.D. in Human Development Darigg Brown Ph.D. in Biobehavioral Health Melissa Burnett B.A. in Psychology Leena Elsadek B.A. in Global Health and Anthropology Rachael Gerber M.P.H. Lisa Lundquist M.A. in Criminal Justice Team co-lead Team co-lead HIV/AIDS Prevention Evaluation Specialist Research Analyst, TTA Liaison Research Analyst, TTA Support Research Analyst, Data Manager Research Analyst, Data Manager HSRI RTI International RTI International HSRI RTI International HSRI HSRI 5

6 MAI Evaluation Questions (1) Baseline characteristics of people served Populations targeted, strategies implemented, services provided Changes in Individual-level knowledge, attitudes, behaviors Awareness of and access to health care services 6

7 MAI Evaluation Questions (2) Individual- and grantee-level characteristics associated with individual-level outcomes Changes in The normative environment Health disparities 7

8 MAI Evaluation Questions (3) Factors associated with environmental changes Effects of implemented strategies and strategy combinations on individual-level and environmental changes 8

9 MAI Cross-Site Evaluation Logic Model Inputs Outputs Outcomes MAI funding TTA Activities Needs assessment Capacity building Strategic planning Implementation o # Direct prevention o # Environmental strategies o # HIV/HCV testing o # Referrals and service linkages Evaluation Participants # Served by demog. # Trained in SA, HIV, HCV prevention # Tested for HIV/ HCV, # positive, # counseled, and # linked to care # Tested for the first time # Number with knowledge of test results Proximal (Individual Level) Knowledge Attitudes Risk perceptions Self-efficacy Intentions Social norms Awareness of and access to health services Intermediate (Individual Level) Any alcohol use Binge/heavy drinking Any illicit drug use Unprotected sex Sex while drunk or high Distal (Environmental Level) Changes in community social norms and attitudes around alcohol use and risky sexual behaviors associated with HIV/HCV transmission Individual-Level Moderators Sociodemographics Victimization Discrimination Mental health Criminal justice involvement Social support 9 Grantee-Environment Level Moderators Fidelity Baseline prevalence of HIV/ HCV/STIs Baseline social/economic characteristics

10 Federal Reporting Requirements Government Performance and Results Act (GPRA) Originally enacted in 1993 Currently: GPRA Modernization Act of 2010 Federally funded programs required to report performance measures & meet targets Each year s performance used to justify budget requests for following year 10

11 SAMHSA/CSAP s MAI GPRA Measures Measure Target Actual (FY2013) Number of program participants exposed to substance abuse prevention education services (Output) Percent of program participants that rate the risk of harm from substance abuse as great (all ages) (Outcome) Percent of program participants who report no use of alcohol at pre-test who remain non-users at post-test (all ages) (Outcome) 5,734 6, % 96.2% 91.2% 89.2% Percent of participants who report no illicit drug use at pre-test who remain non-users at post-test (all ages) (Outcome) 92.6% 93.9% Number of persons tested for HIV through the Minority AIDS Initiative prevention activities (Outcome) Baseline 36,707 Source: CSAP Accountability Report, Volume XII, FY

12 MAI Participant-Level Instruments The National Minority SA/HIV Prevention Initiative has four standard instruments Youth Questionnaire Adult Questionnaire Group Dosage Form Individual Dosage Form 11