BUILDING TEAMS: A TOBACCO EVALUATION AND MONITORING SYSTEM

Transcription

1 BUILDING TEAMS: A TOBACCO EVALUATION AND MONITORING SYSTEM Leah Ranney, PhD: Tobacco Preven3on Evalua3on Program, UNC School of Medicine Leigh Welper BA: Independent Contractor Adam Goldstein, MD, MPH: Tobacco Preven3on Evalua3on Program, UNC School of Medicine Tom Brown, M.Ed: NC Department of Health and Human Services, Tobacco Preven3on and Control Branch

2 Agenda NC Tobacco Initiatives Teen Tobacco Use Prevention and Cessation Initiative Tobacco Evaluation and Management System (TEAMS) How are program activities monitored? What type of outcome data is produced for evaluation? Utility of TEAMS for program managers, evaluators, and Technical Assistance providers Benefits of TEAMS

3 Impact of Tobacco Use } Approximately 400,000 people die each year from their own cigarette smoke } Over 6,000,000+ youth under 18 years old alive today will ultimately die from smoking unless smoking rates decline Campaign for Tobacco-Free Kids (June 13, 2012)

4 NC Tobacco Initiatives Master Settlement funds used to establish Health and Wellness Trust Fund (HWTF): Four primary components: Teen Initiative: 2003 TRU Media Campaign: 2004 Quitline: 2005 Colleges Initiatives: 2006

5 Teen Tobacco Use Prevention and Cessation Initiative Funds 43 School and Community Based Grantees Prevent Youth Initiation of Tobacco Use Promote Tobacco Use Cessation Among Youth Eliminate Youth Exposure to Secondhand Smoke Reduce Tobacco Related Disparities Among Priority Populations

6 Example of Program Indicators Tobacco Prevention # of tobacco use prevention education media messages aired or disseminated # of youth led prevention activities Tobacco Cessation # of presentations promoting tobacco cessation resources # of printed materials distributed with QuitlineNC Logo

7 Continued Reduce Secondhand Smoke Exposure # of improved smoke-free policies (increase from smoke-free to tobacco-free) # of new smoke-free policies (i.e. Parks) Reduce tobacco-related Disparities # of culturally tailored activities conducted targeting an identified high risk group # of activities conducted where materials from the Heritage Toolkit (culturally tailored products and activities) were disseminated

8 TOBACCO EVALUATION AND MANAGEMENT SYSTEM (TEAMS)

9

10

11

12

13

14 TA Provider Services

15 HOW ARE PROGRAM ACTIVITIES MONITORED? Status Reports Indicator Reports Qualitative Data

16

17 TEAMS Status Report

18 TEAMS Quantitative Report

19 TEAMS Qualitative Report

20 Monthly Raw Data Spreadsheet

21 TA Provider Services Report

22 WHAT TYPE OF OUTCOME DATA IS PRODUCED FOR EVALUATION? Quantitative Qualitative

23 Events Conducted by Grantees by Goal Area Fiscal Year ( )

24 Comparison of AAP with Actual Performance

25 # of Active Youth Groups by Semi- Annual Period ( ) Number of ac,ve youth groups Fall 2005 Spring 2006 Fall 2006 Spring 2007 Fall 2007 Spring 2008 Repor,ng Period Fall 2008 Spring 2009 Fall 2009 Spring 2010 Fall 2010 Spring 2011

26 100% Smoke Free Policy Adoptions Fiscal Year ( ) Grantee Quarter Venue Location Alice Aycock Poe 3 Raleigh City Parks Raleigh, NC Catawba County 3 Catawba County Government Catawba County, NC Catawba County 3 Unnamed apartment community Catawba County, NC Dare County 2 All four town parks: Aviation Park, Meekins Field, West Hayman Blvd. and Copley Dr. Kill Devil Hills, NC Dare County 2 The Bathhouse at Ocean Boulevard Kill Devil Hills, NC Durham County 4 Smoke- free playgrounds, bus stops and county/city buildings Durham, NC Halifax County 3 White Oak Baptist church Enfield, NC Union County 4 Dogwood Park at Wesley Chapel Wesley Chapel, NC

27 UTILITY OF TEAMS Evaluators Program Managers Technical Assistance Providers

28 Benefits for Evaluators Quickly check status of data submission for monthly and semi-annual reporting Easily access grantee contact information Use indicator report to review data monthly, quarterly and yearly Download data in spreadsheet and conduct further analysis using statistical software Use TEAMS reports to view qualitative data synopses to support or clarify quantitative data issues

29 Benefits for Managers Easily access grantee/ta profile information View grantee Annual Action Plans online Monitor grantee progress individually or by Region Monitor grantee progress monthly, quarterly, or yearly Check grantee status of monthly and semi-annual data entry

30 Benefits for TA Providers Scope of Work Calendar view Pending, Scheduled, and completed TA request Tracking Services and materials via Spreadsheet

31 Highlights TEAMS is a customized, flexible, web-based tracking system TEAMS collects data related to performance indicators in accordance with the Teen Initiative Annual Action Plans Evaluators and Program Managers can use TEAMS to monitor programmatic changes and evaluate program progress Improved technology allows for the ability to make rapid program improvements

32

33 Leah M. Ranney, PhD Tobacco Prevention and Evaluation Program University of North Carolina at Chapel Hill Phone: Website: