Evidence Based Practice: Substance Abuse and Mental Health Programs Gale A. Held, MPA February 2010 EXPECT SUCCESS Evidence Based Programs: Lasting Impacts Conference West Palm Beach, Florida
Evidence Based Programs Several systems and sources of information for evidence based programs and practices (EBP) Somewhat different criteria for determining EBP Different types of information available on those programs deemed to be EBP
Planning Framework Selection of a practice or program should tie to your policy and planning framework Substance Abuse and Mental Health Services Administration s (SAMHSA) Strategic Prevention Framework Assessment Capacity Planning Implementation Evaluation
Federal Sponsored Resources Find Youth Info National Registry of Evidence based Programs and Practices (NREPP) OJJDP s Model Programs Guide (MPG), which includes a Disproportionate Minority Contact (DMCC) Reduction Best Practices Database
EBP Resources, continued SAMHSA s Evidence Based Practice Web Guide National Institute on Drug Abuse s (NIDA) Preventing Drug Abuse among Children and Adolescents (Red Book) and PreventionNet Social Programs that Work, Council on Excellence in Government Promising Practices Network (PPN), a consortium effort Blueprints, Center for the Study and Prevention of Violence Various university based and state resources
Find Youth Info An interagency online resource to help communities link to effective programs to help at risk youth Focuses on a variety of youth problem behaviors, including substance abuse, family functioning, aggression/violence, gang activity, academic problems, sexual activity/exploitation, and trauma exposure. Can sort programs by risk and protective factors Previously known as Helping America s Youth (HAY) http://www.findyouthinfo.gov/
National Registry of Evidence Based Programs and Practices Substance Abuse and Mental Health Services Administration (SAMHSA) A searchable online registry of substance abuse prevention and treatment, mental health promotion and treatment, and co occurring disorders interventions. http://www.nrepp.samhsa.gov/index.htm
Model Programs Guide Office of Juvenile Justice and Delinquency Prevention (OJJDP) A database of scientifically proven programs that address a variety of youth problems, including: delinquency; violence; youth gang involvement; alcohol, tobacco, and drug use; academic difficulties; family functioning; trauma exposure; sexual activity/exploitation; and mental health. http://www.dsgonline.com/mpg2.5/mpg_index.htm
NIDA s Red Book National Institute on Drug Abuse Preventing Drug Use among Children and Adolescents: A Research Based Guide for Parents, Educators, and Community Leaders, Second Edition. An introduction to research based prevention. Provides examples of research based programs that feature a variety of strategies proven to be effective. http://www.drugabuse.gov/prevention/prevopen.ht ml Related site: PreventionNet http://www.preventionnet.com/
Social Programs That Work Coalition for Evidence Based Policy, Council for Excellence in Government. To promote government policymaking based on rigorous evidence of program effectiveness from well designed randomized controlled trials. Categories include substance abuse prevention and treatment and mental health as well as related risk factor content areas (e.g., violence prevention, youth development, education). http://www.evidencebasedprograms.org/
Promising Practices Network A group of state and private organizations, who provide evidence based information about what works to improve the lives of children, families, and communities. Rand manages the site. Interventions are grouped by Healthy and Safe Children Children Ready for School Children Succeeding in School Strong Families http://www.promisingpractices.net/
Center for the Study and Prevention of Violence (CSPV) CSPV, Blueprints Initiative, University of Colorado at Boulder A national violence prevention initiative to identify effective violence prevention programs, including those addressing adolescent violent crime aggression delinquency substance abuse http://www.colorado.edu/cspv/index.html
SAMHSA s EBP Online Guide Direct connections to Web sites that contain information about evidence based interventions to prevent and/or treat mental and substance use disorders. Information sorted by (a) substance abuse prevention, (b) substance abuse treatment, (c) mental health treatment and (d) prevention of mental health disorders, as well as by age groups. http://www.samhsa.gov/ebpwebguide/index.asp
Rating Systems Many different systems Four have a effectiveness designation, e.g., Exemplary, Model, Effective, Proven, Promising, Screened Reviews typically include Quality of the research, study design Fidelity Evidence of outcomes Evaluation design and findings Statistical significance Replication
Information on Interventions Varies greatly Most include: Program description and developer contact information Studies and quality of the research The population(s) for which the EBP has been tested. Outcomes Some include risk and protective factors, costs, available training and TA, references
Substance Abuse and Mental Health Evidence Based Programs Seven major systems do reviews of substance abuse and mental health programs Six of the seven assign rating categories They are: Find Youth Info OJJDP Model Programs Guide NIDA Red Book/PreventionNet Social Programs That Work Promising Practices Network Blueprints
Substance Abuse and Mental Health Evidence Based Programs, contd. Of those six, Forty eight programs were given the highest rating by one or more of the reviewing systems Life Skills Training was assigned the highest rating by all six Nurse Family Partnership was assigned the highest rating by five Four Guiding Good Choices, Incredible Years, Multidimensional Treatment Foster Care & Multisystemic Therapy were assigned the highest rating by four
Implementation Issues Successful implementation starts with practice or program selection Grounded in your planning system & framework Also consider Cultural competency Maintaining fidelity over time or adaptations Available materials, training and TA Costs Sustainability
Questions to Ask Developers Ask about Implementations Target Population(s) Adaptations Fidelity Instruments Staffing Quality Assurance Mechanisms Materials, Training and Technical Assistance Costs NREPP checklist to query the program developers http://www.nrepp.samhsa.gov/help questions.htm
Contact Information Gale A. Held, MPA gaheld@aol.com