Finding True Program Impacts Through Randomization
|
|
- Lindsey Hunter
- 5 years ago
- Views:
Transcription
1 David Evans (World Bank) Finding True Program Impacts Through Randomization Impact Opportunities: Evidence and Action to Save Lives in Nigeria Uyo, Nigeria, May 7-10, 2013
2 Objective Evaluate the causal impact of a program or an intervention on some outcome Examples How much did free distribution of bednets decrease malaria incidence? Which of two supply chain models was most effective at eliminating drug shortages? 2
3 Counterfactual Criteria Treated & comparison groups Have identical average characteristics (observed & unobserved) The only difference is the treatment Therefore the only reason for any difference in outcomes is the treatment Key question: What would participant look like if she hadn t received the program? 3
4 Perfect Experiment 1. Identify target beneficiaries 2. Clone them! Identical on the outside (observable) We re both fiveyear-old puppets Kami We both love to take up new health interventions! Tami Identical on the inside (unobservable) Muppet photos copyright Sesame Workshop 4
5 Perfect Experiment Give the intervention to one set of clones Kami Tami 5
6 Perfect Experiment Observe some time later Kami Tami Because the groups are identical (inside & out), the difference is due to the bednets! 6
7 Back to Reality What would Tami look like if she didn t receive the bednet???? Room For Improvement Control Groups Before After Participants Non Participants 7
8 RFI: Before-After BEFORE BEDNETS 6 malaria episodes in 6 months AFTER BEDNETS 2 malaria episodes in 6 months What else might be going on besides the bednets? Seasonal differences Rising incomes: Households invest in other measures Too many other factors! Impact of bednets =???
9 RFI: Participants vs Non-Participants Compare recipients of a program to People who were not eligible for the program People who chose not to enroll in the program Example: Complications in childbirth Impact of clinic births? Home births Clinic births What else might explain the difference? 9
10 RFI: Participants vs Non-Participants Kami Observable differences Income Education Grover Unobservable differences Heard rumor about hospitals Neighbor available to care for other children Muppet photos copyright Sesame Workshop 10
11 RFI: Participants vs Non-Participants How much of difference is because of clinic? Example: Complications in childbirth Other factors! Impact of clinic births Home births Clinic births Impact of clinic births =??? 11
12 Selection bias People who choose to join the program are different! If we cannot account completely for those differences in our data We never can How do you capture attitudes toward health systems? Initiative? then our comparison will not show the true impact of the program 12
13 What should we do? Gold standard: Randomized experimental design
14 Randomized Experimental Design Randomly assign potential beneficiaries to be in the treatment or comparison group Treatment and comparison have the same characteristics (observed and unobserved), on average, so Any difference in outcomes is due to treatment 14
15 Why Randomization Works Randomization with two doesn t work! Treatment Comparison But differences average out in a big sample Treatment Comparison On average, same number of Kamis and Grovers Observable AND unobservable Result: Measure true impact of program 15
16 Can we randomize? Randomization does not mean denying people the benefits of the project Usually existing constraints in project roll-out allow randomization Randomization often the fairest way to allocate treatment 16
17 Use Staggered Roll-out Roll-out to 200 clinics Roll-out to 400 more clinics Roll-out to 200 more clinics Jan 2014 July 2014 Jan 2015 Randomize the order in which clinics receive program Compare Jan 2014 group to Jan 2015 group at end of first year Example: Mexico parent training staggered roll-out among vulnerable communities 17
18 Vary treatment INTENSITY OF TREATMENT Malaria Information Campaign 100 villages Malaria Information Campaign + SMS Reminders 100 villages NATURE OF TREATMENT Radio campaign 100 villages Newspaper campaign 100 villages 18
19 What if randomization is impossible? Think again: It often is possible on some level, and it s the best way to get a clear measure of impact Always begin the IE with imagining what the ideal would look like With a national policy Use randomization to test implementation 19
20 Key takeaway #1 The single best way to evaluate the true average impact of an activity is by randomizing treatment. 20
21 Key takeaway #2 Randomization is more flexible than you think: It does not require withholding of benefits. It can take advantage of necessary staggered roll-out. It can test different reforms or packages of services across groups at the same time (so all receive at least some package). 21
22 Key takeaway #3 It is more ethical to test programs rigorously before universally implementing them than it is to use scarce public resources to implement a universal program with uncertain benefits. 22
23 Thank you! 23
24 BONUS SLIDES
25 25
Experimental Methods. Policy Track
Experimental Methods Policy Track East Asia Regional Impact Evaluation Workshop Seoul, South Korea Nazmul Chaudhury, World Bank Reference Spanish Version & French Version also available, Portuguese soon.
More informationImpact Evaluation Toolbox
Impact Evaluation Toolbox Gautam Rao University of California, Berkeley * ** Presentation credit: Temina Madon Impact Evaluation 1) The final outcomes we care about - Identify and measure them Measuring
More informationEvaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank)
Evaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank) Attribution The extent to which the observed change in outcome is the result of the intervention, having allowed
More informationPropensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research
2012 CCPRC Meeting Methodology Presession Workshop October 23, 2012, 2:00-5:00 p.m. Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy
More informationRandomized Evaluations
Randomized Evaluations Introduction, Methodology, & Basic Econometrics using Mexico s Progresa program as a case study (with thanks to Clair Null, author of 2008 Notes) Sept. 15, 2009 Not All Correlations
More informationIntroduction to Program Evaluation
Introduction to Program Evaluation Nirav Mehta Assistant Professor Economics Department University of Western Ontario January 22, 2014 Mehta (UWO) Program Evaluation January 22, 2014 1 / 28 What is Program
More informationComment on Soap Operas, Trust and Financial Inclusion: Experimental Evidence from Peruvian Rural areas
Comment on Soap Operas, Trust and Financial Inclusion: Experimental Evidence from Peruvian Rural areas Raquel Bernal Universidad de los Andes March 2017 Summary This paper studies the effects of the offer
More informationPublic Policy & Evidence:
Public Policy & Evidence: How to discriminate, interpret and communicate scientific research to better inform society. Rachel Glennerster Executive Director J-PAL Global Press coverage of microcredit:
More informationWhy randomize? Rohini Pande Harvard University and J-PAL.
Why randomize? Rohini Pande Harvard University and J-PAL www.povertyactionlab.org Agenda I. Background on Program Evaluation II. What is a randomized experiment? III. Advantages and Limitations of Experiments
More informationFinding the Poor: Field Experiments on Targeting Poverty Programs in in Indonesia
Finding the Poor: Field Experiments on Targeting Poverty Programs in in Indonesia Rema Hanna, Harvard and JPAL Targeting the Poor: Evidence from a Field Experiment in Indonesia with Alatas, Banerjee, Olken,
More informationImpact Evaluation Methods: Why Randomize? Meghan Mahoney Policy Manager, J-PAL Global
Impact Evaluation Methods: Why Randomize? Meghan Mahoney Policy Manager, J-PAL Global Course Overview 1. What is Evaluation? 2. Outcomes, Impact, and Indicators 3. Why Randomize? 4. How to Randomize? 5.
More informationVersion No. 7 Date: July Please send comments or suggestions on this glossary to
Impact Evaluation Glossary Version No. 7 Date: July 2012 Please send comments or suggestions on this glossary to 3ie@3ieimpact.org. Recommended citation: 3ie (2012) 3ie impact evaluation glossary. International
More informationIssues in African Economic Development. Economics 172. University of California, Berkeley. Department of Economics. Professor Ted Miguel
Economics 172 Issues in African Economic Development Professor Ted Miguel Department of Economics University of California, Berkeley Economics 172 Issues in African Economic Development Lecture 11 February
More informationMay 23, 2013 SMU / SMU. Designing Randomized Experiments. Tim Salmon and Danila Serra. Introduction. Benefits of. Experiments.
SMU / SMU May 23, 2013? Can you conduct Economic? Economics...cannot perform the controlled experiments of chemists or biologists because [it] cannot easily control other important factors. (Samuelson
More informationEUROPEAN IMMUNIZATION WEEK APRIL Communications package
EUROPEAN IMMUNIZATION WEEK 23-29 APRIL 2018 Communications package CONTENTS BACKGROUND AND OBJECTIVE... 3 THEME... 4 KEY MESSAGES... 5 CAMPAIGN MATERIALS... 6 RESOURCES... 7 CONNECT... 8 2 BACKGROUND AND
More informationSAMPLING AND SAMPLE SIZE
SAMPLING AND SAMPLE SIZE Andrew Zeitlin Georgetown University and IGC Rwanda With slides from Ben Olken and the World Bank s Development Impact Evaluation Initiative 2 Review We want to learn how a program
More informationHow to Find the Poor: Field Experiments on Targeting. Abhijit Banerjee, MIT
How to Find the Poor: Field Experiments on Targeting Abhijit Banerjee, MIT Why is targeting hard? Targeting entails a different set of challenges in developing countries because governments lack reliable
More informationCorrelation Ex.: Ex.: Causation: Ex.: Ex.: Ex.: Ex.: Randomized trials Treatment group Control group
Ch. 3 1 Public economists use empirical tools to test theory and estimate policy effects. o Does the demand for illicit drugs respond to price changes (what is the elasticity)? o Do reduced welfare benefits
More informationThreats to Validity in Experiments. The John Henry Effect
Threats to Validity in Experiments Office Hours: M 11:30-12:30, W 10:30-12:30 SSB 447 The John Henry Effect Housekeeping Homework 3, due Tuesday A great paper, but far from an experiment Midterm review
More informationTRANSLATING RESEARCH INTO ACTION
TRANSLATING RESEARCH INTO ACTION This case study is based on a current study by Esther Duflo and Tavneet Suri. J-PAL thanks the authors for allowing us to use their project 17 Key Vocabulary 1. Equivalence:
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence Section 8.1 The Practice of Statistics, 4 th edition For AP* STARNES, YATES, MOORE Introduction Our goal in many statistical settings is to use a sample statistic
More informationHOW TO BE AN EVENT PLANNER
EVENT PLANNING BLUEPRINT HOW TO BE AN EVENT PLANNER EVENT PLANNING TRAINING COURSE www.eventplanningblueprint.com EVENT PLANNING TRAINING COURSE How To Be An Event Planner course is a 4-module digital
More informationHomework Assignment Section 2
Homework Assignment Section 2 Carlos M. Carvalho DMBA McCombs School of Business Problem 1 I am interested in building a portfolio of stocks and bonds... a very convenient way is to invest in two ETFs
More informationSex and the Classroom: Can a Cash Transfer Program for Schooling decrease HIV infections?
Sex and the Classroom: Can a Cash Transfer Program for Schooling decrease HIV infections? Sarah Baird, George Washington University Craig McIntosh, UCSD Berk Özler, World Bank Education as a Social Vaccine
More informationThreats and Analysis. Bruno Crépon J-PAL
Threats and Analysis Bruno Crépon J-PAL Course Overview 1. What is Evaluation? 2. Outcomes, Impact, and Indicators 3. Why Randomize and Common Critiques 4. How to Randomize 5. Sampling and Sample Size
More informationQuantitative Methods. Lonnie Berger. Research Training Policy Practice
Quantitative Methods Lonnie Berger Research Training Policy Practice Defining Quantitative and Qualitative Research Quantitative methods: systematic empirical investigation of observable phenomena via
More informationAchieving the Millennium Development Goals
Achieving the Millennium Development Goals How can family planning contribute? Uganda July 2009, Based on 2006 Uganda DHS Content Methodology Results Discussion of costs and savings Health benefits Conclusion
More informationDoes community-driven development build social cohesion or infrastructure?
Working paper brief Governance G.M.B. Akash / Panos Does community-driven development build social cohesion or infrastructure? In community-driven development (CDD) programmes, community members are in
More informationOne slide on research question Literature review: structured; holes you will fill in Your research design
Topics Ahead Week 10-11: Experimental design; Running experiment Week 12: Survey Design; ANOVA Week 13: Correlation and Regression; Non Parametric Statistics Week 14: Computational Methods; Simulation;
More informationCausal Inference. Sandi McCoy, MPH, PhD University of California, Berkeley July 16, 2011
Causal Inference Sandi McCoy, MPH, PhD University of California, Berkeley July 16, 2011 Enhancing Implementa/on Science: Program Planning, Scale- up, and Evalua/on Program? Outcome Fidelity Other programs
More information"Inferring Sibling Relatedness from the NLSY Youth and Children Data: Past, Present, and Future Prospects" Joseph Lee Rodgers, University of Oklahoma
"Inferring Sibling Relatedness from the NLSY Youth and Children Data: Past, Present, and Future Prospects" Joseph Lee Rodgers, University of Oklahoma Amber Johnson, Oregon Social Learning Center David
More informationGet More Out of Life. NCSL Foundation Hunger Partnership Business Meeting August 14, 2013
Helping People An Update on Senior Hunger Get More Out of Life NCSL Foundation Hunger Partnership Business Meeting August 14, 2013 The Problem Nearly 9 million older adults face the risk of hunger annually.
More informationConcreteness and Abstraction in Everyday Explanation. Christos Bechlivanidis, David Lagnado Jeff Zemla & Steve Sloman
Concreteness and Abstraction in Everyday Explanation Christos Bechlivanidis, David Lagnado Jeff Zemla & Steve Sloman What goes into a good explanation? What goes into a good explanation? Why there was
More informationTRANSLATING RESEARCH INTO ACTION. Why randomize? Dan Levy. Harvard Kennedy School
TRANSLATING RESEARCH INTO ACTION Why randomize? Dan Levy Harvard Kennedy School Your background Course Overview 1. What is evaluation? 2. Measuring impacts (outcomes, indicators) 3. Why randomize? 4. How
More informationHunger in America. Tres Bailey Director, Food Issues Walmart Corporate Affairs and Government Relations. August 8, 2012
Hunger in America Tres Bailey Director, Food Issues Walmart Corporate Affairs and Government Relations August 8, 2012 A problem this big requires a commitment equal to the challenge. This is our commitment:
More informationMotherhood Unmasked. A community arts based approach to valuing mothers and mothering. Emma Sampson & Shannon McSolvin
Motherhood Unmasked A community arts based approach to valuing mothers and mothering Emma Sampson & Shannon McSolvin Context: Mothering We live in a society in which our ideologies and policies do not
More informationStatistical Power Sampling Design and sample Size Determination
Statistical Power Sampling Design and sample Size Determination Deo-Gracias HOUNDOLO Impact Evaluation Specialist dhoundolo@3ieimpact.org Outline 1. Sampling basics 2. What do evaluators do? 3. Statistical
More informationThe Top 5 Tips for Picking Your Ideal Donor
The Top 5 Tips for Picking Your Ideal Donor A PUBLICATION OF FAIRFAX CRYOBANK About the Author Cheryl Daubenberger is the Director of Client Services for Fairfax Cryobank and Cryogenic Laboratories, Inc.
More informationOverview of Study Designs in Clinical Research
Overview of Study Designs in Clinical Research Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines + Evidence Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort
More informationSlide 1. [Introduce yourself and your connection to the ELCA Malaria Campaign]
1 [Introduce yourself and your connection to the ELCA Malaria Campaign] World Malaria Sunday April 27, 2014 Every year, concerned people across the globe celebrate World Malaria Day on April 25. The ELCA
More informationOverview Study rationale Methodology How CCT interventions approach health demand and supply Theory-based approach: does the evidence support the impl
CONDITIONAL CASH TRANSFERS AND HEALTH: UNPACKING THE CAUSAL CHAIN Marie Gaarder, 3ie with Amanda Glassman and Jessica Todd DFID, London, November 23 2009 Overview Study rationale Methodology How CCT interventions
More informationQUASI-EXPERIMENTAL APPROACHES
QUASI-EXPERIMENTAL APPROACHES Experimental approaches work by comparing changes in a group that receives a development intervention with a group that does not. The difference is then attributed to the
More informationFrankly Speaking About Cancer Clinical Trials
Frankly Speaking About Cancer Clinical Trials Medical Review The following slides were medically reviewed by Brad Hirsch, MD, in March 2017. Workshop Overview What is a clinical trial? Why clinical trials
More informationIssues in African Economic Development. Economics 172. University of California, Berkeley. Department of Economics. Professor Ted Miguel
Economics 172 Issues in African Economic Development Professor Ted Miguel Department of Economics University of California, Berkeley Economics 172 Issues in African Economic Development Lecture 10 February
More informationSimplifying pediatric immunization with a fully liquid pentavalent vaccine: Evidence from a time-motion study
Simplifying pediatric immunization with a fully liquid pentavalent vaccine: Evidence from a time-motion study Dr. Karin Anne Wiedenmayer Swiss Tropical Institute Basel, Switzerland February 2008 1 Value
More informationSilverSneakers. Reach the largest demographic
SilverSneakers Reach the largest demographic SilverSneakers has filled our facility during traditionally non-busy hours. SilverSneakers is something an owner can count on for consistent revenue. If your
More informationDifference-in-Differences
CHAPTER 7 Difference-in-Differences Evaluating a Program When the Rule of Assignment Is Less Clear The three impact evaluation methods discussed up to this point randomized assignment, instrumental variables
More informationMATH-134. Experimental Design
Experimental Design Controlled Experiment: Researchers assign treatment and control groups and examine any resulting changes in the response variable. (cause-and-effect conclusion) Observational Study:
More informationCOMMUNITY EMERGENCY RESPONSE TEAM PANDEMIC INFLUENZA INTRODUCTION AND OVERVIEW
INTRODUCTION AND OVERVIEW A pandemic is a global disease outbreak. Pandemics are characterized by the sudden onset of an extremely virulent pathogen with potentially lethal results. Though historically
More informationWhy do Psychologists Perform Research?
PSY 102 1 PSY 102 Understanding and Thinking Critically About Psychological Research Thinking critically about research means knowing the right questions to ask to assess the validity or accuracy of a
More informationEconometric analysis and counterfactual studies in the context of IA practices
Econometric analysis and counterfactual studies in the context of IA practices Giulia Santangelo http://crie.jrc.ec.europa.eu Centre for Research on Impact Evaluation DG EMPL - DG JRC CRIE Centre for Research
More informationCOMMUNITY EMERGENCY RESPONSE TEAM PANDEMIC INFLUENZA INTRODUCTION AND OVERVIEW
INTRODUCTION AND OVERVIEW A pandemic is a global disease outbreak. Pandemics are characterized by the sudden onset of an extremely virulent pathogen with potentially lethal results. Though historically
More informationModule 4. Relating to the person with challenging behaviours or unmet needs: Personal histories, life journeys and memories
Module 4 Relating to the person with challenging behaviours or unmet needs: Personal histories, life journeys and memories 1 Key questions How are residents personal histories, life journeys and memories
More informationChildren and AIDS Fourth Stocktaking Report 2009
Children and AIDS Fourth Stocktaking Report 2009 The The Fourth Fourth Stocktaking Stocktaking Report, Report, produced produced by by UNICEF, UNICEF, in in partnership partnership with with UNAIDS, UNAIDS,
More informationThreats and Analysis. Shawn Cole. Harvard Business School
Threats and Analysis Shawn Cole Harvard Business School Course Overview 1. What is Evaluation? 2. Outcomes, Impact, and Indicators 3. Why Randomize? 4. How to Randomize? 5. Sampling and Sample Size 6.
More informationSchooling, Income, and HIV Risk: Experimental Evidence from a Cash Transfer Program.
Schooling, Income, and HIV Risk: Experimental Evidence from a Cash Transfer Program. Sarah Baird, George Washington University Craig McIntosh, UC at San Diego Berk Özler, World Bank Please do not cite
More informationHEALTHCARE DESERTS. Severe healthcare deprivation among children in developing countries
HEALTHCARE DESERTS Severe healthcare deprivation among children in developing countries Summary More than 40 million children are living in healthcare deserts, denied the most basic of healthcare services
More informationMedia pack for secondary breast cancer campaigners
Media pack for secondary breast cancer campaigners Introduction Are you one of Breast Cancer Care s amazing campaigners? Would you be keen to share your story with local newspapers and radio stations to
More informationEvaluating Communications and Outreach
Evaluating Communications and Outreach Contents Why Evaluate?...1 What Should Be Measured?...1 How Do I Get Started?...3 How Can I Analyze the Results?...4 What Do I Do with the Evaluation Findings?...5
More informationWhat Behaviors Do Behavior Programs Change
What Behaviors Do Behavior Programs Change Yingjuan (Molly) Du, Dave Hanna, Jean Shelton and Amy Buege, Itron, Inc. ABSTRACT Utilities behavioral programs, such as audits and web-based tools, are designed
More informationMethods of Randomization Lupe Bedoya. Development Impact Evaluation Field Coordinator Training Washington, DC April 22-25, 2013
Methods of Randomization Lupe Bedoya Development Impact Evaluation Field Coordinator Training Washington, DC April 22-25, 2013 Content 1. Important Concepts 2. What vs. Why 3. Some Practical Issues 4.
More informationIntroduction to Impact Evaluation: What is it and why do we use it?
Introduction to Impact Evaluation: What is it and why do we use it? Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010 Nancy Padian UC Berekeley Efficacy vs. Effectiveness
More informationIntroduction to Qualitative Research
Introduction to Qualitative Research Training Course in Sexual and Reproductive Health Research Geneva 2012 Dr. Khalifa Elmusharaf MBBS, PGDip, FRSPH, PhD researcher Health System & Policy RCRU / UMST
More informationSampling for Impact Evaluation. Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015
Sampling for Impact Evaluation Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015 How many hours do you expect to sleep tonight? A. 2 or less B. 3 C.
More informationTRACER STUDIES ASSESSMENTS AND EVALUATIONS
TRACER STUDIES ASSESSMENTS AND EVALUATIONS 1 INTRODUCTION This note introduces the reader to tracer studies. For the Let s Work initiative, tracer studies are proposed to track and record or evaluate the
More informationEvaluating Survey Data: Mediation Analysis and Propensity Score Matching
Evaluating Survey Data: Mediation Analysis and Propensity Score Matching Emily Ricotta, ScM Senior Research Assistant Johns Hopkins Center for Communication Programs Outline Mediation Analysis What is
More informationAccelerating the Reduction of Malaria Morbidity and Mortality (ARM3) BENIN Behavior Change Communication (BCC): for Malaria Prevention and Treatment
Accelerating the Reduction of Malaria Morbidity and Mortality (ARM3) BENIN Behavior Change Communication (BCC): for Malaria Prevention and Treatment Malaria is endemic in Benin and everyone in the country
More informationDo Something! Have you ever thought you were too young to make a difference?
Do Something! Have you ever thought you were too young to make a difference? We re here to tell you that young people make a difference EVERY DAY. Don t believe us? Here is a story about Andrew Pelham,
More informationChallenges of building a new vaccine delivery platform for LMICs
Challenges of building a new vaccine delivery platform for LMICs Terri B. Hyde, MD MPH Immunizations Systems Branch, GID, CDC 23 March 2017 Immunization in the Elderly Geneva, Switzerland What has been
More informationDaily short message service surveys detect greater HIV risk behavior than monthly clinic questionnaires in Kenya
Daily short message service surveys detect greater HIV risk behavior than monthly clinic questionnaires in Kenya Kathryn Curran, Nelly Mugo, Ann Kurth, Kenneth Ngure, Renee Heffron, Deborah Donnell, Connie
More informationChapter 1 Data Types and Data Collection. Brian Habing Department of Statistics University of South Carolina. Outline
STAT 515 Statistical Methods I Chapter 1 Data Types and Data Collection Brian Habing Department of Statistics University of South Carolina Redistribution of these slides without permission is a violation
More informationRegional Community Mass H1N1 Influenza Vaccination Campaign Skokie, Illinois Oct 16 Dec 31, 2009
Regional Community Mass H1N1 Influenza Vaccination Campaign Skokie, Illinois Oct 16 Dec 31, 2009 This report describes the mass H1N1 vaccination campaign of the Village of Skokie Health Department (SHD),
More informationPrevious Example. New. Tradition
Experimental Design Previous Example New Tradition Goal? New Tradition =? Challenges Internal validity How to guarantee what you have observed is true? External validity How to guarantee what you have
More information25 May
Get Wi ggy with it 25 May 2016 www.clicsargent.org.uk/wigwednesday Five steps Nominate a mate or make yourself look great! FIVE STEPS TO GETTING WIGGY WITH IT 1 Get excited! Empty out this lovely pack,
More informationGlossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha
Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha attrition: When data are missing because we are unable to measure the outcomes of some of the
More informationNUTRITION & HEALTH YAO PAN
NUTRITION & HEALTH YAO PAN INTRODUCTION Accumulation of physical capital and human capital leads to growth Human capital: education & health Health: prerequisite for increase in productivity 2/16 INTRODUCTION
More information#UNITE FOR PARKINSONS A GUIDE FOR WORLD PARKINSON S DAY WEDNESDAY 11 APRIL Brought to you by
#UNITE FOR PARKINSONS A GUIDE FOR WORLD PARKINSON S DAY WEDNESDAY 11 APRIL 2018 Brought to you by CONTENTS 03 ABOUT THIS GUIDE 04 WHY UNITE FOR PARKINSON S? KEY MESSAGES 06 HOW TO GET INVOLVED VIDEOS HASHTAG
More informationMeasuring impact. William Parienté UC Louvain J PAL Europe. povertyactionlab.org
Measuring impact William Parienté UC Louvain J PAL Europe povertyactionlab.org Course overview 1. What is evaluation? 2. Measuring impact 3. Why randomize? 4. How to randomize 5. Sampling and Sample Size
More informationstronger health systems. stronger women and children.
stronger health systems. stronger women and children. INTEGRATED HEALTH PROGRAMS SERVE FAMILIES BETTER photo: Warren Zelman Integrating health services ensures healthier mothers and children and leads
More informationFERTILITY AND FAMILY PLANNING TRENDS IN URBAN NIGERIA: A RESEARCH BRIEF
Your Resource for Urban Reproductive Health FERTILITY AND FAMILY PLANNING TRENDS IN URBAN NIGERIA: A RESEARCH BRIEF BACKGROUND Rapid urbanization in Nigeria is putting pressure on infrastructure and eroding
More informationWorms at Work: Long-run Impacts of Child Health Gains
Worms at Work: Long-run Impacts of Child Health Gains Sarah Baird, George Washington University Joan Hamory Hicks, U.C. Berkeley Michael Kremer, Harvard University and NBER Edward Miguel, U.C. Berkeley
More informationBy Dr. Maryann Kriger, D.D.S - Board Certified Orthodontist Member Midwest Angle Society of Orthodontics. vs Braces Truth Revealed
By Dr. Maryann Kriger, D.D.S - Board Certified Orthodontist Member Midwest Angle Society of Orthodontics vs Braces Truth Revealed 1 Contents Introduction Orthodontist Versus General Dentist? What is the
More informationFit to play but goalless: Labour market outcomes in a cohort of public sector ART patients in Free State province, South Africa
Fit to play but goalless: Labour market outcomes in a cohort of public sector ART patients in Free State province, South Africa Frikkie Booysen Department of Economics / Centre for Health Systems Research
More informationHIV/AIDS SOCIAL MULTIMEDIA CAMPAIGNS IN POLAND in the context of HIV tests promotion
HIV/AIDS SOCIAL MULTIMEDIA CAMPAIGNS IN POLAND in the context of HIV tests promotion The Republic of Poland has a population of 38.2 million people (2004), of whom 66% live in urban areas. life expectancy
More informationStudy Guide Week 6: Shape-Shifting Your Grief Story
1 Study Guide Week 6: Shape-Shifting Your Grief Story In this session, we will focus on 1) why we need to retell our grief story 2) how we can choose to move from victim to victor 3) how to make meaning
More informationDesign Your Own Impact Evaluation
Design Your Own Impact Evaluation Impact Evaluation Workshop Kigali, Rwanda Jacobus Cilliers 30 July 2015 Structure 1. When to Start? 2. How to Evaluate? 3. Who to Sample? 4. How Big is Big Enough? 5.
More informationFundraising proposal for a radio campaign in Guinea, Mali and Niger. Saving 15,500 children s lives for $870 each
Fundraising proposal for a radio campaign in Guinea, Mali and Niger Saving 15,500 children s lives for $870 each Based on a successful randomised controlled trial in Burkina Faso Fundraising proposal for
More informationJANUARY One Shot, One Life Saved. Measles Initiative Saves a Child for $1
WWW.LIONSCLUBS.ORG JANUARY 2012 One Shot, One Life Saved Measles Initiative Saves a Child for $1 ONE SHOT, THE LIONS MEASLES INITIATIVE SAVES A LIFE FOR LESS THAN $1 Randrianarisoa Hariliva, a midwife
More informationDoes AIDS Treatment Stimulate Negative Behavioral Response? A Field Experiment in South Africa
Does AIDS Treatment Stimulate Negative Behavioral Response? A Field Experiment in South Africa Plamen Nikolov Harvard University February 19, 2011 Plamen Nikolov (Harvard University) Behavioral Response
More information[Introduce yourself and your connection to the ELCA Malaria Campaign]
1 [Introduce yourself and your connection to the ELCA Malaria Campaign] World Malaria Sunday April 26, 2015 Every year, people across the globe observe World Malaria Day on April 25. The ELCA Malaria Campaign
More informationVaccine-Preventable Diseases in Colorado s Children 2009 Sean O Leary MD, Carl Armon PhD, Joni Reynolds, RNC, MSN, James Todd MD
State of the Health of Colorado s Children Vaccine-Preventable Diseases in Colorado s Children 29 Sean O Leary MD, Carl Armon PhD, Joni Reynolds, RNC, MSN, James Todd MD Vaccines have been highly effective
More informationMulti-Sectoral Nutrition Strategy Monitoring & Indicators: USAID Working Group Across GH, BFS, FFP, OFDA. Elizabeth Bontrager (GH), Arif Rashid (FFP)
Multi-Sectoral Nutrition Strategy Monitoring & Indicators: USAID Working Group Across GH, BFS, FFP, OFDA Elizabeth Bontrager (GH), Arif Rashid (FFP) USAID Multi-Sectoral Nutrition Strategy: M&E Working
More informationUHC. Moving toward. Ghana NATIONAL INITIATIVES, KEY CHALLENGES, AND THE ROLE OF COLLABORATIVE ACTIVITIES. Public Disclosure Authorized
Public Disclosure Authorized Public Disclosure Authorized Moving toward UHC Ghana NATIONAL INITIATIVES, KEY CHALLENGES, AND THE ROLE OF COLLABORATIVE ACTIVITIES re Authorized Public Disclosure Authorized
More informationThe Invisible Influence: How Our Decisions Are Rarely Ever Our Own By CommonLit Staff 2017
Name: Class: The Invisible Influence: How Our Decisions Are Rarely Ever Our Own By CommonLit Staff 2017 Jonah Berger is a professor at the Wharton School of the University of Pennsylvania. He is the author
More informationOur Mission: What We Do. Our Vision: What We Hope To Accomplish. How We Do It
1 2015 Annual Report Our Mission: What We Do We partner with faith communities to encourage, equip, and empower them to walk in relationship with "Friends/Families in Need" to help them transition from
More informationfamily team captain guide
family team captain guide Setting up your campaign and recruiting team members start your team at marchforbabies.org March of Dimes Foundation Your involvement and fundraising makes our mission possible.
More informationThank you for organizing a grassroots fundraiser to benefit RESULTS/RESULTS Educational Fund! You are making a big impact on our work to end poverty.
Dear Grassroots Fundraising Host, Thank you for organizing a grassroots fundraiser to benefit RESULTS/RESULTS Educational Fund! You are making a big impact on our work to end poverty. As an advocate, you
More informationUnited Way 2017 Campaign s
United Way 2017 Campaign Emails This document contains email messaging for your United Way of Greater St. Louis Campaign. You will find 1 pre-kickoff email, 2 kickoff emails, 4 reminder emails, and a variety
More informationUsing natural experiments to evaluate population health interventions
Using natural experiments to evaluate population health interventions Peter Craig MRC Population Health Sciences Research Network Public Health Intervention Research Symposium Toronto, 29-30 November 2010
More informationIntroduction: Statistics, Data and Statistical Thinking Part II
Introduction: Statistics, Data and Statistical Thinking Part II FREC/STAT 608 Dr. Tom Ilvento Department of Food and Resource Economics Let s Continue with our introduction We need terms and definitions
More information