Program Evaluation: Methods and Case Studies Emil J. Posavac Eighth Edition
|
|
- Charlotte Wilkinson
- 5 years ago
- Views:
Transcription
1 Program Evaluation: Methods and Case Studies Emil J. Posavac Eighth Edition
2 Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: Pearson Education Limited 2014 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without either the prior written permission of the publisher or a licence permitting restricted copying in the United Kingdom issued by the Copyright Licensing Agency Ltd, Saffron House, 6 10 Kirby Street, London EC1N 8TS. All trademarks used herein are the property of their respective owners. The use of any trademark in this text does not vest in the author or publisher any trademark ownership rights in such trademarks, nor does the use of such trademarks imply any affiliation with or endorsement of this book by such owners. ISBN 10: ISBN 10: ISBN 13: ISBN 13: British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library Printed in the United States of America
3 criteria for assessing the work of mental health workers who screen people seeking care. When using multiple variables, it is important to use different kinds of variables expected to be affected by different sources of error. Variables measured in very similar ways from one source may be affected by the same biases. When this happens, the extra effort is of little value. By using several variables, assessed in different ways from different sources of data, evaluators can draw conclusions from the convergence of these variables and thus add considerable strength to an evaluation. Case Study, Using Multiple Measures in an Evaluation of a Summer Community Program for Youth, illustrates how the convergence of multiple measures provided strong support for a summer program for teenagers. Use Nonreactive Measures Nonreactive measurement refers to procedures of gathering information that do not prompt the respondent to give particular answers. For example, whenever it seems obvious that certain answers are desired by interviewers, some respondents tend to give those answers. The previous section hinted at another problem of reactive measures: Merely focusing attention on a variable can lead people to change their behavior. Even surveys can be reactive because they may prompt respondents to think about issues they may have never concerned themselves with before. Clearly when an evaluation leads to changes in the behavior of staff or clients, the evaluation does not accurately reflect the program in operation. Unless the evaluation depends solely on existing records, totally nonreactive measurement is an ideal seldom achieved, although care in designing evaluations can reduce reactivity (Webb, Campbell, Schwartz, Sechrest, and Grove, 1981). Use Only Variables Relevant to the Evaluation Because program evaluation is an applied discipline, the variables selected must be relevant to the specific informational needs of facility management, community representatives, those responsible for budgets, and other stakeholders. In planning an evaluation, evaluators seek to learn what decisions are pressing but not understood. Discussions with staff and managers often reveal the important variables. If no decisions can be affected by a variable, or if no program standards mention the variable, then it probably is not essential to the evaluation. Evaluators take care not to measure variables that some stakeholders might think would be interesting but which would not affect the operation of the program or agency; such variables raise the cost of an evaluation but do not contribute to its value. Sometimes evaluators expect that a variable would be seen as important once summarized for agency leaders; at those times experienced evaluators act in the role of educator. Furthermore, evaluators seek to be sure that they are sensitive to good and bad side effects that cannot be anticipated. 97
4 CASE STUDY 1 Using Multiple Measures in an Evaluation of a Summer Community Program for Youth The value of making observations from a variety of perspectives was illustrated by an evaluation of a community policing project (Thurman, Giacomazzi, and Bogen, 1993). Note that participant observations, focus groups, telephone surveys, and written questionnaires were used and program cost was presented. Note also that the interests of four stakeholder groups participants, parents or guardians, staff, and taxpayers were examined. Police officers worked with a program designed to help 325 high-risk children develop a sense of responsibility, envision occupational roles, recognize the relationship between education and finding a good job, and hold positive images of police officers. The children, whose median age was 13, were nominated by school counselors from the most economically disadvantaged neighborhoods. The week-long program included (a) work periods spent removing trash, weeds, and graffiti; (b) lunches in parks; (c) tours of businesses and museums; (d) a $40 bank account for program completion; and (e) contact with role models, including police officers. Five focus groups were used to assess immediate reactions of the children. Each session was held near the end of the week and lasted one hour. The children volunteered comments that seemed to match the goals of the program: They said that they learned responsibility, were encouraged to complete their education, and for the most part reported positive feelings toward the police officers. The parents or guardians were randomly selected for structured telephone interviews after the program ended; 94 percent agreed to be interviewed. All said that their children had talked about positive aspects of the program and wanted to participate again in the following summer. Nearly all respondents (90 percent) said there were no negative aspects of the program and about half said that their child did gain a sense of responsibility. At the end of the summer all program staff members received surveys. Respondents were aware of organizational problems; however, nearly all had a very positive perception of the program, all recommended that the program be repeated the next summer, and all said that they wanted to be involved if it were offered again. The cost of the program was $46,311, or $ per child. There was no way to compare this cost to the long-term benefits; however, if such efforts motivate only a small number of high-risk children to be more receptive to future encouragement to follow healthy lifestyles and to avoid gangs and drugs, considerable suffering would be avoided and society would save significant future law enforcement, legal, and rehabilitation funds. Use Valid Measures The instruments must validly measure the behaviors that the program is designed to change. These behaviors may be the ultimate criterion behaviors (such as a healthy life, developed skills, employment) or more immediate behaviors believed to be useful in achieving the planned long-term outcomes (such as more consistent adherence to prescribed medical treatment, higher 98
5 quality work, or improved leadership practices). In order to increase the credibility of the evaluation, evaluators make sure that staff members have approved the measures. But because program staff members are often inexperienced in social science methodology and cannot judge how feasible it is to measure a particular variable, evaluators do not depend on them to suggest all the measures and variables. In general, the more a measurement tool focuses on objective behavior rather than on ill-defined or vague terms, the more likely it is to be valid. Objective behaviors (such as late to work less often than once a week or speaks in groups ) can be more validly measured than traits (such as punctual and assertive ), regardless of the specific measurement approach chosen (Mager, 1997). Even when the variables seem quite objective, information taken from official records may not be as valid as it first appears. Changing definitions and differing levels of care in preparing records can introduce changes in the meaning of variables that could influence an evaluation. At least twice Chicago s crime records appeared to reveal an increase in crime when better recordkeeping was begun by the police. After a well-respected person was installed as chief of police, thefts under $50 increased dramatically. Instead of ushering in a crime wave, the new chief simply insisted on better reporting procedures, and may have reclassified some crimes (Campbell, 1969). Since homicides are usually recorded accurately and cannot be reclassified into a different category, homicide rates were used to determine that the crime rate did not increase when the new chief took over. In 1983 a similar increase was observed when recording standards were again strengthened ( Good News, 1983). After the renorming of the SAT, average SAT scores of college freshmen showed an increase between 1994 and 1995, a result solely due to a change in scaling by the Educational Testing Service ( Notebook, 1994). The national jobless rate increased in 1994 because the Bureau of Labor Statistics changed the survey used to assess joblessness to better reflect the participation of women in the workforce ( Survey s Overhaul, 1993). In 2000 the U.S. Census revised the categories used by respondents to indicate their race (Lee, 2001). This change means that information on race from the 2000 Census cannot be directly compared with previous census data. Using records is efficient and often less expensive than making observations specifically for an evaluation, but whenever one uses data collected for a purpose other than the evaluation, a critical examination of the applicability of the data is always in order. Use Reliable Measures The concept of reliability. Reliability refers the consistency of the information that a measure produces for the same person in the same situation (Murphy and Davidshofer, 2005). There are many ways to think about reliability. If different observers describing the same thing report similar levels of 99
6 a variable, we say that the observation procedure is reliable. If different levels are reported, we say that the procedure is unreliable. Reliability is calculated using the correlation coefficient, r. If two observers agreed completely after making a number of observations, a correlation of the two sets of data would be 1.00, perfect reliability. To the extent that they do not agree with each other, the correlation would be smaller; 0.0 would indicate that knowing one observer s reports would tell us nothing about the other observer s reports. If an outcome measure is a 50-item test of knowledge gained from, say, a job training program, there is another way to estimate reliability. The scores that a group of trainees earned on half of the items (say, the odd-numbered items) can be correlated with the scores for the other half of the items; such a correlation is called a split-half reliability. Note that the focus of interest is still consistency just as in the first example concerning interobserver reliability. For split-half reliability the issue is inter-item consistency, that is, the different items seem to be measuring the same thing. Statistical analysis programs make such calculations simple to do (Kirkpatrick and Finney, 2008). Reliability is higher when the measurement procedure is minimally affected by the passing moods of the observer or the individuals observed. Like validity, reliability is likely to be higher when observations are based on objective behaviors rather than on inferences. Reliability is also higher when the measurement instrument contains more items. You may well have a sense of the higher reliability produced by using many questions if you think of a classroom test. A single item forms a larger portion of a short test than it would of a long test. If you had happened to have forgotten the topic covered by a certain question, your score would be affected much more in the context of a short test than in the context of a long test. Because a single question can have major effect, short tests are less reliable than long tests. The more reliable a measure is, the more likely it is to detect an effect of a program (Lipsey, 1990). Evaluators trained in disciplines in which the individual assessment is important are familiar with the reliability of classroom, achievement, or job selection tests. It is crucial that evaluators recognize that using tests to evaluate individuals is markedly different from using tests to evaluate programs. Since evaluators focus attention on groups, not individuals, surveys and observational techniques that would not be useful for individual assessment are quite acceptable to estimate the mean score of a group. By using the standard deviation of a measure and its reliability, it is possible to calculate a range of values likely to include a person s true score. For example, assume a person scored 105 on an IQ test whose standard deviation is 15 and reliability is The true scores of 68 percent of the people getting 105 will be between 105 ; , or and The value added and subtracted to the person s score is called the standard error of measurement and applies when measuring an individual s score (Murphy and Davidshofer, 2005). This range is called a confidence interval. 100
7 By contrast, when estimating a group s mean score, the standard error of the mean should be used to calculate confidence intervals instead of the standard error of measurement. Suppose a group of 100 students are selected at random from a school. Suppose further that they have an average of 105 on the same IQ test mentioned above. For a group, we work with the standard error of the mean which, in this case, is , or We can conclude that 68 percent of such groups have true mean scores between 105 ; , or and Compare this confidence interval with the one found for an individual in the paragraph above. We can be more certain of the likely value of a group mean than the score of any one of the individuals in the group. Even a measure with a reliability of only 0.40 would yield a sufficiently precise estimate for program evaluation purposes because evaluators are concerned about groups, not individuals. Even short scales are often sufficiently reliable for evaluating the effects of college experiences when samples are large (Walvoord, 2004). Different forms of reliability. Some reliability indexes are less relevant to evaluation than to individual assessment. A crucial distinction relates to the difference between assessing a personality trait that is thought to be a stable characteristic of an individual and measuring a behavior that can change, depending on the intentions of people or the situations in which they act. For personality assessment, a high test retest reliability shows that the measure reliably produces consistent estimates of a trait. The items on such measures have been chosen because they produce stable results; however, stability is not the focus of evaluators. Programs are designed to change people or communities; program success cannot be evaluated with measures that were selected to be stable. Evaluators seek measures that are sensitive to change (Lipsey and Cordray, 2000). A form of reliability that evaluators seek in scales is homogeneity, that is, the degree to which a scale measures one thing rather than a mixture of behaviors. If a reading program is to be evaluated, the instrument should measure reading improvement, not general knowledge or quantitative skills. Cronbach s alpha is available in many statistical programs and is often reported when several items are placed together to form a scale. In essence, this index is a generalization of the traditional split-half reliability coefficient without the need to divide the scale into arbitrary halves (Pedhazur and Schmelkin, 1991). When observer ratings are used, evaluators also seek high interobserver reliability. An instrument that yields similar values when used by different people has more credibility than one that yields different values. Obviously, if the ratings are done in different settings at home versus at school a low interobserver reliability index may be observed due to real differences between the settings themselves. Interobserver reliability can be increased through the development of a detailed instruction manual and careful training and periodic monitoring of observers. 101
Research in Education. Tenth Edition
Research in Education John W. Best James V. Kahn Tenth Edition Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationMedical Terminology: A Living Language Bonnie F. Fremgen Suzanne S. Frucht Fifth Edition
Medical Terminology: A Living Language Bonnie F. Fremgen Suzanne S. Frucht Fifth Edition Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
More informationProbability and Statistical Inference NINTH EDITION
GLOBAL EDITION Probability and Statistical Inference NINTH EDITION Robert V. Hogg Elliot A. Tanis Dale L. Zimmerman Editor in Chief: Deirdre Lynch Acquisitions Editor: Christopher Cummings Sponsoring Editor:
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationCHAPTER 3 METHOD AND PROCEDURE
CHAPTER 3 METHOD AND PROCEDURE Previous chapter namely Review of the Literature was concerned with the review of the research studies conducted in the field of teacher education, with special reference
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationElaine N. Marieb Katja N. Hoehn Ninth Edition
Human Anatomy & Physiology Elaine N. Marieb Katja N. Hoehn Ninth Edition Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on
More informationGLOBAL EDITION. Anatomy and Physiology Coloring Workbook. A Complete Study Guide TWELFTH EDITION. Elaine N. Marieb Simone Brito
GLOBAL EDITION Anatomy and Physiology Coloring Workbook A Complete Study Guide TWELFTH EDITION Elaine N. Marieb Simone Brito Courseware Portfolio Manager: Lauren Harp Content Producer: Susan Malloy Managing
More informationValidity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that
Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that it purports to perform. Does an indicator accurately
More informationCraft Personality Questionnaire
Craft Personality Questionnaire Evidence of Reliability and Validity 888-298-6227 TalentLens.com Copyright 2008 Pearson Education, Inc., or its affiliates. All rights reserved. Copyright 2008 by Pearson
More informationEducational Psychology Theory and Practice Robert E. Slavin Tenth Edition
Educational Psychology Theory and Practice Robert E. Slavin Tenth Edition Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationHealth Promotion in Nursing Practice Nola J. Pender Carolyn L. Murdaugh Mary Ann Parsons Sixth Edition
Health Promotion in Nursing Practice Nola J. Pender Carolyn L. Murdaugh Mary Ann Parsons Sixth Edition Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout
More informationDOING SOCIOLOGICAL RESEARCH C H A P T E R 3
DOING SOCIOLOGICAL RESEARCH C H A P T E R 3 THE RESEARCH PROCESS There are various methods that sociologists use to do research. All involve rigorous observation and careful analysis These methods include:
More informationSOCIOLOGICAL RESEARCH
SOCIOLOGICAL RESEARCH SOCIOLOGY Is a scientific discipline rooted in Positivism As such it makes use of a number of scientific techniques Including: The experimental method, the survey and questionnaire
More informationChapter 11. Experimental Design: One-Way Independent Samples Design
11-1 Chapter 11. Experimental Design: One-Way Independent Samples Design Advantages and Limitations Comparing Two Groups Comparing t Test to ANOVA Independent Samples t Test Independent Samples ANOVA Comparing
More informationThe Emergence of Somatic Psychology and Bodymind Therapy
The Emergence of Somatic Psychology and Bodymind Therapy Critical Theory and Practice in Psychology and the Human Sciences Titles include: Barnaby B. Barratt THE EMERGENCE OF SOMATIC PSYCHOLOGY AND BODYMIND
More informationThe Institute of Chartered Accountants of Sri Lanka
The Institute of Chartered Accountants of Sri Lanka Postgraduate Diploma in Business Finance and Strategy Quantitative Methods for Business Studies Handout 01: Basic Statistics What is Statistics? Statistics
More informationSafety & Accountability Audit
Mending the Sacred Hoop & Program for Aid to Victims of Sexual Assault Safety & Accountability Audit of the response to Native women who report sexual assault in Duluth, Minnesota 2006-2008 Executive Summary
More informationPreparing for an Oral Hearing: Taxi, Limousine or other PDV Applications
Reference Sheet 12 Preparing for an Oral Hearing: Taxi, Limousine or other PDV Applications This Reference Sheet will help you prepare for an oral hearing before the Passenger Transportation Board. You
More informationFrom Psycho-Analysis to Culture-Analysis
From Psycho-Analysis to Culture-Analysis Also by Marwan Dwairy COUNSELING AND PSYCHOTHERAPY WITH ARABS AND MUSLIMS: A Culturally Sensitive Approach CROSS-CULTURAL COUNSELLING: The Arab Palestinian Case
More informationDOI: / Empathy and Violent Video Games
DOI: 10.1057/9781137440136.0001 Empathy and Violent Video Games Palgrave Studies in Cyberpsychology Series Editor: Jens Binder, Nottingham Trent University, UK Titles include John Waterworth and Giuseppe
More informationSaville Consulting Wave Professional Styles Handbook
Saville Consulting Wave Professional Styles Handbook PART 4: TECHNICAL Chapter 19: Reliability This manual has been generated electronically. Saville Consulting do not guarantee that it has not been changed
More informationDATA GATHERING. Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings.
DATA GATHERING Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings. 2012 John Wiley & Sons Ltd. Measurement Measurement: the assignment
More information2016 Knighton Award Submission Form
Page 1 of 5 2016 Knighton Award Submission Form 2016 Knighton Award Submission Form Instructions The Knighton Award submission package must be uploaded by January 27, 2017 A. SUBMITTING ORGANIZATION Please
More informationGLOBAL EDITION. Anatomy and Physiology Coloring Workbook. A Complete Study Guide TWELFTH EDITION. Elaine N. Marieb Simone Brito
GLOBAL EDITION Anatomy and Physiology Coloring Workbook A Complete Study Guide TWELFTH EDITION Elaine N. Marieb Simone Brito Courseware Portfolio Manager: Lauren Harp Content Producer: Susan Malloy Managing
More informationVULNERABILITY AND EXPOSURE TO CRIME: APPLYING RISK TERRAIN MODELING
VULNERABILITY AND EXPOSURE TO CRIME: APPLYING RISK TERRAIN MODELING TO THE STUDY OF ASSAULT IN CHICAGO L. W. Kennedy J. M. Caplan E. L. Piza H. Buccine- Schraeder Full Article: Kennedy, L. W., Caplan,
More information11-3. Learning Objectives
11-1 Measurement Learning Objectives 11-3 Understand... The distinction between measuring objects, properties, and indicants of properties. The similarities and differences between the four scale types
More informationChapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 13 Experiments and Observational Studies Copyright 2012, 2008, 2005 Pearson Education, Inc. Observational Studies In an observational study, researchers don t assign choices; they simply observe
More informationEuropean Data Supplement
Chapter 10: Polish MBTI Step I instrument European Data Supplement Polish January 2009 OPP Ltd Elsfield Hall 15 17 Elsfield Way Oxford OX2 8EP UK t: +44 (0)845 603 9958 f: +44 (0)1865 557483 233 MBTI Step
More informationN Utilization of Nursing Research in Advanced Practice, Summer 2008
University of Michigan Deep Blue deepblue.lib.umich.edu 2008-07 N 536 - Utilization of Nursing Research in Advanced Practice, Summer 2008 Tzeng, Huey-Ming Tzeng, H. (2008, October 1). Utilization of Nursing
More informationUnderstanding Your Coding Feedback
Understanding Your Coding Feedback With specific feedback about your sessions, you can choose whether or how to change your performance to make your interviews more consistent with the spirit and methods
More informationALABAMA SELF-ASSESSMENT INDEX PILOT PROGRAM SUMMARY REPORT
ALABAMA SELF-ASSESSMENT INDEX PILOT PROGRAM SUMMARY REPORT July 7, 2000 A large sample (N = 1,127) of welfare recipient clients were administered the Self-Assessment Index Behavior Data Systems, Ltd. P.O.
More informationVARIABLES AND MEASUREMENT
ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 16A LECTURE NOTES [01/29/16] VARIABLES AND MEASUREMENT AGE 1 Topic #3 VARIABLES AND MEASUREMENT VARIABLES Some definitions of variables include the following: 1.
More informationExperimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design
Experimental Research in HCI Alma Leora Culén University of Oslo, Department of Informatics, Design almira@ifi.uio.no INF2260/4060 1 Oslo, 15/09/16 Review Method Methodology Research methods are simply
More informationAARP Bulletin Survey on Volunteering
AARP Bulletin Survey on Volunteering Report Written by: Alicia Williams Copyright 2012 AARP Research & Strategic Analysis 601 E Street, NW Washington, DC 20049 www.aarp.org/research Reprinting with permission
More informationEwing Township Welcome Booklet Neighborhood Group Ewing Township Green Team
Ewing Township Welcome Booklet Neighborhood Group Ewing Township Green Team It was brought to the attention of the Green Team that a Welcome Booklet would be a valuable resource to both current and new
More information@2004-Beyond. BodyweightPilates.com. All Rights Reserved
Quick Start Checklist By: Sylvia Favela Copyright Notice No part of this information may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording,
More informationCoaching, a scientific method
Coaching, a scientific method ROSELYNE KATTAR I. What is coaching? II. What is The Scientific Method in coaching? What are the phases of this process? III. How does a coach help his client? This article
More informationMeasurement page 1. Measurement
Measurement page 1 Measurement In every study, researchers will measure behavior. The behavior could be overt (obvious, easily visible) such as bumping into someone or saying something, or it could be
More informationACDI. An Inventory of Scientific Findings. (ACDI, ACDI-Corrections Version and ACDI-Corrections Version II) Provided by:
+ ACDI An Inventory of Scientific Findings (ACDI, ACDI-Corrections Version and ACDI-Corrections Version II) Provided by: Behavior Data Systems, Ltd. P.O. Box 44256 Phoenix, Arizona 85064-4256 Telephone:
More informationAttention-deficit/ Hyperactivity Disorder
Guide to Assessment Scales in Attention-deficit/ Hyperactivity Disorder Second Edition Scott H. Kollins Associate Professor Director, Duke ADHD Program Department of Psychiatry Duke University Medical
More informationFamily & Individual Support Program - Handbook
Family & Individual Support Program - Handbook Welcome and Introduction to the Simon Fraser Society for Community Living Welcome to the Simon Fraser Society for Community Living (SFSCL). We have been serving
More informationHow to Conduct an Unemployment Benefits Hearing
How to Conduct an Unemployment Benefits Hearing Qualifications for receiving Unemployment Benefits Good Morning my name is Dorothy Hervey and I am a paralegal with Colorado Legal Services and I will talk
More informationTHE INTEGRITY PROFILING SYSTEM
THE INTEGRITY PROFILING SYSTEM The Integrity Profiling System which Soft Skills has produced is the result of a world first research into leadership and integrity in Australia. Where we established what
More informationCh. 11 Measurement. Paul I-Hai Lin, Professor A Core Course for M.S. Technology Purdue University Fort Wayne Campus
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture
More informationBeing an Effective Coachee :
: Things to Act on When Working with a Personal Coach By Roelf Woldring WCI Press / Transformation Partners 21 st Century Staffing Innovators www.21cstaffing.com Elora, Ontario, Canada N0B 1S0 Copyright,
More information32.5. percent of U.S. manufacturers experiencing unfair currency manipulation in the trade practices of other countries.
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture
More informationI. Introduction and Data Collection B. Sampling. 1. Bias. In this section Bias Random Sampling Sampling Error
I. Introduction and Data Collection B. Sampling In this section Bias Random Sampling Sampling Error 1. Bias Bias a prejudice in one direction (this occurs when the sample is selected in such a way that
More informationANATOMY OF A RESEARCH ARTICLE
ANATOMY OF A RESEARCH ARTICLE by Joseph E. Muscolino D.C. Introduction As massage therapy enters its place among the professions of complimentary alternative medicine (CAM), the need for research becomes
More informationExaminers Report January GCSE History 5HA03 3B
Examiners Report January 2012 GCSE History 5HA03 3B Edexcel and BTEC Qualifications Edexcel and BTEC qualifications come from Pearson, the world s leading learning company. We provide a wide range of qualifications
More informationMedicaid Denied My Request for Services, Now What?
Medicaid Denied My Request for Services, Now What? A Handbook on How to Appeal Medicaid Services Denial Kentucky Protection & Advocacy This handbook gives legal information about how to file a Kentucky
More informationImportance of Good Measurement
Importance of Good Measurement Technical Adequacy of Assessments: Validity and Reliability Dr. K. A. Korb University of Jos The conclusions in a study are only as good as the data that is collected. The
More information4-H SWINE RECORD BOOK 1
4HSWR01 4-H SWINE RECORD BOOK 1 Name Date of Birth Address Grade in School Name of School Years in 4-H Years in Swine Projects Name of Local Club Parent or Guardian Local Leader County Extension Agent
More informationCOUNTY LEVEL DATA FROM PWB POLLING JEFFERSON COUNTY
How serious are these issues to Jefferson County residents? Extremely serious Very serious Somewhat serious Not a problem DK/NA High health care costs Too much government spending Lack of affordable housing
More informationOur Pledge to Children in Care and Care Leavers
Our Pledge to Children in Care and Care Leavers 1 Designed and printed by Bristol City Council, Bristol Design OCTOBER 15 BD7047 Bristol Corporate Parenting Strategy The Bristol Pledge The pledge is a
More informationThe New Neighborhood Block Club Manual for Constituents and Organizers. A Guide Book written and prepared by Dan Kleinman Second Edition January 2016
The New Neighborhood Block Club Manual for Constituents and Organizers A Guide Book written and prepared by Second Edition January 2016 This belongs to Block Club Organizer 2 What is: a Block Club A block
More informationalternate-form reliability The degree to which two or more versions of the same test correlate with one another. In clinical studies in which a given function is going to be tested more than once over
More informationSocial. Research SECOND EDITION
Social Research SECOND EDITION Social Research SECOND EDITION Soti rios Sarantakos Charles Sturt University, Australia Sotirios Sarantakos 1993, 1998 All rights reserved. No reproduction, copy or transmission
More informationRESOURCE GUIDE Scheduling Meetings and Educating U.S. Congressional Representatives
RESOURCE GUIDE Scheduling Meetings and Educating U.S. Congressional Representatives National Network for Youth 741 8th Street, SE Washington, DC 20003 Page 0 6 www.nn4youth.org National darla.bardine@nn4youth.org
More informationCOUNTY LEVEL DATA FROM PWB POLLING BROOMFIELD COUNTY
How serious are these issues to Broomfield County residents? Extremely serious Very serious Somewhat serious Not a problem DK/NA Too much government spending 24% 1 45% The quality of public schools 7%
More informationBehavioral Health Barometer. Oregon, 2015
Behavioral Health Barometer Oregon, 2015 Acknowledgments This report was prepared for the Substance Abuse and Mental Health Services Administration (SAMHSA) by RTI International under contract No. 283
More informationDesigning a Questionnaire
Designing a Questionnaire What Makes a Good Questionnaire? As a rule of thumb, never to attempt to design a questionnaire! A questionnaire is very easy to design, but a good questionnaire is virtually
More informationDo not write your name on this examination all 40 best
Student #: Do not write your name on this examination Research in Psychology I; Final Exam Fall 200 Instructor: Jeff Aspelmeier NOTE: THIS EXAMINATION MAY NOT BE RETAINED BY STUDENTS This exam is worth
More informationChapter 13 Summary Experiments and Observational Studies
Chapter 13 Summary Experiments and Observational Studies What have we learned? We can recognize sample surveys, observational studies, and randomized comparative experiments. o These methods collect data
More informationResearch Consent Form Newton-Wellesley Hospital 2014 Washington Street Newton, MA 02462
Protocol Title: Principal Investigator: Description of Subject Population: Protocol Version: Consent Form Revision Date: ABOUT THIS CONSENT FORM STUDY CONTACTS
More informationHOW IS PACE TO BE USED
Introduction and overview of the pace monitor what is THE PACE MONITOR The PACE Monitor is a comprehensive program for the screening, in-depth assessment and the evaluation of the progress and change of
More informationCOUNTY LEVEL DATA FROM PWB POLLING BOULDER
How serious are these issues to Boulder residents? Extremely serious Very serious Somewhat serious Not a problem DK/NA Hight health care costs Lack of affordable housing Income inequality Drug and alcohol
More information2015 Budget Hearing Statement Patricia Jackowiak, Director Department of Administrative Hearings Friday, October 31, 2014
2015 Budget Hearing Statement Patricia Jackowiak, Director Department of Administrative Hearings Friday, October 31, 2014 Good Morning, Chairman Austin and members of the City Council. Thank you for the
More informationCASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH
CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH Why Randomize? This case study is based on Training Disadvantaged Youth in Latin America: Evidence from a Randomized Trial by Orazio Attanasio,
More informationFFY17 PEARS PSE Reporting
FFY17 PEARS PSE Reporting Overarching questions Deciding whether to report on a site for FFY17 1. How do I know for sure that I need to do this reporting? All LIAs working on any PSE activities should
More informationHow Ofsted regulate childcare
Information for parents about Ofsted s role in regulating childcare This section provides information about how Ofsted regulates childcare providers. It sets out how you might like to use the information
More informationACKNOWLEDGEMENTS projects mentoring
mentoring projects mentoring projects ACKNOWLEDGEMENTS The Youth Justice Board would like to thank Roger Tarling, Tonia Davison and Alan Clarke of the Institute of Social Research at the University of
More informationReliability and Validity checks S-005
Reliability and Validity checks S-005 Checking on reliability of the data we collect Compare over time (test-retest) Item analysis Internal consistency Inter-rater agreement Compare over time Test-Retest
More informationChapter Three: Sampling Methods
Chapter Three: Sampling Methods The idea of this chapter is to make sure that you address sampling issues - even though you may be conducting an action research project and your sample is "defined" by
More informationThe Clean Environment Commission. Public Participation in the Environmental Review Process
The Clean Environment Commission Public Participation in the Environmental Review Process Manitoba Clean Environment Commission Who are we? The Manitoba Clean Environment Commission is an arms-length agency
More informationThe Biological Bases of Economic Behaviour
The Biological Bases of Economic Behaviour This page intentionally left blank The Biological Bases of Economic Behaviour A Concise Introduction David McFarland Emeritus Fellow, Balliol College, University
More informationAY PROSPECTIVE RESEARCH TOPIC NOMINATION
AY 2018-2019 PROSPECTIVE RESEARCH TOPIC NOMINATION CLASSIFICATION RESEARCH TOPIC TITLE UNCLASSIFED Animal Decontamination in CBRN Response Enterprise Operations TOPIC DESCRIPTION The purpose of this research
More informationIs It Adult ADHD? From ADDitude s Experts
Is It Adult ADHD? From ADDitude s Experts TERMS OF USE Copyright 2013 by New Hope Media. All rights reserved. No part of this report may be reproduced or transmitted in any form or by any means, electronic
More informationCh. 11 Measurement. Measurement
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture
More informationWorking in Secure Forensic Mental Health Settings
Working in Secure Forensic Mental Health Settings A Care Quality Guide for support workers and staff By Martin Spooner Contents About the author...4 Introduction...5 Section 1: Legislation, policies and
More informationStudents Perception and Attitude Toward Hiring a Former Offender
Students Perception and Attitude Toward Hiring a Former Offender Gloria Enyondo Millersville University of Pennsylvania glenyond@millersville.edu Abstract Much has been written about people s perceptions
More informationResponsible Alcohol Service for St. Mary Parish
Server Responsibility As a Server of alcohol in the state of Louisiana, it is your responsibility to adhere to the local ordinance governing the sale and service of alcohol and tobacco. Ordinances may
More informationAwareness. Community Action. Groups in the. Awareness Phase. Action. SASA! Faith Supplementary Materials - Community Action Groups - Awareness 1
Community Action Groups in the Phase Action SASA! Faith Supplementary Materials - Community Action Groups - 1 Note: There is basic information in the SASA! Faith guide about the types of activities you
More informationValidity and Reliability. PDF Created with deskpdf PDF Writer - Trial ::
Validity and Reliability PDF Created with deskpdf PDF Writer - Trial :: http://www.docudesk.com Validity Is the translation from concept to operationalization accurately representing the underlying concept.
More informationReduce Tension by Making the Desired Choice Easier
Daniel Kahneman Talk at Social and Behavioral Sciences Meeting at OEOB Reduce Tension by Making the Desired Choice Easier Here is one of the best theoretical ideas that psychology has to offer developed
More informationCharacteristics of the Text Genre Nonfi ction Text Structure Three to eight lines of text in the same position on each page
LESSON 14 TEACHER S GUIDE by Karen J. Rothbardt Fountas-Pinnell Level J Nonfiction Selection Summary Children with special needs use a variety of special tools to help them see and hear. This simply written
More informationTechnical Specifications
Technical Specifications In order to provide summary information across a set of exercises, all tests must employ some form of scoring models. The most familiar of these scoring models is the one typically
More information(Weighted sample of 98 respondents) How serious are these issues to Boulder residents? Extremely serious Very serious Somewhat serious 38% 44% 31%
Perspectives on Homelessness in the Denver Metro Area Public opinion survey conducted for The Denver Foundation by Fairbank, Maslin, Maullin, Metz & Associates and Public Opinion Strategies January 14-22,
More informationTHE BLOCKWATCH HANDBOOK
THE BLOCKWATCH HANDBOOK Introduction The Blockwatch Handbook was created to provide a written guide for citizens and officers to refer to for the operation of a blockwatch. This handbook cannot provide
More informationCHAPTER V. Summary and Recommendations. policies, including uniforms (Behling, 1994). The purpose of this study was to
HAPTER V Summary and Recommendations The current belief that fashionable clothing worn to school by students influences their attitude and behavior is the major impetus behind the adoption of stricter
More informationOPWDD: Putting People First. Redefining the Role of the DSP Trainer s Manual. Developed by Regional Centers for Workforce Transformation
Redefining the Role of the DSP Trainer s Manual Developed by Regional Centers for Workforce Transformation Core Competencies This Video Trainer s Manual is designed to guide you through the Workforce Transformation
More informationSampling for Success. Dr. Jim Mirabella President, Mirabella Research Services, Inc. Professor of Research & Statistics
Sampling for Success Dr. Jim Mirabella President, Mirabella Research Services, Inc. Professor of Research & Statistics Session Objectives Upon completion of this workshop, participants will be able to:
More informationISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology
ISC- GRADE XI HUMANITIES (2018-19) PSYCHOLOGY Chapter 2- Methods of Psychology OUTLINE OF THE CHAPTER (i) Scientific Methods in Psychology -observation, case study, surveys, psychological tests, experimentation
More informationPrelims-ESMO-Cancer Prevention-8039.qxd 12/12/2007 7:04 PM Page i. ESMO handbook of cancer prevention
Prelims-ESMO-Cancer Prevention-8039.qxd 12/12/2007 7:04 PM Page i ESMO handbook of cancer prevention Prelims-ESMO-Cancer Prevention-8039.qxd 12/12/2007 7:04 PM Page ii Prelims-ESMO-Cancer Prevention-8039.qxd
More information