Underlying Theory & Basic Issues
|
|
- Helen Butler
- 1 years ago
- Views:
Transcription
1 Underlying Theory & Basic Issues Dewayne E Perry ENS 623 1
2 All Too True 2
3 Validity In software engineering, we worry about various issues: E-Type systems: Usefulness is it doing what is needed Is it doing it in an acceptable or appropriate way S-Type programs: correctness of functionality is it doing what it is supposed to do Are the structures consistent with the way it should perform In empirical work, worried about similar kinds of things Are we testing what we mean to test Are the results due solely to our manipulations Are our conclusions justified What are the results applicable to The questions correspond to different validity concerns Concerned about the logic of evidence 3
4 Validity 4 primary types of validity Construct Validity Internal Validity Statistical Conclusion External Validity Comments This organization differs somewhat from R&R Each sequentially dependent on preceding 4
5 Construct Validity Are we measuring what we intend to measure Akin to the requirements problem: are we building the right system If we don t get this right, the rest doesn t matter Constructs: abstract concepts Theoretical constructions Must be operationalized in the experiment Necessary condition for successful experiment Divide construct validity into three parts: Intentional Validity Representation Validity Observation Validity 5
6 Construct Validity Intentional Validity Do the constructs we chose adequately represent what we intend to study Akin to the requirements problem where our intent is fair scheduling but out requirement is FIFO Are our constructs specific enough Do they focus in the right direction Eg, is it intelligence or cunningness 6
7 Construct Validity Representation Validity How well do the constructs or abstractions translate into observable measures Two primary questions: Do the sub-constructs properly define the constructs Do the observations properly interpret, measure or test the constructs 2 ways to argue for representation validity Face validity Claim: on the face of it, seems like a good translation Very weak argument Strengthened by consensus of experts Content validity Check the operationalization against the domain for the construct The extent to which the tests measure the content of the domain being tested - ie, cover the domain The more it covers the relevant areas, the more content valid Both are nonquantitative judgments 7
8 Construct Validity Observation Validity How good are the measures themselves Different aspects illuminated by Predictive validity Criterion validity Concurrent validity Convergent validity Discriminant validity 8
9 Predictive Validity Construct Validity Observed measure predicts what it should predict and nothing else Eg, college aptitude tests are assessed for their ability to predict success in college Criterion Validity Degree to which the results of a measure agree with those of an independent standard Eg, for college aptitude, GPA or successful first year Concurrent Validity The observed measure correlates highly with an established set of measures Eg, shorter forms of tests against longer forms 9
10 Convergent Validity Construct Validity Observed measure correlates highly with other observable measures for the same construct Utility is not that it duplicates a measure but is a new way of distinguishing a particular trait while correlating with similar measures Discriminant Validity The observable measure distinguishes between two groups that differ on the trait in question Lack of divergence argues for poor discriminant validity R&R discuss various interesting correlations on convergent and discriminant validity among various psychological tests In terms of validity, reliability and stability 10
11 Internal Validity Are the values of the dependent variables solely the result of the manipulations of the independent variables Have we ruled out rival hypotheses Have we eliminated confounding variables Participant variables Experimenter variables Stimulus, procedural and situational variables Instrumentation Nuisance variables 11
12 Internal Validity Never completely satisfied (Systems never error free either) Campbell, Stanley and Cook Standardize choice of control groups Try to isolate potential invalidity sources Confounding effects Treatment effect and some other effect cannot be separated Confounding sources of internal invalidity H: History takes place between pre and post test May contaminate post test results M: Maturation older/wiser/better between pre/post I: Instrumentation change due to test instrument S: Selection nature of participants Control over assignment may have effects 12
13 Statistical Conclusion Validity Are the presumed causal variable X and its effect Y statistically related Ie, do they covary If unrelated then the one cannot be the cause of the other 3 questions (sequentially dependent) Is the study sufficiently sensitive What is the evidence that they covary How strongly do they covary 13
14 External Validity Two positions The generalizability of the causal relationship beyond that studied/observed Eg, do studies of very large reliable real-time systems generalize to small.com companies The extent to which the results support the claims of generalizability Eg, do the studies of 5ESS support the claim that they are representative of real-time ultra reliable systems 14
15 External Validity (EV) SWE: lab studies tend to be with students and that restricts EV and generalization Ecological validity: representativeness of the real world Efficacy vs effectiveness studies Former very rigorous, latter more open Former needs to be more concerned with EV Latter with internal validity EV: the demonstrated validity of the generalizations that the researcher intended the research to make at the outset and the validity of the generalized inferences that the researcher offers at the end 15
16 Generalizability Generalizability considerations People Researchers Places, environments, settings Time Treatments, levels of treatments Procedures, conditions and measurements Technology Reproducibility Key to generalizability is whether the study can be reproduced Replication is an exact as possible repeat Same procedure, different sample Look for congruent results Replications on a broader set of subjects under additional conditions further strengthens generalizability 16
17 Causation Philosophical issues Aristotle: formal, material, efficient, final causes Alternatives: concomitant variation, invariable sequence Issue of power, causal efficacy -> invariably joined Necessity versus invariable sequence Sufficiency Temporal precedence 17
18 Causation Plurality of causes In behavioral sciences more in terms of one of the causes than a single cause Experiment while holding everything else constant Causality reserved for experimental results Working definition of cause Forget infinite regressive trail of reason Non-philosophical working definition: A proximal antecedent agent or agency that initiates a sequence of events that re necessary and sufficient in bringing about the observed effects Proximal since it is occurs at a time near the result Antecedent as it clearly precedes the effect Agent is set up intentionally Experimenter exercises the control lever Sufficient: effect not seen in absence of treatment 18
19 Lack of Causation Correlation and causation Correlations show a relationship With path analysis, multiple regression analysis, one can begin to make causal inferences, or build causal models But demonstration of causality is a logical and experimental, rather than a statistical problem Enabling versus causing Permits but does not cause Eg: marriage is primary cause of divorce - NOT Other Not sufficient May not be necessary (eg, high IQ and good living) May be probabilistic Some unsubstantiated causal claims: Drinking wine prevents arteriosclerosis Eating broccoli prevents colon cancer Post hoc ergo propter hoc necessity not demonstrated 19
20 Hume s Classical Rules C&E must be contiguous in space and time C must be prior to E A constant union between C and E The same C always produces the same E and the same E never arises but from the same C Like Es imply like Cs Like Cs produce like Es Cs may have multiple components, ie subcs Some Cs are not complete in themselves 20
21 Distillation Co-variation Rule : cause is positively correlated with effect Temporal Precedence Rule : causes must precede effects Internal Validity Rule :all plausible alternative explanations must be ruled out Reality : must settle for best available evidence 21
22 Control Constancy of conditions Maintaining extraneous conditions that might affect variables Calibrating various elements in an experiment Control series Expectation control Behavior control Control condition Of primary concern to us Control + treatment 22
23 Mill s Method Method of agreement If X then Y If several instances of this and only X present Then X is a sufficient condition for Y Method of Difference If ~X then ~Y IfY does not occur when X is absent Then X is a necessary condition of Y Joint Method Should lead to better, more highly justified conclusions than either method separately Method of Concomitant Variation Relates changes in the amount or degree of change Y = f(x) Y is functionally related to variations in X Eg, stronger treatments show larger effects 23
24 Practical Application Practical problems: Rare to find perfect covariance, r = 1.0 Rare to rule out every plausible alternative hypothesis Experience needed to determine adequate control conditions Two group design Treatment: if X then Y Control: if ~X then ~Y 24
25 Randomness Randomness is fundamental in experiments Quasi-experimental otherwise Must compensate for it otherwise Must have a clear view of its role It is the reasoned basis for inference in experiments The basis for statistical methods RA Fischer, The Design of Experiments, Edinburgh: Oliver & Boyd, 1935, 1949 Credited with the invention of randomization Introduced the formal properties of randomization 25
26 The Lady Tasting Tea A lady declares that by tasting a cup of tea made with milk she can discriminate whether the milk or the tea infusion was first added to the cup. Experiment 8 cups of tea 4 made each way Presented in random order often determined by a random number table Subject knows the experimental design Her task is to determine two sets of 4 Agreeing if possible with the treatments received 26
27 The Lady Tasting Tea What would be expected if the Lady was without any faculty of discrimination Ie, if she made no changes in her judgments in response to changes in the order of presentation There are 70 possible divisions of 8 into 4 Randomization has insured that all orderings are equally probably The chance of accidentally choosing the right ordering is 1/70 Ie, probability of random ordering agreeing with the Lady s fixed judgments is 1/70 or 8 = is the significance level for testing the null hypothesis of having no judgment 27
28 The Lady Tasting Tea Example serves well The Lady is not a sample from a population of ladies concerns her alone Her eight judgments are not independent observations (rule of 4 each) Later cups differ from earlier ones Inferences are justified because the only probability distribution used in the inference is the one created by the experimenter 28
29 Fischer s argument Experiments do not require That experimental units be homogeneous That experimental units be a random sample from a population of unit It is sufficient to require that treatments be allocated at random to experimental units for valid inferences Probability enters the experiment only thru the random assignment of treatments 29
Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8
Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to
Validity and Reliability. PDF Created with deskpdf PDF Writer - Trial ::
Validity and Reliability PDF Created with deskpdf PDF Writer - Trial :: http://www.docudesk.com Validity Is the translation from concept to operationalization accurately representing the underlying concept.
Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC
Conducting Research in the Social Sciences Rick Balkin, Ph.D., LPC-S, NCC 1 Why we do research Improvement Description Explanation Prediction R. S. Balkin, 2008 2 Theory Explanation of an observed phenomena
PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity
PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with
Rival Plausible Explanations
Ci Criminology i 860 Quasi-Experimentation and Evaluation Research Remember John Stuart Mill s 3 Criteria for inferring the existence of a causal relation: 1. Temporal precedence 2. Existence of a relationship
RESEARCH METHODS. Winfred, research methods,
RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,
VALIDITY OF QUANTITATIVE RESEARCH
Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees
Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013
Study Design Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Single point in time Cross-Sectional Research Multiple points in time Study only exists in this point in time Longitudinal Research Study
Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04
Validity and Quantitative Research RCS 6740 6/16/04 What is Validity? Valid Definition (Dictionary.com): Well grounded; just: a valid objection. Producing the desired results; efficacious: valid methods.
Conducting a Good Experiment I: Variables and Control
CHAPTER SIX Conducting a Good Experiment I: Variables and Control 1 The Nature of Variables! Variable! A variable is an event or behavior that can assume at least two values.! Bridgman (1927) suggested
Group Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search.
Group Assignment #1: Concept Explication 1. Preliminary identification of the concept. Identify and name each concept your group is interested in examining. Questions to asked and answered: Is each concept
PLANNING THE RESEARCH PROJECT
Van Der Velde / Guide to Business Research Methods First Proof 6.11.2003 4:53pm page 1 Part I PLANNING THE RESEARCH PROJECT Van Der Velde / Guide to Business Research Methods First Proof 6.11.2003 4:53pm
Experimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design
Experimental Research in HCI Alma Leora Culén University of Oslo, Department of Informatics, Design almira@ifi.uio.no INF2260/4060 1 Oslo, 15/09/16 Review Method Methodology Research methods are simply
Asking and answering research questions. What s it about?
2 Asking and answering research questions What s it about? (Social Psychology pp. 24 54) Social psychologists strive to reach general conclusions by developing scientific theories about why people behave
Handout 5: Establishing the Validity of a Survey Instrument
In this handout, we will discuss different types of and methods for establishing validity. Recall that this concept was defined in Handout 3 as follows. Definition Validity This is the extent to which
Engineering Science & VALIDITY
Engineering Science & VALIDITY Today we will look at: 1. Scientific foundations 2. Validation 3. Reliability 4. Logic 5. Industrial validation 6. MSc relevance February 24, 2014 1 The linked image cannot
MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.
381 Exam #2 E Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) An approach to qualitative research that focuses on building theories is known
The Role and Importance of Research
The Role and Importance of Research What Research Is and Isn t A Model of Scientific Inquiry Different Types of Research Experimental Research What Method to Use When Applied and Basic Research Increasing
Variables in Research. What We Will Cover in This Section. What Does Variable Mean?
Variables in Research 9/20/2005 P767 Variables in Research 1 What We Will Cover in This Section Nature of variables. Measuring variables. Reliability. Validity. Measurement Modes. Issues. 9/20/2005 P767
Independent Variables Variables (factors) that are manipulated to measure their effect Typically select specific levels of each variable to test
Controlled Experiments experimental investigation of a testable hypothesis, in which conditions are set up to isolate the variables of interest ("independent variables") and test how they affect certain
CHAMP: CHecklist for the Appraisal of Moderators and Predictors
CHAMP - Page 1 of 13 CHAMP: CHecklist for the Appraisal of Moderators and Predictors About the checklist In this document, a CHecklist for the Appraisal of Moderators and Predictors (CHAMP) is presented.
PÄIVI KARHU THE THEORY OF MEASUREMENT
PÄIVI KARHU THE THEORY OF MEASUREMENT AGENDA 1. Quality of Measurement a) Validity Definition and Types of validity Assessment of validity Threats of Validity b) Reliability True Score Theory Definition
CSC2130: Empirical Research Methods for Software Engineering
CSC2130: Empirical Research Methods for Software Engineering Steve Easterbrook sme@cs.toronto.edu www.cs.toronto.edu/~sme/csc2130/ 2004-5 Steve Easterbrook. This presentation is available free for non-commercial
The Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016
The Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016 This course does not cover how to perform statistical tests on SPSS or any other computer program. There are several courses
Chapter 2. The Research Process: Coming to Terms Pearson Prentice Hall, Salkind. 1
Chapter 2 The Research Process: Coming to Terms 2009 Pearson Prentice Hall, Salkind. 1 CHAPTER OBJECTIVES - STUDENTS SHOULD BE ABLE TO: Describe the research process from formulating questions to seeking
Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.
Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).
The essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV.
EXPERIMENTAL DESIGNS I: Between-Groups Designs There are many experimental designs. We begin this week with the most basic, where there is a single IV and where participants are divided into two or more
Chapter 10 Quasi-Experimental and Single-Case Designs
Chapter 10 Quasi-Experimental and Single-Case Designs (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) The experimental research designs
Research Questions, Variables, and Hypotheses: Part 2. Review. Hypotheses RCS /7/04. What are research questions? What are variables?
Research Questions, Variables, and Hypotheses: Part 2 RCS 6740 6/7/04 1 Review What are research questions? What are variables? Definition Function Measurement Scale 2 Hypotheses OK, now that we know how
Variables in Research. What We Will Cover in This Section. What Does Variable Mean? Any object or event that can take on more than one form or value.
Variables in Research 1/1/2003 P365 Variables in Research 1 What We Will Cover in This Section Nature of variables. Measuring variables. Reliability. Validity. Measurement Modes. Issues. 1/1/2003 P365
Bradford Hill Criteria for Causal Inference Based on a presentation at the 2015 ANZEA Conference
Bradford Hill Criteria for Causal Inference Based on a presentation at the 2015 ANZEA Conference Julian King Director, Julian King & Associates a member of the Kinnect Group www.julianking.co.nz www.kinnect.co.nz
Basic Concepts in Research and DATA Analysis
Basic Concepts in Research and DATA Analysis 1 Introduction: A Common Language for Researchers...2 Steps to Follow When Conducting Research...2 The Research Question...3 The Hypothesis...3 Defining the
Science & Software Engineering
Science & Software Engineering Dewayne E Perry ENS 623 Perry@ece.utexas.edu 2000-present, Dewayne E Perry 11 The Scientific Method History of science is a story of a continuous attempt to use the scientific
Experimental Research I. Quiz/Review 7/6/2011
Experimental Research I Day 3 Quiz/Review Quiz Review Normal Curve z scores & T scores More on the normal curve and variability... Theoretical perfect curve. Never happens in actual research Mean, median,
The Scientific Method. Philosophy of Science. Philosophy of Science. Epistemology: the philosophy of knowledge
The Scientific Method Philosophy of Science Epistemology: the philosophy of knowledge Methodology: the specific approach we use to try to understand our world Philosophy of Science Positivism: the goal
Realism and Qualitative Research. Joseph A. Maxwell George Mason University
Realism and Qualitative Research Joseph A. Maxwell George Mason University Philosophic realism in general is "the view that entities exist independently of being perceived, or independently of our theories
Survey of Knowledge Base Content
Survey of Content Introduction Fundamental Expression Types Top Level Collections Time and Dates Spatial Properties and Relations Event Types Information More Content Areas Copyright 2002 Cycorp This set
For her own breakfast she ll project a scheme Nor take her tea without a stratagem. --- Edward Young ( ) Mathematics of a Lady Tasting Tea
For her own breakfast she ll project a scheme Nor take her tea without a stratagem. --- Edward Young (1683-1765) "Come 1ittle girl, you seem To want my cup of tea And will you take a little cream? Now
Psychometrics for Beginners. Lawrence J. Fabrey, PhD Applied Measurement Professionals
Psychometrics for Beginners Lawrence J. Fabrey, PhD Applied Measurement Professionals Learning Objectives Identify key NCCA Accreditation requirements Identify two underlying models of measurement Describe
Propensity Score Analysis Shenyang Guo, Ph.D.
Propensity Score Analysis Shenyang Guo, Ph.D. Upcoming Seminar: April 7-8, 2017, Philadelphia, Pennsylvania Propensity Score Analysis 1. Overview 1.1 Observational studies and challenges 1.2 Why and when
Chapter 4: Defining and Measuring Variables
Chapter 4: Defining and Measuring Variables A. LEARNING OUTCOMES. After studying this chapter students should be able to: Distinguish between qualitative and quantitative, discrete and continuous, and
The Regression-Discontinuity Design
Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations
Introduction to Path Analysis
Introduction to Path Analysis Review of Multivariate research & an Additional model Structure of Regression Models & Path Models Direct & Indirect effects Mediation analyses When & some words of caution
Observational Category Learning as a Path to More Robust Generative Knowledge
Observational Category Learning as a Path to More Robust Generative Knowledge Kimery R. Levering (kleveri1@binghamton.edu) Kenneth J. Kurtz (kkurtz@binghamton.edu) Department of Psychology, Binghamton
Evidence-Based Medicine Journal Club. A Primer in Statistics, Study Design, and Epidemiology. August, 2013
Evidence-Based Medicine Journal Club A Primer in Statistics, Study Design, and Epidemiology August, 2013 Rationale for EBM Conscientious, explicit, and judicious use Beyond clinical experience and physiologic
André Cyr and Alexander Davies
Item Response Theory and Latent variable modeling for surveys with complex sampling design The case of the National Longitudinal Survey of Children and Youth in Canada Background André Cyr and Alexander
Introduction On Assessing Agreement With Continuous Measurement
Introduction On Assessing Agreement With Continuous Measurement Huiman X. Barnhart, Michael Haber, Lawrence I. Lin 1 Introduction In social, behavioral, physical, biological and medical sciences, reliable
STA630 Research Methods Solved MCQs By
STA630 Research Methods Solved MCQs By http://vustudents.ning.com 31-07-2010 Quiz # 1: Question # 1 of 10: A one tailed hypothesis predicts----------- The future The lottery result The frequency of the
A model of parallel time estimation
A model of parallel time estimation Hedderik van Rijn 1 and Niels Taatgen 1,2 1 Department of Artificial Intelligence, University of Groningen Grote Kruisstraat 2/1, 9712 TS Groningen 2 Department of Psychology,
Faculty of Medicine. Introduction to Community Medicine Course ( ) Unit 4 Epidemiology. Introduction to Epidemiology.
Faculty of Medicine Introduction to Community Medicine Course (31505201) Unit 4 Epidemiology Introduction to Epidemiology Disease Causation By Hatim Jaber MD MPH JBCM PhD 25-10-2016 1 Presentation outline
Topic #4 CONTROL. 1. What are the threats to the validity of a contemplated piece of research?
ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 15A LECTURE NOTES [02/22/15] CONTROL PAGE 1 Topic #4 CONTROL Central issue is, of course, one of research validity. Key questions in research: 1. What are the
Communication Research Practice Questions
Communication Research Practice Questions For each of the following questions, select the best answer from the given alternative choices. Additional instructions are given as necessary. Read each question
The Basics of Experimental Design [A Quick and Non-Technical Guide]
The Basics of Experimental Design [A Quick and Non-Technical Guide] Sid Sytsma Website Administrator's Note: I have always considered Sid Sytsma's short article on experimental design one of the best short
Hypothesis-Driven Research
Hypothesis-Driven Research Research types Descriptive science: observe, describe and categorize the facts Discovery science: measure variables to decide general patterns based on inductive reasoning Hypothesis-driven
Guidelines for Making Changes to DSM-V Revised 10/21/09 Kenneth Kendler, David Kupfer, William Narrow, Katharine Phillips, Jan Fawcett,
Guidelines for Making Changes to DSM-V Revised 10/21/09 Kenneth Kendler, David Kupfer, William Narrow, Katharine Phillips, Jan Fawcett, Table of Contents Page 1. Overview.1 2. Criteria for Change in the
Chapter 3 Psychometrics: Reliability and Validity
34 Chapter 3 Psychometrics: Reliability and Validity Every classroom assessment measure must be appropriately reliable and valid, be it the classic classroom achievement test, attitudinal measure, or performance
Artificial Intelligence: Its Scope and Limits, by James Fetzer, Kluver Academic Publishers, Dordrecht, Boston, London. Artificial Intelligence (AI)
Artificial Intelligence: Its Scope and Limits, by James Fetzer, Kluver Academic Publishers, Dordrecht, Boston, London. Artificial Intelligence (AI) is the study of how to make machines behave intelligently,
Generalization and Theory-Building in Software Engineering Research
Generalization and Theory-Building in Software Engineering Research Magne Jørgensen, Dag Sjøberg Simula Research Laboratory {magne.jorgensen, dagsj}@simula.no Abstract The main purpose of this paper is
Lecture Slides. Elementary Statistics Eleventh Edition. by Mario F. Triola. and the Triola Statistics Series 1.1-1
Lecture Slides Elementary Statistics Eleventh Edition and the Triola Statistics Series by Mario F. Triola 1.1-1 Chapter 1 Introduction to Statistics 1-1 Review and Preview 1-2 Statistical Thinking 1-3
Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data
TECHNICAL REPORT Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data CONTENTS Executive Summary...1 Introduction...2 Overview of Data Analysis Concepts...2
How to Think Straight About Psychology
How to Think Straight About Psychology A Quick and Dirty Overview of Stanovich s Wonderful Book. Chapter 1 Freud problem general public s link of Freud to psychology most psychologists don t find his theory
Regression Discontinuity Analysis
Regression Discontinuity Analysis A researcher wants to determine whether tutoring underachieving middle school students improves their math grades. Another wonders whether providing financial aid to low-income
Theory, Models, Variables
Theory, Models, Variables Y520 Strategies for Educational Inquiry 2-1 Three Meanings of Theory A set of interrelated conceptions or ideas that gives an account of intrinsic (aka, philosophical) values.
By Hui Bian Office for Faculty Excellence
By Hui Bian Office for Faculty Excellence 1 Email: bianh@ecu.edu Phone: 328-5428 Location: 1001 Joyner Library, room 1006 Office hours: 8:00am-5:00pm, Monday-Friday 2 Educational tests and regular surveys
Introduction to Epidemiology. Introduction to Epidemiology. Introduction to Epidemiology. Introduction to Epidemiology. Introduction to Epidemiology
Executive Veterinary Program University of Illinois December 11 12, 2014 and Causal Inference Dr. Randall Singer Professor of Epidemiology Epidemiology study of the distribution and determinants of health-related
Human Experimentation
Human Experimentation 1. Introduction: Medical science involves a lot of trial and error. To determine whether or not a new treatment works, or what its side-effects are, and so on, we have to TEST it.
Version No. 7 Date: July Please send comments or suggestions on this glossary to
Impact Evaluation Glossary Version No. 7 Date: July 2012 Please send comments or suggestions on this glossary to 3ie@3ieimpact.org. Recommended citation: 3ie (2012) 3ie impact evaluation glossary. International
CHAPTER ONE CORRELATION
CHAPTER ONE CORRELATION 1.0 Introduction The first chapter focuses on the nature of statistical data of correlation. The aim of the series of exercises is to ensure the students are able to use SPSS to
REVIEW FOR THE PREVIOUS LECTURE
Slide 2-1 Calculator: The same calculator policies as for the ACT hold for STT 315: http://www.actstudent.org/faq/answers/calculator.html. It is highly recommended that you have a TI-84, as this is the
Title: Ch01-02;FI; pg research is research that has a fairly direct, immediate application to a real-world situation. a.
Chapter 1 Title: Ch01-01;FI; pg. 1 1. research is research based on the actual, objective observation of phenomena to achieve scientific knowledge about political phenomena. a. Empirical Title: Ch01-02;FI;
Groups, norms, and conformity. What s it about?
9 Groups, norms, and conformity What s it about? (Social Psychology pp. 310 350) This chapter is about how, when, and why people conform to group norms. People conform to group norms because of their need
Spectrum inversion and intentionalism
Spectrum inversion and intentionalism phil 93507 Jeff Speaks September 15, 2009 1 What is a spectrum inversion scenario?..................... 1 2 Intentionalism is false because inverts could have in common.........
Connexion of Item Response Theory to Decision Making in Chess. Presented by Tamal Biswas Research Advised by Dr. Kenneth Regan
Connexion of Item Response Theory to Decision Making in Chess Presented by Tamal Biswas Research Advised by Dr. Kenneth Regan Acknowledgement A few Slides have been taken from the following presentation
Validation of Scales
Validation of Scales ἀγεωμέτρητος μηδεὶς εἰσίτω (Let none enter without a knowledge of mathematics) D R D I N E S H R A M O O Introduction Validity and validation are crucial to understanding psychological
ARE EX-ANTE ENHANCEMENTS ALWAYS PERMISSIBLE?
ARE EX-ANTE ENHANCEMENTS ALWAYS PERMISSIBLE? forthcoming in the American Journal of Bioethics S. Matthew Liao, D. Phil. Phoebe R. Berman Bioethics Institute Johns Hopkins University Baltimore, MD 21205
Intelligence as the Tests Test It
Boring. E. G. (1923). Intelligence as the tests test it. New Republic, 36, 35 37. Intelligence as the Tests Test It Edwin G. Boring If you take on of the ready-made tests of intelligence and try it on
Threats and Analysis. Bruno Crépon J-PAL
Threats and Analysis Bruno Crépon J-PAL Course Overview 1. What is Evaluation? 2. Outcomes, Impact, and Indicators 3. Why Randomize and Common Critiques 4. How to Randomize 5. Sampling and Sample Size
INTERVIEWS II: THEORIES AND TECHNIQUES 5. CLINICAL APPROACH TO INTERVIEWING PART 1
INTERVIEWS II: THEORIES AND TECHNIQUES 5. CLINICAL APPROACH TO INTERVIEWING PART 1 5.1 Clinical Interviews: Background Information The clinical interview is a technique pioneered by Jean Piaget, in 1975,
SOME PRINCIPLES OF FIELD EXPERlMENTS WITH SHEEP By P. G. SCHINCICEL *, and G. R. MOULE *
SOME PRINCIPLES OF FIELD EXPERlMENTS WITH SHEEP By P. G. SCHINCICEL *, and G. R. MOULE * Summary The principles of scientific method, with particular reference to the role of hypotheses and experiments
Eliminative materialism
Michael Lacewing Eliminative materialism Eliminative materialism (also known as eliminativism) argues that future scientific developments will show that the way we think and talk about the mind is fundamentally
The Concept of Validity
The Concept of Validity Dr Wan Nor Arifin Unit of Biostatistics and Research Methodology, Universiti Sains Malaysia. wnarifin@usm.my Wan Nor Arifin, 2017. The Concept of Validity by Wan Nor Arifin is licensed
Empirical Knowledge: based on observations. Answer questions why, whom, how, and when.
INTRO TO RESEARCH METHODS: Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. Experimental research: treatments are given for the purpose of research. Experimental group
Nothing in biology makes sense except in the light of evolution Theodosius Dobzhansky Descent with modification Darwin
Evolutionary Psychology: Emotion, Cognition and Intelligence Bill Meacham, Ph.D. APDG, 11 May 2015 www.bmeacham.com Evolution Nothing in biology makes sense except in the light of evolution Theodosius
Motivational Interviewing
Motivational Interviewing By: Tonia Stott, PhD What is Motivational Interviewing? A client-centered, directive method for enhancing intrinsic motivation to change by exploring and resolving ambivalence
CHAPTER VI RESEARCH METHODOLOGY
CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the
Fundamental Clinical Trial Design
Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003
Workers Compensation Board of Nova Scotia. Chronic Pain: Causal Connection to Original Compensable Injury Consultation Summary. September 14, 2007
Workers Compensation Board of Nova Scotia Chronic Pain: Causal Connection to Original Compensable Injury Consultation Summary September 14, 2007 1 Introduction In April 2007, the Board of Directors agreed
Structural Approach to Bias in Meta-analyses
Original Article Received 26 July 2011, Revised 22 November 2011, Accepted 12 December 2011 Published online 2 February 2012 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/jrsm.52 Structural
Research Methods & Design Outline. Types of research design How to choose a research design Issues in research design
Research Methods & Design Outline Types of research design How to choose a research design Issues in research design Types of Research Design Correlational Field (survey) Experimental Qualitative Meta-analysis
THE RESEARCH ENTERPRISE IN PSYCHOLOGY
THE RESEARCH ENTERPRISE IN PSYCHOLOGY Chapter 2 Mr. Reinhard Winston Churchill High School Adapted from: Psychology: Themes and Variations by Wayne Weiten, 9 th edition Looking for laws Psychologists share
Using The Scientific method in Psychology
CHAPTER FIVE Using The Scientific method in Psychology 1 The Scientific Method in Psychology Science The key elements of the scientific approach are: Objective measurements of the phenomenon under consideration
Dual-Process Theories: Questions and Outstanding Issues. Valerie A. Thompson University of Saskatchewan
Dual-Process Theories: Questions and Outstanding Issues Valerie A. Thompson University of Saskatchewan Outline Why do we need Dual Process Theories? Integrate with each other, cognitive theories Integration
Introduction. Patrick Breheny. January 10. The meaning of probability The Bayesian approach Preview of MCMC methods
Introduction Patrick Breheny January 10 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/25 Introductory example: Jane s twins Suppose you have a friend named Jane who is pregnant with twins
Controlled Experiments
CHARM Choosing Human-Computer Interaction (HCI) Appropriate Research Methods Controlled Experiments Liz Atwater Department of Psychology Human Factors/Applied Cognition George Mason University lizatwater@hotmail.com
LAW RESEARCH METHODOLOGY HYPOTHESIS
LAW RESEARCH METHODOLOGY HYPOTHESIS Role Name Affiliation Principal Investigator Prof. (Dr.) Ranbir Singh Vice Chancellor, National Law University, Delhi Co-Principal Investigator Prof. (Dr.) G.S. Bajpai
Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted
Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play
Mechanisms and the evidence hierarchy
Mechanisms and the evidence hierarchy Federica Russo Dipartimento di Studi Umanistici, Università di Ferrara 2 Overview The background Evidence-based medicine The Russo-Williamson Thesis Mechanisms and
In this module we will cover Correla4on and Validity.
In this module we will cover Correla4on and Validity. A correla4on coefficient is a sta4s4c that is o:en used as an es4mate of measurement, such as validity and reliability. You will learn the strength
Ambiguous Data Result in Ambiguous Conclusions: A Reply to Charles T. Tart
Other Methodology Articles Ambiguous Data Result in Ambiguous Conclusions: A Reply to Charles T. Tart J. E. KENNEDY 1 (Original publication and copyright: Journal of the American Society for Psychical
PharmaSUG Paper HA-04 Two Roads Diverged in a Narrow Dataset...When Coarsened Exact Matching is More Appropriate than Propensity Score Matching
PharmaSUG 207 - Paper HA-04 Two Roads Diverged in a Narrow Dataset...When Coarsened Exact Matching is More Appropriate than Propensity Score Matching Aran Canes, Cigna Corporation ABSTRACT Coarsened Exact