Introduction. Step 2: Student Role - Your Plan of Action. Confounding. Good luck and have fun!

Size: px
Start display at page:

Download "Introduction. Step 2: Student Role - Your Plan of Action. Confounding. Good luck and have fun!"

Transcription

1 Confounding Introduction You have learned that random error and bias must be considered as possible explanations for an observed association between an exposure and disease. This week we will examine the role of confounding. Unlike random error or bias, confounding is a property of the study population, and occurs when the effect of an exposure on an outcome is mixed together with the effect of a third variable. The following exercise will examine the properties of confounders and describe methods to adjust for confounding through both study design and analysis. (Please see Aschengrau Chapter 11 for more information). Good luck and have fun! Step 1: Learning Objectives A. Basic elements of confounding 1. Define confounding and distinguish it from bias and chance error 2. Identify three criteria a variable must fulfill to be a confounder in an epidemiological study 3. Diagram the relationship of a confounder with exposure and outcome B. Explain methods to adjust for confounding 1. Describe ways of handling confounding at the design phase of a study a. Randomization b. Restriction c. Matching 2. Describe ways of handling confounding at the analysis phase of a study a. Stratification b. Multivariate adjustment techniques C. Describe how to evaluate potential confounding in epidemiological data 1. Explain the difference between a crude and adjusted effect estimate 2. Discuss what is meant by "residual" confounding Step 2: Student Role - Your Plan of Action Reading and understanding scientific articles takes a critical mind. You must carefully evaluate the methodologies employed and conclusions that are formed. At the end of the semester you will be asked to critique a published article. Your work must include some of the core elements highlighted in the summary of Dr. Stellman's hypotheses presented in the paragraphs that follow. Pay particular attention to the areas that are highlighted. If you have any questions, do not hesitate to discuss them with your seminar leader. Please refer to the Student Role section of the Bias module to read the synopis of Dr. Spellman's study. Work through this [interactive exercise ] which demonstrates the "mixing of effects" when confounding is present in the data. 1

2 Step 3: Design Questions 1. Hospital room status, a marker of socioeconomic status, was one of the potential confounders considered in the study of artificial sweetener use and bladder cancer. Please explain why hospital room status was considered to be a potential confounder. a. Hospital room status, a marker for socioeconomic status, was considered a confounder because it is a risk factor for bladder cancer, and is not in the causal pathway of interest between artificial sweetener use and bladder cancer. Correct. For a variable to be a confounder, it must fulfill three basic properties: 1) associated with the exposure, 2) a risk factor for the disease, and 3) not in the causal pathway of interest. Hospital room status, a marker of socioeconomic status, is a potential confounder because it is associated with artificial sweetener use, is a risk factor for bladder cancer, and is not in the causal pathway between sweetener use and cancer. b. Hospital room status, a marker of socioeconomic status, is in the causal path between artificial sweetener use and bladder cancer. Incorrect. A confounder cannot be an intermediate step in the causal pathway of interest. If a third variable is in the causal pathway of interest, it is not a confounder but a mediator. c. Hospital room status, a marker of socioeconomic status, is a risk factor for bladder cancer but is not associated with artificial sweetener. Incorrect. A variable must fulfill three basic properties to be considered a confounder- one, that it is associated with the exposure of interest. 2. How was confounding handled in the design stage of the study? a. Randomization of subjects into cases and controls Incorrect. Subjects were not randomized in this study. Subjects can only be randomized in experimental designs (i.e., RCT s). The behavior of subjects cannot be manipulated by investigators conducting observational studies (i.e., cohort or case-control studies) b. Restriction of cases and controls within a narrow age category Incorrect. In this study cases and controls were not restricted to any specific age category. c. Matching controls to cases on selected characteristics Correct. Controls were matched to cases by age (in decades), sex, hospital, and hospital-room status (private, semiprivate, or ward). Matching in a case-control study is intended to created comparability in the underlying source population of exposed and unexposed by creating mini-studies in which all individual in the study are, for example, in a private ward such that ward can have no effect on the exposure disease relationship. Step 4: Data Analysis Questions 3. Explain how you would assess whether a potential confounder alters an effect estimate after adjusting for it in a multivariable model. a. Look at the crude OR 2

3 Incorrect. You must compare the crude and adjusted OR s to evaluate confounding. Remember, the crude estimate simply reflects the association between the exposure and outcome; it does not take into account the effect of potential confounders. b. Look at the adjusted ORs Incorrect. You must compare the crude and adjusted OR s to evaluate confounding. Remember, the adjusted estimate simply reflects the association between the exposure and outcome after controlling for a potential confounder. Without the crude to compare back to, we would not know what happened to the OR after taking other risk factors into account. c. Compare the crude OR to the adjusted OR Correct. It is important to compare the adjusted OR with the crude OR to see the change in the effect estimate. In this study, it was important to compare the crude OR which assessed the association between artificial sweetener use and bladder cancer only, with the adjusted ORs, which were calculated by taking into account age, hospital, hospital room status, year of interview, and education (see Table 5 of Step 2: Student Role - Your Plan of Action). [ Follow this link to learn more about the evaluation of confounding.] (Note: In the popup window, be sure to scroll down after each correct answer.) 4. Would confounding due to socioeconomic status still be a problem if the investigators chose to conduct a cohort study instead of a case-control study? a. Confounding would not be a problem in a cohort study Incorrect. Confounding is a problem in all study designs. Remember, confounding is a mixing of effects between an exposure, outcome, and third variable. It is not the result of study design or investigators. Instead, confounding results from the fact that risk factors are not evenly distributed between comparison populations (i.e., exposed and unexposed groups). b. Confounding would still pose a problem in a cohort study Correct. Confounding is a problem for all observational study designs. Because epidemiology research concerns human populations, we must always consider that certain characteristics (e.g., age, sex, income, etc.) may be unevenly distributed in our study populations. c. Confounding would be minimal in a cohort study compared to case-control study Incorrect. Confounding can be just as large in a cohort study as it is in a case-control study. Regardless of design, it is important to consider potential confounders in your work and adjust for them appropriately. 5. Stellman et al. matched controls to cases on four factors: age, sex, hospital, and hospital room. Other case-control studies match on fewer factors. Which technique is better and why? a. The other studies are better because it is best to match controls to cases on as few factors as possible. Incorrect. One should match for the minimum amount of factors necessary, but that amount differs from study to study. 3

4 b. Stellman et al. s study is better because it is best to match controls to cases on as many factors as possible. Incorrect. While it may be helpful to match controls to cases on several key confounders, matching on too many factors may be harmful to your study. Once controls are matched to cases by a particular variable, you can no longer assess that variable s effect on the outcome of interest. Furthermore, it is both difficult and expensive to find appropriate controls when matching on several factors. c. It is not possible to determine which study would be better at controlling for confounding by looking at the number of matched factors. Correct. It is not possible to determine whether one study better controls for confounding based on the number of matched factors. 6. What if during data analysis investigators found that the use of vitamin supplementation was associated with artificial sweetener use and was an independent risk factor for bladder cancer. Should they attempt to control for this potential confounder? a. Yes, investigators should control for vitamin supplementation as they did for other potential confounders and add this variable to the list of hypothesized confounders in the Methods section. Incorrect. Many variables may act as confounders in one study. While it is important to hypothesize which factors may confound an association, it is also important to evaluate other potential confounders during the analyses as well. In doing so, you must report the process of how you selected potential confounders (i.e., a priori confounders in the Methods section and a posteriori confounders in the Results section). b. Yes, investigators should control for vitamin supplementation and describe the process of confounder selection in their Results section. Correct. It is important to report the selection process of confounding variables in your work. A priori confounders should be reported in the Methods section, a posteriori confounders in the Results section. c. No, it is inappropriate to control for variables if they were not hypothesized as confounders a priori. Incorrect. It is not always possible to know all potential confounders at the beginning of a study. This may happen when investigating an exposure-disease association which has not been studied well, or if cost and feasibility make it impossible to address all potential confounders at the design phase of a study. Therefore, it is necessary to consider confounding at the analysis phase of a study as well. 7. Suppose investigators wanted to determine if confounding was present during the analysis stage of the study. What can be done at this stage to assess confounding? a. Perform stratified analyses Correct. Stratified analysis is one way to control for confounding at the analysis phase of a study.stratification means the effect of an exposure is evaluated within strata (levels) of a confounder (e.g., gender, looking at the exposure-disease association between males only and then females only). Once you calculate the OR s for each stratum (and if they are similar to one another) you then compare them with the crude OR. If there is a large difference (i.e., >10%) between the stratified and crude OR s, you can conclude that confounding is present. b. Use restriction 4

5 Incorrect. Restriction is used to control for confounding at the design phase of a study. For example, researchers can restrict the study to women aged Thus, both cases and controls would be women aged As a result of such restriction, it would no longer be possible to investigate the effects of sex and age on the outcome of interest. c. Conduct matched analyses Incorrect. As Stellman et al s work has shown, matched analysis is another way to control for confounding at the design phase of a study. 8. Shapiro, et al. matched controls to cases on two factors: age and geographic area, whereas Stellman and Wynder matched controls to cases on four factors: age, sex, hospital, and hospital room. Which study do you think is best at controlling confounding at the design phase of the study? a. Shapiro et al's study is better because it is best to match controls to cases on fewer factors. Incorrect. Although it is not good to match controls to cases on too many factors, matching on fewer factors in itself does not guarantee that confounding is accurately controlled. b. Stellman and Wynder's study is better because it is best to match controls to cases on more factors. Incorrect. A confounder cannot be an intermediate step in the causal pathway of interest. If a third variable is in the causal pathway of interest, it is not a confounder but a mediator. c. It is not possible to determine which study is better at controlling confounding by looking at the number of matched factors. Correct. It is not possible to determine whether one study is better than the other at controlling confounding by the number of factors matched. What should be of foremost importance when controlling confounding is whether confounding variables were measured properly and that their effects were removed at the analysis stage. 9. Age was a potential confounder in this study. Choose an appropriate diagram representing the relationship of this potential confounder with exposure and outcome. a. Correct. In this diagram age meets the requirements to be a confounder because, as depicted in the diagram, age is a risk factor for endometrial cancer and is associated with estrogen use, but it is not a result of estrogen use. b. Incorrect. This diagram illustrates that age is an intermediate in the pathway between estrogen use and endometrial cancer. If a factor is in the pathway between exposure and outcome, it is called a mediator. 5

6 c. Correct. Controls were matched to cases by age (in decades), sex, hospital, and hospitalroom status (private, semiprivate, or ward). Matching in a case-control study is intended to created comparability in the underlying source population of exposed and unexposed by creating mini-studies in which all individual in the study are, for example, in a private ward such that ward can have no effect on the exposure disease relationship. 10. Suppose that during data analysis, investigators found that the number of abortions performed was associated with estrogen use and was an independent risk factor for endometrial cancer. Should they attempt to control for this confounder? a. Yes, investigators should still control for this confounder as they did for other confounding variables. Incorrect. Since attempts to minimize confounding can only be made for known confounders, it is necessary to look for confounders during the analyses as well. However, it is also important to report the process of selection of confounding variables in the description of results (i.e., a priori confounders vs confounders which were identified in the data analysis step). b. Yes, investigators should still control for this confounder and describe the process of confounder selection in the description of the results. Correct. It is important to report the process of selection of confounding variables in the description of results (i.e., a priori confounders vs confouders which were identified in the data analysis step). The information on the process of adjustment for confounders is usually placed in the Methods section for published articles. c. No, investigators should not control for any confounders which they did not specify a priori. Incorrect. It is not always possible to know all the potential confounders at the beginning of the study. This may happen when investigating an exposure-- disease association which has not been studied well or if cost and feasibility may make it impossible to address all potential confounders at the design phase of a study. Therefore, it is necessary to consider confounding at the analysis phase of a study as well. Step 5: Discussion Questions 1. Which study design offers the best opportunity to control for confounding -- randomized clinical trial, cohort study, or case-control study? Explain your reasoning and make examples to prove your point. 2. Suppose that in the study of artificial sweetener and bladder cancer you wanted to evaluate the hypothesis that bladder cancer varies by geographic area. Would you match on geographic area? Please, explain your answer. 3. A principle of case-control studies is that controls should be selected independently of exposure status. Under what circumstances would matching violate this principle? What can be done about this type of violation? Questions for the Intellectually Curious: Why is it important to distinguish between confounding and confounders? 6

Confounding Study. Step 1: Learning Objectives. Step 2: Introduction to the Study. Step 3: Student Role - Your Plan of Action

Confounding Study. Step 1: Learning Objectives. Step 2: Introduction to the Study. Step 3: Student Role - Your Plan of Action Confounding Study Step 1: Learning Objectives A. Explain the importance of comparability groups in epidemiological studies 1. Concept of source population B. Define confounding 1. Identify three criteria

More information

INTERNAL VALIDITY, BIAS AND CONFOUNDING

INTERNAL VALIDITY, BIAS AND CONFOUNDING OCW Epidemiology and Biostatistics, 2010 J. Forrester, PhD Tufts University School of Medicine October 6, 2010 INTERNAL VALIDITY, BIAS AND CONFOUNDING Learning objectives for this session: 1) Understand

More information

Vocabulary. Bias. Blinding. Block. Cluster sample

Vocabulary. Bias. Blinding. Block. Cluster sample Bias Blinding Block Census Cluster sample Confounding Control group Convenience sample Designs Experiment Experimental units Factor Level Any systematic failure of a sampling method to represent its population

More information

TEACHERS TOPICS. The Role of Matching in Epidemiologic Studies. American Journal of Pharmaceutical Education 2004; 68 (3) Article 83.

TEACHERS TOPICS. The Role of Matching in Epidemiologic Studies. American Journal of Pharmaceutical Education 2004; 68 (3) Article 83. TEACHERS TOPICS American Journal of Pharmaceutical Education 2004; 68 (3) Article 83. The Role of Matching in Epidemiologic Studies Kevin W. Garey, PharmD College of Pharmacy, University of Houston Submitted

More information

Chapter 11. Experimental Design: One-Way Independent Samples Design

Chapter 11. Experimental Design: One-Way Independent Samples Design 11-1 Chapter 11. Experimental Design: One-Way Independent Samples Design Advantages and Limitations Comparing Two Groups Comparing t Test to ANOVA Independent Samples t Test Independent Samples ANOVA Comparing

More information

Appendix G: Methodology checklist: the QUADAS tool for studies of diagnostic test accuracy 1

Appendix G: Methodology checklist: the QUADAS tool for studies of diagnostic test accuracy 1 Appendix G: Methodology checklist: the QUADAS tool for studies of diagnostic test accuracy 1 Study identification Including author, title, reference, year of publication Guideline topic: Checklist completed

More information

5 Bias and confounding

5 Bias and confounding Bias and confounding 37 5 Bias and confounding Learning objectives In this chapter students learn about Most important factors that can systematically impair the results of a population based study, like

More information

Overview of Study Designs

Overview of Study Designs Overview of Study Designs Kyoungmi Kim, Ph.D. July 13 & 20, 2016 This seminar is jointly supported by the following NIH-funded centers: We are video recording this seminar so please hold questions until

More information

INTERPRETATION OF STUDY FINDINGS: PART I. Julie E. Buring, ScD Harvard School of Public Health Boston, MA

INTERPRETATION OF STUDY FINDINGS: PART I. Julie E. Buring, ScD Harvard School of Public Health Boston, MA INTERPRETATION OF STUDY FINDINGS: PART I Julie E. Buring, ScD Harvard School of Public Health Boston, MA Drawing Conclusions TRUTH IN THE UNIVERSE Infer TRUTH IN THE STUDY Infer FINDINGS IN THE STUDY Designing

More information

Unit 3: Collecting Data. Observational Study Experimental Study Sampling Bias Types of Sampling

Unit 3: Collecting Data. Observational Study Experimental Study Sampling Bias Types of Sampling Unit 3: Collecting Data Observational Study Experimental Study Sampling Bias Types of Sampling Feb 7 10:12 AM The step of data collection is critical to obtain reliable information for your study. 2 Types

More information

115 remained abstinent. 140 remained abstinent. Relapsed Remained abstinent Total

115 remained abstinent. 140 remained abstinent. Relapsed Remained abstinent Total Chapter 10 Exercises 1. Intent-to-treat analysis: Example 1 In a randomized controlled trial to determine whether the nicotine patch reduces the risk of relapse among smokers who have committed to quit,

More information

Chapter 5: Producing Data

Chapter 5: Producing Data Chapter 5: Producing Data Key Vocabulary: observational study vs. experiment confounded variables population vs. sample sampling vs. census sample design voluntary response sampling convenience sampling

More information

Confounding and Bias

Confounding and Bias 28 th International Conference on Pharmacoepidemiology and Therapeutic Risk Management Barcelona, Spain August 22, 2012 Confounding and Bias Tobias Gerhard, PhD Assistant Professor, Ernest Mario School

More information

Choosing the right study design

Choosing the right study design Choosing the right study design Main types of study design Randomised controlled trial (RCT) Cohort study Case-control study Cross-sectional study Case series/case note review Expert opinion BEST QUALITY

More information

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard

More information

Checklist for Case Control Studies. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews

Checklist for Case Control Studies. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org The Joanna Briggs

More information

INTRODUCTION TO EPIDEMIOLOGICAL STUDY DESIGNS PHUNLERD PIYARAJ, MD., MHS., PHD.

INTRODUCTION TO EPIDEMIOLOGICAL STUDY DESIGNS PHUNLERD PIYARAJ, MD., MHS., PHD. INTRODUCTION TO EPIDEMIOLOGICAL STUDY DESIGNS PHUNLERD PIYARAJ, MD., MHS., PHD. 1 OBJECTIVES By the end of this section, you will be able to: Provide a definition of epidemiology Describe the major types

More information

Chapter 13 Summary Experiments and Observational Studies

Chapter 13 Summary Experiments and Observational Studies Chapter 13 Summary Experiments and Observational Studies What have we learned? We can recognize sample surveys, observational studies, and randomized comparative experiments. o These methods collect data

More information

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Scientific Study of Causation and Treatment Methods for studying causation Case

More information

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Key Dates TU Mar 28 Unit 18 Loss of control drinking in alcoholics (on course website); Marlatt assignment TH Mar 30 Unit 19; Term Paper Step 2 TU Apr 4 Begin Biological Perspectives, Unit IIIA and 20;

More information

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies Copyright 2012, 2008, 2005 Pearson Education, Inc. Observational Studies In an observational study, researchers don t assign choices; they simply observe

More information

Causal Research Design- Experimentation

Causal Research Design- Experimentation In a social science (such as marketing) it is very important to understand that effects (e.g., consumers responding favorably to a new buzz marketing campaign) are caused by multiple variables. The relationships

More information

observational studies Descriptive studies

observational studies Descriptive studies form one stage within this broader sequence, which begins with laboratory studies using animal models, thence to human testing: Phase I: The new drug or treatment is tested in a small group of people for

More information

University of Wollongong. Research Online. Australian Health Services Research Institute

University of Wollongong. Research Online. Australian Health Services Research Institute University of Wollongong Research Online Australian Health Services Research Institute Faculty of Business 2011 Measurement of error Janet E. Sansoni University of Wollongong, jans@uow.edu.au Publication

More information

Supplement 2. Use of Directed Acyclic Graphs (DAGs)

Supplement 2. Use of Directed Acyclic Graphs (DAGs) Supplement 2. Use of Directed Acyclic Graphs (DAGs) Abstract This supplement describes how counterfactual theory is used to define causal effects and the conditions in which observed data can be used to

More information

First author. Title: Journal

First author. Title: Journal First author Title: Journal Year: Volume: Issue: First page: Last Page: 1. Type of study Controlled trial without randomization Section B Observational cohort study Section B 2. Type of report Full paper

More information

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Biases in clinical research Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Learning objectives Describe the threats to causal inferences in clinical studies Understand the role of

More information

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Biases in clinical research Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Learning objectives Describe the threats to causal inferences in clinical studies Understand the role of

More information

PLANNING THE RESEARCH PROJECT

PLANNING THE RESEARCH PROJECT Van Der Velde / Guide to Business Research Methods First Proof 6.11.2003 4:53pm page 1 Part I PLANNING THE RESEARCH PROJECT Van Der Velde / Guide to Business Research Methods First Proof 6.11.2003 4:53pm

More information

Stratified Tables. Example: Effect of seat belt use on accident fatality

Stratified Tables. Example: Effect of seat belt use on accident fatality Stratified Tables Often, a third measure influences the relationship between the two primary measures (i.e. disease and exposure). How do we remove or control for the effect of the third measure? Issues

More information

Checklist for appraisal of study relevance (child sex offenses)

Checklist for appraisal of study relevance (child sex offenses) Appendix 3 Evaluation protocols. [posted as supplied by author] Checklist for appraisal of study relevance (child sex offenses) First author, year, reference number Relevance Yes No Cannot answer Not applicable

More information

Clinical problems and choice of study designs

Clinical problems and choice of study designs Evidence Based Dentistry Clinical problems and choice of study designs Asbjørn Jokstad University of Oslo, Norway Nov 21 2001 1 Manipulation with intervention Yes Experimental study No Non-experimental

More information

Checklist for Analytical Cross Sectional Studies. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews

Checklist for Analytical Cross Sectional Studies. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Analytical Cross Sectional Studies http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org

More information

Confounding, Effect modification, and Stratification

Confounding, Effect modification, and Stratification Confounding, Effect modification, and Stratification Tunisia, 30th October 2014 Acknowledgment: Kostas Danis Takis Panagiotopoulos National Schoool of Public Health, Athens, Greece takis.panagiotopoulos@gmail.com

More information

Confounding and Interaction

Confounding and Interaction Confounding and Interaction Why did you do clinical research? To find a better diagnosis tool To determine risk factor of disease To identify prognosis factor To evaluate effectiveness of therapy To decide

More information

Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time.

Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time. Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time. While a team of scientists, veterinarians, zoologists and

More information

11 questions to help you make sense of a case control study

11 questions to help you make sense of a case control study Critical Appraisal Skills Programme (CASP) making sense of evidence 11 questions to help you make sense of a case control study How to use this appraisal tool Three broad issues need to be considered when

More information

Phil 12: Logic and Decision Making (Winter 2010) Directions and Sample Questions for Final Exam. Part I: Correlation

Phil 12: Logic and Decision Making (Winter 2010) Directions and Sample Questions for Final Exam. Part I: Correlation Phil 12: Logic and Decision Making (Winter 2010) Directions and Sample Questions for Final Exam Part I: Correlation A. Answer the following multiple-choice questions 1. To make a prediction from a new

More information

You can t fix by analysis what you bungled by design. Fancy analysis can t fix a poorly designed study.

You can t fix by analysis what you bungled by design. Fancy analysis can t fix a poorly designed study. You can t fix by analysis what you bungled by design. Light, Singer and Willett Or, not as catchy but perhaps more accurate: Fancy analysis can t fix a poorly designed study. Producing Data The Role of

More information

CHAMP: CHecklist for the Appraisal of Moderators and Predictors

CHAMP: CHecklist for the Appraisal of Moderators and Predictors CHAMP - Page 1 of 13 CHAMP: CHecklist for the Appraisal of Moderators and Predictors About the checklist In this document, a CHecklist for the Appraisal of Moderators and Predictors (CHAMP) is presented.

More information

Protocol Development: The Guiding Light of Any Clinical Study

Protocol Development: The Guiding Light of Any Clinical Study Protocol Development: The Guiding Light of Any Clinical Study Susan G. Fisher, Ph.D. Chair, Department of Clinical Sciences 1 Introduction Importance/ relevance/ gaps in knowledge Specific purpose of the

More information

Clinical Trials. Susan G. Fisher, Ph.D. Dept. of Clinical Sciences

Clinical Trials. Susan G. Fisher, Ph.D. Dept. of Clinical Sciences Clinical Trials Susan G. Fisher, Ph.D. Dept. of Clinical Sciences When to Do a RCT Exposure of interest is modifiable and individuals are willing to relinquish control Legitimate uncertainty exists about

More information

Sampling. (James Madison University) January 9, / 13

Sampling. (James Madison University) January 9, / 13 Sampling The population is the entire group of individuals about which we want information. A sample is a part of the population from which we actually collect information. A sampling design describes

More information

Chapter 11: Experiments and Observational Studies p 318

Chapter 11: Experiments and Observational Studies p 318 Chapter 11: Experiments and Observational Studies p 318 Observation vs Experiment An observational study observes individuals and measures variables of interest but does not attempt to influence the response.

More information

Epidemiologic Methods I & II Epidem 201AB Winter & Spring 2002

Epidemiologic Methods I & II Epidem 201AB Winter & Spring 2002 DETAILED COURSE OUTLINE Epidemiologic Methods I & II Epidem 201AB Winter & Spring 2002 Hal Morgenstern, Ph.D. Department of Epidemiology UCLA School of Public Health Page 1 I. THE NATURE OF EPIDEMIOLOGIC

More information

Student name: SOCI 420 Advanced Methods of Social Research Fall 2017

Student name: SOCI 420 Advanced Methods of Social Research Fall 2017 SOCI 420 Advanced Methods of Social Research Fall 2017 EXAM 1 RUBRIC Instructor: Ernesto F. L. Amaral, Assistant Professor, Department of Sociology Date: October 12, 2017 (Thursday) Section 903: 9:35 10:50am

More information

How to use this appraisal tool: Three broad issues need to be considered when appraising a case control study:

How to use this appraisal tool: Three broad issues need to be considered when appraising a case control study: CASP Checklist: 11 questions to help you make sense of a Case Control Study How to use this appraisal tool: Three broad issues need to be considered when appraising a case control study: Are the results

More information

Pre-Calculus Multiple Choice Questions - Chapter S4

Pre-Calculus Multiple Choice Questions - Chapter S4 1 Which of the following represents the dependent variable in experimental design? a Treatment b Factor 2 Which of the following represents the independent variable in experimental design? a Treatment

More information

Funnelling Used to describe a process of narrowing down of focus within a literature review. So, the writer begins with a broad discussion providing b

Funnelling Used to describe a process of narrowing down of focus within a literature review. So, the writer begins with a broad discussion providing b Accidental sampling A lesser-used term for convenience sampling. Action research An approach that challenges the traditional conception of the researcher as separate from the real world. It is associated

More information

Confounding Bias: Stratification

Confounding Bias: Stratification OUTLINE: Confounding- cont. Generalizability Reproducibility Effect modification Confounding Bias: Stratification Example 1: Association between place of residence & Chronic bronchitis Residence Chronic

More information

Chapter 13. Experiments and Observational Studies

Chapter 13. Experiments and Observational Studies Chapter 13 Experiments and Observational Studies 1 /36 Homework Read Chpt 13 Do p312 1, 7, 9, 11, 17, 20, 25, 27, 29, 33, 40, 41 2 /36 Observational Studies In an observational study, researchers do not

More information

In this second module in the clinical trials series, we will focus on design considerations for Phase III clinical trials. Phase III clinical trials

In this second module in the clinical trials series, we will focus on design considerations for Phase III clinical trials. Phase III clinical trials In this second module in the clinical trials series, we will focus on design considerations for Phase III clinical trials. Phase III clinical trials are comparative, large scale studies that typically

More information

Chapter 1 Data Collection

Chapter 1 Data Collection Chapter 1 Data Collection OUTLINE 1.1 Introduction to the Practice of Statistics 1.2 Observational Studies versus Designed Experiments 1.3 Simple Random Sampling 1.4 Other Effective Sampling Methods 1.5

More information

Chapter 10 Quasi-Experimental and Single-Case Designs

Chapter 10 Quasi-Experimental and Single-Case Designs Chapter 10 Quasi-Experimental and Single-Case Designs (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) The experimental research designs

More information

Chapter 9: Experiments

Chapter 9: Experiments Chapter 9: Experiments WHAT IS EXPERIMENTATION? Experiments are studies involving intervention by the researcher beyond that required for measurement. The usual intervention is to manipulate some variable

More information

MAT Mathematics in Today's World

MAT Mathematics in Today's World MAT 1000 Mathematics in Today's World Last Time 1. What does a sample tell us about the population? 2. Practical problems in sample surveys. Last Time Parameter: Number that describes a population Statistic:

More information

Welcome Module Index Glossary Epiville Chamber of Commerce About this site Requirements. Faculty Highlight: Pam R. Factor-Litvak, PhD

Welcome Module Index Glossary Epiville Chamber of Commerce About this site Requirements. Faculty Highlight: Pam R. Factor-Litvak, PhD - Page 23 45 67 - Discussion Question While many consider the ecological study design methodologically inferior to the cohort and case control designs, this exercise will highlight some of its unique strengths

More information

Chapter 1 - Sampling and Experimental Design

Chapter 1 - Sampling and Experimental Design Chapter 1 - Sampling and Experimental Design Read sections 1.3-1.5 Sampling (1.3.3 and 1.4.2) Sampling Plans: methods of selecting individuals from a population. We are interested in sampling plans such

More information

SRI LANKA AUDITING STANDARD 530 AUDIT SAMPLING CONTENTS

SRI LANKA AUDITING STANDARD 530 AUDIT SAMPLING CONTENTS SRI LANKA AUDITING STANDARD 530 AUDIT SAMPLING (Effective for audits of financial statements for periods beginning on or after 01 January 2014) CONTENTS Paragraph Introduction Scope of this SLAuS... 1

More information

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA PharmaSUG 2014 - Paper SP08 Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA ABSTRACT Randomized clinical trials serve as the

More information

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 381 Exam #2 E Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) An approach to qualitative research that focuses on building theories is known

More information

Challenges of Observational and Retrospective Studies

Challenges of Observational and Retrospective Studies Challenges of Observational and Retrospective Studies Kyoungmi Kim, Ph.D. March 8, 2017 This seminar is jointly supported by the following NIH-funded centers: Background There are several methods in which

More information

The following are questions that students had difficulty with on the first three exams.

The following are questions that students had difficulty with on the first three exams. The following are questions that students had difficulty with on the first three exams. Exam 1 1. A measure has construct validity if it: a) really measures what it is supposed to measure b) appears, on

More information

Lecture 9A Section 2.7. Wed, Sep 10, 2008

Lecture 9A Section 2.7. Wed, Sep 10, 2008 Lecture 9A Section 2.7 Hampden-Sydney College Wed, Sep 10, 2008 Outline 1 2 3 4 5 6 7 8 Exercise 2.23, p. 116 A class consists of 100 students. Suppose that we are interested in the heights of the people

More information

AP Statistics Exam Review: Strand 2: Sampling and Experimentation Date:

AP Statistics Exam Review: Strand 2: Sampling and Experimentation Date: AP Statistics NAME: Exam Review: Strand 2: Sampling and Experimentation Date: Block: II. Sampling and Experimentation: Planning and conducting a study (10%-15%) Data must be collected according to a well-developed

More information

A Guide to Reading a Clinical or Research Publication

A Guide to Reading a Clinical or Research Publication A Guide to Reading a Clinical or Research Publication For people living with a rare disease, being able to read and understand the information found in a clinical or research publication can be especially

More information

Confounding. Confounding and effect modification. Example (after Rothman, 1998) Beer and Rectal Ca. Confounding (after Rothman, 1998)

Confounding. Confounding and effect modification. Example (after Rothman, 1998) Beer and Rectal Ca. Confounding (after Rothman, 1998) Confounding Confounding and effect modification Epidemiology 511 W. A. Kukull vember 23 2004 A function of the complex interrelationships between various exposures and disease. Occurs when the disease

More information

Mobile Phones & Cancer How does epidemiology investigate this?

Mobile Phones & Cancer How does epidemiology investigate this? Mobile Phones & Cancer How does epidemiology investigate this? Anthony Swerdlow ICNIRP MEMBER/ CHAIR OF THE ICNIRP STANDING COMMITTEE ON EPIDEMIOLOGY INSTITUTE OF CANCER RESEARCH There are now >5 billion

More information

Study design. Chapter 64. Research Methodology S.B. MARTINS, A. ZIN, W. ZIN

Study design. Chapter 64. Research Methodology S.B. MARTINS, A. ZIN, W. ZIN Chapter 64 Study design S.B. MARTINS, A. ZIN, W. ZIN Research Methodology Scientific methodology comprises a set of rules and procedures to investigate the phenomena of interest. These rules and procedures

More information

baseline comparisons in RCTs

baseline comparisons in RCTs Stefan L. K. Gruijters Maastricht University Introduction Checks on baseline differences in randomized controlled trials (RCTs) are often done using nullhypothesis significance tests (NHSTs). In a quick

More information

Limitations of 2-cond Designs

Limitations of 2-cond Designs Design Conditions & Variables Limitations of 2-group designs Kinds of Treatment & Control conditions Kinds of Causal Hypotheses Explicating Design Variables Kinds of IVs Identifying potential confounds

More information

Assignment Research Article (in Progress)

Assignment Research Article (in Progress) Political Science 225 UNIVERSITY OF CALIFORNIA, SAN DIEGO Assignment Research Article (in Progress) Philip G. Roeder Your major writing assignment for the quarter is to prepare a twelve-page research article

More information

Matching: Observational research

Matching: Observational research Matching: Observational research 1 When is it deemed acceptable to observe without consent? In a public place where participants would normally expect to be observed by strangers These factors should always

More information

GLOSSARY OF GENERAL TERMS

GLOSSARY OF GENERAL TERMS GLOSSARY OF GENERAL TERMS Absolute risk reduction Absolute risk reduction (ARR) is the difference between the event rate in the control group (CER) and the event rate in the treated group (EER). ARR =

More information

Handout 1: Introduction to the Research Process and Study Design STAT 335 Fall 2016

Handout 1: Introduction to the Research Process and Study Design STAT 335 Fall 2016 DESIGNING OBSERVATIONAL STUDIES As we have discussed, for the purpose of establishing cause-and-effect relationships, observational studies have a distinct disadvantage in comparison to randomized comparative

More information

Main objective of Epidemiology. Statistical Inference. Statistical Inference: Example. Statistical Inference: Example

Main objective of Epidemiology. Statistical Inference. Statistical Inference: Example. Statistical Inference: Example Main objective of Epidemiology Inference to a population Example: Treatment of hypertension: Research question (hypothesis): Is treatment A better than treatment B for patients with hypertension? Study

More information

Observational Study Designs. Review. Today. Measures of disease occurrence. Cohort Studies

Observational Study Designs. Review. Today. Measures of disease occurrence. Cohort Studies Observational Study Designs Denise Boudreau, PhD Center for Health Studies Group Health Cooperative Today Review cohort studies Case-control studies Design Identifying cases and controls Measuring exposure

More information

Bias and confounding. Mads Kamper-Jørgensen, associate professor, Section of Social Medicine

Bias and confounding. Mads Kamper-Jørgensen, associate professor, Section of Social Medicine Bias and confounding Mads Kamper-Jørgensen, associate professor, maka@sund.ku.dk PhD-course in Epidemiology l 7 February 2017 l Slide number 1 The world according to an epidemiologist Exposure Outcome

More information

Designed Experiments have developed their own terminology. The individuals in an experiment are often called subjects.

Designed Experiments have developed their own terminology. The individuals in an experiment are often called subjects. When we wish to show a causal relationship between our explanatory variable and the response variable, a well designed experiment provides the best option. Here, we will discuss a few basic concepts and

More information

International Standard on Auditing (UK) 530

International Standard on Auditing (UK) 530 Standard Audit and Assurance Financial Reporting Council June 2016 International Standard on Auditing (UK) 530 Audit Sampling The FRC s mission is to promote transparency and integrity in business. The

More information

TRACER STUDIES ASSESSMENTS AND EVALUATIONS

TRACER STUDIES ASSESSMENTS AND EVALUATIONS TRACER STUDIES ASSESSMENTS AND EVALUATIONS 1 INTRODUCTION This note introduces the reader to tracer studies. For the Let s Work initiative, tracer studies are proposed to track and record or evaluate the

More information

Higher Psychology RESEARCH REVISION

Higher Psychology RESEARCH REVISION Higher Psychology RESEARCH REVISION 1 The biggest change from the old Higher course (up to 2014) is the possibility of an analysis and evaluation question (8-10) marks asking you to comment on aspects

More information

Overview of Study Designs in Clinical Research

Overview of Study Designs in Clinical Research Overview of Study Designs in Clinical Research Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines + Evidence Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort

More information

Designing Studies of Diagnostic Imaging

Designing Studies of Diagnostic Imaging Designing Studies of Diagnostic Imaging Chaya S. Moskowitz, PhD With thanks to Nancy Obuchowski Outline What is study design? Building blocks of imaging studies Strategies to improve study efficiency What

More information

Chapter Three Research Methodology

Chapter Three Research Methodology Chapter Three Research Methodology Research Methods is a systematic and principled way of obtaining evidence (data, information) for solving health care problems. 1 Dr. Mohammed ALnaif METHODS AND KNOWLEDGE

More information

Understanding Confounding in Research Kantahyanee W. Murray and Anne Duggan. DOI: /pir

Understanding Confounding in Research Kantahyanee W. Murray and Anne Duggan. DOI: /pir Understanding Confounding in Research Kantahyanee W. Murray and Anne Duggan Pediatr. Rev. 2010;31;124-126 DOI: 10.1542/pir.31-3-124 The online version of this article, along with updated information and

More information

Chapter 2. The Data Analysis Process and Collecting Data Sensibly. Copyright 2005 Brooks/Cole, a division of Thomson Learning, Inc.

Chapter 2. The Data Analysis Process and Collecting Data Sensibly. Copyright 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 2 The Data Analysis Process and Collecting Data Sensibly Important Terms Variable A variable is any characteristic whose value may change from one individual to another Examples: Brand of television

More information

Variable Data univariate data set bivariate data set multivariate data set categorical qualitative numerical quantitative

Variable Data univariate data set bivariate data set multivariate data set categorical qualitative numerical quantitative The Data Analysis Process and Collecting Data Sensibly Important Terms Variable A variable is any characteristic whose value may change from one individual to another Examples: Brand of television Height

More information

Chapter 2. The Research Enterprise in Psychology 8 th Edition

Chapter 2. The Research Enterprise in Psychology 8 th Edition Chapter 2 The Research Enterprise in Psychology 8 th Edition The Scientific Approach: A Search for Laws Empiricism Basic assumption: events are governed by some lawful order Goals: Measurement and description

More information

Controlling Bias & Confounding

Controlling Bias & Confounding Controlling Bias & Confounding Chihaya Koriyama August 5 th, 2015 QUESTIONS FOR BIAS Key concepts Bias Should be minimized at the designing stage. Random errors We can do nothing at Is the nature the of

More information

VALIDITY OF QUANTITATIVE RESEARCH

VALIDITY OF QUANTITATIVE RESEARCH Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees

More information

UNIT 5 - Association Causation, Effect Modification and Validity

UNIT 5 - Association Causation, Effect Modification and Validity 5 UNIT 5 - Association Causation, Effect Modification and Validity Introduction In Unit 1 we introduced the concept of causality in epidemiology and presented different ways in which causes can be understood

More information

2-Group Multivariate Research & Analyses

2-Group Multivariate Research & Analyses 2-Group Multivariate Research & Analyses Research Designs Research hypotheses Outcome & Research Hypotheses Outcomes & Truth Significance Tests & Effect Sizes Multivariate designs Increased effects Increased

More information

Checklist for Randomized Controlled Trials. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews

Checklist for Randomized Controlled Trials. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Randomized Controlled Trials http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org

More information

Chapter 8 Experimental Design

Chapter 8 Experimental Design Chapter 8 Experimental Design Causality Review Remember from Chapter 4 that in order to make a causal inference, you need to satisfy three requirements: 1. Covariation 2. Temporal order 3. Eliminate alternative

More information

Why do Psychologists Perform Research?

Why do Psychologists Perform Research? PSY 102 1 PSY 102 Understanding and Thinking Critically About Psychological Research Thinking critically about research means knowing the right questions to ask to assess the validity or accuracy of a

More information

Appraising the Literature Overview of Study Designs

Appraising the Literature Overview of Study Designs Chapter 5 Appraising the Literature Overview of Study Designs Barbara M. Sullivan, PhD Department of Research, NUHS Jerrilyn A. Cambron, PhD, DC Department of Researach, NUHS EBP@NUHS Ch 5 - Overview of

More information

Students will demonstrate knowledge of an experiment by identifying different types of variables.

Students will demonstrate knowledge of an experiment by identifying different types of variables. Students will demonstrate knowledge of an experiment by identifying different types of variables. Research Methods It is actually way more exciting than it sounds!!!! Why do we have to learn this stuff?

More information

Study Designs in Epidemiology

Study Designs in Epidemiology Study Designs in Epidemiology Dr. Sireen Alkhaldi, BDS, MPH, DrPH First semester 2017/ 2018 Department of Family and Community Medicine School of Medicine/ The University of Jordan Epidemiologic Study

More information