The Lens Model and Linear Models of Judgment
|
|
- Leonard Perkins
- 5 years ago
- Views:
Transcription
1 John Miyamoto October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 1 Psych 466: Judgment and Decision Making Autumn 2017 The Lens Model and Linear Models of Judgment The lens model is a conceptualization proposed by Egon Brunswik of the relationship between the environment and the perceiving, cognizing organism. Brunswik emphasized the idea that typically we do not experience objects and qualities directly from an environment - rather we infer the properties of objects from cues that are more directly available to us. In this handout, I will call the person who is making judgments about the environment, the judge. The figure to the right (Figure 3.1 from Hastie and Dawes) is the standard depiction of Brunswik's lens model. The "to-be-judged criterion" on the left is a state of the world that the judge is trying to evaluate. The "judgment" on the right is the judge's evaluation of this state. It is assumed that the judge cannot directly measure or evaluate the criterion; it might be the case that this is impossible in principle or simply difficult in practice. For example, if I meet someone and I'm trying to figure out whether this person supports or opposes gay marriage, the criterion is the true degree to which this person supports or opposes gay marriage, the cues would be any information that I can glean from this persons appearance, conversation, and background. The judgment would be my inference (guess) as to the degree to which this person supports or opposes gay marriage. In general, the cues are pieces of information that the judge is able to observe that are associated with the true state of the criterion. The ecological validities are the validities of the cues, i.e., the conditional probability that the object belongs to a category given the presence of the cue. Cue utilization is the weight that the judge gives to a particular cue. Table 1 Figure 3.1 in Hastie & Dawes. Lens model conceptual framework for the global judgment process. Table 1 below illustrates this terminology with three examples of judgment problems. Terminology Example 1 Example 2 Example 3 Criterion Age of man on street Future college GPA of high school student Future satisfaction of living with a roommate Cues Facial appearance hair color skin quality body motion mode of dress High school GPA SAT scores recommendations essay Social style when interviewed Reputation of person among your friends Self-reported habits of cleanliness, neatness, cooperativeness, etc. Judgment Estimate (guess) of man's age Estimate (guess) of students future college GPA Estimate of future satisfaction of living with this roommate
2 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 2 Examples 1, 2 and 3 are all examples of probabilistic judgment problems. In a probabilistic judgment problem, a judge has to make a judgment about a criterion based on uncertain cues. The lens model is a way to conceptualize the situation in a probabilistic judgment problem. Judgment Problem: Predicting College GPA from Information About High School Applicants to College The remainder of this handout has to do with two questions: Question 1: Suppose we are psychologists who are trying to help the judge make good decision. What kind of decision procedure should we suggest? Question 2: Are the decision procedures that we suggest better or worse than intuitive judgments made by the judge? * Intuitive judgments = holistic judgments = global judgments: In the intuitive judgment, the judge may take all of the different cues into consideration, but the judgment is based on a guess or feeling about what these cues mean; the judgment is not based the calculation of an explicit statistical formula. There are actually several slightly different decision procedures that are worth considering. All of these procedures can be illustrated with the example from Baron's chapter on Quantitative Judgment. The data for this example are shown in Table 2 below. Table 2 (combines the data from Tables 20.2 and 20.4 of Baron's chapter on Quantitative Judgment) subj COL SAT REC ESS GPA PRE ERROR JUD In this example, the judge is trying to predict the college GPA for high school students who have applied to his or her college. The researcher has the data shown in Table 2 available to her. The variables in this analysis are: COL COL is the college GPA of the student. COL is the criterion.. The variables in columns 3-6 are the cues (Baron calls them predictor variables). SAT REC SAT score (standardized education test for high school students). This is a rating of the recommendations on a 5-point scale. The strongest possible recommendation would get a 5. The weakest possible recommendation would get a 1.
3 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 3 ESS GPA The judge has to make the ratings of the recommendations based on his subjective evaluation of the strength of the recommendation. This is a rating of the student's essay on a 5-point scale. The best quality essay would get a 5. The worst quality essay would get a 1. Again, the judge has to make the ratings of the essays based on his subjective evaluation of their quality. GPA = the high school GPA of the student. The next two variables are computed by the statistical formula (multiple regression equation). PRE ERROR This the predicted college GPA based on a statistical formula (multiple regression). Only the variables, COL, SAT, REC, ESS and GPA are used to compute the formula - the judge plays no role in producing the formula other than to give the ratings for REC and ESS. This is the deviation of PRE from the actual value of COL, i.e., ERROR = COL PRE. The last variable is the judged global rating for each case (each student who is applying to college). JUD JUD is the judges intuitive prediction of the student's college GPA after seeing the cues, SAT, REC, ESS and GPA. When the judge makes this prediction, he does not get to see COL until after he has made his prediction. It may seem strange that the values of COL are shown in Table 2 because the judge is trying to estimate the value of COL based on the cue variables. If the judge already knows the values of COL, why is he trying to estimate the values of COL? The answer is that in some cases we may know the values of COL (for example, for students have already been admitted to college) whereas in other case, we may not know the values of COL (for example, prior to admitting the students). We can use information from the known cases to help us predict cases for which COL is not known. Four Methods for Predicting College GPA Method 1: Method 2: Method 3: Method 4: Compute a multiple regression model of the criterion. Compute a multiple regression model of the judge (MUD) Don't compute a model. Just use importance weights (subjective weights that are assigned by the judge). Don't compute a model. Just use unit weights. These four cases are explained below: Method 1: Compute a multiple regression model of the criterion. Characteristics of the situation to which this procedure applies: The judge has available to him data like that shown in Table 2. These data include the values of the criterion as well as the values of the cues. These data can be used to fit a multiple regression model. The judge wants to predict COL for a set of high school students. For thise students, he has the data for the cues (SAT, REC, ESS, GPA) available to him, but COL is not available to him because the students have not yet been admitted.
4 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 4 Procedure: Use the statistical procedure called multiple regression to compute a formula that predicts COL based on the cues, SAT, REC, ESS, and GPA. The input to this procedure are the values of these variables (including COL) shown in Table 2. The output of this procedure is the following formula: PRE = SAT REC ESS GPA (1) Equation (1) is referred to as a linear prediction equation for the criterion, COL. The numbers, , 0.092,..., are called the regression coefficients or the regression weights. The last term, 5.161, is the intercept term. A statistical procedure called multiple regression takes the data in Table 2 to compute the regression weights and the intercept term. To get the predicted value for any particular case in Table 2, we plug in the values of the cue variables to get the prediction. For example, to get the predicted value for Student 1 in Table 2, we compute PRE(Student 1) = (1500) (4.0) (4.0) (4.0) = Of course, this prediction is not so important for Student 1 because we already know the true value of his or her COL (COL for Student 1 is 3.8). But the prediction equation is useful when we get an application from a new student for whom we don't know COL. For example, if we get an application from a student whose predictor variables (cues) have the values: SAT = 1200, REC = 3.7, ESS = 3.9, GPA = 3.2, then the prediction equation tells us that our best prediction for this student is: PRE(new student) = (1200) (3.7) (3.9) (3.2) = SELECTION PROBLEM. If your goal is to pick the K students who are predicted to have the highest college GPA's: Choose the K new students who have the highest values of PRE, e.g., if you want to choose the 50 new students who have the highest predicted GPA's, compute PRE for all of the applicants and select the applicants with the 50 highest values of PRE. PREDICTION. If the goal is to predict the college GPA for a set of applicants: Use Equation (1) to compute PRE for these applicants - these are the predicted values of college GPA. Comparison of procedure for Method 1 to human judgment: Studies have shown that when large amounts of data for the criterion are available, the predictions for new cases derived from a regression model are much more accurate than are the intuitive judgments of a judge. Gigerenzer and Brighton (2009) point out that this may not be true if the available data is not large. Notice that the statistical formula shown in Equation (1) is actually very simple - each cue is multipled by a weight and then these products are added together to produce the prediction. Judges often think that they produce their judgments by means of a complex, interactive, nonlinear evaluation of the cues. Whether or not this is really true, the results of these studies show that a much simpler combination of the cues can produce better predictions than the processes used by human judges.
5 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 5 Method 2: Compute a multiple regression model of the judge (MUD) Characteristics of the situation to which this procedure applies: The judge wants to predict COL for a set of high school students. For thise students, he has the data for the cues (SAT, REC, ESS, GPA) available to him, but COL is not available to him because the students have not yet been admitted. For example, suppose that the judge has available the data for the cues shown in Table 2 (columns 3-6: SAT, REC, ESS, GPA) but not the data for the other columns in the table. Procedure: We show the judge the data for the cues in Table 2. We ask the judge to make an intuitive prediction of the college GPA for each case. Column 9 labeled "JUD" shows the intuitive predictions that were made by the judge. Now we use multiple regression to compute a formula that predicts JUD based on the cues, SAT, REC, ESS, and GPA. The input to this procedure are the values of the variables, JUD, SAT, REC, ESS, and GPA (notice that COL is not input to the procedure because we don't know it yet). The output of this procedure is the following formula: MUD = 0 SAT REC ESS GPA 4.8 (2) MUD is a Model of the judge 1. Finally, we use Equation (2) to predict the college GPA for any new students for whom we know SAT, REC, ESS and GPA, but not the college GPA (COL). For example, if we get an application from a student whose predictor variables (cues) have the values: SAT = 1200, REC = 3.7, ESS = 3.9, GPA = 3.2, then Equation (2) tells us that our prediction for this student is: MUD(new student) = 0 (1200) (3.7) (3.9) (3.2) 4.8 = 2.36 SELECTION PROBLEM. If your goal is to pick the K students who are predicted to have the highest college GPA's: Choose the K new students who have the highest values of MUD, e.g., if you want to choose the 50 new students who have the highest predicted GPA's, use Equation (2) to compute MUD for all of the applicants and select the applicants with the 50 highest values of MUD. PREDICTION PROBLEM. If the goal is to predict the college GPA for a set of applicants: Use Equation (2) to compute MUD for these applicants - these are the predicted values of college GPA. Comparison of procedure for Method 2 to human judgment: Studies have shown that when data for the criterion become available, e.g., after admitting the students, the model of the judge produces more accurate predictions than the intuitive judgments of the judge. Note that this result is superficially rather odd - the regression coefficients in Equation 2 were computed to predict JUD, the judge's predictions. Nevertheless it has been found that the model of the judge, i.e., Equation (2), does a good job predicting the criterion, COL. The results for this case have several implications: 1 Baron came up with this notation - I'm not a big fan of it, but I'm using it so that the Baron chapter will look familiar to you.
6 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 6 a) Although judges often think that they produce their judgments by means of a complex, interactive, nonlinear evaluation of the cues, the results for this case show that a much simpler combination of the cues can produce better predictions than the processes used by human judges. (Same conclusion as for Method 1). b) We don't even need to know the value of the criterion (COL) in order to find a statistical formula (prediction equation) that can outperform the judge. c) The statistical formula that we found in Equation (2) is a simple additive model of the judge's intuitive policy. Studies show that a simple additive model of the judge's policy will typically outperform the judge (even for judge's who are experts in their field). The reason for this is that the statistical formula is consistent - it treats each case by the same formula. A human judge has all sorts of random variations in his or her judgment. These random variations simply increase the inaccuracy (error) of the judge's predictions. Method 3: Don't use multiple regression to compute a model. Just use importance weights in the prediction equation. (a.k.a. MAUT Method or SMART Method). Importance weights are positive or negative numbers that reflect how strongly a particular cue influences the prediction. The decision maker simply makes up these numbers to reflect his or her judgment of the importance of an attribute. Characteristics of the situation to which this procedure applies: (Exactly the same as for Method 2) Procedure: Convert the values of the cues to z-scores. * Compute the mean of the SAT scores for all students in the sample (m SAT ); compute the standard deviation of SAT scores for all students in the sample (sd SAT ). If SAT 1 is the SAT score for student 1, then the SAT z-score for student 1 is z SAT,1 = (SAT 1 m SAT )/sd SAT. * Apply a similar procedure to convert REC, ESS and GPA to z-scores. Based on your judgment, choose "importance weights" for the dimensions. * Example: Consider the cues, SAT, REC, ESS, and GPA. Suppose you give the SAT an importance weight of +1. If you think that the REC is slightly less important than SAT, you could give it a weight, e.g., of If you think that ESS is about half as important as SAT, you would give it a weight of 0.5. If you think that the GPA is twice as important as SAT, give it a weight of +2. Convert the importance weights to normalized weights, i.e., replace the weight w k with wk wi. * Example: Suppose that the judged importance weights are +1 (SAT), +0.7 (REC), +0.5 (ESS) and +2 (GPA). Then wi = = 4.2. Then the normalized weights are: +1/4.2 = 0.24 (SAT), +0.7/4.2 = 0.17 (REC), i +0.5/4.2 = 0.12 (ESS) and 2/4.2 = 0.47 (GPA). Use the normalized weights to compute the predicted z-scores for each student according to the formula: Predicted Z = 0.24 SAT REC ESS GPA. (3) For example, suppose that we have an application from a student whose predictor variables (cues) have the z-scores: z SAT = 1.3, z REC = 0.60, z ESS = 0.42, and z GPA = Then Equation (3) tells us that the predicted z-score for the college GPA of this student is: Predicted Z(new student) = 0.24 (1.3) (0.60) ( 0.42) (0.80) = i
7 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 7 SELECTION PROBLEM. If your goal is to pick the K students who are predicted to have the highest college GPA's: Use Equation (3) to compute the predicted z-scores for college GPA's of all of the applicants. Then, choose the K new students who have the highest values of Predicted Z. PREDICTION PROBLEM. If the goal is to predict the college GPA for a set of applicants: The solution is described in Appendix A. In Psych 466, it is not necessary to work out the mathematical details, although they are fairly simple. Comparison of the procedure for Method 3 to human judgment: Just as in the results for Methods 1 and 2, studies have shown that when data for the criterion become available, e.g., after admitting the students, the importance weighting model produces more accurate predictions than the intuitive judgments of the judge. The results for this case have several implications: a) Same as implication (a) for Method 2. b) Same as implication (b) for Method 2. c) We don't even need to do a complicated calculation of the regression weights in order to find a model that can outperform the judge. All we need to do is guess the relative importance of the various cues. d) An importance weighting model is an extremely simple additive model of the judge's intuitive policy. It will typically outperform the intuitive judgment (even for judge's who are experts in their field). Again, the reason for this is that the statistical formula is consistent - it treats each case by the same formula. A human judge has all sorts of random variations in his or her judgment. These random variations simply increase the inaccuracy (error) of the judge's predictions. Method 4: Don't compute a model. Just use unit weight. (Unit Weighting Model) Weights = +1 for all positive variables, and 1 for all negative variables. Characteristics of the situation to which this procedure applies: (Exactly the same as for Method 2) Procedure: Convert the values of the cues to z-scores. Look at the cues, SAT, REC, ESS, and GPA. If we know that the cue is positively related to college GPA, we give the cue a weight of +1.0; If we know that the cue is negatively related to college GPA, we give the cue a weight of 1.0. Convert the weights to normalized weights, i.e., replace the weight w k with wk wi. * Example: SAT, REC, ESS and GPA are all positive related to college GPA (COL), therefore they all have a unit weight of The sum of the absolute values of the weights is i wi = = 4. Therefore the normalized weights are 0.25, 0.25, 0.25, and Use the normalized weights to compute the predicted z-scores for each student according to the formula: Predicted Z = 0.25 SAT REC ESS GPA. (4) For example, suppose that we have an application from a student whose predictor variables (cues) have the z-scores: z SAT = 1.3, z REC = 0.60, z ESS = 0.42, and z GPA = Then Equation (4) tells us that the predicted z-score for the college GPA of this student is: Predicted Z(new student) = 0.25 (1.3) (0.60) ( 0.42) (0.80) = i
8 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 8 SELECTION PROBLEM. If your goal is to pick the K students who are predicted to have the highest college GPA's: Use Equation (4) to compute the predicted z-scores for college GPA's of all of the applicants. Then, choose the K new students who have the highest values of Predicted Z. PREDICTION PROBLEM. If the goal is to predict the college GPA for a set of applicants: The solution is described in Appendix B. In Psych 466, it is not necessary to work out the mathematical details, although they are fairly simple. Terminology: Equation (4) is called a unit-weighting regression model because, prior to normalizing the weights, all of the weights are equal to +1.0 or 1.0. Equation (1) is called a proper linear model because it is the equation with the best-fitting regression weights for the criterion. We can prove that Equation (1) will have more accurate predictions than any other linear regression model if the model is fit to a large set of data. Equation (2) can also be called a proper linear model because it is the equation with the best-fitting regression weights for the judge's intuitive predictions. Equation (1) is a proper linear model for the criterion; Equation (2) is a proper linear model for the judge's predictions. A prediction equation with weights that are different from the best fitting regression weights is called an improper linear model. Equations (3) and (4) are examples of improper linear models. Comparison of the procedure for Method 3 to human judgment: Just as in the results for Methods 1 and 2, studies have shown that when data for the criterion become available, e.g., after admitting the students, the unit weighting model produces more accurate predictions than the intuitive judgments of the judge. The results for this case have several implications: a) Same as implication (a) for Method 2. b) Same as implication (b) for Method 2. c) We don't even need to do a complicated calculation of the regression weights in order to find a model that can outperform the judge. All we need to know is which cues are positively related to the criterion and which are negatively related to the criterion. Positive cues get a weight of +1.0, and negative cues get a weight of 1.0. d) A unit-weighting regression model is an extremely simple additive model of the judge's intuitive policy. Studies show that a unit-weighting model of the judge's policy will typically outperform the intuitive judgments of a judge (even for judge's who are experts in their field). Again, the reason for this is that the statistical formula is consistent - it treats each case by the same formula. A human judge has all sorts of random variations in his or her judgment. These random variations simply increase the inaccuracy (error) of the judge's predictions. Appendix A. If we are using Method 3 and the goal is to predict the college GPA for a set of applicants: Use Equation (3) to compute the predicted z-scores for college GPA's of all of the applicants. Now you have to convert the predicted z-scores back to the GPA scale (ranging from 0 to 4.0). To do this, you need to know, or be willing to guess, the mean college GPA and standard deviation of college GPA for all students who are enrolled at the college. Let M COL stand for the mean college GPA and let SD COL stand for the standard deviation of the college GPA. Now compute the predicted college GPA by the equation: Predicted College GPA = (Predicted Z-score) SD COL + M COL (5) For example, if you think that the mean college GPA, M COL, is equal to 2.9 and the standard deviation of college GPA is 0.5, then a student with a predicted z-score of +0.3 has a predicted college GPA of
9 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 9 (0.3) = Similarly, a student with a predicted z-score of 0.4 has a predicted college GPA of ( 0.4) = 2.7. Appendix B. If we are using Method 4 and the goal is to predict the college GPA for a set of applicants: Use Equation (4) to compute the predicted z-scores for college GPA's of all of the applicants. Now you have to convert the predicted z-scores back to the GPA scale (ranging from 0 to 4.0). To do this, use the method that is described in Appendix A (the only difference between Method 3 and Method 4 is that the predicted z-scores will be different). Table 3: Summary of the Pros and Cons of Methods 1-4 Possible Requirements Intuitive Judgment Multiple Regression Model Model of the Judge (MUD) Importance Weighting Model Unit Weighting Model You need a list of predictor variables, e.g., SAT, REC, ESS, and GPA. You need to know the value of the criterion for a list of cases, e.g., the value of COL. You need to have the judge make predictions for a list of cases. You need to decide what is the relative importance of the predictor variables You need to convert the predictor variables to z- scores You need to estimate or guess the mean and standard deviation of the criterion in the general population. c Rank order of effort needed to use this method: 1 = least effort, 5 = most effort NO YES YES YES YES NO YES NO NO NO NO NO YES NO NO NO NO NO YES NO NO NO NO YES a YES a NO NO NO YES d YES d Rank order of accuracy: 1 = best, 5 = worst a b c This is easy to do with a computer b 4 b Importance weighting can be less accurate than unit weighting if the decision maker doesn't think carefully about how to choose importance weights. We don't go into this issue in this class. For the importance weighting and the unit weighting models, you need to estimate the mean and variance of the criterion only if you want to produce a quantitative prediction of the criterion. You need the estimated mean and variance of the criterion in
10 October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 10 d order to convert predicted z-scores on the criterion back to the original scale on the criterion. If you only want to rank the different cases, i.e., determine which is best, which is 2 nd best, which is 3 rd best, etc., then you do not need to estimate the mean and variance of the criterion. Practically speaking, this is not hard to do. References Brunswik, E. (1952). The conceptual framework of psychology. Chicago, University of Chicago Press. Brunswik, E., Hammond, K. R., & Stewart, T. R. (Eds.) (2000). The essential Brunswik: Beginnings, explications, and applications. New York: Oxford University Press. * See, also, the Brunswik Society website: Baron (1994), ch 20 (Quantitative Judgment). Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgment. Science, 243, Gigerenzer, G., & Brighton, H. (2009). Homo Heuristicus: Why biased minds make better inferences. Hastie, R., & Dawes, R. M. (2009). Rational choice in an uncertain world (2nd ed.). Thousand Oaks, CA: Sage Publications, Inc. Chapter 3: A general framework for judgment. **End of File **
History of JDM Linear Judgment Models
Finish: Begin: History of JDM Linear Judgment Models Psychology 466: Judgment & Decision Making Instructor: John Miyamoto 10/03/2017: Lecture 02-1 Note: This Powerpoint presentation may contain macros
More informationPsychology 466: Judgment & Decision Making
Psychology 466: Judgment & Decision Making Psychology 466: Judgment & Decision Making Instructor: John Miyamoto 09/28/2017: Lecture 01-2 Note: This Powerpoint presentation may contain macros that I wrote
More informationIntroduction to Preference and Decision Making
Introduction to Preference and Decision Making Psychology 466: Judgment & Decision Making Instructor: John Miyamoto 10/31/2017: Lecture 06-1 Note: This Powerpoint presentation may contain macros that I
More informationCHAPTER 3 DATA ANALYSIS: DESCRIBING DATA
Data Analysis: Describing Data CHAPTER 3 DATA ANALYSIS: DESCRIBING DATA In the analysis process, the researcher tries to evaluate the data collected both from written documents and from other sources such
More informationMULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES OBJECTIVES
24 MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES In the previous chapter, simple linear regression was used when you have one independent variable and one dependent variable. This chapter
More informationResults & Statistics: Description and Correlation. I. Scales of Measurement A Review
Results & Statistics: Description and Correlation The description and presentation of results involves a number of topics. These include scales of measurement, descriptive statistics used to summarize
More informationRegression CHAPTER SIXTEEN NOTE TO INSTRUCTORS OUTLINE OF RESOURCES
CHAPTER SIXTEEN Regression NOTE TO INSTRUCTORS This chapter includes a number of complex concepts that may seem intimidating to students. Encourage students to focus on the big picture through some of
More informationBig data in educational science: Meta-analysis as an analysis tool.
Big data in educational science: Meta-analysis as an analysis tool www.uzh.ch Big data in educational science: Meta-analysis as an analysis tool Since the introduction of the term meta-analysis to the
More information3 CONCEPTUAL FOUNDATIONS OF STATISTICS
3 CONCEPTUAL FOUNDATIONS OF STATISTICS In this chapter, we examine the conceptual foundations of statistics. The goal is to give you an appreciation and conceptual understanding of some basic statistical
More informationISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology
ISC- GRADE XI HUMANITIES (2018-19) PSYCHOLOGY Chapter 2- Methods of Psychology OUTLINE OF THE CHAPTER (i) Scientific Methods in Psychology -observation, case study, surveys, psychological tests, experimentation
More informationGut Feelings: Short Cuts To Better Decision Making Gerd Gigerenzer
The heart has its reasons of which reason knows nothing Blaise Pascal Gut Feelings: Short Cuts To Better Decision Making Gerd Gigerenzer Max Planck Institute for Human Development Berlin An intuition is
More informationVariability. After reading this chapter, you should be able to do the following:
LEARIG OBJECTIVES C H A P T E R 3 Variability After reading this chapter, you should be able to do the following: Explain what the standard deviation measures Compute the variance and the standard deviation
More informationSPSS Correlation/Regression
SPSS Correlation/Regression Experimental Psychology Lab Session Week 6 10/02/13 (or 10/03/13) Due at the Start of Lab: Lab 3 Rationale for Today s Lab Session This tutorial is designed to ensure that you
More informationCAUTIONS ABOUT THE PRACTICE EXAM
Dr. Michael Passer Psych 209, U. of Washington CAUTIONS ABOUT THE PRACTICE EXAM DEAR STUDENT: This practice tests consists of questions from past exams. By taking this practice test, you should gain an
More informationStatistics for Psychology
Statistics for Psychology SIXTH EDITION CHAPTER 12 Prediction Prediction a major practical application of statistical methods: making predictions make informed (and precise) guesses about such things as
More informationStill important ideas
Readings: OpenStax - Chapters 1 13 & Appendix D & E (online) Plous Chapters 17 & 18 - Chapter 17: Social Influences - Chapter 18: Group Judgments and Decisions Still important ideas Contrast the measurement
More informationWhy (and how) Superman hides behind glasses: the difficulties of face matching
Why (and how) Superman hides behind glasses: the difficulties of face matching Kay L. Ritchie 1,2 & Robin S. S. Kramer 1 1 Department of Psychology, University of York, York, UK. 2 School of Psychology,
More informationDear Participants in the Brunswik Society
Dear Participants in the Brunswik Society As many of you will have noticed, the 2009 meeting has been cancelled. This was done because of my dissatisfaction with the program and the manner in which it
More informationSawtooth Software. The Number of Levels Effect in Conjoint: Where Does It Come From and Can It Be Eliminated? RESEARCH PAPER SERIES
Sawtooth Software RESEARCH PAPER SERIES The Number of Levels Effect in Conjoint: Where Does It Come From and Can It Be Eliminated? Dick Wittink, Yale University Joel Huber, Duke University Peter Zandan,
More informationBayes theorem describes the probability of an event, based on prior knowledge of conditions that might be related to the event.
Bayes theorem Bayes' Theorem is a theorem of probability theory originally stated by the Reverend Thomas Bayes. It can be seen as a way of understanding how the probability that a theory is true is affected
More informationExample of Interpreting and Applying a Multiple Regression Model
Example of Interpreting and Applying a Multiple Regression We'll use the same data set as for the bivariate correlation example -- the criterion is 1 st year graduate grade point average and the predictors
More informationRegression. Lelys Bravo de Guenni. April 24th, 2015
Regression Lelys Bravo de Guenni April 24th, 2015 Outline Regression Simple Linear Regression Prediction of an individual value Estimate Percentile Ranks Regression Simple Linear Regression The idea behind
More informationEmpirical Knowledge: based on observations. Answer questions why, whom, how, and when.
INTRO TO RESEARCH METHODS: Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. Experimental research: treatments are given for the purpose of research. Experimental group
More informationChapter 13 Estimating the Modified Odds Ratio
Chapter 13 Estimating the Modified Odds Ratio Modified odds ratio vis-à-vis modified mean difference To a large extent, this chapter replicates the content of Chapter 10 (Estimating the modified mean difference),
More informationThe Regression-Discontinuity Design
Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations
More informationCRITERIA FOR USE. A GRAPHICAL EXPLANATION OF BI-VARIATE (2 VARIABLE) REGRESSION ANALYSISSys
Multiple Regression Analysis 1 CRITERIA FOR USE Multiple regression analysis is used to test the effects of n independent (predictor) variables on a single dependent (criterion) variable. Regression tests
More informationMITOCW conditional_probability
MITOCW conditional_probability You've tested positive for a rare and deadly cancer that afflicts 1 out of 1000 people, based on a test that is 99% accurate. What are the chances that you actually have
More information15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA
15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA Statistics does all kinds of stuff to describe data Talk about baseball, other useful stuff We can calculate the probability.
More informationReliability and Validity
Reliability and Validity Why Are They Important? Check out our opening graphics. In a nutshell, do you want that car? It's not reliable. Would you recommend that car magazine (Auto Tester Weakly) to a
More informationHerbert A. Simon Professor, Department of Philosophy, University of Wisconsin-Madison, USA
Health Economics, Policy and Law (2008), 3: 79 83 ª Cambridge University Press 2008 doi:10.1017/s1744133107004343 Response Valuing health properly DANIEL M. HAUSMAN* Herbert A. Simon Professor, Department
More informationWhat Are Your Odds? : An Interactive Web Application to Visualize Health Outcomes
What Are Your Odds? : An Interactive Web Application to Visualize Health Outcomes Abstract Spreading health knowledge and promoting healthy behavior can impact the lives of many people. Our project aims
More information20. Experiments. November 7,
20. Experiments November 7, 2015 1 Experiments are motivated by our desire to know causation combined with the fact that we typically only have correlations. The cause of a correlation may be the two variables
More informationChapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research
Chapter 11 Nonexperimental Quantitative Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) Nonexperimental research is needed because
More information9 research designs likely for PSYC 2100
9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one
More informationBayes Theorem Application: Estimating Outcomes in Terms of Probability
Bayes Theorem Application: Estimating Outcomes in Terms of Probability The better the estimates, the better the outcomes. It s true in engineering and in just about everything else. Decisions and judgments
More informationPsychology of Perception Psychology 4165, Fall 2001 Laboratory 1 Weight Discrimination
Psychology 4165, Laboratory 1 Weight Discrimination Weight Discrimination Performance Probability of "Heavier" Response 1.0 0.8 0.6 0.4 0.2 0.0 50.0 100.0 150.0 200.0 250.0 Weight of Test Stimulus (grams)
More informationLesson 9: Two Factor ANOVAS
Published on Agron 513 (https://courses.agron.iastate.edu/agron513) Home > Lesson 9 Lesson 9: Two Factor ANOVAS Developed by: Ron Mowers, Marin Harbur, and Ken Moore Completion Time: 1 week Introduction
More informationBasic Concepts in Research and DATA Analysis
Basic Concepts in Research and DATA Analysis 1 Introduction: A Common Language for Researchers...2 Steps to Follow When Conducting Research...2 The Research Question...3 The Hypothesis...3 Defining the
More informationStatistics for Psychology
Statistics for Psychology SIXTH EDITION CHAPTER 3 Some Key Ingredients for Inferential Statistics Some Key Ingredients for Inferential Statistics Psychologists conduct research to test a theoretical principle
More informationStudy Guide #2: MULTIPLE REGRESSION in education
Study Guide #2: MULTIPLE REGRESSION in education What is Multiple Regression? When using Multiple Regression in education, researchers use the term independent variables to identify those variables that
More informationEIQ16 questionnaire. Joe Smith. Emotional Intelligence Report. Report. myskillsprofile.com around the globe
Emotional Intelligence Report EIQ16 questionnaire Joe Smith myskillsprofile.com around the globe Report The EIQ16 questionnaire is copyright MySkillsProfile.com. myskillsprofile.com developed and publish
More informationUnderstanding Uncertainty in School League Tables*
FISCAL STUDIES, vol. 32, no. 2, pp. 207 224 (2011) 0143-5671 Understanding Uncertainty in School League Tables* GEORGE LECKIE and HARVEY GOLDSTEIN Centre for Multilevel Modelling, University of Bristol
More informationobservational studies Descriptive studies
form one stage within this broader sequence, which begins with laboratory studies using animal models, thence to human testing: Phase I: The new drug or treatment is tested in a small group of people for
More informationReadings: Textbook readings: OpenStax - Chapters 1 13 (emphasis on Chapter 12) Online readings: Appendix D, E & F
Readings: Textbook readings: OpenStax - Chapters 1 13 (emphasis on Chapter 12) Online readings: Appendix D, E & F Plous Chapters 17 & 18 Chapter 17: Social Influences Chapter 18: Group Judgments and Decisions
More informationDescriptive Statistics
Descriptive Statistics Available on the class website The rubric is also posted if you want to see how they will be graded You ll need some of the output from today to complete the assignment Let s take
More informationPlacebo and Belief Effects: Optimal Design for Randomized Trials
Placebo and Belief Effects: Optimal Design for Randomized Trials Scott Ogawa & Ken Onishi 2 Department of Economics Northwestern University Abstract The mere possibility of receiving a placebo during a
More informationChapter 4. The Validity of Assessment- Based Interpretations
Chapter 4. The Validity of Assessment- Based Interpretations contents What is validity? Its definition Its importance What are the sorts of evidence of validity? content-related evidence of validity Criterion-related
More informationHOW TO INSTANTLY DESTROY NEGATIVE THOUGHTS
HOW TO INSTANTLY DESTROY NEGATIVE THOUGHTS Groundbreaking Technique Revealed Author Dian Winter YES!! You Can Become a Positive, Confident Person This is a FREE report brought to you by: Dian Winter http://www.destroythedemonwithin.com
More informationREGRESSION MODELLING IN PREDICTING MILK PRODUCTION DEPENDING ON DAIRY BOVINE LIVESTOCK
REGRESSION MODELLING IN PREDICTING MILK PRODUCTION DEPENDING ON DAIRY BOVINE LIVESTOCK Agatha POPESCU University of Agricultural Sciences and Veterinary Medicine Bucharest, 59 Marasti, District 1, 11464,
More informationRisk Aversion in Games of Chance
Risk Aversion in Games of Chance Imagine the following scenario: Someone asks you to play a game and you are given $5,000 to begin. A ball is drawn from a bin containing 39 balls each numbered 1-39 and
More informationTeacher In-Service: Interpreters in the Classroom
Teacher In-Service: Interpreters in the Classroom Dear Parents, At the start of a new school year, teachers and staff may be unfamiliar with interpreters in the classroom. In some cases, there is no access
More informationm 11 m.1 > m 12 m.2 risk for smokers risk for nonsmokers
SOCY5061 RELATIVE RISKS, RELATIVE ODDS, LOGISTIC REGRESSION RELATIVE RISKS: Suppose we are interested in the association between lung cancer and smoking. Consider the following table for the whole population:
More informationOak Meadow Autonomy Survey
Oak Meadow Autonomy Survey Patricia M. Meehan, Ph.D. August 7, 214 1 Contents Contents 3 List of Figures 3 List of Tables 3 1 Introduction 4 2 Data 4 3 Determining the Number of Factors 5 4 Proposed Model
More informationSUMMER 2011 RE-EXAM PSYF11STAT - STATISTIK
SUMMER 011 RE-EXAM PSYF11STAT - STATISTIK Full Name: Årskortnummer: Date: This exam is made up of three parts: Part 1 includes 30 multiple choice questions; Part includes 10 matching questions; and Part
More informationTHE DEATH OF CANCER BY HAROLD W MANNER, STEVEN J. DISANTI, THOMAS L. MICHALSEN
Read Online and Download Ebook THE DEATH OF CANCER BY HAROLD W MANNER, STEVEN J. DISANTI, THOMAS L. MICHALSEN DOWNLOAD EBOOK : THE DEATH OF CANCER BY HAROLD W MANNER, STEVEN Click link bellow and free
More informationPsychology of Perception Psychology 4165, Spring 2003 Laboratory 1 Weight Discrimination
Psychology 4165, Laboratory 1 Weight Discrimination Weight Discrimination Performance Probability of "Heavier" Response 1.0 0.8 0.6 0.4 0.2 0.0 50.0 100.0 150.0 200.0 250.0 Weight of Test Stimulus (grams)
More informationTHERAPEUTIC REASONING
THERAPEUTIC REASONING Christopher A. Klipstein (based on material originally prepared by Drs. Arthur Evans and John Perry) Objectives: 1) Learn how to answer the question: What do you do with the post
More informationConfidence Intervals. Chapter 10
Confidence Intervals Chapter 10 Confidence Intervals : provides methods of drawing conclusions about a population from sample data. In formal inference we use to express the strength of our conclusions
More informationCHAPTER ONE CORRELATION
CHAPTER ONE CORRELATION 1.0 Introduction The first chapter focuses on the nature of statistical data of correlation. The aim of the series of exercises is to ensure the students are able to use SPSS to
More informationTwo-sample Categorical data: Measuring association
Two-sample Categorical data: Measuring association Patrick Breheny October 27 Patrick Breheny University of Iowa Biostatistical Methods I (BIOS 5710) 1 / 40 Introduction Study designs leading to contingency
More information1.4 - Linear Regression and MS Excel
1.4 - Linear Regression and MS Excel Regression is an analytic technique for determining the relationship between a dependent variable and an independent variable. When the two variables have a linear
More informationMentoring. Awards. Debbie Thie Mentor Chair Person Serena Dr. Largo, FL
Mentoring What is a mentor, the dictionary says it is someone who is an experienced and trusted adviser, an experienced person who trains and counsels others in the workings of a workplace or organization.
More informationThe Power of Feedback
The Power of Feedback 35 Principles for Turning Feedback from Others into Personal and Professional Change By Joseph R. Folkman The Big Idea The process of review and feedback is common in most organizations.
More informationCHAPTER 3 RESEARCH METHODOLOGY
CHAPTER 3 RESEARCH METHODOLOGY 3.1 Introduction 3.1 Methodology 3.1.1 Research Design 3.1. Research Framework Design 3.1.3 Research Instrument 3.1.4 Validity of Questionnaire 3.1.5 Statistical Measurement
More informationDescribe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo
Please note the page numbers listed for the Lind book may vary by a page or two depending on which version of the textbook you have. Readings: Lind 1 11 (with emphasis on chapters 10, 11) Please note chapter
More informationEmpowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison
Empowered by Psychometrics The Fundamentals of Psychometrics Jim Wollack University of Wisconsin Madison Psycho-what? Psychometrics is the field of study concerned with the measurement of mental and psychological
More information11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES
Correlational Research Correlational Designs Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are
More informationReview and Wrap-up! ESP 178 Applied Research Methods Calvin Thigpen 3/14/17 Adapted from presentation by Prof. Susan Handy
Review and Wrap-up! ESP 178 Applied Research Methods Calvin Thigpen 3/14/17 Adapted from presentation by Prof. Susan Handy Final Proposals Read instructions carefully! Check Canvas for our comments on
More informationCHAPTER 3 METHOD AND PROCEDURE
CHAPTER 3 METHOD AND PROCEDURE Previous chapter namely Review of the Literature was concerned with the review of the research studies conducted in the field of teacher education, with special reference
More informationCalculating CAHPS Hospice Survey Top-Box Scores
Calculating CAHPS Hospice Survey Top-Box Scores This document summarizes the steps that the Centers for Medicare & Medicaid Services (CMS) uses to calculate top-box CAHPS Hospice Survey measure scores.
More informationChapter 3 CORRELATION AND REGRESSION
CORRELATION AND REGRESSION TOPIC SLIDE Linear Regression Defined 2 Regression Equation 3 The Slope or b 4 The Y-Intercept or a 5 What Value of the Y-Variable Should be Predicted When r = 0? 7 The Regression
More informationHow Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis?
How Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis? Richards J. Heuer, Jr. Version 1.2, October 16, 2005 This document is from a collection of works by Richards J. Heuer, Jr.
More informationCHAPTER TWO REGRESSION
CHAPTER TWO REGRESSION 2.0 Introduction The second chapter, Regression analysis is an extension of correlation. The aim of the discussion of exercises is to enhance students capability to assess the effect
More informationIAPT: Regression. Regression analyses
Regression analyses IAPT: Regression Regression is the rather strange name given to a set of methods for predicting one variable from another. The data shown in Table 1 and come from a student project
More informationErrors and Corrections. to Behavioral Risk Management. by Hersh Shefrin
Errors and Corrections to Behavioral Risk Management by Hersh Shefrin This file contains corrections and edits to Behavioral Risk Management which were identified after the book went to press. Corrections
More informationWeek 8 Hour 1: More on polynomial fits. The AIC. Hour 2: Dummy Variables what are they? An NHL Example. Hour 3: Interactions. The stepwise method.
Week 8 Hour 1: More on polynomial fits. The AIC Hour 2: Dummy Variables what are they? An NHL Example Hour 3: Interactions. The stepwise method. Stat 302 Notes. Week 8, Hour 1, Page 1 / 34 Human growth
More informationIngredients of Difficult Conversations
Ingredients of Difficult Conversations Differing Perceptions In most difficult conversations, there are different perceptions of the same reality. I think I'm right and the person with whom I disagree
More informationSection 3.2 Least-Squares Regression
Section 3.2 Least-Squares Regression Linear relationships between two quantitative variables are pretty common and easy to understand. Correlation measures the direction and strength of these relationships.
More informationOverview of the Logic and Language of Psychology Research
CHAPTER W1 Overview of the Logic and Language of Psychology Research Chapter Outline The Traditionally Ideal Research Approach Equivalence of Participants in Experimental and Control Groups Equivalence
More informationChapter 3: Examining Relationships
Name Date Per Key Vocabulary: response variable explanatory variable independent variable dependent variable scatterplot positive association negative association linear correlation r-value regression
More informationProvided for non-commercial research and educational use only. Not for reproduction, distribution or commercial use.
Provided for non-commercial research and educational use only. Not for reproduction, distribution or commercial use. This chapter was originally published in the book Handbook of Experimental Economics
More informationAddendum: Multiple Regression Analysis (DRAFT 8/2/07)
Addendum: Multiple Regression Analysis (DRAFT 8/2/07) When conducting a rapid ethnographic assessment, program staff may: Want to assess the relative degree to which a number of possible predictive variables
More informationChapter 12. The One- Sample
Chapter 12 The One- Sample z-test Objective We are going to learn to make decisions about a population parameter based on sample information. Lesson 12.1. Testing a Two- Tailed Hypothesis Example 1: Let's
More informationd =.20 which means females earn 2/10 a standard deviation more than males
Sampling Using Cohen s (1992) Two Tables (1) Effect Sizes, d and r d the mean difference between two groups divided by the standard deviation for the data Mean Cohen s d 1 Mean2 Pooled SD r Pearson correlation
More informationChapter 1 Introduction to I/O Psychology
Chapter 1 Introduction to I/O Psychology 1. I/O Psychology is a branch of psychology that in the workplace. a. treats psychological disorders b. applies the principles of psychology c. provides therapy
More informationBottom-Up Model of Strategy Selection
Bottom-Up Model of Strategy Selection Tomasz Smoleń (tsmolen@apple.phils.uj.edu.pl) Jagiellonian University, al. Mickiewicza 3 31-120 Krakow, Poland Szymon Wichary (swichary@swps.edu.pl) Warsaw School
More informationAttitude Measurement
Business Research Methods 9e Zikmund Babin Carr Griffin Attitude Measurement 14 Chapter 14 Attitude Measurement 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or
More informationFrom Causal Models to Sound Heuristic Inference
From Causal Models to Sound Heuristic Inference Ana Sofia Morais (morais@mpib-berlin.mpg.de) 1 Lael J. Schooler (schooler@mpib-berlin.mpg.de) 1 Henrik Olsson (h.olsson@warwick.ac.uk) 2 Björn Meder (meder@mpib-berlin.mpg.de)
More informationHow Different Choice Strategies Can Affect the Risk Elicitation Process
IAENG International Journal of Computer Science, 32:4, IJCS_32_4_13 How Different Choice Strategies Can Affect the Risk Elicitation Process Ari Riabacke, Mona Påhlman, Aron Larsson Abstract This paper
More informationCritical Thinking Assessment at MCC. How are we doing?
Critical Thinking Assessment at MCC How are we doing? Prepared by Maura McCool, M.S. Office of Research, Evaluation and Assessment Metropolitan Community Colleges Fall 2003 1 General Education Assessment
More informationI. Introduction and Data Collection B. Sampling. 1. Bias. In this section Bias Random Sampling Sampling Error
I. Introduction and Data Collection B. Sampling In this section Bias Random Sampling Sampling Error 1. Bias Bias a prejudice in one direction (this occurs when the sample is selected in such a way that
More informationArtificial Neural Networks and Near Infrared Spectroscopy - A case study on protein content in whole wheat grain
A White Paper from FOSS Artificial Neural Networks and Near Infrared Spectroscopy - A case study on protein content in whole wheat grain By Lars Nørgaard*, Martin Lagerholm and Mark Westerhaus, FOSS *corresponding
More informationabout Eat Stop Eat is that there is the equivalent of two days a week where you don t have to worry about what you eat.
Brad Pilon 1 2 3 ! For many people, the best thing about Eat Stop Eat is that there is the equivalent of two days a week where you don t have to worry about what you eat.! However, this still means there
More informationStatisticians deal with groups of numbers. They often find it helpful to use
Chapter 4 Finding Your Center In This Chapter Working within your means Meeting conditions The median is the message Getting into the mode Statisticians deal with groups of numbers. They often find it
More informationTable S1: Perceived Devaluation Discrimination Scale: Item Wording, Frequency Distributions, Item and Scale Statistics 1. Strongly Agree (3) % (N) (7)
Table S1: Perceived Devaluation Discrimination Scale: Wording, Frequency Distributions, and Scale Statistics 1 Scale: Perceived Devaluation Discrimination Scale Mean 1.4, Scale Deviation., 4 Alpha.7 Mean
More informationChapter 14: More Powerful Statistical Methods
Chapter 14: More Powerful Statistical Methods Most questions will be on correlation and regression analysis, but I would like you to know just basically what cluster analysis, factor analysis, and conjoint
More informationUse the above variables and any you might need to construct to specify the MODEL A/C comparisons you would use to ask the following questions.
Fall, 2002 Grad Stats Final Exam There are four questions on this exam, A through D, and each question has multiple sub-questions. Unless otherwise indicated, each sub-question is worth 3 points. Question
More informationJournal of Political Economy, Vol. 93, No. 2 (Apr., 1985)
Confirmations and Contradictions Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Estimates of the Deterrent Effect of Capital Punishment: The Importance of the Researcher's Prior Beliefs Walter
More informationGoodness of Pattern and Pattern Uncertainty 1
J'OURNAL OF VERBAL LEARNING AND VERBAL BEHAVIOR 2, 446-452 (1963) Goodness of Pattern and Pattern Uncertainty 1 A visual configuration, or pattern, has qualities over and above those which can be specified
More informationLesson 11 Correlations
Lesson 11 Correlations Lesson Objectives All students will define key terms and explain the difference between correlations and experiments. All students should be able to analyse scattergrams using knowledge
More information