Standing Between a Bayesian and a Frequentist: An Emperical Bayes Exploration of Movies, Baseball, and Williams College.

Size: px
Start display at page:

Download "Standing Between a Bayesian and a Frequentist: An Emperical Bayes Exploration of Movies, Baseball, and Williams College."

Transcription

1 Standing Between a Bayesian and a Frequentist: An Emperical Bayes Exploration of Movies, Baseball, and Williams College Arthur Berg Pennsylvania State University

2 Bayesian and Frequentist Representatives Rev. Thomas Bayes FRS ( ) English Mathematician Presbyterian Minister Sir Ronald Fisher FRS ( ) English Statistician Evolutionary Biologist, Geneticist P (H E) = P (E H)P (H) P (E) Let the data speak for itself. Arthur Berg Standing Between a Bayesian and a Frequentist 2 / 27

3 Bayes Estimator as a Convex Combination 1 st Goal: List the top 250 movies of all time. Movies are rated on a scale of 1 to 10. Some movies are rated by many people, and some by only a few. Movies with fewer than 3000 votes are not considered. All movies have an average rating of C = 6.9. µ i represents the mean rating by everyone who has seen movie i. The real goal is to construct the best estimate of µ i, then pick the top 250. The frequentist approach uses only X i, the average rating for movie i. = X i ˆµ (Fisher) i The Bayesian approach shrinks X i towards C with more shrinking applied when the number of votes for movie i is small. ˆµ (Bayes) i = α i Xi + (1 α i )C where α i (0, 1) Arthur Berg Standing Between a Bayesian and a Frequentist 3 / 27

4 Internet Movie Database Top 250 Rank WR R Title Votes The Shawshank Redemption (1994) 546, The Godfather (1972) 427, The Godfather: Part II (1974) 257, The Good, the Bad and the Ugly (1966) 170, Pulp Fiction (1994) 436, Inception (2010) 265, Schindler s List (1993) 289, Angry Men (1957) 126, One Flew Over the Cuckoo s Nest (1975) 225, The Dark Knight (2008) 487, Black Swan (2010) 20, Avatar (2009) 285, True Grit (2010) 6,444 Arthur Berg Standing Between a Bayesian and a Frequentist 4 / 27

5 IMDb Weighted Ranking a true Bayesian estimate WR i = v ir i + mc v i + m = v i v i + m α i R i = average rating of the movie i ( X i ) R i + Xi v i = total number of votes from regular voters m v i + m 1 α i m = minimum # of votes to make the list = 3000 C = grand mean across all movies in the database = 6.9 C Arthur Berg Standing Between a Bayesian and a Frequentist 5 / 27

6 A Bayesian Calculation X i = (X i,1,..., X i,vi ) represents the v i ratings of movie i. prior: µ i N (µ 0, σ 2 0 ) conditional: X i,j µ i iid N (µi, σ 2 ) (j = 1,..., v i ) ˆµ (Bayes) i = E[µ i X i ] v i = ( v i + σ 2 /σ0 2 ) X i + ( σ2 /σ0 2 v i + σ 2 /σ0 2 ) µ 0 v i = v i + m R m i + v i + m C µ 0 = C, m = σ 2 /σ0 2 Arthur Berg Standing Between a Bayesian and a Frequentist 6 / 27

7 1 Does 2 How shrinking really help? much to shrink by? Prediction Error = n i=1 (µ i ˆµ i ) 2

8 Standing Between a Bayesian and a Frequentist In 1956, Charles Stein proved the existence of an estimator better than the sample mean under certain assumptions. In 1961, Willard James and Charles Stein explicitly constructed such an estimator. Arthur Berg Standing Between a Bayesian and a Frequentist 8 / 27

9 The James-Stein Estimator (n 4) µ i N (µ 0, σ 2 0) X i µ i iid N (µi, σ 2 ) (i = 1,... n) σ 2 ˆµ (Bayes) i = E [µ i X i ] = ( σ0 2 + σ2 α )µ 0 + ( σ0 2 σ0 2 + )X i σ2 1 α (n ˆµ (JS) 3)σ2 i = ( (X i X) 2 α ) X + ( 1 In practice, if σ 2 is unknown, an estimate is used. (n 3)σ2 (X i X) 2 )X i 1 α Arthur Berg Standing Between a Bayesian and a Frequentist 9 / 27

10 Predicting Batting Averages 2 nd Goal: Predict final batting averages from pre-season performances. Pre-season batting averages for 18 major league players are provided. Season final batting averages for the same players are also recorded. Data is from the 1970 season and is published in JASA (1975) and Scientific American (1977) by Efron and Morris. The frequentist approach uses only X i, the pre-season batting average for player i. = X i ˆp (Fisher) i The Emperical Bayes approach shrinks X i towards X by some empirically determined amount. ˆp (Stein) i = ˆαX i + (1 ˆα) X where ˆα (0, 1) Arthur Berg Standing Between a Bayesian and a Frequentist 10 / 27

11 Name hits/ab pre-season (ˆµ (ML) ) season final (µ) 1 Clemente 18/ Robinson 17/ Howard 16/ Johnstone 15/ Berry 14/ Spencer 14/ Kessinger 13/ Alvarado 12/ Santo 11/ Swoboda 11/ Unser 10/ Williams 10/ Scott 10/ Petrocelli 10/ Rodriguez 10/ Campaneris 9/ Munson 8/ Alvis 7/ Arthur Berg Standing Between a Bayesian and a Frequentist 11 / 27

12 Batting Average Dataset 1977 Batting Averages Dataset (Efron) Batting Average pre season season final Arthur Berg Standing Between a Bayesian and a Frequentist 12 / 27

13 James-Stein Estimation of Batting Averages 1977 Batting Averages Dataset (Efron) Batting Average pre season season final Arthur Berg Standing Between a Bayesian and a Frequentist 13 / 27

14 Ranking Bias Emperical Bayes + Order Statistics 1977 Batting Averages Dataset (Efron) Genome-wide association studies SNPS: AA/Aa/aa or 0/1/2 ( 10 7 ) Batting Average pre season season final ranking bias estimator part frequentist, part Bayesian with robust properties Estimated effects of the top SNPs are biased up. (winner s curse) Applied to 2 GWAS studies with 2,000 cases and 3,000 controls Crohn s Disease Type 1 Diabetes Arthur Berg Standing Between a Bayesian and a Frequentist 14 / 27

15 Williams College Book Survey In the summer of 2009, Williams faculty members were asked to list three books they felt that students should read. 150 faculty members responded. 25 departments are represented. 394 different books were recommended. The original publication dates were added (wikipedia/openlibrary.org). Books with unknown publication dates (13 in total) were approximated. Arthur Berg Standing Between a Bayesian and a Frequentist 15 / 27

16 The Top Picks Most Picked Authors (4+ hits) Fyodor Dostoyevsky (6) The Brothers Karamazov (4) Crime and Punishment (1) Notes from the Underground (1) Gabriel García Márquez (5) One Hundred Years of Solitude (5) Leo Tolstoy (5) Anna Karenina (4) War and Peace (1) Bill Bryson (4) A Short History of Nearly Everything (3) In a Sunburned Country (1) George Eliot (4) Middlemarch (4) Henry David Thoreau (4) Walden (4) Vladimir Nabokov (4) Speak, Memory (3) Lolita (1) Most Picked Titles (3+ hits) One Hundred Years of Solitude (5) Anna Karenina (4) Middlemarch (4) The Brothers Karamazov (4) Walden (4) Independent People (3) Speak, Memory (3) The Death and Life of Great American Cities (3) The Things They Carried (3) Arthur Berg Standing Between a Bayesian and a Frequentist 16 / 27

17 Average Publication Year Predictions Let µ i represent average publication year for department i. Let X i be the average publication year for department i based on only the first book selected. 3 rd Goal: Estimate µ i with only X i. Arthur Berg Standing Between a Bayesian and a Frequentist 17 / 27

18 Observed Data: First Book (Red), Truth : All Books (Gray) Classics Asian Stud Anth & Soc Religion Humanities Political Sci Philosophy Geosciences Music Math & Stat English Art Astronomy Comp Sci Psychology History Theater Ger & Rus Biology Economics Amer Stud Physics Comp Lit Chemistry Rom. Lang Arthur Berg Standing Between a Bayesian and a Frequentist 18 / 27

19 Results µ i N (µ 0, σ 2 0) X i µ i iid N (µi, σ 2 i ) (i = 1,... 25) Set 1 σ i 2 = n (X i X) 2 n i where n i = the number of observed books in department i. 1 ˆµ (1) i 2 ˆµ (2) i 3 ˆµ (3) i = X i = ˆα i X i + (1 ˆα i ) X = ˆα i X i + (1 ˆα i ) X where X denotes the median of X s. Prediction Error = 25 (ˆµ (j) i=1 i µ i ) 2 pe 2 pe 1 =.583 pe 3 pe 1 =.543 Arthur Berg Standing Between a Bayesian and a Frequentist 19 / 27

20 James-Stein Shrinkage Toward the Median Unequal Variances Case Classics Asian Stud Anth & Soc Religion Humanities Political Sci Philosophy Geosciences Music Math & Stat English Art Astronomy Comp Sci Psychology History Theater Ger & Rus Biology Economics Amer Stud Physics Comp Lit Chemistry Rom. Lang Arthur Berg Standing Between a Bayesian and a Frequentist 20 / 27

21 4 th Goal: Investigate how the departments cluster based on the book survey. Departments are classified in the following groups Natural Sciences: Astronomy, Biology, Chemistry, Geosciences, Physics Social Sciences: American Studies, Anthropology & Sociology, Asian Studies, Economics, History, Political Science, Psychology Formal Sciences: Computer Science, Mathematics & Statistics Humanities: Art, Classics, Comparative Literature, English, German & Russian, Humanities, Music, Philosophy, Religion, Romance Languages, Theater Arthur Berg Standing Between a Bayesian and a Frequentist 21 / 27

22 Departments Ranked by Publication Year Philosophy Anth & Soc Classics Asian Stud Political Sci Religion Math & Stat Humanities Astronomy Geosciences English Economics Comp Sci Ger & Rus Music Art Amer Stud History Psychology Comp Lit Theater Rom. Lang Physics Biology Chemistry Arthur Berg Standing Between a Bayesian and a Frequentist 22 / 27

23 Distance Measures Author/Title Data: Jaccard distance=1 A B A B = A B A B A B Year data: absolute value of the two sample t-statistic (non-metric distance measure) Homework Prove the Jaccard distance is a proper metric. Arthur Berg Standing Between a Bayesian and a Frequentist 23 / 27

24 Dendrogram of the Year Distances (Philosophy Removed) Philosophy Anth & Soc Classics Asian Stud Political Sci Religion Math & Stat Humanities Astronomy Geosciences English Economics Comp Sci Ger & Rus Music Art Amer Stud History Psychology Comp Lit Theater Rom. Lang Physics Biology Chemistry Chemistry Anth & Soc Math & Stat Religion Political Sci Asian Stud Classics Economics English Humanities Astronomy Geosciences Art Music Comp Sci Ger & Rus Psychology Amer Stud History Biology Physics Comp Lit Rom. Lang Theater Arthur Berg Standing Between a Bayesian and a Frequentist 24 / 27

25 Multidimensional Scaling of Author Distances Anth & Soc Chemistry Biology Political Sci Classics Theater Rom. Lang AstronomyMath & Stat Asian Stud Religion Comp Lit Ger & Rus Art Amer Stud Comp Sci Humanities History Economics English Physics PsychologyMusic Geosciences Philosophy Arthur Berg Standing Between a Bayesian and a Frequentist 25 / 27

26 Summary There are often multiple statistical approaches to a single problem. The complete statistician makes use of all available tools. When reporting the mean values of several related quantities, think about shrinkage! Arthur Berg Standing Between a Bayesian and a Frequentist 26 / 27

27 Thank You!! Williams.ArthurBerg.com Arthur Berg Standing Between a Bayesian and a Frequentist 27 / 27

ST440/550: Applied Bayesian Statistics. (10) Frequentist Properties of Bayesian Methods

ST440/550: Applied Bayesian Statistics. (10) Frequentist Properties of Bayesian Methods (10) Frequentist Properties of Bayesian Methods Calibrated Bayes So far we have discussed Bayesian methods as being separate from the frequentist approach However, in many cases methods with frequentist

More information

Bayesian and Frequentist Approaches

Bayesian and Frequentist Approaches Bayesian and Frequentist Approaches G. Jogesh Babu Penn State University http://sites.stat.psu.edu/ babu http://astrostatistics.psu.edu All models are wrong But some are useful George E. P. Box (son-in-law

More information

Bayesian performance

Bayesian performance Bayesian performance In this section we will study the statistical properties of Bayesian estimates. Major topics include: The likelihood principle Decision theory/bayes rules Shrinkage estimators Frequentist

More information

Treatment effect estimates adjusted for small-study effects via a limit meta-analysis

Treatment effect estimates adjusted for small-study effects via a limit meta-analysis Treatment effect estimates adjusted for small-study effects via a limit meta-analysis Gerta Rücker 1, James Carpenter 12, Guido Schwarzer 1 1 Institute of Medical Biometry and Medical Informatics, University

More information

Bayesian hierarchical modelling

Bayesian hierarchical modelling Bayesian hierarchical modelling Matthew Schofield Department of Mathematics and Statistics, University of Otago Bayesian hierarchical modelling Slide 1 What is a statistical model? A statistical model:

More information

Title: Campus-Declared and Proposed Majors-Term Tab: Purpose Version 3.0

Title: Campus-Declared and Proposed Majors-Term Tab: Purpose Version 3.0 Title: Campus--Term Tab: Purpose UC Santa Cruz Undergraduate Headcount 2005 Fall Quarter Run Date: 6/2/10 DIVISION NAME DEPARTMENT NAME NAME PERCENT OF TOTAL Arts Division Art Art 205.5 1.51 % Pre-Art

More information

Quantitative Biology Lecture 1 (Introduction + Probability)

Quantitative Biology Lecture 1 (Introduction + Probability) 21 st Sep 2015 Quantitative Biology Lecture 1 (Introduction + Probability) Gurinder Singh Mickey Atwal Center for Quantitative Biology Why Quantitative Biology? (1. Models) Galileo Galilei The Book of

More information

Regents Approved Programs with CIPs and Award Levels Academic Year Lawrence Campus Fall 2016

Regents Approved Programs with CIPs and Award Levels Academic Year Lawrence Campus Fall 2016 Page 1 Accounting School of Business 52.0301 B MACC Adaptive High Incidence Disabilities School of Education 13.1011 CERT Aerospace Engineering School of Engineering 14.0201 ME MS DE African and African-American

More information

Response to the ASA s statement on p-values: context, process, and purpose

Response to the ASA s statement on p-values: context, process, and purpose Response to the ASA s statement on p-values: context, process, purpose Edward L. Ionides Alexer Giessing Yaacov Ritov Scott E. Page Departments of Complex Systems, Political Science Economics, University

More information

EDUCATION - ASSOCIATE DEGREE

EDUCATION - ASSOCIATE DEGREE Education - Associate Degree EDUCATION - ASSOCIATE DEGREE Specific degree requirements for each of the individual Areas of Study can be found below. Area of Study: Elementary Education (60 credits) AREA

More information

Famous Monsters (in Statistics) Erum Marfani Frederick Community College Frederick, MD

Famous Monsters (in Statistics) Erum Marfani Frederick Community College Frederick, MD Famous Monsters (in Statistics) Erum Marfani Frederick Community College Frederick, MD emarfani@frederick.edu The Lady Tasting Tea: How Statistics Revolutionized Science in the 20 th Century by David Salsburg

More information

STA Module 1 The Nature of Statistics. Rev.F07 1

STA Module 1 The Nature of Statistics. Rev.F07 1 STA 2023 Module 1 The Nature of Statistics Rev.F07 1 Learning Objectives 1. Classify a statistical study as either descriptive or inferential. 2. Identify the population and the sample in an inferential

More information

STA Rev. F Module 1 The Nature of Statistics. Learning Objectives. Learning Objectives (cont.

STA Rev. F Module 1 The Nature of Statistics. Learning Objectives. Learning Objectives (cont. STA 2023 Module 1 The Nature of Statistics Rev.F07 1 Learning Objectives 1. Classify a statistical study as either descriptive or inferential. 2. Identify the population and the sample in an inferential

More information

STA Module 1 Introduction to Statistics and Data

STA Module 1 Introduction to Statistics and Data STA 2023 Module 1 Introduction to Statistics and Data 1 Learning Objectives Upon completing this module, you should be able to: 1. Classify a statistical study as either descriptive or inferential. 2.

More information

Bayesian Inference. Review. Breast Cancer Screening. Breast Cancer Screening. Breast Cancer Screening

Bayesian Inference. Review. Breast Cancer Screening. Breast Cancer Screening. Breast Cancer Screening STAT 101 Dr. Kari Lock Morgan Review What is the deinition of the p- value? a) P(statistic as extreme as that observed if H 0 is true) b) P(H 0 is true if statistic as extreme as that observed) SETION

More information

An Introduction to Bayesian Statistics

An Introduction to Bayesian Statistics An Introduction to Bayesian Statistics Robert Weiss Department of Biostatistics UCLA Fielding School of Public Health robweiss@ucla.edu Sept 2015 Robert Weiss (UCLA) An Introduction to Bayesian Statistics

More information

Summer 2016 Examinations Timetable. Pm exams start 13:30 + Period Day / Date Period 1 Period 2 Period 3 Period 4.

Summer 2016 Examinations Timetable. Pm exams start 13:30 + Period Day / Date Period 1 Period 2 Period 3 Period 4. 02/05/16 03/05/16 English as First Language reading - 1hr 45m (12) 04/05/16 05/05/16 06/05/16 English as First Language writing 2 hours (12) 09/05/16 10/05/16 11/05/16 12/05/16 13/05/16 Welsh as Second

More information

EXERCISE SCIENCE BA/BS

EXERCISE SCIENCE BA/BS Exercise Science BA/BS 1 EXERCISE SCIENCE BA/BS A major in Exercise Science prepares students to integrate principles from the physical sciences, kinesiology, and health into the study of the science of

More information

Pilot Program-to-Program Articulation Project Psychology July 1 Interim Report

Pilot Program-to-Program Articulation Project Psychology July 1 Interim Report Pilot Program-to-Program Articulation Project Psychology July 1 Interim Report Submitted: June 30, 2010 The committee has maintained an active online dialogue about the fundamental areas within and outside

More information

School Curriculum and Standards Authority

School Curriculum and Standards Authority Accounting and Finance Stage 2-74 42 12 57 9 43 21-50 Accounting and Finance Stage 3-1366 1181 596 48 635 52 1231 4.2 Ancient History Stage 2-4 10 2 40 3 60 5-50 Ancient History Stage 3-200 212 92 60 62

More information

SUMMER 2018 EXTERNAL EXAMINATION TIMETABLE

SUMMER 2018 EXTERNAL EXAMINATION TIMETABLE SUMMER 2018 EXTERNAL EXAMINATION TIMETABLE Date Start Length Board Level Component Component Title Cands Monday 14 May 9.30 am 1h 00m EDEXCEL BTEC L2 20544 Health & Social Care: Human Lifespan Dev 2 9.30

More information

Number. Aesthetics and Culture ,

Number. Aesthetics and Culture , The given marks and the averages of Master Thesis for the period 01.10.2015-30.09.2016 Side 1 af 7 Arts of marks Average mark quantile Median quantile quantile quantile mark Anthropology 0 0 3 4 10 25

More information

Means and Populations of scaled scores

Means and Populations of scaled scores 2015 Scaling Population ACF2 Accounting and Finance stage 2AB 5 52.8 5 38.4 6 32.0 ACF3 Accounting and Finance stage 3AB 1305 58.9 6.1 1305 59.1 20.7 1336 58.9 26.9 ACF Accounting and Finance 1310 58.9

More information

Biomedical Machine Learning

Biomedical Machine Learning Marco F. Ramoni, PhD Children s Hospital Informatics Program Harvard Medical School Dental Informatics and Dental Research Making The Connection NIH, Bethesda, MD June 12-13, 2003 Machine Learning Artificial

More information

Doing Thousands of Hypothesis Tests at the Same Time. Bradley Efron Stanford University

Doing Thousands of Hypothesis Tests at the Same Time. Bradley Efron Stanford University Doing Thousands of Hypothesis Tests at the Same Time Bradley Efron Stanford University 1 Simultaneous Hypothesis Testing 1980: Simultaneous Statistical Inference (Rupert Miller) 2, 3,, 20 simultaneous

More information

Computer Age Statistical Inference. Algorithms, Evidence, and Data Science. BRADLEY EFRON Stanford University, California

Computer Age Statistical Inference. Algorithms, Evidence, and Data Science. BRADLEY EFRON Stanford University, California Computer Age Statistical Inference Algorithms, Evidence, and Data Science BRADLEY EFRON Stanford University, California TREVOR HASTIE Stanford University, California ggf CAMBRIDGE UNIVERSITY PRESS Preface

More information

MS&E 226: Small Data

MS&E 226: Small Data MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector

More information

UNLOCKING VALUE WITH DATA SCIENCE BAYES APPROACH: MAKING DATA WORK HARDER

UNLOCKING VALUE WITH DATA SCIENCE BAYES APPROACH: MAKING DATA WORK HARDER UNLOCKING VALUE WITH DATA SCIENCE BAYES APPROACH: MAKING DATA WORK HARDER 2016 DELIVERING VALUE WITH DATA SCIENCE BAYES APPROACH - MAKING DATA WORK HARDER The Ipsos MORI Data Science team increasingly

More information

Open Classes 1/24/19

Open Classes 1/24/19 5735 1 Wellness 3: Sport Training 0 S2 1008 1 English III 1 YR 1011 1 Language & Literature I 1 YR 1011 4 Language & Literature I 1 YR 1016 1 Language & Literature II 1 YR 1018 1 Language & Literature

More information

EARLY START PROGRAM. Gen Ed Focus Subj Num Title Credits

EARLY START PROGRAM. Gen Ed Focus Subj Num Title Credits American Studies (AMST) FGB AMST 150 America and the World 3 crs ONLINE DS WI AMST 212 Contemp Amer Global Issues 3 crs DH HAP, WI AMST 220 Intro to Indigenous Studies 3 crs ONLINE Anthropology (ANTH)

More information

Statistical Hocus Pocus? Assessing the Accuracy of a Diagnostic Screening Test When You Don t Even Know Who Has the Disease

Statistical Hocus Pocus? Assessing the Accuracy of a Diagnostic Screening Test When You Don t Even Know Who Has the Disease Statistical Hocus Pocus? Assessing the Accuracy of a Diagnostic Screening Test When You Don t Even Know Who Has the Disease Michelle Norris Dept. of Mathematics and Statistics California State University,

More information

1. Organising information. 2. Mind Mapping for planning. 3. Mind Mapping for revision. 4. Role on the wall. 5. Acronyms

1. Organising information. 2. Mind Mapping for planning. 3. Mind Mapping for revision. 4. Role on the wall. 5. Acronyms 1. Organising information 2. Mind Mapping for planning 3. Mind Mapping for revision 4. Role on the wall 5. Acronyms Sometimes we need to restructure our work to make it easier to remember. If we group

More information

Scientific evaluation of Charles Dickens

Scientific evaluation of Charles Dickens Scientific evaluation of Charles Dickens Mikhail Simkin Department of Electrical Engineering, University of California, Los Angeles, CA 90095-1594 email: simkin@ee.ucla.edu cell phone: 415-407-6542 About

More information

Section Introduction

Section Introduction Section 1.1 - Introduction Raw Data is data before it has been arranged in a useful manner or analyzed using statistical techniques. Statistics involves the procedures associated with the data collection

More information

STUDY ABROAD ADVISING GUIDE University of Glasgow

STUDY ABROAD ADVISING GUIDE University of Glasgow STUDY ABROAD ADVISING GUIDE University of Glasgow The list of courses below is meant to be used as a guide. These courses represent the courses Gonzaga students have taken past semesters. Some of these

More information

Measurement and meaningfulness in Decision Modeling

Measurement and meaningfulness in Decision Modeling Measurement and meaningfulness in Decision Modeling Brice Mayag University Paris Dauphine LAMSADE FRANCE Chapter 2 Brice Mayag (LAMSADE) Measurement theory and meaningfulness Chapter 2 1 / 47 Outline 1

More information

statistics Collecting Data

statistics Collecting Data Date: statistics Collecting Data Objective: Categorize data as qualitative or quantitative. (AS1) Determine whether the data to be analyzed is univariate or bivariate. (AS2) Determine when collected data

More information

Statistics. Dr. Carmen Bruni. October 12th, Centre for Education in Mathematics and Computing University of Waterloo

Statistics. Dr. Carmen Bruni. October 12th, Centre for Education in Mathematics and Computing University of Waterloo Statistics Dr. Carmen Bruni Centre for Education in Mathematics and Computing University of Waterloo http://cemc.uwaterloo.ca October 12th, 2016 Quote There are three types of lies: Quote Quote There are

More information

Unit Three: Behavior and Cognition. Marshall High School Mr. Cline Psychology Unit Three AE

Unit Three: Behavior and Cognition. Marshall High School Mr. Cline Psychology Unit Three AE Unit Three: Behavior and Cognition Marshall High School Mr. Cline Psychology Unit Three AE In 1994, two American scholars published a best-selling, controversial book called The Bell Curve. * Intelligence

More information

Name: Economics Fall Semester October 14, Test #1

Name: Economics Fall Semester October 14, Test #1 Name: Economics 300-01 Fall Semester 2009-10 October 14, 2009 Test #1 Each problem is weighted equally. Write your answers on the test; use an appropriate number of significant digits for each answer;

More information

Lec 02: Estimation & Hypothesis Testing in Animal Ecology

Lec 02: Estimation & Hypothesis Testing in Animal Ecology Lec 02: Estimation & Hypothesis Testing in Animal Ecology Parameter Estimation from Samples Samples We typically observe systems incompletely, i.e., we sample according to a designed protocol. We then

More information

Bayesian graphical models for combining multiple data sources, with applications in environmental epidemiology

Bayesian graphical models for combining multiple data sources, with applications in environmental epidemiology Bayesian graphical models for combining multiple data sources, with applications in environmental epidemiology Sylvia Richardson 1 sylvia.richardson@imperial.co.uk Joint work with: Alexina Mason 1, Lawrence

More information

UPG-WCCC Transfer Guide

UPG-WCCC Transfer Guide WCCC Course WCCC Title UPG Course Desig. Credits ACC 155 Accounting I MGMT 0022 N/A 3 ACC 156 Accounting II MGMT NE N/A 3 ACC 165 Accounting for Managers MGMT NE N/A 3 *ACC 216 or 219 Cost or Managerial

More information

Statistical Decision Theory and Bayesian Analysis

Statistical Decision Theory and Bayesian Analysis Statistical Decision Theory and Bayesian Analysis Chapter 3: Prior Information and Subjective Probability Lili MOU moull12@sei.pku.edu.cn http://sei.pku.edu.cn/ moull12 11 MayApril 2015 Reference 3, James

More information

Semester at Sea -- Spring 2018 USD Course Equivalents

Semester at Sea -- Spring 2018 USD Course Equivalents Semester at Sea -- Spring 2018 USD Course Equivalents Courses designated as under review have been submitted to the appropriate USD Department Chair and are awaiting final evaluation. Courses listed on

More information

Welcome to LANEY s Extended Donor Profile

Welcome to LANEY s Extended Donor Profile Welcome to LANEY s Extended Donor Profile LANEY voluntarily provided the following information which will be disclosed to future parents as an aid in their selection General Information and characteristics

More information

Diagnostic Medical Sonography (DMS)

Diagnostic Medical Sonography (DMS) Diagnostic Medical Sonography 148 The College for Real Careers Diagnostic Medical Sonography (DMS) Program Information This program of study is designed to provide academic and clinical training in the

More information

BLACKLISTED JOURNALS BY MALAYSIA MINISTRY OF EDUCATION (MOE)

BLACKLISTED JOURNALS BY MALAYSIA MINISTRY OF EDUCATION (MOE) BLACKLISTED JOURNALS BY MALAYSIA MINISTRY OF EDUCATION (MOE) 1 African Journal of Agricultural Research Academic Journals 2009 to 2011 2009 to 2010 2 African Journal of Biochemistry Research Academic Journals

More information

GE SLO: Ethnic-Multicultural Studies Results

GE SLO: Ethnic-Multicultural Studies Results GE SLO: Ethnic-Multicultural Studies Results Background: This study was designed to assess the following College s Ethnic/Multicultural Studies General Education SLO. Upon completion of this GE requirement

More information

Data harmonization tutorial:teaser for FH2019

Data harmonization tutorial:teaser for FH2019 Data harmonization tutorial:teaser for FH2019 Alden Gross, Johns Hopkins Rich Jones, Brown University Friday Harbor Tahoe 22 Aug. 2018 1 / 50 Outline Outline What is harmonization? Approach Prestatistical

More information

A point estimate is a single value that has been calculated from sample data to estimate the unknown population parameter. s Sample Standard Deviation

A point estimate is a single value that has been calculated from sample data to estimate the unknown population parameter. s Sample Standard Deviation 7.1 Margins of Error and Estimates What is estimation? A point estimate is a single value that has been calculated from sample data to estimate the unknown population parameter. Population Parameter Sample

More information

Understanding Statistics for Research Staff!

Understanding Statistics for Research Staff! Statistics for Dummies? Understanding Statistics for Research Staff! Those of us who DO the research, but not the statistics. Rachel Enriquez, RN PhD Epidemiologist Why do we do Clinical Research? Epidemiology

More information

PACE Course Offering Sequence:

PACE Course Offering Sequence: 1 PACE Course Offering Sequence: PACE COURSE OFFERINGS and DEFINITIONS: Fall 18- first two courses: In Sequence 1 st 8 Weeks 1. COUNSEL 20: Post-Secondary Education: the Scope of Career Planning 3 units,

More information

SJSU Spartan First Destination Survey: Career Outcomes Graduates

SJSU Spartan First Destination Survey: Career Outcomes Graduates SAN JOSE STATE UNIVERSITY Still Looking Not Looking Campus Qty. % Qty. % Qty. % Qty. % Qty. % Qty. % Qty. Qty. College of Applied Sciences and Arts 396 65% 25 4% 2 0% 10 2% 168 28% 4 1% 605 1,443 College

More information

A Brief Introduction to Bayesian Statistics

A Brief Introduction to Bayesian Statistics A Brief Introduction to Statistics David Kaplan Department of Educational Psychology Methods for Social Policy Research and, Washington, DC 2017 1 / 37 The Reverend Thomas Bayes, 1701 1761 2 / 37 Pierre-Simon

More information

PACE Orientation: COURSE OFFERINGS

PACE Orientation: COURSE OFFERINGS 1 PACE Orientation: PACE COURSE OFFERINGS and DEFINITIONS: The program divides a 16-week semester into two 8 week sessions. Classes meet Tuesdays or Wednesdays and every other Saturday. Fall Foundational

More information

T-Statistic-based Up&Down Design for Dose-Finding Competes Favorably with Bayesian 4-parameter Logistic Design

T-Statistic-based Up&Down Design for Dose-Finding Competes Favorably with Bayesian 4-parameter Logistic Design T-Statistic-based Up&Down Design for Dose-Finding Competes Favorably with Bayesian 4-parameter Logistic Design James A. Bolognese, Cytel Nitin Patel, Cytel Yevgen Tymofyeyef, Merck Inna Perevozskaya, Wyeth

More information

A point estimate is a single value that has been calculated from sample data to estimate the unknown population parameter. s Sample Standard Deviation

A point estimate is a single value that has been calculated from sample data to estimate the unknown population parameter. s Sample Standard Deviation 7.1 Margins of Error and Estimates What is estimation? A point estimate is a single value that has been calculated from sample data to estimate the unknown population parameter. Population Parameter Sample

More information

Monday 13 May at 2.00 pm Edexcel Further Maths Core Pure 1

Monday 13 May at 2.00 pm Edexcel Further Maths Core Pure 1 EXAMS TIMETABLE 2019 Board Paper Description Monday 13 May at 9.30 am Collyers Chemistry Transfer Exam Collyers Economics Transfer Exam Collyers French Transfer Exam AQA Electronics Unit 1 (Legacy) OCR

More information

Monitoring of Open Access publishing in the Dutch academic system

Monitoring of Open Access publishing in the Dutch academic system Monitoring of Open Access publishing in the Dutch academic system Thed van Leeuwen CWTS, Leiden University DANS Workshop on OA Monitoring Den Haag, 23 rd May, 2018 Outline of the presentation Some background

More information

Comments on Limits of Econometrics by David Freedman. Arnold Zellner. University of Chicago

Comments on Limits of Econometrics by David Freedman. Arnold Zellner. University of Chicago Comments on Limits of Econometrics by David Freedman Arnold Zellner University of Chicago David Freedman s impressive paper reveals well his deep understanding of not only statistical techniques and their

More information

LSP 121. LSP 121 Math and Tech Literacy II. Topics. Binning. Stats & Probability. Stats Wrapup Intro to Probability

LSP 121. LSP 121 Math and Tech Literacy II. Topics. Binning. Stats & Probability. Stats Wrapup Intro to Probability Greg Brewster, DePaul University Page 1 LSP 121 Math and Tech Literacy II Stats Wrapup Intro to Greg Brewster DePaul University Statistics Wrapup Topics Binning Variables Statistics that Deceive Intro

More information

List of Acceptable College Courses for Arts & Science Transfer:

List of Acceptable College Courses for Arts & Science Transfer: courses of math, Algonquin DAT5758 Computer Foundations or DAT0066 Computer Foundations for Medicine, MAT0002 Math for Health Science, PHY0001 Physics for Health Sciences SCI5956 Chemistry, SSC0071 Creative

More information

Learning from data when all models are wrong

Learning from data when all models are wrong Learning from data when all models are wrong Peter Grünwald CWI / Leiden Menu Two Pictures 1. Introduction 2. Learning when Models are Seriously Wrong Joint work with John Langford, Tim van Erven, Steven

More information

2.4.1 STA-O Assessment 2

2.4.1 STA-O Assessment 2 2.4.1 STA-O Assessment 2 Work all the problems and determine the correct answers. When you have completed the assessment, open the Assessment 2 activity and input your responses into the online grading

More information

START & RUN A MARIJUANA DISPENSARY OR POT SHOP: WHEREVER IT IS LEGAL! (START & RUN A BUSINESS SERIES) BY JAY CURRIE

START & RUN A MARIJUANA DISPENSARY OR POT SHOP: WHEREVER IT IS LEGAL! (START & RUN A BUSINESS SERIES) BY JAY CURRIE START & RUN A MARIJUANA DISPENSARY OR POT SHOP: WHEREVER IT IS LEGAL! (START & RUN A BUSINESS SERIES) BY JAY CURRIE DOWNLOAD EBOOK : START & RUN A MARIJUANA DISPENSARY OR POT SHOP: SERIES) BY JAY CURRIE

More information

Reasoning with Uncertainty. Reasoning with Uncertainty. Bayes Rule. Often, we want to reason from observable information to unobservable information

Reasoning with Uncertainty. Reasoning with Uncertainty. Bayes Rule. Often, we want to reason from observable information to unobservable information Reasoning with Uncertainty Reasoning with Uncertainty Often, we want to reason from observable information to unobservable information We want to calculate how our prior beliefs change given new available

More information

"PRINCIPLES OF PHYLOGENETICS: ECOLOGY AND EVOLUTION"

PRINCIPLES OF PHYLOGENETICS: ECOLOGY AND EVOLUTION "PRINCIPLES OF PHYLOGENETICS: ECOLOGY AND EVOLUTION" Integrative Biology 200B University of California, Berkeley Lab for Jan 25, 2011, Introduction to Statistical Thinking A. Concepts: A way of making

More information

PS3021, PS3022, PS4040

PS3021, PS3022, PS4040 School of Psychology Important Degree Information: B.Sc./M.A. Honours The general requirements are 480 credits over a period of normally 4 years (and not more than 5 years) or part-time equivalent; the

More information

Granite State College Schedule (Undergraduate) by Campus

Granite State College Schedule (Undergraduate) by Campus 1 FALL WINTER ARTS 501 Introduction to Drawing CMT CRIT 501 Critical Inquiry CMT COMM 542 Interpersonal Communication & Group DynamCMT ENG 504 Introduction to Literature CMT CRIT 502 Connecting to Your

More information

Granite State College Schedule (Undergraduate) by Course

Granite State College Schedule (Undergraduate) by Course 1 FALL WINTER ACCT 550 Accounting Information Systems ACCT 601 Intermediate Accounting II ACCT 600 Intermediate Accounting I APST 505 Career Development & Life Planning (2 CR) ACCT 601 Intermediate Accounting

More information

Detox Juices And Smoothies: Get Healthy, Lose Weight And Feel Great By Sarah Green READ ONLINE

Detox Juices And Smoothies: Get Healthy, Lose Weight And Feel Great By Sarah Green READ ONLINE Detox Juices And Smoothies: Get Healthy, Lose Weight And Feel Great By Sarah Green READ ONLINE Buy The Brothers Karamazov (Penguin Classics) Rev Ed by Fyodor Dostoyevsky, David McDuff (ISBN: 8601404298967)

More information

Group 1. IB Language Choices. Studies in Language and Literature (mother tongue or near-native) Group 2. Language Acquisition

Group 1. IB Language Choices. Studies in Language and Literature (mother tongue or near-native) Group 2. Language Acquisition IB Language Choices Group 1 Studies in Language and Literature (mother tongue or near-native) Group 2 Language Acquisition IB Language Choices QUESTIONS Group 1: Lang A Which is your best academic language?

More information

Granite State College Schedule (Undergraduate) by Course

Granite State College Schedule (Undergraduate) by Course 1 FALL WINTER ACCT 550 Accounting Information Systems ACCT 601 Intermediate Accounting II ACCT 600 Intermediate Accounting I APST 505 Career Development & Life Planning (2 CR) ACCT 601 Intermediate Accounting

More information

Introduction to Bayesian Analysis 1

Introduction to Bayesian Analysis 1 Biostats VHM 801/802 Courses Fall 2005, Atlantic Veterinary College, PEI Henrik Stryhn Introduction to Bayesian Analysis 1 Little known outside the statistical science, there exist two different approaches

More information

Granite State College Schedule (Undergraduate) by Campus

Granite State College Schedule (Undergraduate) by Campus 1 FALL WINTER ARTS 550 Art History: Western World CMT CRIT 501 Critical Inquiry CMT BEHS 502 Human Services & Helping Process CMT ECO 512 Principles of Economics CMT COMM 542 Interpersonal Communication

More information

The Nature and Scope of Psychology. Lecture 1

The Nature and Scope of Psychology. Lecture 1 The Nature and Scope of Psychology Lecture 1 1 William James (1842-1910) Psychology is the science of mental life Principles of Psychology (1890) R.H. Wozniak 2 A Short List of Mental Functions Immanuel

More information

FACULTY OF SOCIAL SCIENCES SUMMER PROGRAMME COURSES OFFERED

FACULTY OF SOCIAL SCIENCES SUMMER PROGRAMME COURSES OFFERED FACULTY OF SOCIAL SCIENCES SUMMER PROGRAMME 2013 - COURSES OFFERED MANAGEMENT STUDIES COURSE CODE TITLE PRE-REQUISITE FOUN 1301 Law, Governance, Economy and Society ACCT 1002 Introduction to Financial

More information

Theory Building and Hypothesis Testing. POLI 205 Doing Research in Politics. Theory. Building. Hypotheses. Testing. Fall 2015

Theory Building and Hypothesis Testing. POLI 205 Doing Research in Politics. Theory. Building. Hypotheses. Testing. Fall 2015 and and Fall 2015 and The Road to Scientific Knowledge and Make your Theories Causal Think in terms of causality X causes Y Basis of causality Rules of the Road Time Ordering: The cause precedes the effect

More information

Inference beyond significance testing: a gentle primer of model based inference

Inference beyond significance testing: a gentle primer of model based inference Inference beyond significance testing: a gentle primer of model based inference Junpeng Lao, PhD Fribourg Day of Cognition 2017/10/04 https://www.nature.com/articles/s41562-017-0189-z An old tale: the

More information

Generation times in epidemic models

Generation times in epidemic models Generation times in epidemic models Gianpaolo Scalia Tomba Dept Mathematics, Univ of Rome "Tor Vergata", Italy in collaboration with Åke Svensson, Dept Mathematics, Stockholm University, Sweden Tommi Asikainen

More information

Who Does History Remember?

Who Does History Remember? 1 / 16 Who Does History Remember? Using Wikipedia to Measure the Historical Reputation of Leaders Jeffrey B. Arnold and H. E. Goemans jeffrey.arnold@rochester.edu April 13, 2012 70th Annual MPSA Conference,

More information

college essays help 76882

college essays help 76882 college essays help 76882 college essays help 76882 >>>CLICK HERE

More information

Granite State College Schedule (Undergraduate and School of Education) by Course

Granite State College Schedule (Undergraduate and School of Education) by Course 1 FALL WINTER ACCT 550 Accounting Information Systems ACCT 601 Intermediate Accounting II ACCT 600 Intermediate Accounting I APST 505 Career Development & Life Planning (2 CR) ACCT 601 Intermediate Accounting

More information

Jake Bowers Wednesdays, 2-4pm 6648 Haven Hall ( ) CPS Phone is

Jake Bowers Wednesdays, 2-4pm 6648 Haven Hall ( ) CPS Phone is Political Science 688 Applied Bayesian and Robust Statistical Methods in Political Research Winter 2005 http://www.umich.edu/ jwbowers/ps688.html Class in 7603 Haven Hall 10-12 Friday Instructor: Office

More information

University of Oxford Returning Student Tuition Fee Rates 2009/10 - Postgraduate Research

University of Oxford Returning Student Tuition Fee Rates 2009/10 - Postgraduate Research University of Oxford Returning Student Tuition Fee Rates 2009/10 - Postgraduate Research These are the tuition fee rates for students who began their programme of study (course) during the academic year

More information

Kepler tried to record the paths of planets in the sky, Harvey to measure the flow of blood in the circulatory system, and chemists tried to produce

Kepler tried to record the paths of planets in the sky, Harvey to measure the flow of blood in the circulatory system, and chemists tried to produce Stats 95 Kepler tried to record the paths of planets in the sky, Harvey to measure the flow of blood in the circulatory system, and chemists tried to produce pure gold knowing it was an element, though

More information

Granite State College Schedule (Undergraduate and School of Education) by Location

Granite State College Schedule (Undergraduate and School of Education) by Location 1 FALL WINTER ARTS 501 Introduction to Drawing CMT CMPL 511 Software Tools CMT COMM 542 Interpersonal Comm & Group Dynamics CMT COMM 551 Small Group Communication CMT CRIT 501 Critical Inquiry CMT CRIT

More information

What is probability. A way of quantifying uncertainty. Mathematical theory originally developed to model outcomes in games of chance.

What is probability. A way of quantifying uncertainty. Mathematical theory originally developed to model outcomes in games of chance. Outline What is probability Another definition of probability Bayes Theorem Prior probability; posterior probability How Bayesian inference is different from what we usually do Example: one species or

More information

Descriptive Statistics Lecture

Descriptive Statistics Lecture Definitions: Lecture Psychology 280 Orange Coast College 2/1/2006 Statistics have been defined as a collection of methods for planning experiments, obtaining data, and then analyzing, interpreting and

More information

Measuring the User Experience

Measuring the User Experience Measuring the User Experience Collecting, Analyzing, and Presenting Usability Metrics Chapter 2 Background Tom Tullis and Bill Albert Morgan Kaufmann, 2008 ISBN 978-0123735584 Introduction Purpose Provide

More information

Lecture 14: Size-biasing, regression effect and dust-to-dust phenomena.

Lecture 14: Size-biasing, regression effect and dust-to-dust phenomena. Lecture 14: Size-biasing, regression effect and dust-to-dust phenomena. David Aldous October 19, 2017 Why do lottery winners live longer than others (on average)? Why do your friends have more friends

More information

Education. ignored good behavior and scolded misbehavior and offered threats.

Education. ignored good behavior and scolded misbehavior and offered threats. LP 8A applying operant cond 1 Education By using the processes of shaping and positive reinforcement, we can make schools a place where students are challenged, successful and can enjoy themselves, rather

More information

Computational Ethics for NLP

Computational Ethics for NLP Lecture 2: Ethical Challenges in NLP History and Philosophy Defining Ethics It s the good things It s the right things So what are the right things? Is there some absolute definition of right? Aristotle

More information

Chapter 11: Advanced Remedial Measures. Weighted Least Squares (WLS)

Chapter 11: Advanced Remedial Measures. Weighted Least Squares (WLS) Chapter : Advanced Remedial Measures Weighted Least Squares (WLS) When the error variance appears nonconstant, a transformation (of Y and/or X) is a quick remedy. But it may not solve the problem, or it

More information

KARUN ADUSUMILLI OFFICE ADDRESS, TELEPHONE & Department of Economics

KARUN ADUSUMILLI OFFICE ADDRESS, TELEPHONE &   Department of Economics LONDON SCHOOL OF ECONOMICS & POLITICAL SCIENCE Placement Officer: Professor Wouter Den Haan +44 (0)20 7955 7669 w.denhaan@lse.ac.uk Placement Assistant: Mr John Curtis +44 (0)20 7955 7545 j.curtis@lse.ac.uk

More information

Blending Psychometrics with Bayesian Inference Networks: Measuring Hundreds of Latent Variables Simultaneously

Blending Psychometrics with Bayesian Inference Networks: Measuring Hundreds of Latent Variables Simultaneously Blending Psychometrics with Bayesian Inference Networks: Measuring Hundreds of Latent Variables Simultaneously Jonathan Templin Department of Educational Psychology Achievement and Assessment Institute

More information

Bayes-Verfahren in klinischen Studien

Bayes-Verfahren in klinischen Studien Bayes-Verfahren in klinischen Studien Dr. rer. nat. Joachim Gerß, Dipl.-Stat. joachim.gerss@ukmuenster.de Institute of Biostatistics and Clinical Research J. Gerß: Bayesian Methods in Clinical Trials 2

More information

Inferential Statistics: An Introduction. What We Will Cover in This Section. General Model. Population. Sample

Inferential Statistics: An Introduction. What We Will Cover in This Section. General Model. Population. Sample Inferential Statistics: An Introduction 10/13/2003 P225 Inferential Statistics 1 What We Will Cover in This Section Introduction. Probability and the Normal Curve. Probability and Sampling Means. The Z-test.

More information