BIOSTATISTICS. Lecture 1 Data Presentation and Descriptive Statistics. dr. Petr Nazarov

Transcription

1 Genomcs Research Unt BIOSTATISTICS Lecture 1 Data Presentaton and Descrptve Statstcs dr. Petr Nazarov petr.nazarov@lh.lu

2 COURSE OVERVIEW Organzaton: 60h = 12 days Theoretcal course (30h) Theory Explanatons to all Common work Practcal course (30h) Indvdual work Indvdual explanatons Fnal examnaton (questons) 3 ntermedate tests scored 0-3 (9 ponts n total) Fnal examnaton (tasks n Excel) Goal: your FINAL knowledge and sklls n bologcal data analyss! not markng of your work Data Mcrosoft Excel Software wth Data Analyss Add-In nstalled moodle, & 2

3 COURSE OVERVIEW Recommended Lterature presentaton methodology 3

4 COURSE OVERVIEW Introducton Drug dscovery Any bologcal study where numbers are measured or reported BIOSTATISTICS: why and where? Genomcs and systems bology Publc health 4

5 OUTLINE Lecture 1 Data and statstc elements, varables and observaton types of data (qualtatve and quanttatve) and scales (nomnal, ordnal, nterval, rato) Descrptve statstcs: tabular and graphcal presentaton frequency dstrbuton pe, bar chart and hstogram representaton cumulatve dstrbutons crosstabulaton and scatter dagram Descrptve statstcs: numercal measures measures of locaton: mean, mode, medan, quantles/quartles/percentles measure of varablty: varance, standard devaton, MAD, coeffcent of varaton other measures: skewness of dstrbuton z-score. Chebyshev's theorem. Detecton of outlers. Exploratory analyss. 5 number summary box plot Measure of assocaton between two varables covarance and correlaton coeffcent nterpretaton of correlaton coeffcent 5

6 DATA AND STATISTICS Elements, varables, and observatons, data scales and types 6

7 observaton DATA AND STATISTICS Data: Elements, Varables, and Observatons Data The facts and fgures collected, analyzed, and summarzed for presentaton and nterpretaton. elements varables Person Place Gender Net Worth ($BIL) Age Source Internet Fame Score Wllam Gates III 1 M Mcrosoft 9.5 Warren Buffett 2 M Berkshre Hathaway 6.6 Carlos Slm Helu 3 M telecom 2.1 Lawrence Ellson 4 M Oracle 2.8 Ingvar Kamprad 5 M IKEA 2.4 Karl Albrecht 6 M Ald 3.6 Mukesh Amban 7 M petrochemcals 4.4 Lakshm Mttal 8 M steel 5.4 Theo Albrecht 9 M Ald 1.5 Amanco Ortega 10 M Zara 1.9 Jm Walton 11 M Wal-Mart 3.9 Alce Walton 12 F Wal-Mart 2.9 Can we consder the Place as element? IFS 3 log10 N 4.5 7

8 Quanttatve Qualtatve DATA AND STATISTICS Data Scales and Types Data scales: Nomnal scale data use labels or names to dentfy an attrbute of an element. Ex.1: Ex.2: Male, Female Rooms #: 101, 102, 103, Ordnal scale data exhbt the propertes of nomnal data and the order or rank of the data s meanngful. Ex.1: Ex.2: Wnners: The 1 st, 2 nd, 3 rd places Marks: A, B, C, Interval scale data demonstrate the propertes of ordnal data and the nterval between values s expressed n terms of a fxed unt of measure Ex.1: Examnaton score Ex.2: Internet fame score Rato scale data demonstrate all the propertes of nterval data and the rato of two values s meanngful. Ex.1: Ex.2: Weght Prce 8

9 DATA AND STATISTICS Task: Defne the Scales Person Place Gender Net Worth ($BIL) Age Source Internet Fame Score Wllam Gates III 1 M Mcrosoft 9.5 Warren Buffett 2 M Berkshre Hathaway 6.6 Carlos Slm Helu 3 M telecom 2.1 Lawrence Ellson 4 M Oracle 2.8 Ingvar Kamprad 5 M IKEA 2.4 Karl Albrecht 6 M Ald 3.6 Mukesh Amban 7 M petrochemcals 4.4 Lakshm Mttal 8 M steel 5.4 Theo Albrecht 9 M Ald 1.5 Amanco Ortega 10 M Zara 1.9 Jm Walton 11 M Wal-Mart 3.9 Alce Walton 12 F Wal-Mart 2.9 IFS 3 log10 N 4.5? 9

10 TABULAR AND GRAPHICAL PRESENTATION Frequency dstrbuton, bar and pe charts, hstogram, cumulatve frequency dstrbuton, scatter plot 10

11 TABULAR AND GRAPHICAL PRESENTATION Frequency Dstrbuton Frequency dstrbuton A tabular summary of data showng the number (frequency) of tems n each of several nonoverlappng classes. Marks A B C B A B B A B C Frequency dstrbuton: Mark Frequency A 3 B 5 C 2 Total 10 Relatve frequency dstrbuton: Mark Frequency A 0.3 B 0.5 C 0.2 Total 1 In MS Excel use the followng functons: Percent frequency dstrbuton: Mark Frequency A 30% B 50% C 20% Total 100% =COUNTIF(data,element) to get number of elements found n the data area =SUM(data) to get the sum of the values n the data area 11

12 TABULAR AND GRAPHICAL PRESENTATION pancreatts.xls Example: Pancreatts Study The role of smokng n the etology of pancreatts has been recognzed for many years. To provde estmates of the quanttatve sgnfcance of these factors, a hosptal-based study was carred out n eastern Massachusetts and Rhode Island between 1975 and patents who had a hosptal dscharge dagnoss of pancreatts were ncluded n ths unmatched case-control study. The control group conssted of 217 patents admtted for dseases other than those of the pancreas and blary tract. Rsk factor nformaton was obtaned from a standardzed ntervew wth each subject, conducted by a traned ntervewer. adapted from Chap T. Le, Introductory Bostatstcs Pancreatts patents: Smokers Ex-smokers Ex-smokers Smokers Smokers Smokers Ex-smokers Smokers Smokers Smokers Smokers Smokers Ex-smokers Smokers Smokers Ex-smokers Smokers Smokers Ex-smokers Ex-smokers Smokers Ex-smokers Smokers Smokers Never Smokers Ex-smokers Ex-smokers Smokers Ex-smokers Smokers Smokers Ex-smokers Smokers Smokers Smokers Smokers Smokers Ex-smokers Smokers Smokers Smokers Smokers Smokers Smokers Smokers Smokers Smokers Smokers Never Smokers Smokers Smokers 12

13 FREQUENCY DISTRIBUTION Relatve Frequency Dstrbuton Frequency dstrbuton A tabular summary of data showng the number (frequency) of tems n each of several nonoverlappng classes. Relatve frequency dstrbuton A tabular summary of data showng the fracton or proporton of data tems n each of several nonoverlappng classes. Sum of all values should gve 1 Estmaton of probablty dstrbuton When number of experments n, R.F.D. P.D. pancreatts.xls Frequency dstrbuton: Smokng Cases Controls Never 2 56 Ex-smokers Smokers Total Relatve frequency dstrbuton: Smokng Cases Controls Never Ex-smokers Smokers Total 1 1 In Excel use the followng functons: =COUNTIF(data,element) to get number of elements found n the data area =SUM(data) to get the sum of the values n the data area 13

14 TABULAR AND GRAPHICAL PRESENTATION Crosstabulaton pancreatts.xls Dsease Smokng other pancreatts Total Ex-smokers Never Smokers Total Dsease Smokng other pancreatts Total Ex-smoker Never Smoker Total In Excel use the followng steps: Insert Pvot Table Set the range, ncludng the headers of the data Select output and set layout by drag-and-droppng the names nto the table 14

15 Percentage TABULAR AND GRAPHICAL PRESENTATION Bar and Pe Charts pancreatts.xls other Smokng Influence on Pancreatts other pancreatts Never Ex-smoker Smoker pancreatts Never Ex-smoker Smoker Never Ex-smoker Smoker Smokng In MS Excel use the followng steps: Try to avod usng n scentfc reports. For publc/busness presentatons only! Insert Column Set data range (both columns of Percent freq. dstrbuton) Insert Pe Set data range (one columns of Percent freq. dstrbuton) 15

16 TABULAR AND GRAPHICAL PRESENTATION Example: Mce Data Seres Tordoff MG, Bachmanov AA Survey of calcum & sodum ntake and metabolsm wth bone and body composton data Project symbol: Tordoff3 Accesson number: MPD:103 mce.xls 790 mce from dfferent strans parameter Startng age Endng age Startng weght Endng weght Weght change Bleedng tme Ionzed Ca n blood Blood ph Bone mneral densty Lean tssues weght Fat weght 16

17 TABULAR AND GRAPHICAL PRESENTATION The followng are weghts n grams for 970 mce: Hstogram mce.xls Sorted weghts show that the values are n the grams. Let us dvde the weght nto the bns bns Weght,g Frequency >= More 0 17

18 TABULAR AND GRAPHICAL PRESENTATION Now, let us use bn-sze = 1 gram Hstogram Bn Frequency More 0 Frequency Hstogram 10 In Excel use the followng steps: Specfy the column of bns (nterval) upper-lmts Data Data Analyss Hstrogram select the nput data, bns, and output (Analyss ToolPak should be nstalled) use Chart Wzard Columns to vsualze the results Weght, g 18

19 Endng weght TABULAR AND GRAPHICAL PRESENTATION Scatter Plot mce.xls Let us look on mutual dependency of the Startng and Endng weghts. 60 Scatter plot In Excel use the followng steps: Select the data regon Use Insert XY (Scatter) Startng weght 19

20 NUMERICAL MEASURES Populaton and sample, measures of locaton, quantles, quartles and percentles, measures of varablty, z-score, detecton of outlers, exploraton data analyss, box plot, covaraton, correlaton 20

21 NUMERICAL MEASURES Populaton and Sample Populaton parameter A numercal value used as a summary measure for a populaton (e.g., the populaton mean, varance 2, standard devaton ) POPULATION µ mean 2 varance N number of elements (usually N= ) SAMPLE x m, mean s 2 varance n number of elements Sample statstc A numercal value used as a summary measure for a sample (e.g., the sample mean m, the sample varance s 2, and the sample standard devaton s) mce.xls 790 mce from dfferent strans All exstng laboratory Mus musculus ID Stran Sex Startng age Endng age Startng weght Endng weght Weght change Bleedng tme Ionzed Ca n blood Blood ph Bone mneral densty Lean tssues weght Fat weght 1 129S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ f S1/SvImJ m S1/SvImJ m S1/SvImJ m S1/SvImJ m S1/SvImJ m S1/SvImJ m S1/SvImJ m S1/SvImJ m S1/SvImJ m

22 NUMERICAL MEASURES Measures of Locaton Mean A measure of central locaton computed by summng the data values and dvdng by the number of observatons. Medan A measure of central locaton provded by the value n the mddle when the data are arranged n ascendng order. Mode A measure of locaton, defned as the value that occurs wth greatest frequency. x p m x N x n n x true Weght Mode = 23 Medan = 23.5 Mean =

23 NUMERICAL MEASURES Measures of Locaton mce.xls Hstogram and p.d.f. approxmaton medanmean mode Female proporton p f = Densty weght, g Bleedng tme In Excel use the followng functons: = AVERAGE(data) = MEDIAN(data) = MODE(data) Densty medan = 55 mean = 61 mode = N = 760 Bandwdth =

24 NUMERICAL MEASURES Quantles, Quartles and Percentles Percentle A value such that at least p% of the observatons are less than or equal to ths value, and at least (100-p)% of the observatons are greater than or equal to ths value. The 50- th percentle s the medan. Quartles The 25th, 50th, and 75th percentles, referred to as the frst quartle, the second quartle (medan), and thrd quartle, respectvely. In Excel use the followng functons: =PERCENTILE(data,p) Weght Q 1 = 21 Q 2 = 23.5 Q 3 = 39 24

25 NUMERICAL MEASURES Measures of Varablty Interquartle range (IQR) A measure of varablty, defned to be the dfference between the thrd and frst quartles. Varance A measure of varablty based on the squared devatons of the data values about the mean. Standard devaton A measure of varablty computed by takng the postve square root of the varance. IQR Q 3 Q 1 populaton sample s 2 N x 2 2 x m n 1 2 Sample standard devaton s Populaton standard devaton 2 s 2 Weght IQR = 18 Varance = St. dev. = 17.9 In Excel use the followng functons: =VAR(data) =STDEV(data) =STDEV.S(data) 25

26 NUMERICAL MEASURES Measures of Varablty Coeffcent of varaton A measure of relatve varablty computed by dvdng the standard Standard devaton devaton by the mean. 100% Weght Mean CV = 57% Medan absolute devaton (MAD) MAD s a robust measure of the varablty of a unvarate sample of quanttatve data. MAD medan x medan x Set 1 Set Set 1 Set 2 Mean Medan St.dev MAD

27 NUMERICAL MEASURES Measures of Varablty Skewness A measure of the shape of a data dstrbuton. Data skewed to the left result n negatve skewness; a symmetrc data dstrbuton results n zero skewness; and data skewed to the rght result n postve skewness. Skewness n n 1 n 2 s x m 3 adapted from Anderson et al Statstcs for Busness and Economcs 27

28 NUMERICAL MEASURES Measure of Assocaton between 2 Varables Covarance A measure of lnear assocaton between two varables. Postve values ndcate a postve relatonshp; negatve values ndcate a negatve relatonshp. xy populaton x x y y N s xy sample x xy y n 1 mce.xls Endng weght vs. Startng weght Endng weght Startng weght In Excel use functon: =COVAR(data) s xy = 39.8 hard to nterpret 28

29 NUMERICAL MEASURES Measure of Assocaton between 2 Varables Correlaton (Pearson product moment correlaton coeffcent) A measure of lnear assocaton between two varables that takes on values between -1 and +1. Values near +1 ndcate a strong postve lnear relatonshp, values near -1 ndcate a strong negatve lnear relatonshp; and values near zero ndcate the lack of a lnear relatonshp. populaton x x y y xy xy N x y x y r xy s s x xy s y sample x x y y s s n 1 x y Endng weght In Excel use functon: =CORREL(data) r xy = Startng weght mce.xls 29

30 NUMERICAL MEASURES Correlaton Coeffcent If we have only 2 data ponts n x and y datasets, what values would you expect for correlaton b/w x and y? Wkpeda 30

31 NUMERICAL MEASURES z-score and Detecton of Outlers z-score A value computed by dvdng the devaton about the mean (x x) by the standard devaton s. A z-score s referred to as a standardzed value and denotes the number of standard devatons x s from the mean. Chebyshev s theorem For any data set, at least (1 1/z 2 ) of the data values must be wthn z standard devatons from the mean, where z any value > 1. z x m s Weght z-score For ANY dstrbuton: At least 75 % of the values are wthn z = 2 standard devatons from the mean At least 89 % of the values are wthn z = 3 standard devatons from the mean At least 94 % of the values are wthn z = 4 standard devatons from the mean At least 96% of the values are wthn z = 5 standard devatons from the mean 31

32 NUMERICAL MEASURES Detecton of Outlers For bell-shaped dstrbutons: Approxmately 68 % of the values are wthn 1 st.dev. from mean Approxmately 95 % of the values are wthn 2 st.dev. from mean Almost all data ponts are nsde 3 st.dev. from mean Outler An unusually small or unusually large data value. For bell-shaped dstrbutons data ponts wth z >3 can be consdered as outlers. Example: Gaussan dstrbuton Weght z-score

33 NUMERICAL MEASURES Task: Detecton of Outlers mce.xls Usng Excel, try to dentfy outler mce on the bass of Weght change varable z x m s For bell-shaped dstrbutons data ponts wth z >3 can be consdered as outlers. In Excel use the followng functons: = AVERAGE(data) - mean, m = STDEV(data) - standard devaton, s = abs(data) - absolute value sort by z-scale to dentfy outlers 33

34 DETECTION OF OUTLIERS Iglewcz-Hoagln Method Iglewcz-Hoagln method: modfed Z-score These authors recommend that modfed Z-scores wth an absolute value of greater than 3.5 be labeled as potental outlers. z x MAD medan z >3.5 outler medan( x) MAD( x) x medan x Bors Iglewcz and Davd Hoagln (1993), "Volume 16: How to Detect and Handle Outlers", The ASQC Basc References n Qualty Control: Statstcal Technques, Edward F. Mykytka, Ph.D., Edtor More methods are at: 34

35 NUMERICAL MEASURES Exploraton Data Analyss Fve-number summary An exploratory data analyss technque that uses fve numbers to summarze the data: smallest value, frst quartle, medan, thrd quartle, and largest value chldren.xls Mn. : 12 Q 1 : 25 Medan: 32 Q 3 : 46 Max. : 79 In Excel use: Data Data Analyss Descrptve Statstcs Box plot A graphcal summary of data based on a fve-number summary Mn Q 2 Q 1 Box Qplot 3 Max 1.5 IQR 35

36 NUMERICAL MEASURES Box-Plot n Excel Example Buld a box plot for endng weghts of male and female mce mce.xls 5-num. sum. FEMALE MALE Mn Q Q2 (medan) Q Max box szes FEMALE MALE box 1 hdden = Q1 box 2 lower = Q2 - Q1 box 3 uper = Q3 - Q2 1. Buld 5 number summares for males and females and calculate boxes sze + whskers 2. Calculate the szes of the boxes and whskers (here smplfed whskers are used) 3. Show Stacked Columns, swtch rows/columns 4. Make hdden box transparent 5. Add custom error bars whskers wsker top = MAX - Q3 whsker bot = Q1 - MIN See Contextures Inc. tutoral 36

37 NUMERICAL MEASURES Weghted mean The mean obtaned by assgnng each observaton a weght that reflects ts mportance Weghted Mean m w x w As an example of the need of weghted mean, consder the followng sample of fve purchases of a raw materal over several months Note that the cost per pound vares from $2.80 to $3.40, and quantty purchased has vared from 500 to Suppose that manager asked for nformaton about the mean cost per pound of the raw materal. If we would use a smple mean of the cost p.p.: we overestmate the average cost! Anderson et al Statstcs for Busness and Economcs 37

38 NUMERICAL MEASURES Grouped Mean Grouped data Data avalable n class ntervals as summarzed by a frequency dstrbuton. Indvdual values of the orgnal data are not avalable. chldren.xls Bn Frequency More 0 Mean for grouped data m k f n M Varance for grouped data s 2 k f M n 1 m 2 38

39 QUESTIONS? Thank you for your attenton to be contnued 39