5/14/2014. Repeated Measures Designs. Why Researchers Use Repeated Measures Designs. each individual participates in each condition of the experiment.

Transcription

1 Repeated Measures Designs each individual participates in each condition of the This design is also called a within-subject design because the entire experiment is conducted within each subject. Why Researchers Use Repeated Measures Designs don t have to worry about balancing individual differences across conditions of the experiment these designs require fewer participants, they are convenient and efficient, and repeated measures designs are more sensitive. Sensitivity A sensitive experiment is one that can detect the effect of the independent variable, even when that effect is small. Repeated measures designs are more sensitive because error variation is reduced. Because the same people participate in each condition, the variability in responses due to different people is reduced (compared to independent groups). 1

2 Repeated Measures Designs Practice Effects The main disadvantage of repeated measures designs is practice effects. Practice effects arise because people change as they are repeatedly tested. As participants complete the dependent variable measures after each condition, they may get better with practice, or they may become tired or bored. Practice effects - become a confounding variable if not controlled. Practice effects must be balanced, or averaged across the conditions of the Counterbalancing the order of the conditions makes sure that the practice effects are distributed equally across the conditions of the Practice Effects, continued Practice effects must be balanced, or averaged across the conditions of the Counterbalancing the order of the conditions makes sure that the practice effects are distributed equally across the conditions of the 2

3 Practice Effects, continued Counterbalancing the study conditions: half of the participants do Condition A first, then Condition B, the remaining participants do Condition B first, then Condition A. In this way, both Conditions A and B have the same amount of practice effects. Practice effects can t be eliminated but they can be balanced, or averaged, across the conditions of an Balancing Practice Effects There are two types of Repeated Measures Designs: Complete and Incomplete. The purpose of each type of design is to counterbalance practice effects. Each repeated measures design uses different procedures for balancing practice effects across the conditions of the Complete Design Practice effects are balanced within each participant in the complete design. Each participant experiences each condition of the experiment several times (or hundreds of times), using different orders each time. A complete repeated measures design is most often used when each condition is brief (e.g., simple judgments about stimuli). 3

4 Complete Design, continued Two methods for generating orders of the conditions in the complete design are block randomization and ABBA counterbalancing. Block randomization A block represents all conditions of the experiment (e.g., 4 conditions, A B C D). A random order of the block is generated (e.g., ACBD) Thus, a participant would first do condition A, then C, then B, then D. A new random order would be generated for each time the participant completes the conditions of the Example: 4 stories Example: 4 stories 4

5 Complete Design, continued Block randomization balances practice effects only when the conditions are presented many times. Many administrations of the conditions are needed to balance, or average, practice effects across the conditions of the Block randomization is not useful when the conditions are presented only a few times to each participant. Complete Design, continued A different method is needed when conditions are presented only a few times to each participant. ABBA Counterbalancing Present the conditions of the experiment in one random sequence (e.g., D A B C), followed by the opposite of that sequence (C B A D). If the conditions are presented again, generate another random order of the conditions, followed by the opposite sequence. Complete Design, continued ABBA counterbalancing balances practice effects only when practice effects are linear. Linear practice effects occur when participants change in the same way following each condition. Nonlinear practice effects occur when participants change dramatically following the administration of a condition. This can occur when participants experience an insight ( aha ) regarding how to complete the experimental task during the course of the They are likely to use this new insight in subsequent conditions. 5

6 Incomplete Design Each participant experiences each condition of the experiment exactly once (rather than many times, as in the complete design). Practice effects are balanced across participants in the incomplete design rather than within subjects, as in the complete design. Incomplete Design, continued The general rule for balancing practice effects in the incomplete design is that each condition of the experiment (e.g., A, B, C) must appear in each ordinal position (1 st, 2 nd, 3 rd ) equally often. If this rule is followed, practice effects will be balanced and will not confound the Incomplete Design, continued Techniques for balancing practice effects in the incomplete design include all possible orders and selected orders. All possible orders: The preferred technique for balancing practice effects in an incomplete design that has four or fewer conditions of the independent variable. 6

7 Incomplete Design, continued With two conditions (A, B) there are two possible orders: AB and BA. Half of the participants would be randomly assigned to receive condition A first, followed by B. The remaining participants would complete condition B first, followed by A. With three conditions (A, B, C), there are six possible orders: ABC, ACB, BAC, BCA, CAB, CBA Participants would be randomly assigned to one of the six orders. Incomplete Design, continued With four conditions (ABCD) there are 24 possible orders (ABCD, ABDC, ACBD, ACDB, etc.). With five conditions there are 120 possible orders, and with six conditions there are 720 possible orders. At least one participant must receive each order of the conditions. Because of this, all possible orders is usually used for experiments with four or fewer conditions of the independent variable. Incomplete Design, continued Selected orders: Rather than using all possible orders, another method for balancing practice effects in the incomplete design is to select particular orders of the conditions. Two methods for selecting orders are the Latin Square method and Random Starting Order with Rotation. 7

8 2 conditions Group 1 gets A B B A A condition appears precisely once in each row and column in the square Learning effect tends to balance out 3 conditions Group 1 gets A B C C A B B C A A condition appears precisely once in each row and column in the square Learning effect tends to balance out 4 conditions Group 1 gets Group 4 gets A B C D D A B C C D A B B C D A A condition appears precisely once in each row and column in the square Learning effect tends to balance out 8

9 4 conditions Group 1 gets Group 4 gets A B C D D A B C C D A B B C D A A condition appears precisely once in each row and column in the square Learning effect tends to balance out 5 conditions Group 1 gets Group 4 gets Group 5 gets A B C D E E A B C D D E A B C C D E A B B C D E A A condition appears precisely once in each row and column in the square Learning effect tends to balance out 3 conditions Group 1 gets A B C C A B B C A However, does not fully eliminate learning effect. B follows A twice 9

10 Balanced Group 1 gets 4 conditions A B C D B D A C D C B A C A D B Each condition appears once in each row and column, as before Each condition before and after each other condition an equal number of times 10