ORPAT VALIDATION STUDY FOR CORRECTIONS OFFICER Authored By: Rick Gardner Senior Research Analyst Date: 2006
ORPAT VALIDATION Introduction The Oregon Physical Abilities Test (ORPAT) was originally developed for use in assessing police officer fitness and agility capabilities. Its use in other law enforcement disciplines requires additional validation. Content Validity For the ORPAT test to be valid for law enforcement disciplines other than police, it is necessary to validate the test against known physical requirements of the specific job under consideration. There must be a reasonable correlation between the skills and abilities ORPAT assesses and the demonstrated critical and essential physical tasks entry-level corrections incumbents perform in on-the-job (and in training), after completing the academy training program. The primary basis for determining content validity is the Job Task Analysis (JTA). In 2006 a comprehensive physical task JTA was completed for entry-level corrections officers. From this assessment an updated list of essential physical tasks and requirements for the job of corrections officer was established. Because the ORPAT is a hybrid testing process, it combines elements of both classical job sample testing and physical abilities testing. Determining content validity, therefore, is a two-part process. The first step is to reconcile actual physical activities performed in the ORPAT (stations) with the validated corrections officer physical job requirements; the second is to validate overall constructs (what ORPAT assesses as a whole, in addition to the individual stations) against known, validated job requirements). Validation Levels Currently, ORPAT is used in the corrections curriculum without a minimum pass cut-off score. Students must take and complete a pre and post test and show some degree of improvement between the two. This is the only requirement. As such, it is NOT used as testing or employment screen, other than students must be in sufficient physical condition to successfully complete the course. ORPAT is currently used in a manner that does NOT significantly impact the correction students employment. However, both ORPAT and Defensive Tactics (DT s) present risk for personal injury in mandatory training, which in tern represents a potential risk to employment. Page 2
ORPAT VALIDATION FOR CORRECTIONS OFFICER Therefore, it is important to establish a clear, logical and reasonable link between these training activities and the bona fide job performance requirements of being a corrections officer. Because ORPAT does not constitute an actual functional employment test for corrections officers, its validity is subject to less stringent requirements. It s present use in the corrections curriculum is primarily diagnostic and for self-awareness, so recruits have a clear understanding of their personal job-related physical abilities. It also serves to motivate recruits to participate in Physical Training (PT s) and direct more effort towards personal physical health and conditioning. In order to be valid for this application, the use of the ORPAT (in total) must be reasonably representative of the physical requirements of being a corrections officer. It is not strictly necessary that each station in the ORPAT correspond to a defined critical and essential task, so long as the overall assessment process can be demonstrated to be reasonably job-related. In this study, both the specific stations of the ORPAT and its overall functioning are examined and compared against the 2006 Corrections Physical Task JTA findings. The first portion of this analysis focuses on the specific ORPAT stations, beginning on page four (4). A complete list of validated critical and essential physical tasks is provided. For each station, the applicable items are noted under the description of the station. In addition, for each station the validity level for that specific station is noted. This is determined by the degree to which the specific station can be related to one or more of the critical and essential tasks. Validity ratings run from excellent to poor.
Corrections Officer Essential Physical Tasks and Capabilities SITTING STANDING WALKING RUNNING 11 Run on flat surface 12 Walk continuously 13 Stand continuously 14 Walk up/down stairs 15 Sit continuously (car, desk, etc.) 16 Run up/down stairs 17 Walk/run - irregular, potentially hazardous surfaces CRAWLING, CLIMBING OVER/ UNDER OBSTACLES 20. Climb Steps, railings, external features, obstacles LIFTING CARRYING PUSHING 23 Lift objects off ground 25 Assisted carry of unresisting inmate 26 Carry and place objects 27 Lift objects down from elevated surface, place on ground or floor STRUGGLE FIGHT DEFEND 31 Grip and hold inmate to maintain control 32 Extract/place struggling inmate in/ from cell 33 Hold/restrain struggling inmate 34 Physically defend against and control attacking inmate 35 Take down and subdue resisting inmate 36 Handcuff - mechanically restrain inmate 39 Use chemical weapon (OC) to subdue inmate 42 Continue to function effectively after exposure to OC 43 Physically intervene to break up inmate fights/physical confrontations 44 Dodge/evade blows, thrown objects 45 Exposure to hazardous materials JUMPING -VAULTING (no items met cut-off) Page 4
Corrections Officer Essential Physical Tasks and Capabilities COMBINED PHYSICAL ACTIVITIES 47 Subdue and mechanically restrain, lift/carry inmate to/from holding area/cell 48 Transport inmate (resisting, not resisting) within facility; negotiate physical barriers 49 Being struck by and/or striking inmates 51 Falling/being knocked down in struggle, recover to feet, resume struggle/pursuit 53 Loading, unloading, driving transport vehicles - maintain control of inmates 54 Participate in Defensive Tactics training 55 Continuing to function in physical altercation after being struck PSYCHOLOGICAL ELEMENTS WITH PHYSICAL EFFECTS 56. Maintain state of hypervigilance 57 Cope with physical effects of acute emotional stress (self) 58 Cope with physical effects of acute emotional stress (others) 59 Cope with physical effects of chronic emotional stress (self) 60 Cope with physical effects of chronic emotional stress (others) 61 Cope with chronic physical effects of shift work 62 Cope with the emotion and physical results of bodily fluid contact/exposure 63 Cope with emotional and physical impact of verbal threats of violence by inmates 65 Cope with emotional impact of working with seriously mentally ill inmates 66 Cope with the emotion reactions to verbal abuse by inmates Page 5
Corrections Officer Essential Physical Tasks and Capabilities GENERAL PHYSICAL ACTIVITIES SENSORY ACUITY DISCRIMINATION 67 Kneel, squat and recover to feet 68 Repetitive hand movements (typing, mouse, bar code scanning, etc.) 69 Bending over from waist, at or below waist level 71 Cardio-vascular endurance (over three minutes - high intensity) 72 Accurately resolve visual images in various conditions - to 100 feet 73 Accurately determine full-range of colors 74 Resolve and understand faint auditory signals 75 Resolve and understand speech in noisy environment 76 Detect and resolve odd odors 77 Accurately resolve visual images in low light conditions 78 Three-dimensional vision sufficient for accurate depth perception in high risk situations 79 Accurately visually detect and resolve transitory and subtle changes in body language" Page 6
STATION BALANCE BEAM Station Description From a standing start, the officer runs around a cone and jumps up on the fifteen-foot balance beam, running the entire length. If he/she falls off the beam the officer must return to the course start-point and repeat the obstacle. Page 7 Assessment Elements Job Tasks Walk/run - irregular, potentially hazardous surfaces Physical Abilities Balance Depth perception Validation Level Good Agility Lower body strength
STATION FIVE-FOOT JUMP OBSTACLE Station Description After completing the balance beam obstacle the officer rounds another cone and jumps the five foot obstacle (designed to simulate a ditch, or other opening-type obstacle). The officer s feet (foot) cannot land within the marked obstacle perimeter. Assessment Elements Job Tasks Walk/run - irregular, potentially hazardous surfaces Physical Abilities Depth perception Running speed Agility Lower body strength Core strength Ability to jump Validation Level Poor No jumping activities emerged as critical and essential. Page 8
STATION STAIRS CLIMB-SIMULATOR Station Description After completing the jump obstacle the officer rounds another cone and runs 60 feet of the course to the stair simulator. Comprised of five steps on either side, the officer runs up one side, down the other, rounds a cone and repeats the stair obstacle. The officer must hit at least one step and the top platform, going up and down. Assessment Elements Job Tasks Walk up/down stairs Run up/down stairs Physical Abilities Depth Perception Visual acuity Agility Coordination Lower Body Strength Core strength Validation Level Excellent Page 9
STATION CRAWL OBSTACLE Station Description After completing the stair simulator obstacle, the officer runs to the crawl obstacle, drops down and goes under the 23 high bar. Assessment Elements Job Tasks Kneel, squat and recover to feet Physical Abilities Agility Flexibility Coordination Core Body Strength Core power Lower body strength Validation Level Fair no crawl activities emerged as critical and essential. Page 10
STATION EIGHTEEN INCH BARRIER JUMP (X2) Station Description After completing the crawl obstacle the officer traverses the center section of the course, which contains two eighteen-inch jump barriers. These barriers are intended to represent small obstructions, such as curbs, landscape features, etc. Assessment Elements Job Tasks Walk/run - irregular, potentially hazardous surfaces Physical Abilities Depth Perception Agility Coordination Balance Lower Body Strength Core strength Ability to jump Validation Level Poor no jumping activities arose as critical and essential Page 11
STATION THREE-FOOT VAULT Station Description After completing the two 18-inch jump barriers the officer does a controlled vault of three feet, makes a twofooted landing, then drops to a prone position, rises without assistance and begins the obstacle course again. Assessment Elements Job Tasks Climb Steps, railings, external features, obstacles Falling/being knocked down in struggle, recover to feet, resume struggle/pursuit Participate in Defensive Tactics training Physical Abilities Depth Perception Agility Coordination Balance Core power Upper/Lower body strength Validation Level Good Page 12
STATION FALL TO BACK FRONT Station Description After completing the vault obstacle and returning to feet the officer falls to stomach and then to back, recovering to their feet each time without using any assistance. The purpose of this is to simulate recovery from falling/being knocked down, after clearing an obstacle. Assessment Elements Job Tasks Falling/being knocked down in struggle, recover to feet, resume struggle/pursuit Participate in Defensive Tactics training Physical Abilities Balance Core strength Upper/lower body strength Validation Level Excellent Page 13
SECTION TWO PUSH-PULL MACHINE PUSH (FIGHT PORTION) Station Description After completing six laps of the obstacle course the officer moves to the push-pull machine. This machine simulates struggling with, and controlling a subject, and extracting subject from car or room. It presents a standardized fight obstacle to each participant. Assessment Job Tasks Assisted carry of unresisting inmate Grip and hold inmate to maintain control Extract/place struggling inmate in/ from cell Hold/restrain struggling inmate Physically defend against and control attacking inmate Take down and subdue resisting inmate Physically intervene to break up inmate fights/physical confrontations Physical Abilities Balance Agility Core strength Upper/lower body strength Validation Level Excellent Page 14
STATION FALL TO BACK FRONT Station Description After completing the push portion machine the officer moves to a wall and executes front and back falls to the floor, simulating being knocked down or falling to the ground in a fight scenario, and recovering to feet. Assessment Elements Job Tasks Falling/being knocked down in struggle, recover to feet, resume struggle/pursuit Participate in Defensive Tactics training Physical Abilities Balance Core strength Upper/lower body strength Validation Level Excellent Page 15
SECTION THREE DUMMY DRAG Station Description After completing the fight portion of the test, the officer is given a sixty (60) second recovery time, and then moves to a 165- pound dummy. The dummy must be moved in a controlled manner for 25 feet. Assessment Elements Job Tasks Lift objects off ground Assisted carry of unresisting inmate Carry and place objects Extract/place struggling inmate in/ from cell Bending over from waist, at or below waist level Subdue and mechanically restrain, lift/carry inmate to/from holding area/cell Physical Abilities Balance Core strength Lower/upper body strength Ability to recover (the drag takes place after running the rest of the course, participants are usually quite fatigued at this point in the process) Validation Level Excellent Page 16
ORPAT General Exertion Elements In addition to the specific station tasks, ORPAT is designed to function as a whole. In it s entirety it is intended to also assess: 1. Overall cardio-vascular endurance 2. Muscular endurance 3. Core body strength 4. Explosive power 5. Balance 6. Agility 7. Flexibility 8. Coordination 9. Speed 10. Depth perception For each of the composite abilities, specific critical and essential tasks or activities performed by corrections officers are listed. 1 Overall cardio-vascular endurance Run on flat surface Walk up/down stairs Run up/down stairs Extract/place struggling inmate in/ from cell Hold/restrain struggling inmate Physically defend against and control attacking inmate Take down and subdue resisting inmate Cardio-vascular endurance (over three minutes - high intensity) Subdue and mechanically restrain, lift/carry inmate to/from holding area/cell 2 Muscular endurance Climb Steps, railings, external features, obstacles Grip and hold inmate to maintain control Extract/place struggling inmate in/from cell Hold/restrain struggling inmate Physically defend against and control attacking inmate Take down and subdue resisting inmate Handcuff - mechanically restrain inmate Physically intervene to break up inmate fights/physical confrontations Dodge/evade blows, thrown objects Participate in Defensive Tactics training Page 17
3. Core body strength Climb Steps, railings, external features, obstacles Lift objects off ground Assisted carry of unresisting inmate Carry and place objects Lift objects down from elevated surface, place on ground or floor Grip and hold inmate to maintain control Extract/place struggling inmate in/ from cell Hold/restrain struggling inmate Physically defend against and control attacking inmate Take down and subdue resisting inmate Physically intervene to break up inmate fights/physical confrontations Subdue and mechanically restrain, lift/carry inmate to/from holding area/cell Participate in Defensive Tactics training 4. Explosive power 5. Balance 6. Agility Lift objects off ground Lift objects down from elevated surface, place on ground or floor Physically defend against and control attacking inmate Take down and subdue resisting inmate Participate in Defensive Tactics training Walk up/down stairs Run up/down stairs Walk/run - irregular, potentially hazardous surfaces Kneel, squat and recover to feet Run up/down stairs Walk/run - irregular, potentially hazardous surfaces Take down and subdue resisting inmate Falling/being knocked down in struggle, recover to feet, resume struggle/pursuit Page 18
7. Flexibility Extract/place struggling inmate in/ from cell Hold/restrain struggling inmate Physically defend against and control attacking inmate Take down and subdue resisting inmate Falling/being knocked down in struggle, recover to feet, resume struggle/pursuit Participate in Defensive Tactics training Kneel, squat and recover to feet Bending over from waist, at or below waist level 8. Coordination Walk/run - irregular, potentially hazardous surfaces Dodge/evade blows, thrown objects Kneel, squat and recover to feet Repetitive hand movements (typing, mouse, bar code scanning, etc.) 9. Speed No specific Tasks 10. Depth perception Walk up/down stairs Run up/down stairs Dodge/evade blows, thrown objects Transport inmate (resisting, not resisting) within facility; negotiate physical barriers Loading, unloading, driving transport vehicles - maintain control of inmates Three-dimensional vision sufficient for accurate depth perception in high risk situations Page 19
ORPAT VALIDATION CONCLUSIONS While two of the specific stations in the ORPAT do not correspond to specific critical and essential tasks identified in the 2006 Corrections Officer JTA (Five-foot jump, 18 Barrier Jump), and one (Crawling) does so marginally, unlike pure physical abilities tests, such as the Coopers, these stations do correspond to tasks that are performed by corrections officers, albeit at a somewhat lesser frequency and/or criticality level than that required to meet the mathematical cutoff for critical and essential. Jumping (overall average of Consequences of Inadequate Performance = 2.5 out of 6, over 60% of survey respondents indicating they perform these tasks once or more per year)* Crawling (overall average of Consequences of Inadequate Performance = 2.7 out of 6, over 60% of survey respondents indicating they perform these tasks once or more per year.)* * Source DPSST 2006 Corrections Officer Physical Task Job Task Analysis The overall abilities assessed by the ORPAT correlate very well to the critical and essential tasks of being a corrections officer, with all but Speed addressing multiple critical and essential tasks. If the ORPAT were to be used as a graded test, or in employment screening, some modifications in individual stations might be desirable. However, in its current application there is sufficient evidence to assert that ORPAT is a defensible assessment tool for the physical conditioning and functional abilities of corrections officers, and reasonably approximates the established physical demands of the job. This assertion is strengthened by five years of measurements showing that if the ORPAT score of mean plus one standard deviation (6:30) were used as a standard, not only is there no disparate impact for females and minorities, there is actually relatively little difference in the pass rates of female, male and minorities. The test is clearly non-discriminatory at the first standard deviation. As is, the ORPAT constitutes a defensible and reasonable assessment tool for examining the overall job-related fitness and physical functioning of corrections officer candidates. Rick Gardner Senior Analyst Page 20