Contents 1 Measurement in Human Service Enterprises: History and Challenges 2 Measurement as Communication

Transcription

1 Contents 1 Measurement in Human Service Enterprises: History and Challenges... 1 Differences Between Measurement in Science and Commerce... 3 The History and Definition of Measurement... 6 Problems that Result from the Development of Measures by Normal Science... 7 Measurement as Communication... 8 Communication Theory and Measurement... 9 Communimetrics and the Philosophy of Science Organization of the Book Measurement as Communication A Brief Review of Current Theories of Measurement Classical Test Theory Item Response Theory Clinimetrics Comparison of Communimetrics to Psychometrics and Clinimetrics Input Processes in Measurement The Output Process in Measurement The Relationship of Input and Output Process Input and Output Processes in Human Service Enterprises Principles of Communimetrics Each Item Has Implications for Differential Action Levels of Items Translate Immediately to Action Considering Context Measurement is Descriptive Use of Time Frames (Windows of Observation) Information Integration Exploring Myths in Measurement ix

2 x Contents 3 Designing a Communimetric Measure Phase 1. Defining the Objectives Phase 2. Determine the Audiences: Those Participating in the Communication Process Phase 3. Selecting Items Phase 4. Create Action Levels for the Items Phase 5. Develop Anchored Definitions of Action Levels for Each Item Danger to Self Antisocial Behavior (Compliance with Society s Rules) Phase 6. Share Draft Items for Feedback from Audience Representatives Phase 7. Test the Tool in a Field Application Phase 8. Implement Immediate Widespread Planned Incremental Individual/Gradual Working the Organization Super User Programs Phase 9. Repeat the Processes in Phases 1 to 6 During the Course of Service Delivery Building Decision Models Summary Defining a Good Communimetric Measurement Tool: Reliability and Validity Considerations Reliability Internal Consistency Test Retest Inter-rater Audit Reliability Validity Utility Validity Relevance to the work Transparency Multiple purposes Correspondence to sociopolitical considerations Indicators of Utility Validity Respondent satisfaction Relationship to subsequent action Use penetration Impact evaluation Decision Validity Enhancing the Reliability and Validity Through Training... 86

3 Contents xi Field audit Enhancing the Reliability and Validity Through Use The Convergence of Communimetric and Psychometric Approaches with the Use of Aggregate Item Analyses Comparing Versions Severity and Complexity The Child and Adolescent Needs and Strengths A Developmental History Measurement Characteristics of the Child and Adolescent Needs and Strengths Reliability Validity Scoring Options Psychometric Scale Properties Rasch Modeling the Child and Adolescent Needs and Strengths Decision Support for Level of Care and Intensity of Services CANS and Level of Care Recommendations Using CANS Scores to Assess Change Overtime: Outcome Applications Implementation Experiences Matching Child Needs to Specific Providers The Intermed Development of the INTERMED Design of the INTERMED History Biological Domain Psychological Domain Social Domain Health Care Domain Current State Biological Domain Psychological Domain Social Domain Health Care Domain Prognosis Biological Domain Psychological Domain Social Domain Health Care Domain Establishing Action Levels Reliability and Validity Training and Use

4 xii Contents 7 The Entrepreneurial League System Assessment The Entrepreneurial League System Assessment Item Structure Recommended Assessment Process Psychometric Characteristics of the ELSA Impact Analysis Qualitative Analyses The Future of Measurement in Human Services Settings An Integrative Model of Measurement Understanding Transformational Offerings Academic and Field Collaborations Mass Collaboration and Measurement Design, Development, and Use Increasing the Use of Measurement in Human Services Enterprises The Application of Information Technology Creating Innovative Applications of Measurement Creating Consumers of Information References Appendix Index

5