Adult Consumer and Family Member Perceptions of Care 2012: Findings from the Annual Survey of Pennsylvania Behavioral Health Service Recipients

Transcription

1 Adult Consumer and Family Member Perceptions of Care 2012: Findings from the Annual Survey of Behavioral Health Service Recipients

2 CONTENTS INTRODUCTION.. 1 METHODOLOGY.. 2 ADULT SURVEY FINDINGS.. 4 to Care 4 Quality and Appropriateness 5 of Care Social Connectedness 7 Functioning 7 FAMILY SURVEY FINDINGS.. 8 to Care 8 of Care 9 9 Cultural Sensitivity of Staff Social Connectedness 11 Functioning 11

3 INTRODUCTION It has been said that one of the most significant performance indicators available for measuring the success of a health care service delivery system is the assessment of how the actual recipients of those services are doing in their lives; as a direct result of those services that they received. Accordingly, what better way to evaluate how individuals perceive they are doing than to simply ask them? This performance outcomes report offers a summary view of recent thoughts on that very topic, as reported by a statewide sampling of adult recipients (and family members of youth recipients) of the Commonwealth s publicly-funded, behavioral health service system. The Department of Public Welfare s Office of Mental Health and Substance Abuse Services (OMHSAS) has conducted an annual survey of behavioral health service recipients each year since OMHSAS, like fifty-one (51) other state and territory mental health authorities, uses the nationally-recognized Mental Health Statistics Improvement Program (MHSIP) survey instrument to assess adult consumer perception of care. The MHSIP survey and the companion Youth Services Survey for Families (YSS-F) which is used by forty-two (42) states and territories, were created, tested and refined over the course of several years by groups of mental health consumers, family members of children/adolescents, state government data experts, researchers and federal government project officers. The annual survey is a mandatory component of the data reporting requirements within the Community Mental Health Services Block Grant (CMHSBG) that OMHSAS receives from the federal government. Consumer and family perception of outcomes of care together represent one of nine National Outcome Measures (NOMS) adopted by the federal Center for Mental Health Services (CMHS) for mental health services. The NOMS are derived from the Uniform Reporting System (URS) data tables. The URS was developed in response to the need for federal accountability for the expenditure of community mental health block grant funds received by States. The intent of the URS tables is to allow for both the tracking of individual State performance over time, and the aggregation of state information to develop a national picture of the public mental health system. States are encouraged to use the URS data in planning, program development, and evaluation efforts. This consumer/family survey study and report was funded, in part, by federal Grant Number: 5 SM The Office of Mental Health and Substance Abuse Services wishes to acknowledge the support of the U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services for its State Mental Health Data Infrastructure Grants for Quality Improvement. 1

4 METHODOLOGY During calendar year 2012, the Office of Mental Health and Substance Abuse Services (OMHSAS) conducted a mailed survey campaign to assess adult consumer and family member perception of care. The three populations surveyed were: 1) Adult consumers who had received Medicaid-funded peer support services during Calendar Year 2011, under either the HealthChoices Behavioral Health program or the Medical Assistance Fee-For-Service program. a. Every one () of the unduplicated 1,732 peer support recipients statewide were selected to receive the Mental Health Statistics Improvement Program (MHSIP) consumer survey instrument. Peer Support service recipients were identified through a query of the Department of Public Welfare ( Department ) Enterprise Data Warehouse (EDW), examining all Medical Assistance (aka, Medicaid) Fee-For-Service claims and all HealthChoices Behavioral Health encounters where the service occurred between January 01, 2011 and December 31, ) Adult consumers who had received Medicaid-funded behavioral health services during Calendar Year 2011, under the HealthChoices Behavioral Health program (i.e., Medicaid managed behavioral health care). a. Using a convenience sample approach, 5,000 adult service recipients were selected from among all behavioral health service recipients statewide to receive the Mental Health Statistics Improvement Program (MHSIP) consumer survey instrument. The sample did not include persons who had received peer support services. Adult behavioral health service recipients were identified through a query of the Department s EDW, examining all HealthChoices Behavioral Health encounters where the service occurred between January 01, 2011 and December 31, ) Family members of children and adolescents who had received Medicaid-funded behavioral health services during calendar Year 2011, under the HealthChoices Behavioral Health program. a. Using a convenience sample approach, 5,000 child/adolescent service recipients were identified from statewide universe child or adolescent behavioral health service recipients (ages 17 and under), and their parents/guardians were selected to receive the Youth Services Survey for Families (YSS-F) instrument. Child and adolescent behavioral health service recipients were identified through a query of the Department s EDW, examining all HealthChoices Behavioral Health encounters where the service occurred between January 01, 2011 and December 31,

5 Each survey was sent to the recipient/family member s mailing address, as identified within the Department s Client Information System (CIS). The survey mailing consisted of a cover letter (which served to explain the purpose of the survey and to request participation), the respective survey instrument, and a postage-paid, business reply return envelope. A Spanish-translation version of each letter and survey was mailed to those consumers and family members whose CIS-identified preferred language was Spanish. A postcard reminder was mailed approximately 14 days following the initial mailing, as a means of maximizing the survey return rates. Of the total 6,732 MHSIP surveys sent to adults, 6,695 surveys were deliverable, and 1,994 (or 29.78%) of that subtotal were completed and returned by adult consumers. Of the total 5,000 YSS-F surveys sent to families, 4,991 were deliverable, and 1,253 (or 25.11%) of that subtotal were completed and returned by family members. The survey responses were entered into the OMHSAS survey database by contracted Temporary Clerical Personnel, and the responses were then analyzed by the OMHSAS Division of Systems Management s Data Analytics Group. The survey results were reported to the Substance Abuse and Mental Health Services Administration (SAMHSA), as part of our required Uniform Reporting System (URS) measures. This presentation of the survey findings allows for more detailed information-sharing. Table Survey Sample Results Family Member of Child or Adolescent Service Recipient Adult Service Recipient Peer Support Service Recipient Totals Surveys mailed (Attempted contact) Undeliverable (Unable to contact) Delivered (Contacted) Survey Responses (Form Returned) Response Rate (Survey Responses/ Contacted) 5,000 5,000 1,732 11, ,991 4,971 1,724 11,686 1,253 1, , % 28.38% 33.82% 27.79% Total family survey response rate = 25.11%, as calculated by 1,253 responses divided by 4,991 delivered surveys. Total adult survey response rate = 29.78%, as calculated by (1, responses) / (4, ,724 delivered). 3

6 ADULT SURVEY FINDINGS For the purpose of this report, all adult survey responses (i.e., those surveys completed and returned to OMHSAS by recipients of Peer Support services as well as those responses from adult recipients of any other behavioral health service) have been aggregated into an Adult Consumer group. Additional analysis of the Peer Support survey responses will be presented in a separate OMHSAS performance outcomes report. Aggregating the responses here allows for consistency in how OMHSAS reported the summary-level 2012 adult consumer survey findings to SAMHSA. The following survey results are presented by Mental Health Statistics Improvement Program (MHSIP) adult consumer survey domain (aka, survey scale). Each domain represents a combined indicator score created from a specific set of MHSIP consumer survey items. Domain scores are calculated using surveys that had 2/3 or more of the corresponding survey items completed for that domain. The percentage of adult consumers Reporting Positively about a particular survey domain is determined by those who responded that they Strongly Agree or Agree to the statements on the survey, when compared to all applicable responses. United States (U.S.) averages are based on 2011 data - the most recent national figures available at the time of the report. Figure 1. Adult Consumer to Care Quality and Appropriateness to Care: PA Multi-Year Comparison to Care: FY 2012 Comparison 84.51% % 84.67% % 84.51% 4

7 Figure 2. Adult Consumer Quality and Appropriateness Quality and Appropriateness Quality and Appropriateness of Care: PA Multi-Year Comparison Quality and Appropriateness of Care: FY 2012 Comparison 81.78% 82.75% 81.77% 82.39% Figure 3. Adult Consumer of Care Quality and Appropriateness of Care: PA Multi-Year Comparison of Care: FY 2012 Comparison 62.97% % 64.15% 63.39% 62.97% 56.84% 5

8 Figure 4. Adult Consumer Quality and Appropriateness : PA Multi-Year Comparison : FY 2012 Comparison 83.96% 85.59% 81.43% 80.84% 83.91% 83.91% 80. Figure 5. Adult Consumer with Services Quality and Appropriateness General Satisfaction with Services: PA Multi-Year Comparison General Satisfaction with Services: FY 2012 Comparison 82.93% % 81.35% 84.57% 84.57%

9 Figure 6. Adult Consumer Social Connectedness Social Connectedness Functioning Social Connectedness: PA Multi-Year Comparison Social Connectedness: FY 2012 Comparison 70.59% % 70.51% % 70.59% Figure 7. Adult Consumer Functioning Social Connectedness Functioning Functioning: PA Multi-Year Comparison Functioning: FY 2012 Comparison 60.02% % 63.37% 64.75% 57.83% 60.02% 7

10 FAMILY SURVEY FINDINGS Similar to the construction of the 36-item MHSIP adult consumer survey, the Youth Services Survey for Families (YSS-F) survey tool is comprised primarily of 26 items organized into seven survey domains. Each grouping of survey items that comprise a domain assesses the perceptions of the family members, specific to that domain s area of interest. Survey items are presented in the form of statements; using a standard Likert scale to define how much the respondents agreed or disagreed with the statements. Domain scores are calculated only using surveys that had 2/3 or more of the corresponding survey items completed for that domain. As with the adult survey data, those survey item responses reported as Not Applicable were recoded as missing values. Other responses were recoded using numerical values, to facilitate calculations. The percentage of family members of child/adolescent service recipients Reporting Positively about a particular survey domain is determined by those who responded that they Strongly Agree or Agree to the statements on the survey, when compared to all applicable responses. The United States (U.S.) averages are based on 2011 data the most recent national figures available to OMHSAS at the time this report was written. Figure 8. Family Member to Care Cultural Sensitivity of Staff to Care: PA Multi-Year Comparison to Care: FY 2012 Comparison 82.39% 83.89% 86.06% 85.71% 87.05% 87.05%

11 Figure 9. Family Member of Care Cultural Sensitivity of Staff of Care: PA Multi-Year Comparison of Care: FY 2012 Comparison 62.62% % 61.06% 64.26% 62.62% Figure 10. Family Member Cultural Sensitivity of Staff : PA Multi-Year Comparison : FY 2012 Comparison % 89.58% 91.49% 93.65% 93.65% 86. 9

12 Figure 11. Family Member Cultural Sensitivity of Staff Cultural Sensitivity of Staff Cultural Sensitivity of Staff: PA Multi-Year Comparison Cultural Sensitivity of Staff: FY 2012 Comparison % 91.67% 94.62% 93.73% 93.73% 93.0 Figure 12. Family Member with Services Cultural Sensitivity of Staff with Services: PA Multi-Year Comparison General Satisfaction with Services: FY 2012 Comparison 81.26% % 77.21% 80.29% % 10

13 Figure 13. Family Member Social Connectedness Social Connectedness Functioning Social Connectedness: PA Multi-Year Comparison Social Connectedness: FY 2012 Comparison 79.27% 79.97% 82.53% 82.17% 83.09% 83.09% 85. Figure 14. Family Member Functioning Social Connectedness Functioning Functioning: PA Multi-Year Comparison Family Members Reporting Positively about Functioning: FY 2012 Comparison 62.51% % 62.26% 60.74% 65.25% 62.51% 11