ISSUE NO. 11, WINTER 1974 103 diagnostic consistency in catatonic schizophrenia Frederick G. Guggenheim and Haroutun M. Babigian Two basic methods have been used to study consistency in diagnosing schizophrenia: 1) surveillance of diagnoses as they are routinely given within a community and 2) comparison of judgments of a limited number of experts observing selected patients. An example of the surveillance approach is the study conducted by Babigian et al. (1965), who found that 70 percent of patients first diagnosed as schizophrenic in the Monroe County Psychiatric Case Register were again diagnosed as schizophrenic in their subsequent Register contacts. An example of the selective comparison approach is the study of Beck (1962). In that study, four psychiatrists agreed in 53 percent of their diagnoses on a group of outpatients with possible or definite schizophrenia. But neither these nor other recent studies of diagnostic consistency (Ash 1949, Cooper 1967, Hordern et al. 1968, Kaelblingand Volpe 1963, Kendell et al. 1971, Sandifer et al. 1968, and Schmidt and Fonda 1956) have focused primarily on diagnostic consistency for a particular type of schizophrenia. The investigators in the present study have surveyed an aspect of current diagnostic practice as part of an earlier investigation (Guggenheim and Babigian 1974) into the epidemiology and outcome of patients diagnosed as having catatonic schizophrenia. It was demonstrated in those studies that, in comparison to patients with other types of schizophrenia, patients consistently diagnosed as having catatonic schizophrenia are significantly more often females than males and come from a lower socioeconomic class. Moreover, those consistently diagnosed as having catatonic schizophrenia have longer episodes than those inconsistently diagnosed as having catatonic schizophrenia. This study was designed to investigate the consistency of diagnoses applied to 572 patients who obtained treatment in Monroe County, N.Y. All had multiple diagnostic contacts and had been considered by at least one psychiatrist to have catatonic schizophrenia. Method and Material The Monroe County Psychiatric Case Register (Gardner et al. 1963) has accumulated a longitudinal file of diagnostic, demographic, and treatment data since 1960 on all psychiatric patients in a relatively stable population of 625,000' persons living in Monroe County, N.Y. This area comprises the city of Rochester, its suburbs, and a significant rural population. Between January 1, 1960, and the end of 1966, the Register had received diagnostic data on the 39,475 residents of the county seen in the various inpatient and outpatient psychiatric facilities of the county. These facilities include a State hospital, a university hospital psychiatric service, the outpatient departments of these two facilities, a community hospital psychiatric unit, child diagnostic clinics, and other outpatient clinics. Patient care by private psychiatrists in the county is also reported. The criteria used to select the 572 cases in the "multiple contact cohort" (MCC) were 1) the entry into the Monroe County Psychiatric Case Register, 2) the diagnosis of catatonic schizophrenia given at least once 1 1964 special census.
104 SCHIZOPHRENIA BULLETIN by any psychiatric facility in the county in 1960 through 1966, and 3) two or more diagnostic contacts in the Register. The average number of contacts per case was 6.2. The MCC has been divided into four groups according to diagnostic concordance of catatonic schizophrenia. Group A contains cases diagnosed as catatonic schizophrenia on all Register contacts; group B comprises those patients diagnosed as catatonic schizophrenia in a clear majority of contacts but not always so diagnosed; and group C contains those cases diagnosed as catatonic schizophrenia more than once but not in a majority of contacts. Patients with multiple Register contacts but only one diagnosis of catatonic schizophrenia are assigned to group D. This study also focused on 345 patients with Register contacts at multiple psychiatric facilities. This group is called the "multiple facility cohort" (MFC). Criteria for selection are the same as for the MCC, except that, in addition, 1) the MFC has made contact with two or more of the four major facilities, and 2) the diagnosis of catatonic schizophrenia was made in at least one of the following four facilities: the State hospital, the university hospital inpatient service, the university hospital psychiatric emergency department, or the community Figure 1. Cases with multiple contacts diagnosed as catatonic schizophrenia. 100 90 80 70 CASES 60 50 40 CS ON ALL CONTACTS NOT CS ON ALL CONTACTS hospital psychiatric unit. Thus, the MFC comprises cases seen at two, three, and four facilities (e.g., the twofacility cohort, the three-facility cohort, and the fourfacility cohort). Two terms that should be defined are "contact" and "episode." A Register diagnostic contact may vary from a single brief outpatient visit to a prolonged outpatient therapeutic program or an inpatient stay of any length. A Register episode is defined as a contact or contacts commencing with hospitalization and sometimes involving a transfer from one inpatient facility to another. An episode is terminated by a discharge to outpatient status. Results Effects of Multiple Contacts With an increasing number of contacts, there is an increased likelihood that there will not be unanimity in the diagnosis of catatonic schizophrenia. This trend is illustrated in figure 1. Slightly less than half of those in the MCC group receive the diagnosis of catatonic schizophrenia in a majority of contacts, as can be seen in table 1. 30 20 10 0 5 6 CONTACTS 10 +
ISSUE NO. 11, WINTER 1974 105 Table 1. Consistency of a diagnosis of catatonic schizophrenia in cases with multiple contacts. Multiple contact cohort Catatonic schizophrenia diagnosis N Percent Mean contacts Mean episodes Contacts per episode Group A Group B Group C Group D Total Always Mostly Sometimes Once 147 122 105 199 572 Twenty-six percent are always called catatonic schizophrenia (group A), and 21 percent are called catatonic schizophrenia in a clear majority of their contacts (group B). But 18 percent are diagnosed catatonic schizophrenia in less than a clear majority of their contacts (group C), and 35 percent are called catatonic schizophrenia only once (group D). There is no major difference in the number of episodes for each of the groups. There is, however, a rank ordering to the number of contacts per episode for each of the groups. Those groups with greater diagnostic 26 21 18 35 100 4.7 6.8 7.5 6.2 6.2 2.3 2.3 2.5 2.0 2.3 2.0 2.5 3.0 3.1 2.7 inconsistency have more contacts; hence a greater opportunity exists for diagnostic disagreement. Effects of Multiple Facilities A considerable difference was found in the degree to which different facilities used the diagnosis of catatonic schizophrenia. In figure 2, it can be seen that the diagnoses of catatonic and the hebephrenic types of schizophrenia are applied many times more frequently to first admission patients at the State hospital than at the university hospital or at the community hospital. Figure 2. Diagnoses of schizophrenics, first admission to each facility. CATATONIC HEBEPHRENIC PARANOID SCHIZOAFFECTIVE ACUTE ^DIFFERENTIATED. CHRONIC (^DIFFERENTIATED. MIXED SIMPLE CATATONIC HEBEPHRENIC PARANOID SCHIZOAFFECTIVE ACUTE UNOIFFERENTIATED.. CHRONIC UNOIFFERENTIATED MIXED SIMPLE 40 ~T~ 50 60 70 ~~l STATE HOSPITAL 873 1 st ADMISSION CASES UNIVERSITY HOSPITAL 865 1* ADMISSION CASES CATATONIC HEBEPHRENIC PARANOID SCHIZOAFFECTIVE ACUTE UNDIFFERENTIATED. CHRONIC UNOIFFERENTIATED. MIXED SIMPLE COMMUNITY HOSPITAL 783 1 st ADMISSION CASES
106 SCHIZOPHRENIA BULLETIN Other types of schizophrenia (e.g., acute and chronic undifferentiated types) are diagnosed less frequently at the State hospital but more frequently at the other facilities. With successive hospitalizations, the proportion of cases diagnosed as catatonic schizophrenia stays relatively the same. For example, at the State hospital, catatonic schizophrenia constitutes 13 percent of first-admission schizophrenic diagnoses and 14 percent of successive schizophrenic admissions. At the university hospital, these figures are 2 percent and 3 percent, respectively. Comparable figures for the community hospital are 3 percent and 5 percent. On successive admissions, there is an increase in cases diagnosed as chronic undifferentiated and schizoaffective schizophrenia and a decrease in cases called acute undifferentiated schizophrenia. Among those cases admitted to several of the most frequently used facilities, there is a very low degree of consensus for the diagnosis of catatonic schizophrenia. Nonetheless, there is a high degree of consistency for the diagnosis of schizophrenia per se. Table 2 demonstrates that for the two-, three-, and four-facility cohorts there is unanimous agreement on the diagnosis of schizophrenia of any type in 76 percent of the 345 MFC cases. On the other hand, there is only majority agreement for the diagnosis of catatonic schizophrenia in 7 percent of the MFC cases: 10 percent for the two-facility cohort, 4 percent for the three-facility cohort, and 3 percent for the four-facility cohort. Yet, all of these cases were given a diagnosis of catatonic schizophrenia at least once by one of these facilities. Consistency Within a Facility Considerable variation was also found in the consistency of the use of the diagnosis of catatonic schizophrenia within an individual facility, and this can be demonstrated for the 31 cases of the four-facility cohort. For this group, catatonic schizophrenia is the most frequent diagnosis (81 contacts), followed by paranoid schizophrenia (59 contacts), and chronic undifferentiated schizophrenia (30 contacts). Indeed, some type of schizophrenia is the most frequent diagnosis in 25 cases (81 percent). The ratio of patients with consistent diagnoses (i.e., the same schizophrenic type in all contacts with the facility) to those with inconsistent diagnoses was calculated. For the State hospital, the community hospital, the university hospital, and the emergency service, the ratios were 6.0, 2.0, 1.0, and 0.4, respectively. That is, the State hospital and the community hospital only infrequently give more than one schizophrenic type to a patient seen on multiple occasions. By contrast, the university hospital inpatient service gives different schizophrenic types as frequently as the same diagnostic type, and the emergency service gives different schizophrenic types to the four-facility cohort much more frequently than the same type. Discussion Only half (47 percent) of the patients diagnosed as having catatonic schizophrenia in this study had been so diagnosed in a majority of their Register contacts. The Table 2. Diagnostic consistency in cases seen in multiple facilities diagnosed as catatonic schizophrenia. Cohort Cases Complete agreement on schizophrenic diagnosis at each facility Majority agreement on catatonic schizophrenia diagnosis at all facilities N Percent N Percent Two-facility Three-facility Four-facility 181 133 31 147 91 23 81 68 74 18 5 1 10 4 3 Total 345 261 76 24 7
ISSUE NO. 11, WINTER 1974 107 degree of diagnostic inconsistency observed can be explained by 1) the transient nature of the catatonic syndrome in certain conditions and 2) widespread differences in the frequency with which certain diagnoses were applied between and within various facilities. Catatonia as a Symptom The presence of catatonic behavior is not pathognomonic of catatonic schizophrenia. Placid or rigid immobility, stupor, posturing, catalepsy, grimacing, automatism, stereotypy, mimic actions, profound negativism, and psychotic thinking can occur in other entities. Reports have described catatonia in organic diseases (Belfer and d'autremont 1971, Herman, Harpham, and Rosenblum 1942, and Jaffe 1967), hysteria (Thomson, Forbes, and Bolles 1937), and psychotic depressive reactions (Rachlin 1935). Furthermore, Kraepelin (1919) long ago pointed out that transient catatonic behavior can frequently be seen in other schizophrenic types. His criteria for catatonic schizophrenia included predominant and persistent catatonic symptoms added onto a basic matrix of dementia praecox. Moreover, he also noted that the catatonic type had the conjunction of a peculiar excitement with catatonic stupor. In a recent study of the outcome of catatonic behavior, it was found that 43 percent of the patients thought to have catatonic schizophrenia at acute treatment facilities are diagnosed more frequently as having other types of schizophrenia (Guggenheim and Babigian 1974). Effects of Drug Treatment Another aspect of catatonic schizophrenia that makes consistency of diagnosis so difficult is the effect of phenothiazines on certain psychomotor signs. For example, waxy flexibility disappears within hours in many patients treated with chlorpromazine. Muteness may also pass, rendering accessible the delusional and at times paranoid ideation (Thorner 1938) of the catatonic. Thus, some patients may demonstrate prominent catatonic behavior but be called paranoid, schizoaffective, or chronic undifferentiated schizophrenic a short time later. We found that the diagnosis of paranoid schizophrenia is most often used as an alternative diagnosis to catatonic schizophrenia. Effects of Diagnostic Process Additionally, there are certain features of the diagnostic process that may also be responsible for the low degree of diagnostic consistency in catatonic schizophrenia. The low priority assigned to schizophrenic types by practicing psychiatrists, especially in harried triage centers, relates to a currently perceived lack of therapeutic or heuristic importance associated with these types. Perhaps the advent of a specific medication, benefiting nonparanoid schizophrenics markedly more than the paranoid type, might imbue the diagnosis of schizophrenic types with more than academic merit. Certainly, since lithium has been so useful in the treatment of manic depressive reactions, many centers have noted a marked increase in its incidence and in its diagnostic consistency. Diagnostic consistency regarding the type of schizophrenia varied most in facilities with rapid staff turnover: at the emergency and the inpatient service of the university hospital where residents were responsible for diagnostic reports. By contrast, the State and community hospitals, where permanent staff psychiatrists were often responsible for diagnosis, had considerably higher diagnostic consistency. Diagnostic criteria actually used varied widely, a phenomenon noted elsewhere (Schorer 1968). Spot checks on hospital charts, as well as informal discussion with many clinicians, clearly brought this out. Whereas some psychiatrists used a strict Kraepelinian approach, others were more idiosyncratic. Nonetheless, concurrence in the diagnosis of schizophrenia per se in our cases was high, with more than three-quarters of one large group given a unanimous diagnosis of some type of schizophrenia on all contacts. Summary Diagnostic consistency was examined in a group of 572 cases with multiple contacts diagnosed at least once as having catatonic schizophrenia in the Monroe County Psychiatric Register between 1960 and 1966. The diagnosis of catatonic schizophrenia was made in a majority of contacts for less than half the group.. Catatonic schizophrenia is used inconsistently and rarely by some facilities; not infrequently and consistently by other facilities. When a patient has visited multiple
108 SCHIZOPHRENIA BULLETIN facilities and catatonic schizophrenia has been diagnosed at one of them, he has less than a 10 percent chance of having agreement on the diagnosis of catatonic schizophrenia in a majority of contacts with each of the facilities. The transient occurrence of catatonic symptoms in other types of schizophrenia as well as in other types of mental and physical illnesses is implicated as one of the reasons for the low degree of diagnostic consistency. The diagnostic process, often hurried, imprecise, and without heuristic or therapeutic interest with respect to the particular type of schizophrenia, is also implicated. References Ash, P. Short articles and notes: The reliability of psychiatric diagnoses. Journal of Abnormal and Social Psychology, 44:272-276,1949. Babigian, H. H.; Gardner, E. A.; Miles, H. C; and Romano, J. Diagnostic consistency and change in a follow-up study of 1215 patients. American Journal of Psychiatry, 121:895-901, 1965. Beck, A. T. Reliability of psychiatric diagnoses: 1. A critique of systematic studies. American Journal of Psychiatry, 119 (part 1):210-216, 1962. Belfer, M. L., and d'autremont, C. C. Catatonia-like symptomatology. Archives of General Psychiatry, 24:119-120,1971. Cooper, J. E. Diagnostic change in a longitudinal study of psychiatric patients. British Journal of Psychiatry, 113:129-142,1967. Gardner, E. A.; Miles, H. C; Iker, H. P.; and Romano, J. A cumulative register of psychiatric services in a community. American Journal of Public Health, 53:1269-1277,1963. Guggenheim, F. G., and Babigian, H. M. Catatonic schizophrenia: Epidemiology and clinical course. Journal of Nervous and Mental Disease, 158:291-305, 1974. Herman, M.; Harpham, D.; and Rosenblum, M. Nonschizophrenic catatonic states. New York State Journal of Medicine, 42:624-627, 1942. Hordern, A.; Sandifer, M. G.; Green, L. M.; and Timbury, G. C. Psychiatric diagnosis: British and North American concordance on stereotypes of mental illness. British Journal of Psychiatry, 114:935-944, 1968. Jaffe, N. Catatonia and hepatic dysfunction. Diseases of the Mental System, 28:606-608, 1967. Kaelbling, R., and Volpe, P. A. Constancy of psychiatric diagnoses in readmissions. Comprehensive Psychiatry, 4:29-39,1963. Kendell, R. E.; Cooper, J. E.; Gourlay, A. J.; and Copeland, J. R. M. Diagnostic criteria of American and British psychiatrists. Archives of General Psychiatry, 25:123-130,1971. Kraepelin, E. Dementia Praecox and Paraphrinia. 8th ed. Translated by R. M. Barclay and G. M. Robertson. Edinburgh: E. S. Livingstone, Ltd., 1919. pp. 131-153. Rachlin, H. L. A follow-up study of Hoch's benign stupor cases. American Journal of Psychiatry, 92:531-558,1935. Sandifer, M. G.; Hordern, A.; Timbury, G. C; and Green, L. M. Psychiatric diagnosis: A comparative study in North Carolina, London and Glasgow. British Journal of Psychiatry, 114:1-9,1968. Schmidt, H. O., and Fonda, C. P. The reliability of psychiatric diagnosis: A new look. Journal of Abnormal and Social Psychology, 52:262-267, 1956. Schorer, C. E. Mistakes in the diagnosis of schizophrenia. American Journal of Psychiatry, 124:1057-1062,1968. Thomson, M. M.; Forbes, T. W.; and Bolles, M. M. Brain potential rhythms in a case showing self-induced apparent trance states. American Journal of Psychiatry, 93:1313-1314,1937. Thorner, M. W. Psychologic structure of catatonia. Archives of Neurology and Psychiatry, 39:513-518, 1938. Acknowledgment The Monroe County Psychiatric Case Register is currently supported by the New York State Department of Mental Hygiene, the Monroe County Board of Mental Health, and the University of Rochester. From 1960 through 1969 the Register was supported by NIMH Grant MH-00381. This work was also partially supported by NIMH Grant MH-08469. Ms. Helen Hagan and Ms. Caroline Fribance provided technical and editorial assistance. The Authors Frederick Guggenheim, M.D., is an Assistant Professor of Psychiatry at the Harvard Medical School, Boston, Mass., and Haroutun Babigian, M.D., is a Professor of Psychiatry at the University of Rochester School of Medicine and Dentistry, Rochester, N.Y.