Anota et al. Health and Quality of Life Outcomes (2016) 14:168 DOI /s y

Transcription

1 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 DOI /s y RESEARCH Cross-cultural adaptation and validation of the French version of the Expanded Prostate cancer Index Composite questionnaire for health-related quality of life in prostate cancer patients Amélie Anota 1,2,3*, Anne-Sophie Mariet 4,5,6, Philippe Maingon 7,12, Florence Joly 8, Jean-François Bosset 3, Anne-Valérie Guizard 9, Hugues Bittard 3,10, Michel Velten 1,11 and Mariette Mercier 1,3 Open Access Abstract Background: Health-related quality of life (HRQoL) has been positioned as one of the major endpoints in oncology. Thus, there is a need to validate cancer-site specific survey instruments. This study aimed to perform a transcultural adaptation of the 50-item Expanded Prostate cancer Index Composite (EPIC) questionnaire for HRQoL in prostate cancer patients and to validate the psychometric properties of the French-language version. Methods: The EPIC questionnaire measures urinary, bowel, sexual and hormonal domains. The first step, corresponding to transcultural adaptation of the original English version of the EPIC was performed according to the back translation technique. The second step, comprising the validation of the psychometric properties of the EPIC questionnaire, was performed in patients under treatment for localized prostate cancer (treatment group) and in patients cured of prostate cancer (cured group). The EORTC QLQ-C30 and QLQ-PR25 prostate cancer module were also completed by patients to assess criterion validity. Two assessments were performed, i.e., before and at the end of treatment for the Treatment group, to assess sensitivity to change; and at 2 weeks interval in the Cured group to assess test-retest reliability. Psychometric properties were explored according to classical test theory. Results: The first step showed overall good acceptability and understanding of the questionnaire. In the second step, 215 patients were included from January 2012 to June 2014: 125 in the Treatment group, and 90 in the Cured group. All domains exhibited good internal consistency, except the bowel domain (Cronbach s α = 0.61). No floor effect was observed. Test-retest reliability assessed in the cured group was acceptable, expect for bowel function (intraclass coefficient = 0.68). Criterion validity was good for each domain and subscale. Construct validity was not demonstrated for the hormonal and bowel domains. Sensitivity to change was exhibited for 5/8 subscales and 2/4 summary scores for patients who experienced toxicities during treatment. Conclusions: The French EPIC questionnaire seems to have adequate psychometric properties, comparable to those exhibited by the original English-language version, except for the construct validity, which was not available in original version. Keywords: Health-related quality of life, Cross-cultural adaptation, Validation, Psychometric properties, EPIC questionnaire, Prostate cancer, Classical test theory * Correspondence: aanota@chu-besancon.fr 1 French National Quality of Life in Oncology Platform, Besançon, France 2 Methodology and Quality of Life in Oncology Unit, University Hospital of Besançon, Besançon, France Full list of author information is available at the end of the article The Author(s) Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

2 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 2 of 14 Background Prostate cancer is the second most common cause of cancer and the sixth leading cause of cancer death among men worldwide, with an estimated 1.1 million cases in 2012 and 307,000 new deaths [1]. In France, prostate cancer has been the most frequent cancer in men for the last two decades, with around 54,000 new prostate cancers diagnosed in 2011 [2]. However, prostate cancer is the fifth overall cause of cancer-related death, with less than 10,000 deaths per year as of 2011 [2]. For prostate cancer that is diagnosed when still at a local stage, several curative treatment strategies exist that can achieve long-term remission. However, these treatments can induce significant functional impairment at the urinary, sexual, digestive and hormonal level [3, 4]. In this context, health-related quality of life (HRQoL) is an important endpoint for such patients. Moreover, HRQoL is now recognized as a second primary endpoint by the American Society of Clinical Oncology and the Food and Drug Administration if no effect of treatment on overall survival is observed [5 7]. In order to capture all symptoms specific to prostate cancer and the side effects of prostate cancer treatment, it is recommended to use disease-specific HRQoL questionnaires [8]. These questionnaires must also be adapted to the culture and the language of the study [9], especially in non-english-speaking countries, and validation of the psychometric properties of adapted questionnaires remains mandatory. Few HRQoL questionnaires specific to prostate cancer have been validated in the French language. The QLQ- PR25 prostate-cancer-specific module of the European Organization of Research and Treatment of Cancer (EORTC) is available and validated in French [10], but only explores symptoms from a factual point of view. The University of California-Los Angeles Prostate Cancer Index (UCLA-PCI) is widely used in Englishspeaking countries [11]. The Expanded Prostate Cancer Index Composite (EPIC) was developed from the UCLA-PCI by supplementing it with items focusing on urinary irritative and obstructive voiding symptoms and with items addressing hormonal symptoms [12]. The availability of a validated French-language version of the EPIC, which would be better adapted to epidemiological studies [13], is thus essential to allow comparison of French data with existing reports in the international literature. In this context, the objective of this study was to perform transcultural adaptation and validation of the French version of the EPIC questionnaire according to classical test theory. This study is part of the French National QALIPRO project that aims to investigate the long-term side effects of prostate cancer, in which the EPIC questionnaire is used. Methods Study design The validation of the French version of the EPIC questionnaire was performed in two steps. Nine French cancer care centers and university hospitals participated in patient recruitment. Step 1: Transcultural adaptation and qualitative validation (face validity) Transcultural adaptation of the EPIC questionnaire in French was done using back translation technique and was pretested on a planned sample of 50 patients [14]. These patients were recruited during urology or radiotherapy consultations. Patients had to fill out a debriefing questionnaire to assess their completion of the EPIC: i.e., they could indicate if the questionnaire was too long, or too complicated, or if some items were found to be disturbing, irrelevant, redundant or missing, among other questions. The time required to complete the questionnaire was also recorded. This information gave an indication of both the quality of the translation and the possible acceptability of the questionnaire. Step2: Quantitative validation of the psychometric properties of the questionnaire Participants For the second step, both patients with ongoing treatment and cured patients were recruited and categorized into two groups as follows: In the Cured group, patients had to be considered cured of prostate cancer ( 3 years after diagnosis), regardless of initial treatment, and attending a follow-up consultation. Patients withrecurrencewereexcluded. In the Treatment group, patients were prospectively included before curative treatment for localized prostate cancer. Patients were eligible to participate if they had a histologically confirmed diagnosis of localized prostate cancer, and if they had no previous treatment for their prostate cancer. Patients were excluded if the curative treatment had already been performed, or in case of metastasis. All patients had to have social security coverage, and had to be able to complete HRQoL questionnaires. All patients were fully informed of the study and provided signed written informed consent. The protocol was approved by the local ethics committee (Comité de Protection des Personnes Est II). Questionnaires Patients were required to complete the EPIC questionnaire, as well as the EORTC QLQ-C30 cancer specific questionnaire, and the QLQ-PR25 prostate cancer module, to assess criterion validity.

3 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 3 of 14 The EPIC questionnaire is a 50-item instrument specific to prostate cancer developed and validated in the English language [12]. Items are separated in domains and each item contains four or five response categories. The questionnaire assesses four domains, namely: urinary, bowel, sexual and hormonal; and each domain comprises two subscales, namely symptom severity (function subscale) and symptom-related impairment (bother subscale). The urinary domain can also be separated into two other subscales, combining both function and bother items, namely a urinary incontinence subscale and a urinary irritation/obstruction subscale. The last item evaluates overall satisfaction. Scale scores (one score per subscale) are transformed linearly to a 0- to-100 scale, with higher scores representing higher HRQOL, i.e., high function and low bother. A summary score is also generated for each domain, corresponding to the mean of the function and bother subscales. Scores were generated according to the recommendations of the questionnaire developers [15]. The QLQ-C30 includes 30 items and measures five functional scales (physical, role, emotional, cognitive and social functioning), global health status (GHS), financial difficulties and eight symptom scales (fatigue, nausea and vomiting, pain, dyspnea, insomnia, appetite loss, constipation, diarrhea) [16]. One score is generated for each dimension. Scores vary from 0 (worst) to 100 (best) for the functional dimensions and GHS, and from 0 (best) to 100 (worst) for the symptom dimensions, and were generated according to the EORTC Scoring Manual [17]. The QLQ-PR25 module contains 25 items assessing two functional scales (sexual activity and sexual functioning) and four symptomatic scales (urinary symptoms, bowel symptoms, hormone treatmentrelated symptoms and incontinence aid) specific to prostate cancer. This module must be completed in conjunction with the QLQ-C30 questionnaire. As with the QLQ-C30, one score is generated for each scale and standardized on a scale such that a high score represents a high functional or symptomatic level [10]. Measurement times Patients were required to complete the questionnaires twice, as follows: In the Cured group, patients completed the questionnaires at baseline (T 1 ) and again 2 weeks later (T 2 ) to assess test-retest reliability; In the Treatment group, patients completed the questionnaires immediately before the initiation of treatment (T 1 ) and then again at the end of treatment (6 to 8 weeks after the first assessment, T 2 ) to assess sensitivity to change. Sample size calculation For the qualitative validation, we planned to include 50 patients. For the quantitative validation of the psychometric properties of the EPIC questionnaire, it was planned to include 300 patients in order to ensure the statistical robustness of the analyses. In particular, exploratory factor analysis (EFA) to investigate the dimensionality of the questionnaire requires a minimum of 150 patients [18], with a minimum of 30 patients per response category with 5 response categories per item. We planned to include 100 patients in the Cured group and 200 patients in the Treatment group. In the Treatment group, to highlight a minimal clinically important difference (MCID) of 10 points in one dimension between both questionnaire measurements, with a standard deviation (SD) of 20 points, a type I error of 5% and statistical power of 80%, a minimum of 150 patients was required (75 patients in two groups defined by an external criteria). Statistical analysis Baseline socio-demographic and clinical characteristics of the patients are described using mean ± SD or median (range) for continuous variables, and number (percentage) for qualitative variables. Face validity was assessed using the debriefing questionnaire from step 1. All other analyses were performed on the validation population from step 2 including all patients (both Cured and Treatment groups) at the first measurement point (except if a specific population is concerned). Acceptability of the questionnaire was assessed by the percentage of missing data (missing items and missing forms). A high proportion of missing forms may indicate poor acceptability of the instrument [8]. Information provided in the debriefing questionnaire in step 1 was also used to gain additional insights into the acceptability of the questionnaire. For example, if the patient found some questions to be disturbing, difficult to understand, or found the questionnaire too long, this could explain some missing data and could similarly lead to missing data in future studies. The debriefing questionnaire was summarized as number and percentage for each question for all patients of step 1. The mean ± SD time required to complete the questionnaire was also reported. Floor and ceiling effects were estimated for each subscale and for the overall score. The number and percentage of patients who obtained the lowest or highest possible score for each subscale and overall domain were recorded. Floor or ceiling effects were considered to be present if more than 15% of the responders achieved the lowest or highest possible score respectively [19].

4 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 4 of 14 Reliability of the questionnaire was assessed using Cronbach s α coefficient for internal consistency and the test-retest method for repeatability. Cronbach s α was estimated for all subscales and overall domains. It was expected to be higher than 0.70 [20]. Test-retest reliability was assessed from the data of the Cured group with estimation of the interclass correlation coefficient (ICC) between assessments T 1 and T 2 [21]. Convergent and discriminant validities were evaluated using multitrait scaling analysis [18] conducted separately for the eight subscales and for the four domains. The convergent validity of each item was assessed using Spearman s correlation coefficient between each item and its own subscale score, computed without including the corresponding item. The convergent validity was considered satisfactory if the correlation coefficient was higher than 0.40, in absolute value. For the discriminant validity, the correlation between each item and its own scale score was expected to be greater than the correlation between that item and the other scale scores. Similar analyses were conducted for each domain. EFA was performed to assess the dimensionality of the questionnaire with orthogonal rotation of the factors and imposing four factors. All items were integrated into the EFA except the last item assessing overall satisfaction. EFA was performed on patients who had completed all items at the first measurement timepoint. The variance explained by the four factors was reported and the resulting factors were interpreted [22]. Criterion validity was assessed using a correlation matrix between the EPIC domain summary scores and the QLQ-PR25 scores. The correlation between the EPIC and QLQ-PR25 scores assessing the same HRQoL domain was expected to be higher than 0.4, in absolute value. Conversely, the correlation between each EPIC domain summary score and other scales of the QLQ-PR25 assessing other HRQoL domains was expected to be lower. Sensitivity to change was assessed among patients from the Treatment group by comparing, using a paired T-test, the change in scores between T2 and T1 according to the presence or absence of at least one toxicity rated grade 2 or higher during treatment. We assumed that patients experiencing at least one toxicity would experience a greater deterioration in their HRQoL level than patients without toxicity. Mean change between T2 and T1, with the SD of the change between the two measures was reported. The Standardized Response Mean (SRM) was also estimated, corresponding to the mean change divided by the SD of change. An absolute SRM value less than 0.2 was considered as a small change, between 0.2 and 0.5 as moderate, and greater than 0.5 as large [23]. Each domain and subscale was analysed without any specific hypothesis as to whether the effect of toxicity on each scale was similar. The median (range) time between the two assessments was also reported. We expected a clinically significant change of at least 10 points in all the subscales and summary scores for patients who experienced toxicities during treatment. All analyses were performed using SAS version 9.4 (SAS Institute Inc., Cary, NC, USA). All tests were twosided and the type I error was set at No adjustment for multiple testing was performed. Results Step1: Face validity Forty-six patients were included in step 1. None of them considered the questionnaire to be too long. Five patients (11.6%) reported that they found at least one question disturbing. These patients mainly reported that the disturbing questions referred to symptoms that they did not experience, so they had some difficulty judging the impact of the given symptom on their HRQoL level, for example. Two patients mentioned that they found some questions to be disturbing, explaining that it was too private (questions 17 and 21 about sexuality). Four patients (8.7%) needed help completing the questionnaire. Twenty-eight patients (62.2%) considered that the questionnaire addressed relevant issues. Forty-one patients (91.1%) considered that the questionnaire might concern other men. Finally, 38 patients (84.4%) declared that the questionnaire enabled them to deal more easily with problems or difficulties related to their disease. The mean time required to complete the questionnaire was less than 20 min (mean 19.8, SD = 9.3). In light of these results, the French version of the EPIC questionnaire tested in step 1 was maintained as is for step 2. Step2: Quantitative validation of psychometric properties Study population In step 2, 215 patients were included between January 2012 and June 2014: 125 patients in the Treatment group and 90 patients in the Cured group. The mean age was 68 years (SD = 6.6). The baseline sociodemographic and clinical characteristics of the study population are summarized in Table 1. Validation of the psychometric properties Acceptability Nineteen patients (8.8%) did not fill out the baseline EPIC questionnaire: 11 patients (8.8%) in the Treatment group and 8 patients (8.8%) in the Cured group. Nine of these patients (47.4%) reported that they forgot to return the questionnaire. Eighty-one patients (37.7%) fully completed the baseline questionnaire. Floor and ceiling effects Mean (SD) scores for all patients at baseline, as well as the percentage of lowest or highest possible scores to quantify floor and ceiling

5 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 5 of 14 Table 1 Baseline characteristics of the patients All patients Cured group Treatment group N = 215 N =90 N = 125 N % N % N % Age. mean (SD) (6.6) (6.5) (6.3) Marital status Living maritally Divorced Widower Single Missing data Profession Retired Professionally active Unemployed Missing data Performance Status at baseline Missing data Cancer stage at diagnosis Local Locoregional Metastatic Missing data Disease treatment Chemotherapy Yes No Missing data Radiotherapy Yes No Missing data Hormone therapy Yes No Missing data Surgery Yes No Missing data Table 1 Baseline characteristics of the patients (Continued) Brachytherapy Yes No Missing data effects respectively, for each subscale and for each summary score are given in Table 2. A ceiling effect (i.e., more than 15% of patients having the highest possible score) was observed for the bowel (15.35%) and hormonal (20.93%) summary scores, and for the main subscales, except for the sexual subscales, bother, and the irritation/obstruction subscales of the urinary domain. No floor effect was observed. Reliability Regarding internal consistency, Cronbach s alpha was 0.70 for each subscale except for urinary function, bowel function and hormonal symptoms, where Cronbach s alpha was 0.63, 0.53 and 0.63 respectively (Table 2). Regarding the summary scores, Cronbach s alpha coefficient was <0.70 for the bowel domain only (0.61). Table 3 displays the mean (SD) scores for each summary score and subscale for patients in the Cured group at the two measurement times, as well as the ICC for test-retest reliability. An ICC 0.70 was observed for each subscale and summary score, except for bowel function, where the ICC was Construct validity Convergent validity was achieved for all items of the sexual function subscale, with a correlation between the sexual function score and summary score greater than 0.4 (Table 4). Regarding the items of the sexual bother subscale, the convergent validity was respected in terms of correlation with the sexual bother score, but not for the sexual domain summary score, with the correlation between each item and the summary score being less than 0.4. Convergent validity was also respected for all items of the urinary bother subscale, except for item q30, with a correlation of 0.28 with both the urinary bother subscale score and the urinary domain summary score. Likewise, convergent validity was also respected for all items of the bowel bother subscale, except for item q53, with a correlation of 0.38 with the bowel bother subscale score, and 0.31 with bowel domain summary score. For all other dimensions, the convergent validity was respected for only a minority of items, in particular hormonal function, where no item of this subscale respected the convergent validity with respect to its own subscale. Yet, most of items of the hormonal scale respected the convergent validity with the overall hormonal domain. Discriminant validity was achieved for all items of both the urinary and sexual domains. Conversely,

6 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 6 of 14 Table 2 Characteristics of EPIC domain-specific summary and subscales scores (N = 215; T 1 ) HRQoL domain Number of Items N mean score (SD) range (min-max) HRQoL Domain Summary Scores Floor effects (%) Ceiling effects (%) Cronbach s α Urinary (13.61) Bowel (9.93) Sexual (21.98) Hormonal (12.49) Domain-Specific HRQoL Subscales Urinary subscales Function (11.02) Bother (17.33) Irritation/obstruction (14.42) Incontinence (17.22) Bowel subscales Function (9.07) Bother (13.36) Sexual subscales Function (28.96) Bother (34.14) Hormonal subscales Function (13.18) Bother (13.59) Cronbach s α in the original version (Wei et al. 2000) discriminant validity was not respected for 5/7 items of the bowel function subscale, 1/7 item of the bowel bother subscale, 3/5 items of the hormonal function subscale and 2/6 items of the hormonal bother subscale. The result of the EFA is summarized in Table 5. Fifty-three percent of the variance was explained by the four factors. Items of the sexual function subscale were highly correlated with Factor 1, while those of the sexual bother subscale were correlated with Factor 2. Most of the items of the urinary domain were correlated with Factor 3 while those of the bowel domain were correlated with Factor 4. Finally, items of the hormonal domain were equally distributed over the first three factors. Criterion validity Correlation between each EPIC summary score and the equivalent scale of the QLQ-PR25 was greater than 0.4, highlighting good criterion validity (Table 6). In particular, the correlation was highest between the urinary symptoms scale of the QLQ-PR25 module and the urinary summary score of the EPIC questionnaire, at The urinary, sexual and hormonal summary scores of the EPIC were also highly correlated with the incontinence aid dimension of the QLQ- PR25 (at 0.66, 0.55 and 0.57, respectively). Sensitivity to change The median time between the two assessments was 7.8 weeks (range ). Among the patients of the Treatment group, 55 (44%) experienced at least one toxicity rated grade 2 or higher during treatment. For all subscales and summary scores, these patients experienced a decrease of mean HRQoL at T2 as compared to T1, with a clinically significant difference (10-point MCID) observed for 7/10 subscales and 2/4 summary scores (Table 7). As compared to patients without toxicity during treatment, patients who experienced toxicities presented a greater decrease in the sexual summary score (mean difference = vs , P-value < 0.001), urinary function subscale (mean difference = vs , P-value = 0.004), incontinence subscale (mean difference = vs , P-value < 0.001), sexual function subscale (mean difference = vs , P-value = 0.001) and sexual bother subscale (mean difference = vs. 1.83, P-value = 0.022). Discussion This paper reports the cross-cultural adaptation and validation of the French version of the EPIC HRQoL questionnaire specific to prostate cancer, using classical test theory. The qualitative step overall exhibited good acceptability and understanding of the questionnaire. Few

7 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 7 of 14 Table 3 Assessment of test-retest reliability between the two assessment times for the Cured group Time 1: baseline Time 2: two weeks later HRQoL domain N mean (SD) N mean (SD) ICC for test-retest (ICC of Original version) HRQoL domain summary scores Urinary (15.01) (14.18) 0.90 (0.88) Bowel (11.79) (12.64) 0.86 (0.84) Sexual (20.84) (20.18) 0.94 (0.91) Hormonal (13.15) (13.34) 0.89 (0.80) Domain-specific HRQoL subscales Urinary subscales Function (14.37) (13.29) 0.84 (0.83) Bother (17.11) (18.39) 0.90 (0.87) Irritation/obstruction (13.28) (13.48) 0.82 (0.85) Incontinence (22.09) (19.28) 0.94 (0.87) Bowel subscales Function (10.46) (9.94) 0.68 (0.78) Bother (15.14) (16.26) 0.88 (0.85) Sexual subscales Function (26.82) (25.80) 0.98 (0.90) Bother (36.36) (33.23) 0.78 (0.78) Hormonal subscales Function (15.07) (13.63) 0.76 (0.79) Bother (13.63) (13.44) 0.84 (0.73) SD standard deviation, ICC intraclass coefficient patients reported that they found the questions to be disturbing, and the comments provided showed that this was not due to translation problems, but rather to the construction of the questionnaire itself, since some symptoms were not experienced by the patients and therefore, they found it difficult to judge its impact, while some other items were perceived to be too private. The number of patients who refused to participate in this study could also be informative for acceptability, but unfortunately, it was not possible to collect this data in each center. Ceiling effects were found for bowel and urinary summary scores, although the percentage of patients with the highest possible score was close to the threshold of 15% for the urinary domain. A high ceiling effect was observed for the function and incontinence subscales of the urinary domain. Conversely, no floor effect was observed for any domain or subscale. Similar findings were observed in the original English version of the EPIC questionnaire [12]. Good internal consistency was observed for all summary scores, except for the bowel domain, where the Cronbach s alpha was The repeatability was also demonstrated for all domains and subscales, expect for bowel function (ICC = 0.68). Thus, the reliability of the questionnaire was globally good for all scales, except for the bowel dimension. In comparison, good internal consistency and repeatability were observed for each subscale, except for hormonal function (Cronbach s alpha coefficient 0.51), and for all summary scores in the original English version [12]. We also observed high criterion validity, with a high correlation between EPIC domains and the equivalent scales of the QLQ-PR25. Wei et al. [12] compared the English version of the EPIC questionnaire to both the Functional Assessment of Cancer Therapy-Prostate (FACT-P) module [24] and to the American Urological Association Symptom Index (AUA-SI) [25, 26]. For both these prostate-cancer-specific questionnaires, only one overall score is generated. The QLQ-PR25 presents the advantage, as with the EPIC, of generating scores for each HRQoL domain, and may thus be considered to be more precise. The sensitivity to change assessed in this study highlighted a clinically and statistically significant change on 5 of the 8 subscales, and 2 of the 4 summary scores in patients who experienced toxicity during treatment. Compared to patients who did not suffer toxicity during treatment, those with toxicities had a greater decrease in the sexual summary score, and in the urinary and sexual

8 Table 4 Mutitrait matrix with correlation of each item and the domain-specific HRQoL subscales and summary scores Domain Subscale Items Urinary domain Urinary Function Urinary Bother Bowel domain Bowel Function Bowel Bother Sexual domain Sexual Function Sexual Bother Hormonal domain Hormonal Function Urinary Function q q q q q Bother q q q q q q q Bowel Function q q q q q q q Bother q q q q q q q Sexual Function q q q q q q Hormonal Bother Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 8 of 14

9 Table 4 Mutitrait matrix with correlation of each item and the domain-specific HRQoL subscales and summary scores (Continued) q q q Bother q < q q < q Hormonal Function q q q q q Bother q q < q q q q Values in bold for item own-scale correlation and item own-domain correlation correspond to items respecting convergent validity, i.e., correlation >0.4 in absolute value. Values in bold for correlation between an item and other scale scores correspond to items that did not respect discriminant validity, i.e., correlation between the item and the other scale scores was greater than that between the item and its own-scale score Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 9 of 14

10 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 10 of 14 Table 5 Exploratory factor analysis with varimax rotation and 4 factors performed at the first measurement time including all patients with complete data (N = 111) Domain Subscale Item Factor 1 Factor 2 Factor 3 Factor 4 Urinary Function q q q q q Bother q q q q q q q Bowel Function q q q q q q q Bother q q q q q q q Sexual Function q q q q q q q q q Bother q q q q Hormonal Function q q q Table 5 Exploratory factor analysis with varimax rotation and 4 factors performed at the first measurement time including all patients with complete data (N = 111) (Continued) q q Bother q q q q q q Values in bold correspond to the highest correlation observed between each item and factors subscales. Wei et al. did not assess the sensitivity to change of the original English version of the EPIC, therefore precluding comparison with our results [12]. Regarding the construct validity, multitrait analysis and EFA showed complementary results. Only the urinary domain and sexual function subscale reached the goal of good construct validity. Most of the dimensions showed good discriminant validity, except for bowel and hormonal functions. The bowel bother subscale also exhibited good convergent validity. The sexual function and bother subscales seemed to capture complementary results, since a bidimensional component was highlighted by the EFA. In fact, these subscales were highly correlated with two separate factors in the EFA. Moreover, items of the sexual bother subscale were poorly correlated to the sexual summary scores, as shown by the multitrait analysis. The hormonal domain presented poor construct validity overall, since neither convergent nor discriminant validity was respected, and correlation was observed with three of the four factors of the EFA. These poor results for the hormonal domain could be partially explained by the low number of patients treated by hormone therapy (only 45 patients (20.9%)). The construct validity was not reported for the original English version of the EPIC questionnaire, rendering comparison impossible. These poor results could also be partially explained by the low number of patients with complete data included in the EFA analysis (only 111 patients), whereas at least 150 patients are required to ensure the robustness of these analyses [18]. Indeed, the main limitation of this study is the low number of patients involved in step 2. Only 215 patients were actually enrolled in step 2, whereas a sample size of 300 patients was initially expected. Nonetheless, this sample size may be sufficient for most of the statistical analyses, even though the observed statistical power was lower than expected. The low sample size stems from the fact that the inclusion period was longer than planned, and the study had to be interrupted due to financial constraints.

11 Table 6 Interscale correlations between EPIC summary scores and subscales and QLQ-PR25 scores (N = 215; T1) EPIC Urinary Bowel Sexual Hormonal QLQ-PR25 Domain Function Bother Irritation Obstruction Incontinence Domain Function Bother Domain Function Bother Domain Function Bother Sexual activity Sexual functioning Urinary symptoms Bowel symptoms Hormonal treatment-related symptoms Incontinence aid Values in bold correspond to correlation between EPIC domains and subscales and the equivalents scales of the QLQ-PR25. For the QLQ-PR25 a high score indicates a high functional level and a high symptomatic level. For the EPIC questionnaire, a high score indicates a high health-related quality of life level Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 11 of 14

12 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 12 of 14 Table 7 Mean difference between the two assessments (T2 minus T1) for Treatment group patients, comparing patients without toxicities with patients who experienced toxicities during treatment, in order to assess sensitivity to change Patients without toxicities (N = 70) Patients experienced toxicities (N = 55) Dimensions N mean difference (SD) SRM N mean difference (SD) SRM P-value HRQoL domain summary scores Urinary (22.80) (19.44) Bowel (17.15) (12.16) Sexual (17.72) (24.42) 1.25 <0.001 Hormonal (13.67) (10.24) Domain-specific HRQoL subscales Urinary subscales Function (22.57) (21.21) Bother (24.54) (24.01) Irritation/obstruction (23.39) (21.00) Incontinence (29.86) (31.66) 1.44 <0.001 Bowel subscales Function (17.15) (15.21) Bother (17.01) (15.49) Sexual subscales Function (23.42) (24.32) Bother (24.34) (37.05) Hormonal subscales Function (14.10) (15.61) Bother (14.89) (10.75) SD standard deviation, SRM standardized Response Mean; P-value of paired T-test One of the strengths of this study is the assessment of all psychometric properties, including both reproducibility and sensitivity to change, which are not always systematically assessed in the validation process of HRQoL questionnaires. In order to complement these results according to classical test theory, particularly the construct validity, a modern psychometric approach using item response theory is essential [27], such as the use of Rasch-family models [28, 29]. These analyses are planned and will be fully reported in a separate paper. Moreover, these analyses present the advantage of being robust in the presence of missing data, and thus, all patients with at least one item completed can contribute to the analyses [30]. These further analyses should make it possible to validate or rule out the trend observed on EFA analysis. It would also be interesting to study the impact of other demographic and clinical data on the results of the EPIC validation, including the impact of age, relationship status or treatment modality and race. However, the sample size was not sufficient to ensure adequate variability to enable these additional analyses. We also plan to study the occurrence of differential item functioning using item response theory analysis. While the impact of race could be of interest, in France, as in several other European countries, current legislation does not allow data on racial origin to be collected routinely in studies, without ample justification of the importance of this variable. Another strength of this study is that both patients with ongoing treatment and cured patients were included in the validation process. This enables validation of the EPIC questionnaire for future epidemiological studies performed late after diagnosis. This adaptation and validation of the French version of the EPIC questionnaire was essential in order to enable the use this tool in future French-language studies. This validation was also mandatory to enable the second part of the QALIPRO study, which aims to investigate the long-term side effects of prostate cancer treatment. Moreover, although this questionnaire was initially developed for prostate cancer patients, other elderly patients without prostate cancer could be concerned by some of the issues mentioned in this instrument. In fact, in the debriefing questionnaire in step 1, forty-one patients (91.1%) considered that the questionnaire could concern other men with no prostate cancer.

13 Anota et al. Health and Quality of Life Outcomes (2016) 14:168 Page 13 of 14 Conclusions In conclusion, the French version of the EPIC questionnaire showed good psychometric properties in patients with prostate cancer, similar to those of the original English version. An item response theory analysis will complete these results. Abbreviations AUA-SI: American Urological Association Symptom Index; EFA: Exploratory factor analysis; EORTC: European Organisation of Research and Treatment of Cancer; EPIC: Expanded prostate cancer index composite; ES: Effect size; FACT-P: Functional assessment of cancer therapy-prostate; GHS: Global health status; HRQoL: Healthrelated quality of life; ICC: Interclass correlation coefficient; MCID: Minimal clinically important difference; SD: Standard deviation; SRM: Standardized response mean; UCLA-PCI: University of California-Los Angeles Prostate Cancer Index Acknowledgments The authors thank Fiona Ecarnot (EA3920, University Hospital Jean Minjoz, Besancon, France) for editorial assistance. Funding This study was financed by a French National Grant (PAIR Prostate 2009) obtained from the Institut National du Cancer, Ligue Contre le Cancer and Fondation ARC. Availability of data and materials Data are unsuitable for public deposition due to ethical and legal restrictions and are therefore available upon request with the Prof. Mariette Mercier ( mariette.mercier@univ-fcomte.fr). Authors contributions AA performed the statistical analyses and interpretation and written the manuscript, ASM interpreted the data and drafted the manuscript, AVG, FJ, MV, designed the study, written protocol and review the draft, PM, JFB, HB included the patients, MM designed the study, written protocol, managed the statistical analyses, interpreted the data and review the draft. All authors read and approved the final manuscript. Competing interests The authors declare that they have no competing interests. Consent for publication Not applicable. Ethics approval and consent to participate Written consent was obtained from all subjects and the protocol was approved by the local ethics committee, the by CCTIRS and CNIL french institutions (CCTIRS: Comité Consultatif sur le Traitement de l Information en matière de Recherche dans le domaine de la Santé; CNIL: Commission Nationale de l Informatique et des Libertés). Author details 1 French National Quality of Life in Oncology Platform, Besançon, France. 2 Methodology and Quality of Life in Oncology Unit, University Hospital of Besançon, Besançon, France. 3 EA3181, University of Franche-Comté, Besançon, France. 4 Service biostatistiques et information médicale (DIM), University Hospital of Dijon, Dijon, France. 5 INSERM, CIC 1432, Centre d investigation clinique, University Hospital of Dijon, Dijon, France. 6 INSERM UMR 1181 Biostatistiques, Biomathématiques, Pharmacoépidemiologie et Maladies infectieuses (B2PHI), University of Burgundy Franche-Comté, Dijon, France. 7 Department of Radiation Oncology, Georges François Leclerc Cancer Center, Dijon, France. 8 Department of Medical Oncology, Centre François Baclesse, Inserm U1086, Caen, France. 9 Registre général des tumeurs du Calvados, Cancers & Préventions - U 1086 Inserm - UCBN, Centre François Baclesse, Caen, France. 10 Department of Urology, University Hospital of Besançon, Besançon, France. 11 Registre des Cancers du Bas-Rhin, Strasbourg, France. 12 Université Pierre et Marie Curie, Paris, France. Received: 16 March 2016 Accepted: 30 November 2016 References 1. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN Int J Cancer. 2015;136:E Grosclaude P, Belot A, Daubisse Marliac L, Remontet L, Leone N, Bossard N, Velten M. Prostate cancer incidence and mortality trends in France from 1980 to Prog Urol. 2015;25: Parker WR, Montgomery JS, Wood Jr DP. Quality of life outcomes following treatment for localized prostate cancer: is there a clear winner? Curr Opin Urol. 2009;19: Penson DF. Quality of life after therapy for localized prostate cancer. Cancer J. 2007;13: Lipscomb J, Donaldson MS, Arora NK, Brown ML, Clauser SB, Potosky AL, Reeve BB, Rowland JH, Snyder CF, Taplin SH. Cancer outcomes research. J Natl Cancer Inst Monogr. 2004;2004(33): Johnson JR, Temple R. Food and Drug Administration requirements for approval of new anticancer drugs. Cancer Treat Rep. 1985;69: Beitz J, Gnecco C, Justice R. Quality-of-life end points in cancer clinical trials: the U.S. Food and Drug Administration perspective. J Natl Cancer Inst Monogr. 1996;1996: Fayers PM, Machin D: Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. England: John Wiley & Sons; Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of healthrelated quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46: van Andel G, Bottomley A, Fossa SD, Efficace F, Coens C, Guerif S, Kynaston H, Gontero P, Thalmann G, Akdas A, et al. An international field study of the EORTC QLQ-PR25: a questionnaire for assessing the health-related quality of life of patients with prostate cancer. Eur J Cancer. 2008;44: Litwin MS, Hays RD, Fink A, Ganz PA, Leake B, Brook RH. The UCLA Prostate Cancer Index: development, reliability, and validity of a health-related quality of life measure. Med Care. 1998;36: Wei JT, Dunn RL, Litwin MS, Sandler HM, Sanda MG. Development and validation of the expanded prostate cancer index composite (EPIC) for comprehensive assessment of health-related quality of life in men with prostate cancer. Urology. 2000;56: Wei JT, Dunn RL, Sandler HM, McLaughlin PW, Montie JE, Litwin MS, Nyquist L, Sanda MG. Comprehensive comparison of health-related quality of life after contemporary therapies for localized prostate cancer. J Clin Oncol. 2002;20: Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25: Wei JT. Scoring Instructions for the Expanded Prostate cancer Index Composite (EPIC). Ann Arbor. 2002;1001: Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de Haes JC, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85: Fayers PM, Aaronson NK, Bjordal K, Groenvold M, Curran D, AobotEQoLG. B: EORTC QLQ-C30 Scoring Manual (3rd edition). Brussels: EORTC; Nunnally J, Bernstein I: Psychometric Theory (3) McGraw-Hill. New York: McGraw-Hill; Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60: Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16: Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86: Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7: Cohen J. Statistical power analysis for the behavioral sciences (revised ed.). New York: Academic; Esper P, Mo F, Chodak G, Sinner M, Cella D, Pienta KJ. Measuring quality of life in men with prostate cancer using the functional assessment of cancer therapy-prostate instrument. Urology. 1997;50: Barry MJ, Fowler Jr FJ, O Leary MP, Bruskewitz RC, Holtgrewe HL, Mebust WK. Correlation of the American Urological Association symptom index with selfadministered versions of the Madsen-Iversen, Boyarsky and Maine Medical Assessment Program symptom indexes. Measurement Committee of the American Urological Association. J Urol. 1992;148: discussion 1564.