Spatial Dynamics of Bovine Tuberculosis in the Autonomous Community of Madrid, Spain ( )

Similar documents
Filipa Matos, Mónica V. Cunha*, Ana Canto, Teresa Albuquerque, Alice Amado, and. INRB, I.P./LNIV- Laboratório Nacional de Investigação Veterinária

School of Veterinary Medicine, University College Dublin (UCD), Dublin 4, Ireland

Bovine TB: the science-policy challenges

A case study of bovine tuberculosis in an area of County Donegal, Ireland

Survey of Mycobacterium bovis infection in badgers found dead in Wales

Bovine TB testing strategy: optimising the use of current diagnostic tools

Current development in the diagnosis of tuberculosis

Bovine TB: Epidemiology and Ecology of a Multi-Host Disease

A PRELIMINARY TRIAL TO EVALUATE THE GAMMA- INTERFERON ASSAY FOR THE DETECTION OF TUBERCULOSIS IN CATTLE UNDER LOCAL CONDITIONS IN SERBIA

The Enferplex TB test and the role of serology in TB diagnosis

Molecular Epidemiology of Tuberculosis. Kathy DeRiemer, PhD, MPH School of Medicine University of California, Davis

Modelling the Dynamic of the Foot-and Mouth Disease in England 2001

Competent Authority comments on the draft report received 2 March 2018

bovis infections in badgers and cattle

The Royal Veterinary College. The Swiss Federal Veterinary Office

Badgers & TB Dave Dawson Defra 2011

Preventing and controlling btb is not just black and white.

ERADICATION OF BOVINE TUBERCULOSIS IN SLOVENIA

Interferon-gamma blood test What is it and why do we use it?

Modeling classical swine fever spread using a spatial hybrid model

P. Dandapat. Eastern Regional Station ICAR-Indian Veterinary Research Institute 37 Belgachia Road, Kolkata

Multi-clonal origin of macrolide-resistant Mycoplasma pneumoniae isolates. determined by multiple-locus variable-number tandem-repeat analysis

Use of GIS to Evaluate Livestock-Wildlife Interactions Relative to Tuberculosis Spread on Molokai Island, Hawaii

Persistence and molecular evolution of population from cattle and wildlife in Doñana National Park revealed by genotype variation

Overview of 2015 Zoonoses Data

Peer reviewed Volume 58 (11) : November, 2005 irish Veterinary Journal

A dynamic spatio-temporal model to investigate the effect of movements of animals on the spreading of Bluetongue BTV-8 in Belgium

Some interpretational issues connected with observational studies

Annual surveillance report 2015

Molecular typing for surveillance of multidrug-resistant tuberculosis in the EU/EEA

Exotic diseases approaching EU EFSA mandates on Peste des Petits Ruminants (PPR) and lumpy skin disease (LSD) coordinated by Alessandro Broglia

EU measures for surveillance and control of ASF in feral pigs

Lumpy skin disease: Scientific report

Exotic diseases approaching EU EFSA mandates on PPR, sheep pox, lumpy skin disease

Overview of 2014 Zoonoses Data

agriculture ISSN

Working Document. Eradication of Bovine Tuberculosis in the EU. accepted by the Bovine tuberculosis subgroup of the

Molecular typing for surveillance of multidrug-resistant tuberculosis in the EU/EEA

Unit 1 Exploring and Understanding Data

ANIMAL HEALTH SURVEILLANCE

Transmission of Mycobacterium orygis from a Tuberculosis Patient to a Dairy

Introduction. In the past 15 years, several technological advancements have open new perspectives and applications in the field of vaccinology.

Long-Term Assessment of Wild Boar Harvesting and Cattle Removal for Bovine Tuberculosis Control in Free Ranging Populations

Welsh Assembly Government Bovine TB Eradication Programme. Consultation on Badger Control in the Intensive Action Area. (Response from RSPB Cymru)

Research Article Proposal of a Screening MIRU-VNTR Panel for the Preliminary Genotyping of Mycobacterium bovis in Mexico

Camelid btb Testing Scenarios Guidance

in control group 7, , , ,

Agencia Española de Medicamentos y Productos Sanitarios C/Campezo 1, Edificio Madrid España (Reference Member State)

Annual surveillance report 2016

Telehealth Data for Syndromic Surveillance

List of Figures. List of Tables. Preface to the Second Edition. Preface to the First Edition

Field-Isolated Genotypes of Mycobacterium bovis Vary in Virulence and Influence Case Pathology but Do Not Affect Outbreak Size

Mycobacterium bovis in Swine: Spoligotyping of Isolates from Argentina

Risk Assessment Centre on Food Chain Project link to the Delphi priorities / EFSA Strategy topics

Expert mission on African swine fever in Estonia

To test the possible source of the HBV infection outside the study family, we searched the Genbank

OUT-TB Web. Ontario Universal Typing of Tuberculosis: Surveillance and Communication System

Transmissibility, virulence and fitness of resistant strains of M. tuberculosis. CHIANG Chen-Yuan MD, MPH, DrPhilos

The role of superspreading in Middle East respiratory syndrome coronavirus (MERS-CoV) transmission

ArcGIS for revealing space-time patterns of livestock diseases spread

MODELLING INFECTIOUS DISEASES. Lorenzo Argante GSK Vaccines, Siena

Enhancing animal health security and food safety in organic livestock production

African swine fever in the EU 13/10/16 EP

Geographical differences in prevalences and mortality rates of COPD

Infectious bovine rhinotracheitis: causes, signs and control options

LUMPY SKIN DISEASE. Exotic diseases approaching EU: Alessandro Broglia Animal and Plant Health Unit European Food Safety Authority - EFSA

Epidemiology of ASF in wild boar

Trichinellosis SURVEILLANCE REPORT. Annual Epidemiological Report for Key facts. Methods

TB Could Ruin Your Day (And Your Life)

Scientific Opinion on field trials for bovine tuberculosis vaccination 1

FMD Report - Syria 6 th Regional FMD West Eurasia Roadmap Meeting - Almaty, Kazakhstan 28 to 30 April 2015

between Norway and England plus Wales.

Walkability vs. Several Health Diagnoses for Klamath Falls, OR

What can pathogen phylogenetics tell us about cross-species transmission?

ZOETIS ARE PROUD TO SUPPORT THE JOINT ACTION AGAINST BLUETONGUE CAMPAIGN

Scientific Opinion on sheep pox and goat pox - first part

Investigating the benefits of an adaptive management approach involving emergency vaccination using simulated FMD outbreaks in New Zealand

The effects of annual widespread badger culls on cattle tuberculosis following the cessation of culling

OUTLINE INTRODUCTION 10/17/2011. Introduction Current Knowledge Future Directions

Division of Global Epidemiology, Research Center for Zoonosis Control. Conduct of ELISA test sample collection for the research study in Japan

Options for vaccinating cattle against bovine tuberculosis

California s Experiences Using Tuberculosis Whole Genome Sequencing

EUROPEAN COMMISSION SUMMARY REPORT OF THE STANDING COMMITTEE ON PLANTS, ANIMALS, FOOD AND FEED HELD IN BRUSSELS ON 12 JANUARY 2016

Application from the Autonomous Region of the Aosta Valley to declare the territory free, pursuant to article 10 of Directive 64/432/EC, from one of

NFU INFORMATION & ANALYSIS

Relationship between neighbourhood-level killed oral cholera vaccine coverage and protective efficacy: evidence for herd immunity

ANIMAL HEALTH in CROATIA with emphesis on CSF and other trade relevant animal diseases and zoonosis. Veterinary Directorate - MA April 3, 2012

National strategy for contagious bovine pleuropneumonia control in Guinea

The use of models in contingency planning. Anette Boklund, DVM, ph.d.

Shelley Rhodes & Martin Vordermeier

Veterinaria, Universidad de Córdoba, 14071, Córdoba, Spain. Autònoma de Barcelona, Bellaterra, Barcelona, Spain

Report Zoonosi. Unità campionata. Peso

BVDFree England FAQs

Eradication and monitoring programme for Bluetongue

Ministry of Agriculture RABIES CO-FINANCED ERADICATION PROGRAMME IN HUNGARY 2014 SCOPAFF

California s Experiences Using Tuberculosis Whole Genome Sequencing

ExperimentalPhysiology

Diabetes and Tuberculosis: A Practical Approach to Diagnosis and Treatment

Epidemiology of Verotoxigenic E. coli O157 in Ireland, 2003 Patricia Garvey and Paul McKeown

CHAPTER 3 CONTROL AND ERADICATION OF FMD

Transcription:

RESEARCH ARTICLE Spatial Dynamics of Bovine Tuberculosis in the Autonomous Community of Madrid, Spain (2010 2012) Maria Luisa de la Cruz 1, Andres Perez 2, Javier Bezos 1,3, Enrique Pages 4, Carmen Casal 1, Jesus Carpintero 4, Beatriz Romero 1, Lucas Dominguez 4,5, Christopher M. Barker 6, Rosa Diaz 4, Julio Alvarez 2 * OPEN ACCESS Citation: de la Cruz ML, Perez A, Bezos J, Pages E, Casal C, et al. (2014) Spatial Dynamics of Bovine Tuberculosis in the Autonomous Community of Madrid, Spain (2010 2012). PLoS ONE 9(12): e115632. doi:10.1371/journal.pone. 0115632 Editor: Christophe Sola, Institut de Génétique et Microbiologie, France Received: April 21, 2014 Accepted: November 5, 2014 Published: December 23, 2014 Copyright: ß 2014 de la Cruz et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Data Availability: The authors confirm that, for approved reasons, some access restrictions apply to the data underlying the findings. Data used in this study are available upon request to the official veterinary services of the Autonomous Community of Madrid but cannot be made freely available to the general public due to legal restrictions. The reason for this is that data used here come from the official records of the bovine tuberculosis eradication campaigns in the region of Madrid, and contains private information that cannot be disclosed without the individual agreement of each of the farmers tested in the eradication program. Data may be provided to any interested party that request it to the official veterinary services provided that any information that could lead to the individual identification of a given farm (such as its individual spatial location - coordinates - or the results of any individual herd test) is conveniently removed. Aggregated data at the county/year level can be shared without any inconvenience if a request is made. Requests should be directed to the head of the livestock area of the regional government of the Autonomous Community of Madrid, Ms. Rosa Diaz (rosa.diaz@madrid.org). 1. Centro de Vigilancia Sanitaria Veterinaria VISAVET, Universidad Complutense, Madrid, Spain, 2. Department of Veterinary Population Medicine, University of Minnesota, St. Paul, Minnesota, United States of America, 3. MAEVA SERVET SL, Alameda del Valle, Madrid, Spain, 4. Área de Ganadería, Dirección General de Medio Ambiente, Consejería de Medio Ambiente, Vivienda y Ordenación del Territorio de la Comunidad de Madrid, Madrid, Spain, 5. Departamento de Sanidad Animal, Facultad de Veterinaria, Universidad Complutense, Madrid, Spain, 6. Center for Vectorborne Diseases and Department of Pathology, Microbiology, and Immunology, School of Veterinary Medicine, University of California Davis, Davis, California, United States of America *jalvarez@umn.edu Abstract Progress in control of bovine tuberculosis (btb) is often not uniform, usually due to the effect of one or more sometimes unknown epidemiological factors impairing the success of eradication programs. Use of spatial analysis can help to identify clusters of persistence of disease, leading to the identification of these factors thus allowing the implementation of targeted control measures, and may provide some insights of disease transmission, particularly when combined with molecular typing techniques. Here, the spatial dynamics of btb in a high prevalence region of Spain were assessed during a three year period (2010 2012) using data from the eradication campaigns to detect clusters of positive btb herds and of those infected with certain Mycobacterium bovis strains (characterized using spoligotyping and VNTR typing). In addition, the within-herd transmission coefficient (b) was estimated in infected herds and its spatial distribution and association with other potential outbreak and herd variables was evaluated. Significant clustering of positive herds was identified in the three years of the study in the same location ( high risk area ). Three spoligotypes (SB0339, SB0121 and SB1142) accounted for.70% of the outbreaks detected in the three years. VNTR subtyping revealed the presence of few but highly prevalent strains within the high risk area, suggesting maintained transmission in the area. The spatial autocorrelation found in the distribution of the estimated within-herd transmission coefficients in herds located within distances,14 km and the results of the spatial PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 1/16

Funding: This project was partly supported by Agriculture and Food Research Initiative Competitive Grant no. 2013-67015-21244 from the USDA National Institute of Food and Agriculture. CMB also acknowledges support from the Research and Policy for Infectious Disease Dynamics program of the Science and Technology Directorate, Department of Homeland Security and the Fogarty International Center, National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing Interests: Dr. Bezos is currently affiliated with MAEVA SERVET SL, but this affiliation does not represent any competing interest with the results reported here and does not alter the authors adherence to PLOS ONE policies on sharing data and materials. regression analysis, support the hypothesis of shared local factors affecting disease transmission in farms located at a close proximity. Introduction Bovine tuberculosis (btb), caused by members of Mycobacterium tuberculosis complex (mainly M. bovis, and to a lesser extent, M. caprae) is an important zoonotic disease with a global distribution that has major implications for both animal and human health [1]. Implementation of eradication programs, mainly through test-and-slaughter strategies, has led to a significant decrease of the prevalence and even to disease eradication in many developed countries [2, 3] However, success of eradication programs is not uniform, leading to the persistence of btb in certain areas, usually associated with the presence of one or more known risk factors, such as wildlife reservoir, large herds, or extensive management that complicates animal testing [4 6]. The efficacy of eradication programs may be improved by using spatial statistics to detect clusters of persistent infection and consequently targeting control efforts to those high risk clusters [7], as shown previously for bovine tuberculosis in livestock [8, 9] and wildlife [10, 11]. Spatial analysis can be particularly powerful when combined with molecular typing techniques, such as spoligotyping [12], and MIRU-VNTR typing [13], which can provide critical information on the spatio-temporal patterns of pathogen transmission [14]. The use of those techniques has provided useful information of the distribution of M. bovis/m. caprae in a number of countries [15 18], demonstrated the transmission between livestock and wildlife [19], and provided useful information at a regional/local scale [11]. Strain-related differences in terms of transmissibility and/or virulence has been also suggested [20]. In Spain, a national btb eradication program has been in place since 1987, resulting in a marked decrease of btb herd prevalence (from 11.4% in 1986 to 1.31% in 2012), although progress has been heterogeneous. This program is nowadays based on yearly skin testing of every $6 weeks old animal, parallel use of the interferon-gamma (IFN-c) assay as an ancillary diagnostic test in infected herds, slaughter of all reactors, control of livestock movement, slaughterhouse surveillance and monitoring, and control measures in wildlife reservoirs [21]. Despite the program s success, the disease is still present at levels of concern in some areas, such as the Autonomous Community of Madrid (ACM) [21], in which a special incidence area was recently declared [22], thus suggesting the presence of factors impairing the progress of the eradication campaigns. In the present study, a spatial analysis was carried out using btb data collected in the ACM during a three-year period (2010 2012) with the objective of identifying clusters of farms at high risk of disease. In addition, information on the molecular profiles of the M. tuberculosis complex strains isolated from cattle PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 2/16

during the study was used to identify highly prevalent strains associated with persistent local transmission. Finally, differences in the within-herd transmission coefficients estimated at a herd level in infected herds were also assessed, as well as possible factors associated with high rates of disease transmission. Results found here will help to evaluate the progress of btb control in ACM and to support the design and implementation of effective eradication programs in the regions. Materials and Methods 1. Study population The ACM, located in central Spain, covers an area of 8,022 km 2, with a mean altitude of 650 m and a continental-mediterranean climate. During the 2010 2012 study period, ACM was home to 1,496 cattle herds that were tested at least once during the 3 year study period in the frame of the eradication program. Only herds for which the spatial location (coordinates) was available to us (n51,387, 92.7%) were included in the study (Fig. 1). The predominant production type was beef (83.3% of the herds), followed by bullfighting (6.9%) and dairy (6.1%), whereas the remaining herds (,4%) were of mixed types. Information included in the study was exclusively derived from the work performed in the frame of the eradication programs, and thus no experimental research on animals was performed. 2. In-vivo tuberculosis diagnostic tests All active cattle herds included in the program were subjected to at least one annual herd test using the single intradermal tuberculin (SIT) test according to the European and Spanish regulations [23, 24]. SIT tests were performed by field practitioners in all animals.6 weeks old by inoculation of 0.1 mg of the official bovine PPD (CZ Veterinaria, Porriño, Spain) in the left side of the neck. After 72 hours, animals with an increase of the skin fold thickness.2 mm were considered reactors (severe interpretation). In addition, animals.6 months old from positive herds (in which the infection was confirmed by detection of lesions, culture and/or epidemiological evidences) were also subjected to IFN-c testing. Hence, the IFN-c assay was used in those herds as an ancillary test to maximize the number of infected animals detected [23] as described elsewhere [25]. 3. Post-mortem laboratory tests All reactors were subjected to post-mortem analysis to confirm the infection: first, animals were screened to detect macroscopic lesions compatible with btb in the slaughterhouse. Lesions (if present) or tissue samples (lung and retropharyngeal, bronchial and mediastinal lymph nodes) were collected from all reactors and processed in the laboratory for isolation of M. tuberculosis complex members [26]. Isolates were identified as M. bovis/m. caprae and characterized using spoligotyping [12]. Isolates from the most prevalent spoligotypes in areas of high prevalence were also typed using the Variable Number of Tandem Repeats PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 3/16

Fig. 1. Location of cattle herds tested in the btb eradication program during 2010 2012 in the ACM. Black dots indicate herds that were positive at some stage in 2010 2012, and white dots indicate herds consistently negative during the three years. Circles indicate clusters of high risk identified in 2010, 2011 and 2012. doi:10.1371/journal.pone.0115632.g001 (VNTR) method as described before [13] using four loci (ETR-A, ETR-B, QUB11a and 3232s) (S1 Table) previously described to be highly variable among M. bovis isolates from the Iberian peninsula [27, 28]. 4. Data analysis Information on the herd type (beef, dairy, bullfighting or other) and census, management (extensive/intensive), location and btb test results (date, tests PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 4/16

performed, number of animals tested, number of reactors at each test, number of M. bovis/m. caprae positive cultures, spoligotype/vntr profiles found) during 2010 2012 were collected at the herd level from the official veterinary services and the MycoDB (http://www.mycodb.es) databases. Positive herds were those in which at least one reactor at the SIT test and/or the IFN-c assay was disclosed in a herd-test during the study period. An outbreak was defined as the time period from first disclosure of a btb reactor until the herd had recovered its official btbfree (OTF) status. Proportions and quantitative outcomes obtained in different groups/clusters were compared using non-parametric tests (chi-square test, Mann-Whitney test, Kruskal-Wallis test). The evolution of the herd prevalence in the ACM was evaluated using the Cochrane-and-Armitage and Mantel tests for lineal trend. Cochrane Orcutt procedure was applied to control serial correlation [29]. The discriminatory power (D) of spoligotyping and combined spoligo- VNTR typing, defined as the average probability that each technique will allocate two isolates randomly sampled from a population in two different groups, was calculated using the Hunter and Gaston equation [30]. For the analysis each different profile obtained from a given herd was counted once regardless the number of typed isolates sharing the same profile. Clustering of positive herds/prevalent molecular profiles was assessed using the Bernoulli model of the spatial scan statistic. This model compares the observed number of btb-positive herds within all possible circular spatial windows in the study area with the expected number of cases under the null hypothesis of random distribution of positive herds [31]. We limited candidate clusters to 50% of the total herds, and the region was scanned for areas at high and low risk for the disease. The test was implemented using the SaTScan software version 9.1.1 [32]. In addition, we estimated the transmission coefficient (b, the average number of animals infected from an infectious individual per unit of time) [33, 34] in positive herds with sufficient available information (date of first positive herd-test, size of the herds, and number of reactors at each diagnostic test). Estimates for b were calculated at the herd level as previously described with a slight modification: the sensitivity and specificity of the in-vivo diagnostic tests were assumed to range from 0.632 to 0.839 and 0.755 to 0.968, respectively, in agreement with previous findings in a similar epidemiological setting as the one studied here [35]. Values of b were computed after 1000 simulations using @RISK 5.5 (Palisade Co, Ithaca, NY, USA). Incremental spatial autocorrelation (ISA) of the log-transformed b coefficients in the region was evaluated at increasing distances up to 22 km using Moran s I [36]. Before autocorrelation was assessed, spatially isolated herds (defined as herds separated from their nearest neighbor by more than three standard deviations of the nearest-neighbor distances for all herds) were removed. When Moran s I detected significant autocorrelation, the locations of any clusters were identified using the Getis-Ord G* i statistic [37], which compared local b values (for each herd and its neighbors within various distance bands) with global values to identify areas with b values that were higher ( hot spots ) or lower than expected ( cold spots ). All autocorrelation tests were carried out using the Spatial PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 5/16

Statistics Tools implemented in ArcGIS 10.1 SP1 (ESRI, Redlands, California, USA). Possible association between the herd-level factors and the log-transformed b coefficient for each herd were identified using simple linear regression. Potentially significant (p,0.3) covariates were then included as main effects in a multiple regression model including significant (p,0.05) scientifically sound two-way interactions. The final model was selected by an all-possible-subset regression algorithm using the C p criterion developed by Mallows [38]. Residuals of the final model were analyzed for spatial autocorrelation using Moran s test [36] to determine whether any spatial autocorrelation detected by the ISA above had been explained by the model for herd-level factors. For this analysis, the neighborhood for each herd was defined by the ISA distance band identified above with inversedistance weighting between herds. When significant residual spatial autocorrelation was found, a conditional autoregressive (CAR) model [39] was fitted using the same covariates [40]. Regression analyses were carried out using R [41] and the spdep package for CAR models [42]. Results 1. Distribution of btb-positive farms Herd-level prevalence (number of positive herds) was 5.5% (n572), 7.3% (n594), and 5.9% (n580) in 2010, 2011, and 2012 respectively, providing a nonsignificant trend for the evolution of the herd prevalence in the three-year period of study (p.0.05). Herd prevalence was not associated with production type (Chi-square test, p.0.05). High risk clusters (p,0.05) were identified at approximately the same spatial location in each of the three years of study (Fig.1, Table 1). Up to 230 herds (16.6% of those included in the study) were included in a significant cluster at least once during the study period, 157 of which were consistently found in the area in which all three clusters overlapped (defined as high risk area from now on). A significantly higher proportion of bullfighting herds were found in the 230 herds included at least once in a significant cluster compared with the rest of the population (10.9% vs. 6.1%, Chi-square test, p50.012) although this difference became non-significant when the group was narrowed to include only the 157 herds consistently found in the high risk area (p50.12). No significant differences were observed in the herd size depending on the location (inside/outside high risk areas) (Mann-Whitney test, p50.3). 2. Molecular characterization of btb outbreaks At least one positive M. bovis culture was obtained and characterized in 76.4% (55/72), 73.4% (69/94) and 72.5% (58/80) of the positive herds detected in 2010, 2011 and 2012 respectively. Overall M. bovis spoligotypes were available for 129 (72.9%) of the 179 herds that were positive at some stage during the study period; PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 6/16

Table 1. Significant (p,0.05) clusters of bovine tuberculosis-positive herds found in each year during the period 2010 2012 in the Autonomous Community of Madrid. Year Radius (km) Included herds Cases Observed Cases Expected RR a P-value 2010 14.6 217 37 11.9 5.35,0.001 2011 13.4 154 56 11.3 10.8,0.001 2012 14.0 144 43 9.15 9.00,0.001 a Relative risk within the cluster. doi:10.1371/journal.pone.0115632.t001 in 64 of them more than one (and up to seven) different spoligotype profiles were detected. A total of 30 spoligotypes were found, with three profiles accounting for.70% of the profiles found every year (SB0339: 36.0%; SB0121: 20.2%; and SB1142: 17.4%). The discriminatory index at the herd level was D50.81. A significant cluster of high prevalence (p50.027) was only found for SB1142, comprising most of the isolates located in the high risk area and in fact isolates belonging to this spoligotype were found significantly (Chi-square test, p50.001) more often within the high risk area than outside (with 85.7% of all the SB1142 spoligotypes identified in the ACM found within this area). The discriminatory index obtained including herds located in the high risk area was D50.75. Two-hundred and eighteen isolates belonging to the three most prevalent spoligotypes in the high risk area (SB0339, n5112; SB0121, n561 and SB1142, n545), recovered in the 2010 2012 period from 53 different herds, were subjected to VNTR-typing (1 18 VNTR-typed isolates per herd). Fifteen of these 53 herds were positive at least two years during the study period. The three spoligotypes were subdivided into 24 different combined spoligotype-vntr patterns. Spoligotypes SB0339 and SB1142 were subdivided into eight and four VNTR subtypes respectively, although one of them accounted for the majority of the isolates (MV0006 for SB0339, present in 72/112 (64.3%) of the isolates, and MV0003, found in 41/45 (91.1%) SB1142 isolates) (S1 Table). In contrast, SB0121 was further subdivided into 12 VNTR types, of which MV0001 and MV0074, the most abundant, were observed in only 16 (26.2%) isolates each of the 61 SB0121 typed strains (S1 Table). No significant (p.0.05) clustering of any spoligotype- VNTR pattern was identified within the high risk area. At the herd level the discriminatory index for the combination of spoligotyping and VNTR in the high risk area was 0.83. More than one spoligotype-vntr profile was observed in 22 (41.5%) of the 53 herds in the high risk area. In 12 of the 15 recurrently positive herds (positive at least two years) in 2010 2012 more than one profile was found (OR compared with non-recurrently positive herds 511.2, 95% CI52.6 48). 3. Spatial distribution of the b coefficient Estimated within-herd transmission coefficients, b, were available for 152 btb outbreaks in 142 cattle herds during 2010 2012 in Madrid, of which 143 occurred in 133 cattle herds (114 beef, 13 dairy and 6 bullfighting) with a known spatial PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 7/16

location. Sixty-one of these herds were located within the high risk area. The median b estimate was 4.42 (IQR52.62 6.29). No significant differences were found between locations of the outbreaks (within/outside the high risk area; Mann-Whitney test, p50.6) or production types (Kruskal-Wallis test, p50.25). In contrast, b was significantly higher (Mann-Whitney test, p,0.001) in herds in which the IFN-c assay had been applied (n587, median b54.85) compared to those where only the SIT test was used (n546, median b52.6) and in those where M. bovis was isolated (n5100, median b54.67) compared with those where it was not (n533, b52.58). The analysis of the log-transformed bs estimated in herds from the whole ACM (n5133) suggested the absence of clustered transmission dynamics (Moran s I50.40, Z51.32, p50.19) once spatial outliers (n56) were removed. Still, incremental spatial autocorrelation analysis revealed that most clustering, although not significant (p50.09), occurred at 14 km. When the analysis was performed using only infected herds located in the high risk area (n560), incremental spatial correlation analysis of the log-transformed bs revealed the occurrence of highly significant positive autocorrelation (p50.0003 0.036) between 6 and 14 km distance with a peak at 12 km (Fig. 2). In the high risk area, Getis-Ord G* i revealed the presence of hot and cold spots with unexpectedly high and low log-transformed b values (p,0.05) in the western and eastern parts of the area respectively, including 5 and 7 herds (Fig. 3). 4. Regression analysis Bivariate linear regressions using data from all the ACM failed to identify any herd- or management-related variable associated with disease. However, there were six btb-related variables as potentially (p,0.3) associated with the logtransformed b coefficient: number of reactors in the first herd test, number of positive herd-tests in the outbreak, use of IFN-c, isolation of M. bovis during the outbreak, number of spoligotypes present and existence of previous outbreaks). The final multivariable model included only the number of reactors in the first herd-test, use of IFN-c assay, isolation of M. bovis and the interaction between the latter two (Table 2). Moran s I test for spatial autocorrelation in residuals from this model did not detect any evidence of spatial correlation (p50.20). Bivariate analysis of data from herds located in the high risk area identified a slightly different set of production (management type and categorized census) and outbreak-associated (number of reactors in the first herd test, use of IFN-c, isolation of M. bovis during the outbreak and existence of previous outbreaks) variables as potentially associated with the log-transformed b coefficient. The final model included only number of positive reactors in the first herd test, isolation of M. bovis and existence of previous outbreaks. However, in this case Moran s I test for spatial autocorrelation in residuals from the model suggested the presence of spatial correlation (p50.06). Consequently, a CAR model was fitted, which resulted in controlling for spatial autocorrelation (l56.69*10 25,p50.15) (Table 2). PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 8/16

Fig. 2. ISA of the log-transformed b coefficient of btb infected herds located in a high risk area (n560) in the ACM in 2010 2012. doi:10.1371/journal.pone.0115632.g002 Discussion Despite the efforts and funds invested on btb control programs, disease eradication from the cattle population still remains a challenge in many developed countries. Even within a single country, the results of national eradication programs may be highly variable. This heterogeneity is often linked to the presence of a significant wildlife reservoir that maintains the infection [43], but may occur also in areas such as the ACM in which prevalence of infection in the potential wildlife reservoir species present, the wild boar, is considered low. Here, we analyzed the spatial variation in btb within the ACM to describe risk patterns and determine the causes of departures from typical transmission levels within the region. Data from a last three-year period (2010 2012) revealed a consistent cluster of high prevalence (Fig. 1). This is not surprising, given the considerable time required for regaining the OTF status in infected herds, with a median duration of 307 days in the period 2006 2012 in the same region [35]. The lack of additional clusters in other areas in which estimates of wild boar density are similar or higher than in the high risk area [44, 45] suggest that at least this is not the only factor playing a role in the maintenance of btb in the region. Given the limitations of btb diagnostic techniques, isolation of the causative agent is desirable (and usually required) to confirm the infection at the herd level. In this study, we were able to confirm the infection in 75.6% of the positive herds, and at least one isolate was characterized using spoligotyping in 96.9% of them PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 9/16

Fig. 3. Cluster of herds showing significantly (p,0.05) low (black dots) or high (white dots) values for the log-transformed b coefficient as determined by Getis-Ord G* i within a high risk area of the ACM. doi:10.1371/journal.pone.0115632.g003 (approximately 73% of all detected outbreaks). Molecular typing data revealed the presence of three highly prevalent spoligotypes in the region, two of which (SB0121 and SB0339) are among the 15 most abundant profiles in a database of M. bovis isolates collected throughout all Spain in 1992 2007 [15]. Discriminatory power of spoligotyping in the region was lower than that described for the whole country (D50.81 vs. D50.87) [15]. In fact, finding that more than 70% of the profiles belonged to just three spoligotypes highlights the limitations of this technique for epidemiological purposes. This is particularly true when PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 10 / 16

Table 2. Point estimates, standard errors (S.E.) and 95% confidence intervals (95% CI) of the regression coefficients (b) and P-value of the variables remaining in the final models measuring the association between herd-level covariates and the log-transformed within-herd transmission coefficient for all infected herds located in the Autonomous Community of Madrid in 2010-2012 (n5246) and infected herds located in a high risk area (n565). Population studied Variable b S.E. P All herds reactors in first herd-test 0.047 0.008,0.001 use of IFN-c 0.397 0.095,0.001 History of previous outbreaks 20.211 0.109 0.05 Herds in high risk area reactors in first herd-test 0.054 0.009,0.001 Isolation of M. bovis 0.574 0.203 0.006 History of previous outbreaks 20.255 0.133 0.06 doi:10.1371/journal.pone.0115632.t002 spoligotypes highly prevalent at the country level are found [46], as with no further information it is impossible to conclude if finding them is due to the recirculation of a limited number of highly prevalent strains or to a lack of discriminatory power of the technique. For this reason isolates belonging to the three most prevalent spoligotypes in the high risk area were further subtyped using VNTR analysis. However, although the use of VNTR subtyping increased the discriminatory ability, a considerable genetic homogeneity was still found for SB0339 and SB1142 (with one spoligo- VNTR pattern accounting for 60 90% of the isolates) (S1 Table). The larger variability in isolates with a SB0121 spoligotype found here was in agreement with a previous study in which a panel of 115 SB0121 M. bovis isolates was further divided in 65 VNTR profiles [28]. Still, a more limited variability was observed here (D50.83 compared with D50.99), probably related with the increased probability of finding isolates epidemiologically related. At the national level SB0339 and SB1142 are found predominantly in the ACM (up to November 2013 52% and 78.2% of all typed isolates belonging to these profiles were coming from cattle located in this region according to the Spanish database of animal mycobacteriosis) [47]. Therefore, the limited genetic variability found in those spoligotypes may reflect the endemicity of a reduced number of spoligo-vntr types widely distributed in the region. On the other hand, the higher heterogeneity found in isolates from the SB0121 spoligotype, the most abundant in the Iberian Peninsula [48, 15], could be a consequence of several different and unrelated introductions of M. bovis strains from other regions of the country. Thus, usefulness in outbreak investigation of VNTR to determine the potential relatedness of isolates with an epidemiological link would be highly dependent on the spoligotype of the isolates being typed. Still, the association between a higher number of spoligo-vntr patterns found in a given herd and its positivity for at least two years in 2010 2012 suggests that recurrence of btb in the herd in this three-year period may be related not only with persistence of infection but also to exogenous introductions of different M. bovis strains. Within-herd transmission coefficient estimates found in the present study were in line with those obtained in the ACM [35] and elsewhere [49 51]. Horizontal transmission of btb is considered to be low under normal circumstances, but PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 11 / 16

certain management factors (such as herd size and density, or lack of hygienic measures in place) may contribute to increase the cattle-to-cattle transmission [52, 53]. In addition, the ancillary use of more sensitive diagnostic techniques, such as the IFN-c detection assay, may induce an increase in the number of positive animals being detected, yielding an apparent increased transmission within a herd [35]. Therefore finding herd and outbreak-related variables potentially associated with the b estimate in a given herd was not an unexpected finding. Final models selected only variables associated with the outbreak (use of IFN-c, number of reactors found in the first positive herd test and history of previous btb outbreaks for the whole region and reactors in the first herd, history of previous outbreaks and isolation of M. bovis in the herd for the high risk area) reflecting the expected strong impact of increased number of reactors and of confirming the infection in the method used for b estimation. Although a prior history of disease in the herd has been associated previously with an increased risk of future outbreaks [54], here it was associated with a decreased estimate of b (both in the whole ACM and the high risk area) (Table 2). This would suggest that transmission was particularly low in herds experiencing repeated outbreaks compared with the rest of infected farms present in the region during the study period. Possible explanations for such finding include the presence of an increased rate of false-negative reactors in these farms (that could lead to an incorrectly lower estimate of within-herd transmission) or anergic infected cattle that would originate the different outbreaks. Interestingly the genetic profile of the isolate was not associated with the estimated transmission at the herd level; this could be due to a lack of strain-dependent differences in the transmissibility of a given strain or to the effect of the test-and-cull strategies that would hamper the expression of these differences at demonstrable levels [20]. The spatial pattern of the b coefficient across the region and particularly in the high risk area revealed a significant effect of the location of the herds in their estimates. A strong positive autocorrelation was found at low distances (,14 km) suggesting that the intensity of transmission within neighboring herds was similar. Such result may be due to a shared contact network (between-herd contacts in shared pastures, controlled and uncontrolled local cattle movements, exposure to infected wildlife or other as yet unidentified local source in herds located in the same vicinity). Neighboring contacts can be highly variable between and within regions [55], and no information was available here to further characterize the contact networks between farms in the ACM. However, the lack of autocorrelation in the residuals of the best model found for the whole region suggests that at the regional level variables included in the final model (use of IFN-c assay, number of reactors in the first herd test and previous history of bovine tuberculosis) may account for the majority of the spatial variation of the b coefficient. At a local scale in the high risk area, evidences suggesting the existence of autocorrelation in the residuals of the best linear regression model led to the use of a CAR model, selected due to its best fit for situations with relatively local spatial autocorrelation [56], as those shown by the incremental spatial autocorrelation analysis here. The lack of autocorrelation in the residuals once the PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 12 / 16

CAR model was fit supports the hypothesis of shared local factors affecting disease transmission in farms located at a close proximity (,14 km) within the high risk area. In summary, btb was unevenly distributed in the ACM, with a cluster of increased incidence being present in 2010 2012. Most cases (.70%) detected in the region were due to three spoligotypes (SB0339, SB0121 and SB1142). VNTR analysis of isolates from the high risk area belonging to these profiles revealed a high genetic homogeneity of isolates belonging to SB0339 and SB1142, thus suggesting a wide distribution of certain strains with a sustained transmission in the area. Within-herd transmission coefficient estimates were in agreement with those reported earlier for the same area, but the strong spatial dependence between the data, particularly in the high risk area, found at distances,14 km further supports the hypothesis of local transmission of strains between neighbor herds, or from a common source. These results will help to evaluate progress and to increase the effectiveness of btb control programs in the region. Supporting Information S1 Table. VNTR subtypes of the three more prevalent spoligotypes recovered from the high risk area during the study period. doi:10.1371/journal.pone.0115632.s001 (DOCX) Author Contributions Conceived and designed the experiments: LD RD JA JC. Performed the experiments: MC JB EP CC BR. Analyzed the data: MC AP CB JA. Contributed reagents/materials/analysis tools: EP BR RD LD. Wrote the paper: MC AP CB JA. References 1. Collins JD (2006) Tuberculosis in cattle: Strategic planning for the future. Vet Microbiol 112: 369 381. 2. Cousins DV, Roberts JL (2001) Australia s campaign to eradicate bovine tuberculosis: the battle for freedom and beyond. Tuberculosis (Edinb) 81: 5 15. 3. European Food Safety Authority (EFSA) ECfDPaCE (2013) The European Union Summary Report on Trends and Sources of Zoonoses, Zoonotic Agents and Food-borne Outbreaks in 2011. EFSA Journal 11: 1 250. 4. Humblet MF, Boschiroli ML, Saegerman C (2009) Classification of worldwide bovine tuberculosis risk factors in cattle: a stratified approach. Vet Res 40: 50. 5. Menzies FD, Neill SD (2000) Cattle-to-cattle transmission of bovine tuberculosis. Vet J 160: 92 106. 6. Ramirez-Villaescusa AM, Medley GF, Mason S, Green LE (2009) Herd and individual animal risks associated with bovine tuberculosis skin test positivity in cattle in herds in south west England. Prev Vet Med 92: 188 198. 7. Ward MP, Carpenter TE (2000) Analysis of time-space clustering in veterinary epidemiology. Prev Vet Med 43: 225 237. PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 13 / 16

8. Allepuz A, Casal J, Napp S, Saez M, Alba A, et al. (2011) Analysis of the spatial variation of Bovine tuberculosis disease risk in Spain (2006 2009). Prev Vet Med 100: 44 52. 9. Perez AM, Ward MP, Torres P, Ritacco V (2002) Use of spatial statistics and monitoring data to identify clustering of bovine tuberculosis in Argentina. Prev Vet Med 56: 63 74. 10. Olea-Popelka FJ, Griffin JM, Collins JD, McGrath G, Martin SW (2003) Bovine tuberculosis in badgers in four areas in Ireland: does tuberculosis cluster? Prev Vet Med 59: 103 111. 11. Olea-Popelka FJ, Flynn O, Costello E, McGrath G, Collins JD, et al. (2005) Spatial relationship between Mycobacterium bovis strains in cattle and badgers in four areas in Ireland. Prev Vet Med 71: 57 70. 12. Kamerbeek J, Schouls L, Kolk A, van AM, van SD, et al. (1997) Simultaneous detection and strain differentiation of Mycobacterium tuberculosis for diagnosis and epidemiology. J Clin Microbiol 35: 907 914. 13. Frothingham R, Meeker-O Connell WA (1998) Genetic diversity in the Mycobacterium tuberculosis complex based on variable numbers of tandem DNA repeats. Microbiology 144 (Pt 5): 1189 1196. 14. Maslow JN, Mulligan ME, Arbeit RD (1993) Molecular epidemiology: application of contemporary techniques to the typing of microorganisms. Clin Infect Dis 17: 153 162. 15. Rodriguez S, Romero B, Bezos J, De JL, Alvarez J, et al. (2010) High spoligotype diversity within a Mycobacterium bovis population: clues to understanding the demography of the pathogen in Europe. Vet Microbiol 141: 89 95. 16. Rodriguez S, Bezos J, Romero B, De JL, Alvarez J, et al. (2011) Mycobacterium caprae infection in livestock and wildlife, Spain. Emerg Infect Dis 17: 532 535. 17. Smith NH, Berg S, Dale J, Allen A, Rodriguez S, et al. (2011) European 1: a globally important clonal complex of Mycobacterium bovis. Infect Genet Evol 11: 1340 1351. 18. Smith NH (2012) The global distribution and phylogeography of Mycobacterium bovis clonal complexes. Infect Genet Evol 12: 857 865. 19. Romero B, Aranaz A, Sandoval A, Alvarez J, De JL, et al. (2008) Persistence and molecular evolution of Mycobacterium bovis population from cattle and wildlife in Donana National Park revealed by genotype variation. Vet Microbiol 132: 87 95. 20. Wright DM, Allen AR, Mallon TR, McDowell SW, Bishop SC, et al. (2013) Field-isolated genotypes of Mycobacterium bovis vary in virulence and influence case pathology but do not affect outbreak size. PLoS One 8: 74503. 21. Ministerio de Agricultura AyMA (2013) Programa nacional de erradicación de tuberculosis bovina presentado por España para el año 2013. Available: http://rasve.magrama.es/publica/programas/ NORMATIVA%20Y%20PROGRAMAS/PROGRAMAS/2013/TUBERCULOSIS%20BOVINA/ PROGRAMA%20TB%202013 PDF. 22. Consejería de Medio Ambiente y Ordenación del Territorio C (2013) Resolución de 19 de marzo de 2013. BOCM 73: 77 79. 23. Anon. (2006) Working Document on Eradication of Bovine Tuberculosis in the EU accepted by the Bovine tuberculosis subgroup of the Task Force on monitoring animal disease eradication. SANCO/ 10200/2006. 24. Real Decreto 2611/1996, de 20 diciembre (1996) "por el que se regulan los programas nacionales de erradicación de enfermedades de los animales". BOE. 307: 38115 33. 25. Alvarez J, Perez A, Bezos J, Marques S, Grau A, et al. (2011) Evaluation of the sensitivity and specificity of bovine tuberculosis diagnostic tests in naturally infected cattle herds using a Bayesian approach. Vet Microbiol 155: 38 43. 26. Corner LA, Trajstman AC (1988) An evaluation of 1-hexadecylpyridinium chloride as a decontaminant in the primary isolation of Mycobacterium bovis from bovine lesions. Vet Microbiol 18: 127 134. 27. Duarte EL, Domingos M, Amado A, Cunha MV, Botelho A (2010) MIRU-VNTR typing adds discriminatory value to groups of Mycobacterium bovis and Mycobacterium caprae strains defined by spoligotyping. Vet Microbiol 143: 299 306. PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 14 / 16

28. Rodriguez-Campos S, Navarro Y, Romero B, De JL, Bezos J, et al. (2013) Splitting of a prevalent Mycobacterium bovis spoligotype by variable-number tandem-repeat typing reveals high heterogeneity in an evolving clonal group. J Clin Microbiol 51: 3658 3665. 29. Cochrane D, Orcutt GH (1949) Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms. J-Am-STAT-Assoc, 44: 32 61. 30. Hunter PR, Gaston MA (1988) Numerical index of the discriminatory ability of typing systems: an application of Simpson s index of diversity. J Clin Microbiol 26: 2465 2466. 31. Kulldorff M, Nagarwalla N (1995) Spatial disease clusters: detection and inference. Stat Med 14: 799 810. 32. Kulldorff M, Information Management Services I (2009) SaTScan TM v8.0: Software for the spatial and space-time scan statistics. Available: http://www.satscan.org/. 33. Begon M, Bennett M, Bowers RG, French NP, Hazel SM, et al. (2002) A clarification of transmission terms in host-microparasite models: numbers, densities and areas. Epidemiol Infect 129: 147 153. 34. de Jong MCM (1995) Mathematical modelling in veterinary epidemiology: why model building is important. Prev Vet Med 25: 183 193. 35. Alvarez J, Perez AM, Bezos J, Casal C, Romero B, et al. (2012) Eradication of bovine tuberculosis at a herd-level in Madrid, Spain: study of within-herd transmission dynamics over a 12 year period. BMC Vet Res 8: 100. 36. Moran PA (1950) Notes on continuous stochastic phenomena. Biometrika 37: 17 23. 37. Ord JK, Getis A (1995) Local spatial autocorrelation statistics: distributional issues and an application. Geographical analysis 27: 286 306. 38. Mallows CL (1973) Some comments on Cp. Technometrics 15: 676. 39. Schabenberger O, Gotway CA (2005) Statistical methods for spatial data analysis. London: Chapman & Hall. 40. Bivand RS, Pebesma EJ, Gomez-Rubio V (2008) Applied spatial data analysis with R. Springer Science+Business Media. 41. R development core team (2011) R: a language and environment for statistical computing. Vienna, Austria. 42. Bivand R (2011) spdep: spatial dependence: weighting schemes, statistics and models. http://cranrprojectorg/package5spdep. 43. Pfeiffer DU (2013) Epidemiology caught in the causal web of bovine tuberculosis. Transbound Emerg Dis 60 Suppl 1: 104 110. 44. Bosch J, Peris S, Fonseca C, Martinez M, de la Torre A, et al. (2012) Distribution, abundance and density of the wild boar on the Iberian Peninsula, based on the CORINE program and hunting statistics. Folia Zoologica 61: 138 151. 45. Acevedo P, Quirós-Fernández F, Casal J, Vicente J (2014) Spatial distribution of wild boar population abundance: Basic information for spatial epidemiology and wildlife management. Ecol Indic 36: 594 600. 46. Hewinson RG, Vordermeier HM, Smith NH, Gordon SV (2006) Recent advances in our knowledge of Mycobacterium bovis: a feeling for the organism. Vet Microbiol 112: 127 139. 47. Rodriguez-Campos S, Gonzalez S, De JL, Romero B, Bezos J, et al. (2012) A database for animal tuberculosis (mycodb.es) within the context of the Spanish national programme for eradication of bovine tuberculosis. Infect Genet Evol 12: 877 882. 48. Duarte EL, Domingos M, Amado A, Botelho A (2008) Spoligotype diversity of Mycobacterium bovis and Mycobacterium caprae animal isolates. Vet Microbiol 130: 415 421. 49. Barlow ND, Kean JM, Hickling G, Livingstone PG, Robson AB (1997) A simulation model for the spread of bovine tuberculosis within New Zealand cattle herds. Prev Vet Med 32: 57 75. 50. Fischer EA, van Roermund HJ, Hemerik L, van Asseldonk MA, de Jong MC (2005) Evaluation of surveillance strategies for bovine tuberculosis (Mycobacterium bovis) using an individual based epidemiological model. Prev Vet Med 67: 283 301. PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 15 / 16

51. Perez AM, Ward MP, Charmandarian A, Ritacco V (2002) Simulation model of within-herd transmission of bovine tuberculosis in Argentine dairy herds. Prev Vet Med 54: 361 372. 52. Goodchild AV, Clifton-Hadley RS (2001) Cattle-to-cattle transmission of Mycobacterium bovis. Tuberculosis (Edinb) 81: 23 41. 53. Phillips CJ, Foster CR, Morris PA, Teverson R (2003) The transmission of Mycobacterium bovis infection to cattle. Res Vet Sci 74: 1 15. 54. Olea-Popelka FJ, White PW, Collins JD, O Keeffe J, Kelton DF, et al. (2004) Breakdown severity during a bovine tuberculosis episode as a predictor of future herd breakdowns in Ireland. Prev. Vet. Med. 63: 163 72. 55. Dommergues L, Rautureau S, Petit E, Dufour B (2012) Network of contacts between cattle herds in a French area affected by bovine tuberculosis in 2010. Transbound Emerg Dis 59: 292 302. 56. Srinivasan S (2008) Spatial regression models. In:, Shekhar S, Xiong H,, editors., Encyclopedia of GIS. Springer. pp. 1102 1105. PLOS ONE DOI:10.1371/journal.pone.0115632 December 23, 2014 16 / 16