GRID computing for AUGER

Size: px

Start display at page:

Download "GRID computing for AUGER"

Scarlett Norris
6 years ago
Views:

4.2008, ASPERA Czech National Day Meeting,

1 GRID computing for AUGER Jiří Chudoba, Jaroslava Schovancová, Petr Trávníček , ASPERA Czech National Day Meeting, Prague EGEE and glite are registered trademarks

Pierre Auger Collaboration More than 250 PhD scientists from more than 60 institutions from 16 (+2) countries > 400 authors Participating countries: Argentina, Australia, Bolivia *,

2 Pierre Auger Collaboration More than 250 PhD scientists from more than 60 institutions from 16 (+2) countries > 400 authors Participating countries: Argentina, Australia, Bolivia *, Brazil, Czech Republic, France, Germany, Italy, Mexico, Netherlands, Poland, Portugal, Slovenia, Spain, United Kingdom, USA and Vietnam * * - associated countries ASPERA meeting, Paris

3 Auger Computing Model Data recorded at the experiment site are copied to Lyon - CCIN2P3 slow line from Malargue, transfer via recorded DVD EU funded project AUGERACCESS will improve connectivity All Auger members have accounts at CCIN2P3 Data is analyzed remotely at CCIN2P3 or copied and processed on PCs or small computing farms users must install new versions of the offline sw users check for availability of new data CPU intensive simulations done at various sites and results copied to CCIN2P3 some sets are not at CCIN2P3, available to only some users ASPERA meeting, Paris

GRID experience Institute of Physics (FZU)

TB RAW disk capacity 458 CPU cores 10 Gbps

of research groups, Institute of Nuclear

Operation costs paid by FZU, manpower by FZU

4 GRID experience Institute of Physics (FZU) hosts a WLCG Tier2 site Golias supporting LHC experiments ALICE and ATLAS Current Tier2 resources (also for non LHC groups) 85 TB RAW disk capacity 458 CPU cores 10 Gbps network devices HW financed by FZU, grants of research groups, Institute of Nuclear Physics and CESNET. Operation costs paid by FZU, manpower by FZU and by EGEE II project (via CESNET, Czech EGEE partner) ASPERA meeting, Paris

5 Expectations from Grid more computing resources available to more collaboration members uniform way for simulation productions easier access to data tests with simulations were done using regional VOs (central Europe - VOCE, SouthWest) ASPERA meeting, Paris

6 VO AUGER Created in 2006 by the Czech group in cooperation with CESNET CESNET provides and maintains central services LCG RB, glite WMS, LB, UI, LFC, registration portal, VOMS server, JP server VOMS server replica at FNAL 10 sites from 8 countries support VO AUGER EELA project considers AUGER as supported application E-infrastructure shared between Europe and Latin America IST UNAM (National Autonomous University of Mexico) is the 1 st EELA site supporting VO AUGER ASPERA meeting, Paris

7 Registration to the VO AUGER Enabling Grids for E-sciencE ASPERA meeting, Paris

8 Resources, Usage Production of libraries of cosmic ray showers Access to the simulated data files Resources for individual users golias25.farm.particle.cz Prague, ASCR 15 6 TB skurut17.cesnet.cz Prague, CESNET 20 1 TB apcpc79.in2p3.fr GRIF (APC), Paris 5 0 TB grid10.lal.in2p3.fr GRIF (LAL), Paris 15 0 TB ce02.lip.pt LIP, Lisboa 2 0 TB tbn20.nikhef.nl NIKHEF, Amsterodam 20 0 TB lcgce.ijs.si IJS, Ljubljana 10 2 TB UNAM 4 0 TB CCIN2P3, Lyon FZK, Karlsruhe TB Aachen TB Wuppertal TB Number of CPUs and available storage for the VO Auger are rough estimates!! They fluctuate by a large factor ASPERA meeting, Paris

9 CPU Challenge in April 2007 number of really usable CPUs varies ASPERA meeting, Paris

10 Corsika simulations Offline software: CORSIKA (v for tests, v for proton and iron production) Model: epos, fluka Primary particle proton (epos_gr01, 3, 7) or iron (epos_gr04, 6) Energy of primary particle log(e/ev)=17.5, 18.0, 18.5, 19.0, 19.5, 20.0, 20.5, 21.0 Zenith angle q=0, 18, 26, 38, 45, 53, 60 deg 50 jobs per each [E, q] pair different random number seed seed generated using srand(time(null)) and rand() functions implemented in standard math.h library ASPERA meeting, Paris

11 CORSIKA Parameters CORSIKA inputs (current production) RUNNR 2800 ARRANG 0 NSHOW 1 EPOPAR input../epos/epos.param PRMPAR 14 (5626) EPOPAR fname inics../epos/epos.inics ESLOPE -2.7 EPOPAR fname iniev../epos/epos.iniev ERANGE E E+12 EPOPAR fname initl../epos/epos.initl THIN E E E+04 EPOPAR fname inirj../epos/epos.inirj THINH 1.000E E+02 EPOPAR fname inihy../epos/epos.ini1b THETAP E E+01 EPOPAR fname check none PHIP EPOPAR fname histo none SEED EPOPAR fname data none SEED EPOPAR fname copy none OBSLEV 1.452E+05 LONGI T 5. T T FIXCHI 0. ECTMAP 2.5E+5 MAGNET 2.010E E+01 MAXPRT 1 HADFLG DIRECT./ ECUTS 1.000E E E E-04 DATBAS T MUADDI T USER yourname MUMULT T PAROUT T T ELMFLG T T DEBUG F 6 F STEPFC EXIT RADNKG 5.0E+05 ASPERA meeting, Paris

12 Shower libraries epos_gr01 proton, EPOS , test (deleted) epos_gr02 proton, EPOS test (deleted) epos_gr03 proton, EPOS epos_gr04 iron, EPOS epos_gr05 proton, EPOS JPtest epos_gr06 iron, EPOS epos_gr07 proton, EPOS ASPERA meeting, Paris

13 Library productions 2800 jobs per production Test production (epos_gr01) August 28 September 10, 2007 (14 days) 1 st usable proton production (epos_gr03) October 3 24, 2007 (major part in 21 days) 2745 jobs finished, < 2.5 % crashes 1 st iron production (epos_gr03) October 22 December 15, jobs finished, < 2.5 % crashes Job outputs stored on SE Primarily at golias100.farm.particle.cz, later also at dcache.ijs.si ASPERA meeting, Paris

14 Running jobs proton showers Enabling Grids for E-sciencE epos_gr03 (proton) CE CE Jobs CPU time Avg. CPU [#] [hr] time [hr] ce02.lip.pt LIP, Lisbon golias25.farm.particle.cz FZU, Prague grid10.lal.in2p3.fr+apcpc79 GRIF, Paris lcgce.ijs.si IJS, Ljublan skurut17.cesnet.cz CESNET, Prague tbn20.nikhef.nl NIKHEF, Amsterdam JOBS COMPUTED (DONE) SHOWERS DONE TOTAL (SHOWERS) 2800 ASPERA meeting, Paris

15 Running jobs iron showers epos_gr04 (iron) CE CE Jobs CPU time Avg. CPU [#] [hr] time [hr] ce02.lip.pt LIP, Lisbon golias25.farm.particle.cz FZU, Prague grid10.lal.in2p3.fr + apcpc79 GRIF, Paris lcgce.ijs.si IJS, Ljublan skurut17.cesnet.cz CESNET, Prague tbn20.nikhef.nl NIKHEF, Amsterdam JOBS COMPUTED (DONE) SHOWERS DONE TOTAL (SHOWERS) 2800 example of a logical file name: lfn:/grid/auger/prod/epos_gr04/en20.000/th18.000/dat part ASPERA meeting, Paris

16 Site ratios ASPERA meeting, Paris

17 Walltime per site Used CPUs CESNET FZU IJS LAL LIP NIKHEF ASPERA meeting, Paris

18 Used walltime per library ASPERA meeting, Paris

19 Job Provenance Information ASPERA meeting, Paris

20 DB of available showers ASPERA meeting, Paris

21 Summary production of CORSIKA libraries for AUGER files are accessible to VO auger members plans to copy (part of) libraries to CCIN2P3 working on the detector simulation on the grid expect at least double CPU capacity soon challenge to keep these resources busy hw resources for central services provided by CESNET enough CPU power provided by various sites AUGER gridification supported by the EGEE II project (finishing April 2008) no support for AUGER in the EGEE III ASPERA meeting, Paris

22 Backup slides ASPERA meeting, Paris

23 gr06, gr07 epos_gr06 (iron) epos_gr07 (proton) CE CE Jobs CPU time Avg. CPU CE CE Jobs CPU time Avg. CPU [#] [hr] time [hr] [#] [hr] time [hr] ce02.lip.pt LIP, Lisbon ce02.lip.pt LIP, Lisbon golias25.farm.particle.cz FZU, Prague golias25.farm.particle.cz FZU, Prague gridka... FZK, Karlsruhe gridka... FZK, Karlsruhe grid10.lal.in2p3.fr LAL, Paris lcgce.ijs.si IJS, Ljublan skurut17.cesnet.cz CESNET, Prague grid10.lal.in2p3.fr lcgce.ijs.si skurut17.cesnet.cz LAL, Paris IJS, Ljublan CESNET, Prague tbn20.nikhef.nl NIKHEF, Amsterdam tbn20.nikhef.nl NIKHEF, Amsterdam JOBS COMPUTED (DONE) JOBS COMPUTED (DONE) SHOWERS DONE SHOWERS DONE TOTAL (SHOWERS) 2800 TOTAL (SHOWERS) 2800 ASPERA meeting, Paris

24 Jobs per day ASPERA meeting, Paris

25 Walltime Used CPUs CESNET FZK FZU IJS LAL LIP NIKHEF ASPERA meeting, Paris

LHC Physics or How LHC experiments will use OSG resources

LHC Physics or How LHC experiments will use OSG resources OSG Consortium Meeting 08 / 21 / 06 Oliver Gutsche USCMS / Fermilab Particle Physics Probe innermost structure and explain it from first principles