Overview of HCC. Dr. David R. Swanson, Director Holland Computing Center

Size: px

Start display at page:

Download "Overview of HCC. Dr. David R. Swanson, Director Holland Computing Center"

Jodie Lindsey
6 years ago
Views:

1 Overview of HCC Dr. David R. Swanson, Director Holland Computing Center

2 Geographic center of US Mean center of US population Middle of Everything David Swanson, Nebraska

3 HCC operates as a core facility and provides services that are critical to the research productivity of faculty and students across the University of Nebraska campuses. HCC 5-year Review, 2016

4 HCC exists to reduce the time to science. David Swanson

5 Kick-start (verb):

6 : to start (a motorcycle) by pushing down on a lever with your foot

7 : to cause (something) to start quickly

8 : to give new energy to (something)

9 HCC is good at Big Data: We manage over 10,000 TeraBytes (10PB) Scaled Out Computing: 30,000 cores, OSG, advanced networking, high bandwidth transfers Scaled Up Computing: Parallel processing, XSEDE, GPUs

10 HCC has great people Most are computational scientists 5 Full time research personnel, 5 Sys Admins 5 Application Specialists Favorite collaborative tools: table with a whiteboard Collaboration, not outsourcing outfit

11 HCC is free* Shared usage of resources: no charge Best effort support: no charge Dedicated computing, storage or support: up-front fees *to many users! Paid for by NRI, NSF, and NU researchers

12 Enough about HCC What is your area of study? What question do you wish you could answer? Do you currently use HCC resources? What type of computing (storage/networking/ visualization) do you do now? Are you experiencing any bottlenecks?

13 Area of study Tried and true: Chemistry, Physics Other Science: Biology, Engineering, Agriculture Other Disciplines: Business, Humanities, Theatre

14 Current Computing Use HCC resources Which machine(s)? Storage? What would you change? Also use other resources? Bottlenecks? Don t use HCC resources What do you utilize? What about data? Any reason to change? Other (campus) resources? Bottlenecks?

15 Questions? Is HCC a UNL entity? Is HCC part of ITS? of CSE? Who uses HCC?

16 Kickstart Crane and Tusker Globus and file transfers Lunch on your own Anvil OSG Panel Discussion Consultation/Tour

17 More to come HCC is buying incrementally, annually MRI or other grant funding could enhance this What should we target? Establishing an annual process Gather input in fall purchase in spring add to this in summer

18 More to come Currently 3 types of storage /home backed up, per machine, 25 GB/user, free /work purged, per machine, 50 TB / group, free Attic near-line archive, not mounted, $25/TB/year Will add /project this fall semester /project not purged, all machines, hybrid

19 Thank you HCC wants to collect information about publications, grants, etc. We thus will give the following carrots 2 core years (17,520 hrs) for acknowledgements in publications, funded grant awards 1 core year (8,760 hrs) for acknowledgements in reviewed presentations 0.5 core year (4,380) for acknowledgements in unreviewed presentations, unfunded grant proposals, news articles

20 This work was completed utilizing the Holland Computing Center of the University of Nebraska, which receives support from the Nebraska Research Initiative.

21 Thank you NSF NRI ITS, ARD, Campus researchers UNL, UNO HCC you!

22 HCC On Ramp 1. Nebraska Faculty Connection (HCC Group) 2. Log in (HCC account and Duo set up) 3. Moving and editing your data 4. Launch jobs! (module, SLURM)

2 GHz (64bit) Red January 2002 June 2004 August

2 GHz (64bit) Crane 248x64 2.3 GHz 44x32 2.

PrairieFire January July October June October

23 Attic Merritt PrairieFire GHz (32bit) GHz 512 GB RAM GHz (64bit) Red January 2002 June 2004 August x GHz 256 GB RAM 1151x4 2.6 GHz August 2007 May * GHz 64 GB RAM Tusker Firefly GHz (64bit) Crane 248x GHz 44x GHz 1 PB NearLine Storage August 2011 PrairieFire January July October June October Firefly May 2013 Merritt Equipment Timeline Anvil 76x GHz 256 GB RAM August 2015

/project 248x64 2.3 GHz 44x32 2.0 GHz Crane 452*16 2.6 GHz 64 GB RAM Attic 1 PB NearLine Storage Red 5888 cores 4 PB 40 1 PB Shared Storage Tusker 98x64 2.1 GHz 256 GB RAM Anvil 76x20 2.

24 /project 248x GHz 44x GHz Crane 452* GHz 64 GB RAM Attic 1 PB NearLine Storage Red 5888 cores 4 PB 40 1 PB Shared Storage Tusker 98x GHz 256 GB RAM Anvil 76x GHz 256 GB RAM CraneOPA 44* GHz 512 GB RAM August 2011 January 2012 October 2013 June 2014 October 2014 August 2015 December 2015 (ongoing) May 2016 October 2016 Equipment Timeline Fall 2017 January 2018 December 2019 Crane Tusker Sandhills

25 Local speed record to date 42 (+10!) Gbps Software Defined Networks PerfSONAR Performance Testing

26 Broad Collaborations U.S. CMS Open Science Grid GpENI CaRC

27 Statewide Collaborations HCC is HPC and HTC provider to NU system Accounts granted for any educational institution in state Doane, Creighton, Wayne State College Henry Doorly Zoo

Collaboration Infrastructure Internet2 via GPN Internet2 via CIC Network Nebraska UNL Science DMZ Composit Traffic 100 Gigabit Composit Traffic 100 Gigabit Fu I2 100 Gbps between HCC and Internet2

28 Collaboration Infrastructure Internet2 via GPN Internet2 via CIC Network Nebraska UNL Science DMZ Composit Traffic 100 Gigabit Composit Traffic 100 Gigabit Fu I2 100 Gbps between HCC and Internet2 via GPN Holland Computing Center WDM 100 Gigabit Capable West Campus Border Router DMZ to/from HCC 2x 10 Gigabit Lincoln Core Router OSG access to HCC resources DTNs, Globus Connect Omaha Core Omaha HPC Clusters perfsonar + BRO IDS additions Lincoln Core Switch (CMS and HPC clusters) 10x 10 Gigabit DYNES Equipment Center for Brain Imaging and Behavior Campus Network Researchers 10x CMS Data Transfer Nodes

Mitglied der Helmholtz-Gemeinschaft. Advanced System Monitoring in PTP

Mitglied der Helmholtz-Gemeinschaft Advanced System Monitoring in PTP November 19, 2013 Wolfgang Frings and Carsten Karbach Content 1 PTP System Monitoring status quo 2 Short term enhancements 3 Long term