OUTCOME OF THE LHCB DATA-CENTRE REVIEW 31 OCT - 1 NOV - CONTAINER VS BUILDING OPTION NOV 4, ALICE/LHCB IT MEETING NIKO NEUFELD - CERN Indico
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
OUTCOME OF THE LHCB DATA- CENTRE REVIEW 31 OCT - 1 NOV CONTAINER VS BUILDING OPTION NOV 4, ALICE/LHCB IT MEETING NIKO NEUFELD
REVIEWERS • Stefano Bertolasi • Wayne Salter • Michael Patterson, Intel • Ferdinand Hahn • Eliseo Perez • Yannic Body
non chi comincia ma quel che persevera
Location
• West side of the SX8
• Close to the technical gallery SL-84
7
• Surface not allocated for any other LHCb purpose
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016
non chi comincia ma quel che persevera
The development – floor spaces
Ground First Floor Second
Floor Floor
Gross area 140 m2 196 m2 196 m2 • Total surface: 532 m2
Floor - to -ceiling height* 3.5 m 3m 3m • Total height of the bld: 12 m
Slab – to – slab height 4m 3.5 m 3.5 m
• Total n. of IT racks: 120
Racks (18 + 60 60
18)**
*Subject to the final design revisions
** 18 racks LV switchboards + 18 racks for fibers
8
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016
non chi comincia ma quel che persevera
The general characteristcs
Slab-on-grade foundation
• The building’s structure will be made with steel frames, suitable for a load of 2 t/ m2;
• Foundations (15.0 x 10.0 m2) will be independent of the existing buildings;
• The envelope of the new building will be made by a sandwich panel composed by two steel
sheets and Rockwool core (total thickness 15 cm);
• 1st & 2nd floor is made with structural grillage;
• The roof is made by steel deck + concrete (to be able to install cooling equipment);
• Two sky-domes are foreseen on the roof which should be combined with the air ventilation
system and the smoke rapid extraction in case of fire at the 1st & 2nd floors. 9
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016
non chi comincia ma quel che persevera
Ground floor plan – level 0
The ground floor is essentially dedicated to the technical rooms
(electrical cabinets, fibre patch panels & star-point racks).
10
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016non chi comincia ma quel che persevera
First & Second floors plan – level 1&2
1st and 2nd floors are dedicated to the installation of racks.
2885 (SX8)
The access at the first
floor is foreseen from
the SX8 building, then
access to the 2nd floor
by inside stairs.
11
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016non chi comincia ma quel che persevera
IT Cooling
• The racks can be cooled down using “passive/active doors” (~20kW)
supplied with water at 20÷26 degree (connected to the cooling system).
• An Air/water heat exchanger is integrated in the back door of the rack.
Active door Passive door
12
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016non chi comincia ma quel che persevera
Cooling systems
A water cooled solution has been chosen to cool down the racks.
There are two main options in terms of cooling system.
1. Use the SF8 cooling towers with dry coolers in winter backup: a connection to the SF8
cooling towers can be implemented by branching off from the SF8 circuit (building
2865) and installing pipes in a new gallery (across the parking).
2. Install two new cooling towers (one in backup): local cooling tower, used solely for the
data centre, installed close to the building.
13
DANIEL LACARRERE - ALESSANDRO SAPUTI - CERN 31TH OCTOBER 2016non chi comincia ma quel che persevera
Solution 1: SF8 CT + dry coolers
• SF8 pump is safe but temperature can’t follow external conditions because of other
users.
• Dry cooler working in degraded conditions (DeltaT of 10K) and only if TextARE THE PRESENTED REQUIREMENTS SOUND AND DO THEY FOLLOW BEST PRACTICES? • Yes, we believe the requirements are sound and follow best practices • Future trends in IT equipment have been considered, as well • Lifetime questions exist, what is the plan for upgrades through the life of the infrastructure
DO THE PROPOSED SOLUTIONS MEET THESE REQUIREMENTS? DO YOU SEE ANY SHOWSTOPPERS? • Containers • Building • Yes, the containers can support the • Yes, the building can support the next generation of IT needed next generation and subsequent • Possible show-stopper: airflow generation of IT needed recirculation with tight container • Show-stopper: How good are layout schedule and budget estimates?
WHAT INFORMATION IS MISSING IN ORDER TO MAKE A
DECISION?
• Containers • Building
• Reference sites using the containers now • Next level of design details
• Demonstrated success
• Better cost estimates
• CFD analysis of airflow outside containers
• Next level engineering details
• Better schedule details
• Is the system compliant with the technical spec? • Not clear how humidification / dehumidification is controlled
• Needs broader CERN review; may require more info/clarifications from
bidder
• Not clear how humidification / dehumidification is controlled
• Better description of specific roles and responsibilities for operation and
maintenance (between contractor, LHCb, and CERN Tech Svcs
• Reverse Osmosis may not be required; high cost and maintenance reqts.
Filtered softened water may be better, need tap water analysis,
Softened water primarily just has hardness (Ca, Mg) removed.ARE THE COST ESTIMATES REALISTIC AND DO THEY
INCLUDE ALL KEY COMPONENTS?
• Containers • Building
• Yes, Bid in hand from container mfg • No, we looked at alternative Euros/kW
estimates and think the project may be
• External work, even if +/- 20% is a small
underestimated by millions
portion of job so ok
• How much of this “lower” price is due to
internal CERN support not showing as a cost?
• One of the reasons to use containers is they
are cheaper
• This is another reason we think the building
estimate is lowPLEASE ALSO HIGHLIGHT ADVANTAGES,
DISADVANTAGES, AND RISKS OF THE TWO OPTION
• Container • Building
• Will likely have some features lower than CERN standards • Risks: schedule, schedule, schedule
• Maintenance ends at 10 years, containers will be a challenge for • Requires more CERN resources, are they fully committed?
CERN to maintain past this
• Is the space large enough for years 10-20?
• We don’t expect a useful life after 15 years
• Proper infrastructure for 15 to 25 years (with recognition some IT
• Local (on-site) noise level connections may need upgrades)
• Parking, and loss of laydown area • Risk: airflow issues with liquid cooling only, will hot air cause
problems or will liquid be able to capture 100% of the heat? Is
• No support, unpack, prep area in containers some ventilation needed?
• Filtration looks lacking, two levels? Is filter mesh tight enough?
• 24C inlet air is niceREVIEWER SUMMARY
• If you must make a choice now, we recommend rapidly checking
container airflow, reference installations, and next round of
engineering document submittals, then going with containers
• The review team all liked the building option better, but were very
concerned that the budget and schedule may not support the need
date.
• If additional time could confirm the schedule and budget, this would
become the preferred option.You can also read
