Remote Operation Update ALICE shift plan 2021 - Taku Gunji (Center for Nuclear Study, the University of Tokyo) Federico Ronchetti (INFN-LNF, CERN)
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Remote Operation Update
ALICE shift plan 2021
Taku Gunji (Center for Nuclear Study, the University of Tokyo)
Federico Ronchetti (INFN-LNF, CERN)
CB meeting 26/3/2021
Remote Operation Update
A Large Ion Collider Experiment
ALICE Remote Operation
Mixture of onsite and remote shifts during global commissioning
Run coordination • 2 onsite shifts : DCS + SL/ECS
• MM/AA/NN (same as Run2) Remote operation task force (ROTF)
• 2 remote shifts: QC + EPN/PDP (RC,Vasco, Roberto, Peter, Pierre, Daniele)
(Run Manager) • M/A/Nx6 (same as Run1)
ARC
360deg motorized camera
Shift Leader Onsite (ARC)
Webcam and Jabra for SL installed
(SL) Zoom Logitech
C310
sessions
DCS ECS EPN/PDP QC Remote Operation
Site (ROS)
Detector DAQ Monitoring Monitoring
Control CTP (online data (detector
System processing) data) Each institute can be the ROS or each country can build a few hubs
(depending on COVID travel restriction inside country)
2021/3/26 Remote 3
A Large Ion Collider Experiment
Pilot ROS in Tokyo
• DELL Precision 3640 Tower (core i7/16G MEM) with NVIDIA P1000 (~1500 CHF)
• 2x34’’ displays (~700 CHF x2), webcam + speaker (~200 CHF)
Webcam/mic(logicool BRIO C1000ER)
List of displays
acer 34’’ display • LHC OP vistar
oncalls
MM • LHC_IF
OP Vistar DCS ECS
QC • DCS
(EPN/PDP)
• Event Display
• ECS
LHC_IF ED infoLogger • infoLogger
ZOOM • logbook
• QC
speaker(logicool Z150) • EPN/PDP
• Oncall list
• MM (web version)
Webcam/mic/speaker(logicool BCC950)
Pilot ROS was verified during MW3 and
• All information is (will be) accessible from web-browser. dedicated test sessions
• Only the web-browser, zoom, and MM will be needed. • communication, zoom operation (click, edit,
enter text on shared display), zoom control
• Windows 10 is certified.
2021/3/26 4
A Large Ion Collider Experiment
Minimum requirements
• HW
DELL Precision 3640 Tower
• Multi-displays (4x24”, 2x32”, 2x34”)
Tower HP 800 G6 Tower
• Core i5, 8 GB Memory (16 GB preferred), 256 GB SSD
• Ex) Desktop Tower HP 800 G6 Tower (CERN store), DELL Precision
3640 Tower
• Video card to support multi-displays
• Ex) Quadro P1000
NVIDIA Quadro
• Webcam, mic, speaker Logitech Z150
Logitech C310 P1000
• Ex) Logicool C310N as webcam and mic, logicool Z150BK as speaker
• SW
• Windows 10 is certificated [our recommendation].
• Linux has not been tested and will be tried. We may use CS8
in the ARC setup.
2021/3/26 5
A Large Ion Collider Experiment
Next Step for ROS
• RC will talk to each country and understand each country’s plans for the shifts
(onsite shifts – possibilities and difficulties, oncalls, remote shifts and plans for ROS)
• ROS spread sheet
• https://docs.google.com/spreadsheets/d/1gKpotHLW-V9_MRa7l0NXLm0i7LqJAWSYYcXUG-DNpFA/edit?usp=sharing
• Next Step
• Ask each ROS to start ordering the needed materials and to setup the ROS → April
• Remote training and hands-on sessions, tests and validation of functionality using other pilot
ROS (volunteers needed!) → April – May
2021/3/26 6
ALICE shift plan 2021
A Large Ion Collider Experiment
ALICE Plan 2021
• ALICE global commissioning 2021 from 12/7 to 17/12
• Pilot beam tests in W39-W40.
• O(105) collisions with pilot beams
• O(107) collisions with nominal beams + B fields
2021/3/26 8
A Large Ion Collider Experiment
Shift Plan shown Monday
Month Activity Central Oncalls or Experts on Credits Shift information
shifts detector shifts site at P2 or
zoom
Jan - June Expert work No On demand No No Shift reservation
open (~June 1st)
1/7 – 11/7 Pre-global YES YES No YES
commissioning (M:A) (M:A) (training, course,
tests under
12/7 – Global YES* YES* Preferred YES
discussion in ROTF)
W38 commissioning*
W39 – Test beam YES YES Required YES
W40
W41 – Global YES YES No YES l ~ 6.2
W50 commissioning
RC further optimized this shift plan based on the very
2021/3/26
recent discussion with experts 9
A Large Ion Collider Experiment
Further optimization
• Minimum 16 weeks global commissioning is needed https://indico.cern.ch/event/849396/
https://indico.cern.ch/event/849400/
• [Before] 12 weeks data taking (24/7) devoted to cosmic data taking (00/++/--) for
pre-alignment studies considered
• 20 Hz for TPC/TOF/TRD → 145M tracks, 0.03 Hz with ITS → 0.22 M tracks
• [Update] O(107) collisions with nominals during pilot beam tests will help a lot.
• no strong needs to devote 12 weeks for cosmics
• more important systematic tests (dry-runs, calibrations, full system tests using MC, cosmics)
• All systems and software will be continuously developed during global
commissioning.
• Coexistence of those developments and operation supports for shifters
• [Update] Enough time for developments and enough support for operation must
be considered and secured, which will be hardly achieved during 24/7 operation
2021/3/26 10A Large Ion Collider Experiment
New central shift schedule
• 1.7 – 11.7 : Pre-global commissioning
• M&A and no night shifts
changed
• 12.7 – 5.9 : Global commissioning
• M&A and no night shifts → Better balance between developments and operation supports
• 6.9 – 26.9 : Global commissioning for pilot beam test preparation
• M&A&N
• 27.9 – 10.10: Pilot beam tests
• M&A&N
changed
• 11.10 – 21.12 : Global commissioning
• M&A or M&A&N will be decided based on the maturity of the system in July/August
2021/3/26 11A Large Ion Collider Experiment
Shift Plan 2021
Month Activity Central shifts Oncalls or Experts on Credits
detector site at P2 or
shifts zoom
Jan - June Expert work No On demand No No
1.7 – 11.7 Pre-global YES YES No YES
commissioning (M:A)
12.7 – 5.9 Global YES YES Preferred YES
commissioning (M:A)
6.9 – 26.9 Global YES YES Preferred YES
commissioning (M:A:N)
27.9 – 10.10 Test beam YES YES Required YES
(M:A:N)
11.10 – 21.12 Global YES YES No YES
commissioning (M:A or M:A:N)
2021/3/26 12A Large Ion Collider Experiment
Credits
• Credits
• Central system: 1 credit/shift
• Oncall shifts: 0.5 credit/day
• For the case of M&A from 11.10 to 21.12
• Statistics : https://alice-glance.cern.ch/alice/sams/run/manage?view=statistics
• Institute: https://alice-glance.cern.ch/alice/sams/institute/overview?id=9
Carryover from 2018 for under-booking institutes (A Large Ion Collider Experiment
Plan for Shift booking
• Shift booking will be progressively opened.
• Avoid all shifts being taken with hours
• Allow different time zones to get equal number of shifts
• Limit is set by RC for fraction of due credits allowed to book
• Once the booking has exceeded limit – no more booking allowed
• Requires coordination from team leaders to organize institutes’ booking
• Requirements for booking
• SLIMOS permission is required for booking any central shift
• https://alice-collaboration.web.cern.ch/run_coordination/shifts/howtobook.html
• (attendance of shift class is not needed – see later)
• Booking actions
• Email about booking will be sent as soon as the procedures are approved
• Booking will open ~ May 12 (~2 month before the Global commissioning)
2021/3/26 14A Large Ion Collider Experiment
SAMS Update
Development of SAMS completed
• DCS + SL/ECS : MM/AA/NN
• QC + EPN/PDP: M/A/N x 6
• Local time displayed
Already integrated into production
site.
https://alice-glance.cern.ch/alice/sams/
SAMS exports iCal file, which can
be imported to your calendar.
Mario Gunter Simao
2021/3/26 15A Large Ion Collider Experiment
Shift class and training strategy
RUN2 Procedure
• To book training and real shifts, attendance to formal class published in SAMS was required.
• Release of shift block could be done until 15 days from start of shift block
• Shift procedures were well defined (mostly shaped on RUN1 structure)
RUN3
• Shift procedures not yet fully shaped as central systems are still evolving
• Formal classes and training not yet defined
• Attendance to the formal class and training is not required in booking the shifts (SLIMOS needed!)
• SAMS classes can be opened just as a “tutorial” and training can be heuristic
• Ex) Actual training would be organized in a first few days of the shifts with the experts
• Ex) Class or training could be organized in the zoom for the shifts (breakout-rooms)
• Shifters will be initially fished mostly among local experts at CERN
• Release of shift block could be done until 10 (?) days from start of shift block
2021/3/26 16
RC, Roberto, Daniele, David, Vasco, MarioA Large Ion Collider Experiment
Summary
• Pilot ROS built and remote operation using pilot ROS was tested satisfactory
• communication, zoom operation (click, edit, enter text on shared display), Zoom control
• RC will check each country’s plans for shifts (onsite, oncall, remote and ROS).
• RC will push for ROS to buy the needed materials and to build the ROS. → April/May
• New shift schedule
• First 2 month of the Global commissioning will have M&A shifts to balance developments for
integration and operation supports for shifters.
• l = 5.21 – 5.67
• RC will assess each institute’s shift plans and try to see if the numbers of onsite and remote shifts
are balanced (50:50, enough onsite shifters), and if remote shifts can be fairly distributed.
• SAMS is developed and ready to be in use.
• Aim at opening shift reservation about May 12th.
2021/3/26 17backup
A Large Ion Collider Experiment
Shift time for remote site
Morning will be for Europe → Asia
Afternoon will be for Europe → US
Night will be for Asia and US
22-6 1-9 M:7-15 11-19 14-22
6-14 9-17 A:15-23 19-3 22-6
2021/3/26 14-22 17-1 N:23-7 3-11 6-14 19A Large Ion Collider Experiment
Shifts in 2018
2021/3/26 20You can also read
