EA Tech OHL Colloquium - 29 March 2018 - EA Technology
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
EA Tech OHL Colloquium 29 March 2018
STORM/EX-HURRICANE OPHELIA ESBN experience
ESB Networks
• Distribution System Operator and Transmission Asset Owner for Republic of Ireland
• Service Area of approx. 70,000 sq. km.
• Approximately 1.8 million customers
• Network
• 6,000 route km of transmission network
• 200 approx. transmission bulk supply points
• 6,000 route km of 38kV OH line
• 85,000 route km of MV (20kV and 10kV) overhead ine
• 250,000 Pole Mounted Transformers
• 100,000 route km of LV overhead line
2 esbnetworks.ie
Narrative of Ophelia Story
Safety Information Restoration
3 esbnetworks.ie
Timeline
Day -3: Initial Warning – Start Preparing Day +3: Engaging the Customer
Day -2: Initiating Network Emergency Procedures Day +4: Safety Leadership
Day -1: Declaring Emergency Day +5: Customer and Staff Welfare
Day 0: Communicating the impact Day +6: Push for the remaining 5%
Day +1: Managing Stakeholders Day +7: Planning for De-mobilisation
Day +2: Resourcing the Restoration
4 esbnetworks.ie
Before Forecasts Met Éireann Advisory issued on Thursday afternoon: A combination of a vigorous Atlantic weather system and the remnants of Hurricane Ophelia will pass close to Ireland on Monday, and has the potential to be a high-impact event in parts of the country. There is a lot of uncertainty as to the exact evolution and movement of this weather system during the coming four days, but storm-force winds, outbreaks of heavy rain, and very high seas are threatened. Met Éireann will maintain a close watch on the evolution and issue further advisories and warnings as these are warranted. Escalation • 2pm on Friday 13 October 2017 Saturday 14/10/17 Level Red for southwest & west (5 counties), orange for the rest of country. Ex-hurricane Ophelia is expected to bring severe winds and stormy conditions on Monday. Mean wind speeds in excess of 80 km/h and gusts in excess of 130km/h are expected, potentially causing structural damage and disruption, with dangerous marine conditions due to high seas and potential flooding. • 5pm Saturday • 3pm Sunday 5 esbnetworks.ie
Day -3 Friday 13th: Start Preparing
Information
● Friday 13th Oct initial weather alert on Storm Ophelia
● Met Eireann indicated 70% probability of Ophelia landing
in Ireland with forecast winds of 180km/hr
● Stakeholders
– National Emergency Co-ordination Group ( NECG) on alert
Restoration
● Networks Crisis Team Setup
● Escalation of all relevant functions across ESB Networks
● Initial briefing of NEWSAC (meetings schedule for
Saturday and Sunday and Monday)
● Invocation of Emergency Call centre in Leixlip
enabled
– Alerted trained volunteers
6 esbnetworks.ie
Day -2: Saturday 14th: Initiating Network Emergency Procedures
Information
● IBM Weather Service Forecasted 80% probability of Ophelia making
landfall in Ireland with wind speeds of 170km/hr
● NECG (National Emergency Co-ord Group) calls meeting Sunday
15th@ 10am
Restoration
Divisional Storm response teams put in place
● ESBN Storm response Co-ordination Group meet
● Invocation of Emergency Call Centre - Telecoms, Facilities and
ITS
7 esbnetworks.ie
Day -1 :Sunday 15th: Declaring Emergency
Information
● NECG and Government meet
● Weather warnings initiated, Red Alert in the Southern and Western part of the country, and then extended
nationally
● Press release issue
● Networks Storm Co-ordination group meet to agree priorities and actions
Restoration
● At 5pm our Customer Business Line Manager declared a state of emergency and Emergency response
plan initiated .
● Staff mobilised for storm response
● Roles assigned nationally
– Networks Crisis Manager – Senan Colleran
– Operations Manager/NECG rep – Derek Hynes
– Divisional Managers /Storm Managers in place
– Information Co-ordination – Marina Hunt /Conor Garrigan
– System Restoration – Seamus Berry
– Resources – John Tuohy / John Byrne
– Make ready staff for deployment
– Escalate emergency with Local Authorities
– Key Transmission stations to be manned for Monday
– Escalated Helicopter availability (Executive Helicopters )
8 esbnetworks.ie
Day -1 :Sunday 15th:Declaring Emergency
Call Centre
● Meeting of Call Centre Co-ordination Group
– Initial Volunteers for Monday contacted and told to
report to Leixlip
– Wilton staff rostered and contacted
– ITS Telecoms facilities in Leixlip in place
Safety
● Message to staff to stay home unless required for
Storm response
● Pre Storm Safety Brief issued
● MV Network control handed back to local day-time
Controllers
● Low Ground conductor protocol suspended (SHE-09?)
9 esbnetworks.ie
Day 0 : Storm Strikes Monday 16th Oct: Communicating the impact
Information
● Storm makes landfall in the South part of Ireland with wind speeds of 150km/hr forecast
– First fault at 07:45 Ballincollig Co Cork
● NECG meeting @10am/2pm/4pm
● Network Storm Emergency Management Team group meet 8am/2pm/7pm
● NEWSAC Meeting 9am Requesting support from UK utilities
● Government/CRU briefings issued
● Significant Media interest
● Forecasted customer outage of 450k at 3pm
Restoration
● No work during the storm except for remote operations via the Control Centre
● Requested Air Corp Heli support
● Work commenced at approx. 4 pm in the south
● Calls managed in two sites by NCCC priority to emergency calls sufficient resources in place
● Main priority was assessing the Network damage
Safety
● Public Safety – National/Networks messages – Stay Safe Stay Clear
– National TV and Radio campaign advertising plus RTE Radio 1 Weather sponsorship
– Social Media Campaign
– Digital Display and Search Advertising
● Staff Safety
– Text Alerts: Work only when safe to do so
– Daily Safety brief issued
10 esbnetworks.ieWind Levels 11 esbnetworks.ie
Customers Impacted across the Country
● At its peak 374,301 customers had no supply
– South West 193,000
– Dublin South and South East 53,000
– Mid West 59,000
– Dublin North/Dundalk 36,000
– North West 11,000
This equates to 11.7M CHL ( Customer Hours Lost) in
comparison Darwin in 2014 had 12M CHL.
Date Day Messages
15-Oct -1 Public Safety Preparedness
16-Oct 0 Public Safety Expectations Damage Assessment What will come tomorrow
17-Oct 1 Public Safety Restoration Prioritisation Stakeholder Information What will come tomorrow
18-Oct 2 Public Safety Estimated Restoration Times What will come tomorrow
19-Oct 3 Public Safety Geographic Report What will come tomorrow
20-Oct 4 Public Safety Updated ERTs Storm Brian
12 esbnetworks.ieIreland Turned Red 13 esbnetworks.ie
Customer Outages Day 1 14 esbnetworks.ie
Network Plant impacted by Storm
● 32 x 38kV circuit outage
● 2 x 110/38kV transformer
● 2 x 110kV transmission line
● 334 x MV CBs open
● 69 FPE systems operated and locked on –
minimising risk to the Public
– All FPEs cleared by 2am
At midnight on Day 0 there were 313,000 customers without supply
15 esbnetworks.ieDay +1 Tues 17th Restoration begins: Managing Stakeholders
Information
● Focus on keeping Stakeholders informed
– Minister Naughten visited the control Centre in Leopardstown and was presented a copy
of the Restoration plan
– Taoiseach visited a staff working at a fault in Kilcock in the afternoon
– NECG were still meeting
– Irish Water and Telcos were starting to become an issue a Stakeholder plan was
developed
– Customers .. Three call centre fully Operational handling at peak were 50,000 calls/day
between Agents and IVR
Restoration
● ESB Networks’ Crews dispatched to patrol lines and assess damage .
● ESB Networks begin deploying contractors.
● NIE commit resources
● Request for international assistance responses
● 2,500 emergency calls in particular lines down
● Restored Supply to 107k customers
Safety
● Lines down warning to the public
● Emergency calls
At midnight on Day +1 there were 207,000 customers without supply
16 esbnetworks.ieDay +2 Weds 18th Restoration continues: Resourcing the Restoration
Information
● Focus on keeping Stakeholders informed
– Appointed individual to manage Irish Water and Telco’s
● Initiated programme of updating ERT for
customers
● Minister Naughton visited Portlaoise Training
Centre to meet staff and international crews
● Published Outages by Area
Restoration
– Prioritising the Irish Water and Telco’s restoration
– Additional Resources from abroad continue to arrive
– Restored Supply to 65k customers
Safety
● Vulnerable customer
● Staff welfare
At midnight on Day +2 there were 142,000 customers without supply
17 esbnetworks.ieAssistance from NEWSAC and France
Contractor Resources Location Arrived Departed
Enniscorthy
NIE 187 17-19/10 25/10
Fermoy & Bandon
Northern PowerGrid 16 Dunmanway 18/10 24/10
WPD 37 Waterford 18/10 24/10
Manx 5 Enniscorthy Clonmel 18/10 24/10
Scottish Power 20 Enniscorthy 19/10 24/10
UK Power Networks 24 Cork City 18/10 24/10
Electricity North-West 38 Cork City 18&19/10 24/10
ENEDIS (France) 27 Waterford 19&20/10 25/10
Morrison Utility Services 15 Fermoy 21/10 25/10
Total 359
18 esbnetworks.ieDay +3 Thurs 19th Oct Restoration continues: Engaging the Customer
Information
● Focus on keeping Stakeholders informed
– NECG had ceased meeting
– Storm Brian start to be a concern
Restoration
● Restored Supply to 29k customers
● Continue to update ERT as new information becomes
available so customers have the latest information
● Army mobilised to help in restoration efforts
Safety
● Staff welfare being consider particularly in relation to
fatigue
– With the numbers of contractors in some areas accommodation was
becoming an issue, Army provided Kilworth Barracks
● Programme of contacting vulnerable customer to assess if
they required assistance started
At midnight on Day +3 there were 113,000
customers without supply
19 esbnetworks.ieSafety
Falling timber caused this pole to lean to one side. While the timber was being cleared from around the leaning pole, from a
hoist, the pole fell and narrowly missed the main body of the hoist. Upon inspection the pole was rotten beneath ground level.
Before
Be Aware
& look out for
hazards
before
starting
work!
After
20 esbnetworks.ieDay +4 Friday 20th Restoration continues: Safety Leadership
Information
● Message shifting to more local media
● Convened special NECG meeting in
Leopardstown to warn of Storm Brian & potential
impact on restoration can creation of additional
faults
Restoration
– Restored Supply to 48k customers
Safety
● Looking at customer welfare for those without
supply since Monday particularly vulnerable
customers
At midnight on Day +4 there were 65,000
customers without supply
21 esbnetworks.ieDay +5 Sat 21st Oct Restoration continues: Customer and Staff Welfare
Information
● Emergency calls to be prioritised
Restoration
● Restored Supply to 30k customers
Safety
● At midnight on Day +5 there were 35,000 customers without supply
● Storm Brian has only a limited impact
22 esbnetworks.ieFind the fault
Disconnect the network
Cut trees/remove debris
Replace poles
Replace wire
Test and commission
Reconnect
23 esbnetworks.ieDay +6 Sun 22nd Oct Restoration continues: Push for the remaining 5%
Restoration
● Restored Supply to 32k customers
Safety
● Note issued to cease work no later than 19:30 this evening
● Forced rest periods for staff
At midnight on Day +6 there were 3,000 customers
without supply
24 esbnetworks.ieDay +7 Mon 23rd Oct Restoration continues: Planning for De-mobilisation
Information
● Local Media interest
Restoration
● Storm reconnections largely completed
● Winding down International contractors
● Safety
● Providing rest day to staff following return to base
25 esbnetworks.ieKey Statistics
Storm Ophelia Customer Contacts Handled 27 esbnetworks.ie
Call Takers Across Three Sites
Location Unit Available
to roster
Wilton NCCC 80
Wilton SSC 49
Wilton Meter 20
Reading/DUOS/
Others
Leixlip ESB 180
External Abtran 20
TOTAL 349
Max of 104 call takers rostered across all sites at
peak
28 esbnetworks.ieCustomer Contacts: Powercheck Hits: Web and App 29 esbnetworks.ie
Customer Contacts: Website and Social Media
Website Hits:
● 766,863 pages views
● Blog viewed 310,854 times
● Power Outage updates was viewed 43,306
times
Social Media: TBC
• TwitterImpressions Engagement Rate Followers
•Twitter
4.4m Impressions
4.4m 2.1% 31,300
Facebook 3.8m 3% 16,600
30 esbnetworks.iePublic Safety Media Campaign Storm Ophelia
TV: Reach = 13 million
Radio: 3,379,500 Total Reach: 30m
Online:
VOD: 860K impressions
Display: 10 million impressions .33% CTR
Partnerships:
The Journal: 1.56m impressions - .47% CTR
Agriland: 489K impressions - .32 CTR
Independent Farming: 451K impressions - .08% CTR
Search: 213K impressions - 3.24% CTR
Social Media: 567K impressions
31 esbnetworks.ieMaterials Used During Storm
● Stock Value €2M
● Poles: 2,000
● Conductor: 350kM
● Transformers: 250 (No Lightning this time)
● 10’s of thousands of other items such as Stay wire, Cross-arms,
Connectors, Insulators, Stay Blocks & Sleepers, etc., etc
32 esbnetworks.ieStorm Ophelia Restoration curve
Equates to 11.7M CHL
33 esbnetworks.ieOphelia V Darwin V Irma (USA) 34 esbnetworks.ie
Customers Restored by Day 35 esbnetworks.ie
Ophelia Projected Restoration
120%
% Affected Customers without power
100%
80%
60%
40%
20%
0%
0 2 4 6 8 10 12
36 esbnetworks.ieLessons learnt for people involved
• Resources • Emergency Management
• Nothing gets done without people • Responsibility splitting – stakeholder, operations, media, welfare, action log & lessons learned,
resources, information, communications, customer, safety
• Army
• Devolved Control & Splitting areas
• NEWSAC
• Daily SMT conference calls + SMT experienced in weather events
• Contractors
• Help, support and interest from other parts of ESB
• Organisation
• Customer and Stakeholder Management
• Staff Safety and Welfare • Leixlip Contact Centre open early
• Information management
• Mobile drying units
• Managing politicians
• Daily Safety presentations & Safety Performance
• Regular media & stakeholder briefings
• Food for depots
• Inductions in Training Centre • Media
• Safety Briefings & Warnings to Public about fallen wires • Extent of media interest
• Stock of PPE
• IT and Social Media
• Materials Management
• New OMS
• Data Analytics
• Depot, Worksite & MPRN Apps
37 esbnetworks.ieYou can also read
