Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation

Page created by Ralph Cunningham
 
CONTINUE READING
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
Replacing Legacy Systems in the
        Weather Service
              • Danie Malan
                (South African Weather Service)

                Ninjo Interactive Workstation
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
Index
1. Software Development In the SAWS.
2. Quick Overview of IT Servers.
3. Discussion of a few Large IT Systems
   Aquired or Replaced.
4. Disaster Recovery Site
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
1. Software Development.
• History.
     SAWS has been developing visualization , database capture, Climate QC systems since
    early 70’s.

• Developed by Meteorologists.
    Almost all successful software systems were developed by Meteorologist software
    developers. Large systems became unmanageable due to promotions and more often
    resignations due to the IT boom in SA.

• Solution in the South African environment.
•   Systems beeing developed became smaller.
•   Exceptions METCAP (Norwegian Funds).
•   Search for “of the shelf” products.
•   Outsourcing large systems.
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
2 Overview of SAWS IT Servers.
• 2.1 Server Backup -
                                         Backup
 VERITAS Netbackup
                                          LAN
      22.5 TB                                           Servers
    20 LTO tape                            1 GB FIBRE

                          2 GB FIBRE

       Brocade Switch   Brocade Switch
                            2 GB FIBRE

                          SAN
                         22.5 TB
                         60 HDU
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
2. Overview of SAWS IT Servers.
2.2 Server List

•   3 Web servers    Radar products – HTML based
                      Aviation – DHP
                      SAWS external Web - Websphere (JSP)
•   FTP Server
•   Zetafax Server
•   DNS Server – control weathersa.co.za domain
•   2 GPS Timeservers
•   MAIL -> MailXServer (spam Antivirus/Archive/Content Filtering
              Scalix Mailserver | MS Exchange Server
•   Domain Controller | Active Directory Services
           Group Policies
           Auditing
           Security
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
2. Overview of SAWS IT
                 SERVERS.
2.2 Server List continued

•   Antivirus for Windows Desktop
         Trend Micro Neatsuite
•   DHCP/PROXY SERVER
         Dansguardian (Content Filter, Banned Sites, Weighted phrases)
         Trent Micro Internet Web Service Security.
•   NEC SX 8
•   2 X Satellite image SERVERS ( earth station and image processing)
•   Research - CYCLONE host
•   Long term forecast research LORENZ server
      METLAB Portland Group Compilers
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
3 Discussion of a Few Large ICT
    SYSTEMS Acquired or Replaced.
•   3.1 Observation capturing system and climate QC system. (METCAP)

•   3.2 Replacement of Weather visualization system to the Ninjo
    Workstation.

•   3.3 The NCAR radar software.

•   3.4 Development of MSG satellite display systems with European
    Commission funds.

•   3.5 The Vaisala lightning display network.

•   3.6 Transfer of the NWP model from ETA to UNIFY Model.
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
Meteorological Data Capture System

Why develop this system inhouse?

•   Developed with funds provided by the Norwegian Government (Nor-Aid
    Program)

•   Compiled detailed specifications and user requirements. A lot of
    meteorological expertise available in weather observers and forecasters.

•   Assemble a large development and maintenance team (10 persons)

•   The need to replace the previous 20 year old system became critical due to the
    fact that the developer retired. The old system were programmed in BASIC
    and storing data in flat files. None of the current developers know BASIC.

•   System Will Also be used by other SADEC countries.
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
Meteorological Data Capture System

Phase 1: Delivery Date 2003/04/01
• Communication with AWS systems
• METAR/SYNOP Observation capture
• METAR/ SYNOP message generation
• LOCAL (REMOTE) database store.
• Point of Entry Quality Controll framework
Phase 2: Delivery Date 2003/09/01
• Weather Information Display System (Aviation)
• Climate Capture
• Local Reporting (Inventory, extraction)
• Data replication to Climate database (Configuration)
• Quality Controll (POE and higher levels.)
• Upper Air
Replacing Legacy Systems in the Weather Service - Danie Malan Ninjo Interactive Workstation
Components
1. MetCapCon                   5. MSGGEN
  •   Scheduler
                                                               10. Quality control
                                  •   SYNOP Message                •   Point of Entry Rules
  •   Config                      •   METAR Message
  •   Component Controll                                           •   Higher level QC
                                  •   Transmit to GTS              •   QC verification
  •   Version Controller
                               6. RuleEditor                   11. Upper Air
2. COMMS                          •   Point of entry rules
  •   Realtime data
  •   5 minute data            7. WIDS
  •   Upperair                    •   ATC display
  •   AWS reprogram               •   AWS real time data display
3. OBSENTRY                    8. REPORTS
  •   Weather observations        •   Graphs
  •   Cloud Observations          •   Inventories
  •   Visability                  •   Data Extractions
4. ADMINMETA                   9. DBREPLICATE
  •   PC configuration            •   Meta data transfer
  •   Schedule config             •   Data updates
  •   Active elements
  •   Climate capture config
Dataflow
                                                      Head Office
AWS
          22 Regional Offices                   CLIMDB
AWS                                                                   Research
                                                                        And
            PC         METCAP
                                                                    Climatologists
AWS                      MS
                                                 SQL

            PC          SQL       Replication
                                                Database                 PC
UpAir                  Database

            PC                                                           PC
Climate                                                                  PC
                                                 WEB
3 Discussion of a Few Large ICT SYSTEMS
           Acquired or Replaced.
•   3.1 Observation capturing system and climate QC system. (METCAP)

•   3.2 Replacement of Weather visualization system to the Ninjo
    Workstation.

•   3.3 The NCAR radar software.

•   3.4 Development of MSG satellite display systems with European
    Commission funds.

•   3.5 The Vaisala lightning display network.

•   3.6 Transfer of the NWP model from ETA to UNIFY Model.
Ninjo forecasting Workstation
• Old system consisted of a number of independent
  programs each visualizing some part of the weather.

• Different types of data could not be overlaid.

• Developers of some of the systems resigned.

• Some new development was required to provide weather to
  clients like SABC and national press in a more
  professional way.
NinJo Consortium Partners –
                           Distribution
•   International project with 4 national
    meteorological services, the Bundeswehr
    Geoinformation Service and consulting
    companies
•   ~ 60+ members
•   10 sites
•   Utilization of competences of each partner
The whole NinJo Team
                                     wants to say HELLO !!
•   On behalf of the whole NinJo team and the participating services, we friendly
    welcome SAWS as the Customer No 1 !!

      Picture taken from last NInJo Team Meeting November 2006
NinJo - examples of work packages
Geography: Offenbach
     Cross Section: Switzerland
                 Graphical Editor: Canada
                            Diagram: Denmark
                                        Sounding: BW Geoinformation Service
NinJo GUI
NWP (GRIB) Layer
•   all numerical weather
    prediction models
     •   GME, LME, ECMWF,
         GFS, LFP..
•   more models, elements,
    calculated elements (precip.
    sums, differences,..)
•   cropping (reduce resolution,
    interpolation)
•   display modes:
     •   Isolines
     •   Isoareas
     •   Numbers, Symbols
     •   Wind barbs
Christine Oppe
           EuMetSys
c/o Ernst Basler + Partner GmbH
   E-Mail: christine.oppe@ebp.de
3 Discussion of a Few Large ICT SYSTEMS
           Acquired or Replaced.
•   3.1 Observation capturing system and climate QC system. (METCAP)

•   3.2 Replacement of Weather visualization system to the Ninjo
    Workstation.

•   3.3 The NCAR radar software.

•   3.4 Development of MSG satellite display systems with European
    Commission funds.

•   3.5 The Vaisala lightning display network.

•   3.6 Transfer of the NWP model from ETA to UNIFY Model.
3.3 NCAR / SAWS RADAR
           System.
• Cooperation since the early 1970’s on ETA model
  and RADAR (TITAN) software development and
  maintenance.
• Bethlehem Precipitation Research Program –
  Weather Modification REASEARCH.
• It was thru this program that the links with NCAR
  and the “Raped Application development
  Program” (RAP) really took off .
TITAN SYSTEM
•   South Africa became one of the first users of the “TITAN” sweet of
    programs out side the US for real-time radar thunder storm,
    identification, tracking and now-casting program developed by Dr
    Michele Dixon (NCAR).

•   The main features were the ability to look at the storm movement,
    vertical storm structure, identification of new development and the
    ability to control seeding aircraft on the same console. The South
    African experts played a big roll in getting TITAN installed in Europe,
    Canada, USA, Mexico, South America and the Middle East.

•   Thru continues collaboration with NCAR on these fields’ mentions
    above the South African Weather Service is in a world leading position
    today. With the diversion of NCAR in many critical fields we hope
    that we can keep the momentum of the past to keep up with the new
    global issues for whish we all need the same answers. Recourses in
    these fields are scares and needs to be shares.
3 Discussion of a Few Large ICT SYSTEMS
           Acquired or Replaced.
•   3.1 Observation capturing system and climate QC system. (METCAP)

•   3.2 Replacement of Weather visualization system to the Ninjo
    Workstation.

•   3.3 The NCAR radar software.

•   3.4 Development of MSG satellite display systems with European
    Commission funds.

•   3.5 The Vaisala lightning display network.

•   3.6 Transfer of the NWP model from ETA to UNIFY Model.
1. SUMO history.
• Part of MTAP
• MTAP had three main pillars, namely:
• The provision to each African NMS with ground
  receiving equipment.
• Training of NMS’s to utilize the data and maintain
  their systems (scientific and technical training).
• The dissemination of METEOSAT-8 data and
  products to non-meteorological users through the
  vehicle of Outlook Activities.
2. What Is SUMO?
•   SUMO is FREE software.
•   A natural companion to Meteosat receiving stations
•   Target users
•                    Natural resources management
•                     Vegetation production (agriculture, forestry)
•                     Water management (fisheries, watershed management,
    security)
•                     Hazards response (fire, flood, drought)
•   Full Weather Service Functionality
•           All basic MSG channels.
•           Full RGB and channel difference capability.
•           Image viewer, zoom/pan, Gamma Correction, Histogram enhancement
•           Command language (Web Publishing, product control)
•
4. SUMO components

SUMO.EXE application
3 Discussion of a Few Large ICT SYSTEMS
           Acquired or Replaced.
•   3.1 Observation capturing system and climate QC system. (METCAP)

•   3.2 Replacement of Weather visualization system to the Ninjo
    Workstation.

•   3.3 The NCAR radar software.

•   3.4 Development of MSG satellite display systems with European
    Commission funds.

•   3.5 The Vaisala lightning display network.

•   3.6 Transfer of the NWP model from ETA to UNIFY Model.
The Network
Preliminary Work:
Ground Flash Density for 2006
A Free State Thunderstorm

                   Some Statistics (50 km buffer)

                   •Total number of strokes between
                   17:00 and 22:30 = 6306

                   •8% of all strokes were positive
      Rain onset
                   •Average kiloAmperage = 16 kA

                   •Highest recorded stroke = 83 kA

                   •Lowest recorded stroke = 4 kA
3 Discussion of a Few Large ICT SYSTEMS
               Acquired or Replaced.
•   3.1 Observation capturing system and climate QC system. (METCAP)

•   3.2 Replacement of Weather visualization system to the Ninjo
         Workstation.

•   3.3 The NCAR radar software.

•   3.4 Development of MSG satellite display systems with European
    Commission funds.

•   3.5 The Vaisala lightning display network.

•   3.6 Transfer of the NWP model from ETA to UNIFY Model.
Unified Model at the SAWS
• Replaces Eta3245 at end 2006
• Version 6.1 (since March 2006), will upgrade in
  sync with Met Office
• Negotiating operational licence with Met Office:
   – May use the model for operational forecasting
     responsibilities
   – Includes commercial use up to 10% of turnover
   – Real-time feed of observations, LBCs and initial dump
   – Software support from Met Office scientists, visits
Ported Unified Model Philosophy
• Developed to run on:
  – Workstations
  – PCs running Linux OS
  – Massively parallel computer systems (NEC
    SX-series)
• Advanced scientific and technical
  capabilities
• Available to universities and meteorological
  institutes under a licencing agreement
UM SA12 & SA15 Domains
XAANA

        XAANJ

         XAANG
Met Office Collaboration
•       Research tropical convection for better diurnal cycle that
        feeds into cloud, precipitation and surface temperature
    –       (will need to build up expertise at the SAWS)
•       Model sensitivity studies of vegetation/ surface type, soil
        moisture, etc.
    –       (are these important to improve model analyses and forecast skill)
•       Ground-truth verification of the UM over SA using RADAR
        and station network
    –       (emphasis on case-studies to identify cause of forecast failure)
•       DA OSE studies
    –        (must work with Met Office DA team to prevent duplication)
•       WWRP/WMO Southern Africa severe weather forecasting
        project input and using the UM in a short-range ensemble
        forecast system and how a SREF could add value
    –       (Pretoria is a WMO RSMC for southern Africa)
FIN
You can also read