International Data Acquisition and Production: Meteorological Service of Canada

1. Meteorological Service of Canada Data acquisition and production 2nd Global Observation Data Exchange for NWP New Delhi, India José garcia Meteorological Service of Canada 27-30 November, 2018

2. Contents • International Data Acquisition • Where does the data come from? • Canadian data, Production and Dissemination • Radiosondes • SYNOP • SHIPS • BUOY • METAR • AMDAR • RADAR • Collaborative Monitoring • TAC2BUFR Status • HPC upgrade Architecture

3. International Data Acquisition (1/2) • RTH-Washington • most of our GTS bulletins • GTS backup: UCAR-UNIDATA,NOAAPORT • RMDCN (MetOffice) • some GTS bulletins (EARS, AMV) • European BUFR (surface, raobs, bouoy) • PDA-NESDIS • Global AMSUA/AMSUB/MHS/HIRS - METOPA/B, NOAA15/18/19 (processed with AAPP) • AMSUA AQUA (BUFR) • SBUV - NOAA19 • SSMI - DMSP15 (TDRR) • SSMI/S - DMSP17/18 • GOME • AIRS - AQUA • AMSR2 - GCOM-W1 • Global ATMS/CrIS - NPP.NOAA20 • OMPS - NPP • PAMS – NPP

4. International Data Acquisition (2/2) • KNMI (ftp://ftp.knmi.nl/) • ASCAT METOP-1/2 • ScatSat (not yet) • UCAR-SUOMINET (https://www.suominet.ucar.edu/data/ncConusHourly/) • GPS Zenith Total Delay (in replacement for FSL) • CLS (ftp://ftpsedr.cls.fr/) • Buoy + argos insitu data • CMEMS (ftp://nrt.cmems-du.eu/) • Sea Level Anomalies from diverse satellite sources • NASA (ftp://podaac-ftp.jpl.nasa.gov/) • OMI/Aura OMTO3 (total column ozone) • AVHRR/VIIRS (Sea Surface TT)

5. Canadian data, Production and Dissemination • Data Management System • DMS is a platform for managing data and generating products • The initial focus was on MSC and third party point observation data. DMS provides these to a variety of internal and external clients and applications including: NinJo, NWP, the Archive, WMO • DMS has also getting involved in the management of raster data, satellite SAR winds, in future it will also get involved in radar data

6. DMS Data Flow Source Destination Decoder 1 PG 1 Decoder 2 PG 2 DMS Core Interface Decoder 3 PG 3 xml xml <xml> ... ... Decoder 26 PG 25 Decoders Product Generators

7. Canadian data, Production and Dissemination • Radiosondes • 28 stations • 12 stations migrated to GRAW (from Vaisala) as of Nov 01st 2018 • TAC and BUFR bulletins issued at the stations • Geopotential height from pressure sensor • Presently mandatory and significant levels • High resolution observations to be tested soon

8. Canadian data, Production and Dissemination • SYNOP • 806 stations, 83 manned/723 automatic • Raw data is sent to the DMS in various formats • The DMS produces TAC and BUFR bulletins for all stations • Working on hourly reports early FY 2019

9. Canadian data, Production and Dissemination • SHIPS / moored buoys • 45 ships, 416 observations (Nov 1st 2018, 12Z ± 3h) • SHIPS • Raw message -> IMARSAT -> (Legacy system USA) -> DMS(FM-13) -> GTS • No BUFR • moored buoys • Raw message -> WBS (legacy system) -> FM-13 -> GTS • Raw message -> DMS -> FM-13 & BUFR, to be validated

10. Canadian data, Production and Dissemination • DRIFTING BUOYS • 737 BUFR observations, 84 TAC+BUFR (Nov 1st 2018) • BUFR bulletins produced by Scotia Weather Services Inc.

11. Canadian data, Production and Dissemination • METAR • 270 stations • 3 different formats (METAR,WinIDE,READAC) are sent to the DMS • The DMS generates METAR bulletins to be sent to the GTS

12. Canadian data, Production and Dissemination • AMDAR • Messages are provided to CMC by ARINC in ARINC-620 format • The MSCADAS system does QC on the data and generates BUFR bulletins to be sent on the GTS for the airplanes which are not blacklisted (old template) • The blacklist is updated monthly based on the QC control results

13. Canadian data, Production and Dissemination • C-AMDAR : Current Status • Present Canadian AMDAR program is and will continue to decline • Jazz is replacing it’s CRJ-200 with DHC-8/Q-400, which do not have capability of meeting AMDAR temperature accuracy requirements • As of Nov/2018 – 10 AC Jazz aircraft reporting Project Decommissioning Timelines

14. Canadian data, Production and Dissemination • C-AMDAR : Future • Early 2019 • Monitoring and QC will be done with two airlines, First Air and Canadian North • First Air Fleet • ATR 42-500 • ATR 42-300 Combi • Boeing 737-400/400C • Canadian North Fleet • Boeing 737-200 Combi • Later 2019 • Processsing to be done by DMS • Update template

15. Canadian data, Production and Dissemination • RADAR • 33 sites, C-Band range 240KM to be upgraded to S-Band, 240KM • 5 replaced so far • 7 to be replaced each subsequent year • Data exchanged internationally use the ODIM_H5 format • The format is expected to change to the WMO (emerging) standard CfRadial 2.0 which is based on CF Conventions (NetCDF 4).

16. Canadian Radars : original network Non-Doppler range: 256 km Doppler range: 112.5 km

17. Canadian Radar Renewal project S-band range 240 km 2023 Two new S band Sites

18. Canadian Radar Renewal project : actual status 28 C-band: range 240km, Dedicated Doppler range 150km 5 S-band: range 240 km

19. Canadian data, Production and Dissemination • Collaborative Monitoring ( used to be NON) • 18 different networks • Mix of governmental and private networks • Total of ~3000 stations • Mostly hourly, TT, P, Wnd, Precip

20. Collaborative MonitoringAn initiative to enhance access, quality and interoperability of hydrometeorological data in Canada

22. TAC2BUFR Status • Radiosondes : nov 25 2018 12Z • total:697 • only TAC: 255 (specific templates) • only BUFR: 11 • both: 431

23. TAC2BUFR Status • SYNOP : nov 1st 2018 12Z • total: 8487 • only TAC: 1519 • only BUFR: 565 • both: 6403

24. TAC2BUFR Status • Ships: nov 1st 2018 12Z • total: 919 • only TAC: 549 • only BUFR: 43 • both: 327

25. TAC2BUFR Status • Drifting buoys: nov 1st 2018 12Z • total: 1724 • only TAC: 19 • only BUFR: 1409 • both: 296

26. ECCC HPC Upgrade Architecture

27. Resulting Architecture