Forecast Broker Open archive for hydrological forecast and observed data Gerben Boot

Aim of Forecast Broker Forecast Broker aims to provide an open and accessible way to store, search and exchange hydrological observation & forecast data. It makes use of well - known international software standards such as; Catalogue - Service – for – the -Web (CSW),

NetCDF .

OPeNDAP,

What’s a forecaster… • Who of you is a forecaster …? • Who uses or interprets forecast information…? • (readable) products? • Who uses or is familiar with forecast data? • Automatically? • Metadata?

15 maart 2016

What’s a forecaster… • And what is so special about forecasts and forecast data? • Short lifetime (valid until the next one…) • Large amounts of data,grids, ensembles (should not bother daily work) • T0 and a time window of interest around it • Store/retrieve them for reproduction (legal?)

15 maart 2016

Forecasting System… • Deltares: Delft-FEWS (Flood Early Warning System) • Since 2003 • Applied in > 40 countries • System scope: • National (USA, Aus, UK, Scotland, Swiss, Taiwan…) • Regional (NL, Waterboards, Po, Mekong…) • (many) Others…

15 maart 2016

Forecasting System… • Characteristics • Large (central) database • Lots of data i/o, data processing, visualisation aspects • Responsive (even with large amounts of data) • impact on (central) database • need of having some sort of ‘offline’ archive / storage which is easily coupled (brought online) and queried on request…

15 maart 2016

Forecast Broker: idea & design

data set

query

retrieve

storage importer

15 maart 2016

catalogue harvester

Behind the scenes query

Meta data

retrieve

OPeNDAP

HTTP

harvest

storage

CSW catalogue

link

Data: netcdf

15 maart 2016

Query & retrieve of observed/forecast data… Forecast Broker Web Application

Delft-FEWS

Forecast Broker: search & download

Forecast Broker Archive 15 maart 2016

Forecast Broker: seamless integration

15 maart 2016

Forecast Broker applications… • Bureau of Meteorology (Australia) • National Hydrological Forecasting System (HyFS) • Bonneville Power Administration (US) • ARPA (Italy) • More to come…(Delft-FEWS community)

15 maart 2016

2 –pager Forecast Broker • Web application (without installing) on any machine • Delft-FEWS (installing & starting) on SMHI computers: ’03’, ’07’ and ‘13’

15 maart 2016