Difference between revisions of "Meteorological data from ECMWF models"

From Agri4castWiki
Jump to: navigation, search
(Extraction of data into files)
 
(365 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<div class="regular">
+
__NOTOC__
 +
{{Scientific}}
 +
=General description=
 +
The {{Gloshint|ECMWF|European Centre for Medium-Range Weather Forecasts. |ECMWF}} is one of the world's leading centres for numerical modelling. It runs a suite of global models and data assimilation systems for the dynamics, thermodynamics and composition of the Earth's fluid envelope and interacting parts of the Earth system. The data assimilation systems harmonise observations from ground stations, radiosondes, satellites and many other sources with the meteorological equations to form a physically valid state of the atmosphere. These data are used as initial conditions for the various forecast models.
  
Under construction
+
To extend the analysis period and improve crop monitoring and yield forecasting, weather forecasts are integrated into the MCYFS. The data provide important information on the development of the most important meteorological phenomena on the mesoscale.
  
- overview data (ERA, HIS, OPE, EPS, MON and SEA)
+
ECMWF model outputs are used to produce meteorological and derived agrometeorological parameters, which are then visualised in dynamic maps and diagrams in [[Software Tools#Marsop viewer|analyst viewers]] and in static maps [[Analysis of Weather Indicators#Static Maps (Quick-looks)|quick-looks]].
  
- processing from hourly to daily data
+
Data from the ECMWF's ensemble forecast system (ENS) and seasonal forecast model (SEAS) provide several forecast outputs. Since the atmosphere is a chaotic system, small differences in initial conditions can lead to large differences in the resulting forecasts. In 1992, ECMWF introduced an ensemble forecast system that provides information on the uncertainty of a weather forecast. Small perturbations of the initial condition are used to produce (nowadays) 50 different initial conditions. Together with the non-perturbed control run, this results in an ensemble of 51 model results.
  
- overview elements per model
+
Before the ECMWF predicted weather data can be fed into the MCYFS, the data must be pre-processed to obtain the required resolutions in time and space.
 +
[[File:2016-07-13 S2ECMWFFlow.gif|link=|frame|Pre-Processing of ECMWF model data|none]]
  
- link to tables per model
+
==Data acquisition from ECMWF==
 +
Model results for surface and pressure levels is provided by ECMWF in FM-92 {{Gloshint|GRIB|GRIdded Binary. |GRIB}} format which is specified in WMO Publication 306 Manual on Codes.
  
</div>
+
Data from six products of the ECMWF model suite is ingested into the MCYFS:
 +
{|class="wikitable"
 +
!Model set with ECMWFs abbrevation !! Abbreviation within MCYFS !!Number of forecast days used for MCYFS !! Number of ensemble members !! Original ECMWF grid* !! Corresponding original horizontal model resolution* !! Acquired resolution in MCYFS** !! Delivery of data files and maps
 +
|-
 +
|ERA5 || ERA || 1 || 1 || N320 reduced Gaussian grid ||~30 km || 0.28125° x 0.28125° || in April for the previous year
 +
|-
 +
|Deterministic model as analysis HRES || OPE|| 1 || 1 || O1280 octahedral grid*** || ~9 km ***|| 0.25° x 0.25° || Daily (10.30 hr)
 +
|-
 +
|Deterministic forecast HRES || OPE ||10 || 1 || O1280 octahedral grid || ~9 km ***|| 0.25° x 0.25° || Daily (12.00 hr)
 +
|-
 +
|Ensemble Prediction System ENS || ENS ||15 || 50+1 || O640 octahedral grid *** || ~18 km *** || 0.5° x 0.5° || Daily (14.00 hr)
 +
|-
 +
|Seasonal forecast system SEAS || SEAS ||183 || 50+1 || 0320 octahedral grid || ~36 km || 0.4° x 0.4° || February - June and November, 13th of the month
 +
|}
 +
<nowiki>*</nowiki> Grid in which the model simulates the weather indicators (state: 2021). Depending on the model subset, ECMWF uses for surface and pressure levels either a [https://software.ecmwf.int/wiki/display/FCST/Introducing+the+octahedral+reduced+Gaussian+grid Octahedral grid] or a {{Gloshint|Reduced Gaussian grid||Reduced Gaussian grid}}. The octahedral grid names start with ‘O’ followed by the number of latitude lines between the pole and equator. Gaussian grid names start with 'N' followed by number of lines by which latitude is divided.<br>
 +
<nowiki>**</nowiki> Spatial resolution in which the simulated indicators are acquired and loaded into the MCYFS. The simulated indicators are distributed over the earth using a {{Gloshint|WGS84|World Geodetic System, revision 1984|WGS84}} coordinate system.<br>
 +
<nowiki>***</nowiki> HRES and ENS are run by ECMWF twice daily, based on 00 and 12 UTC observations. The SEAS is started by ECMWF each 01st of the month as 00 UTC-run. Depending on the forecast horizon it takes between 5.5 hours (+0 hours HRES) and nearly 9 days (last day SEAS) until the centre disseminates the results.<br>
 +
 
 +
The short range results of the subsequent HRES model runs are processed as analysis of the previous day and added to the archive (as HIS), assuming this is the best estimator for weather indicators of that day. Details are described below.
 +
 
 +
The other data of the forecasting suite is replaced when a more recent forecast becomes available (OPE forecast, ENS, SEAS). As the delivery into the MCYFS databases needs to take place until 15.00 hours of each day in standard situation the 00 UTC model runs are used. In the rare case that the model dissemination is delayed as fallback the 12 UTC model result of the previous day is taken into account.
 +
 
 +
ECMWF’s reanalysis data set ERA5 is used to build a consistent archive of gridded model results from January 1979 onwards. Below, details are described.
 +
 
 +
==Spatial representation==
 +
The ECMWF model computes surface parameters of HRES and ENS on octahedral grids, with different resolutions. The central MCYFS database however requires the initial data in a specific grid resolution with regular latitudes and longitudes, see section [[#Data acquisition from ECMWF|Data acquisition from ECMWF]]. Therefore, conversion is needed.
 +
 
 +
====OPE====
 +
The deterministic forecast model, within MCYFS addressed as OPE, including the short range forecast which is used as analysis, produces forecast weather for grid cells currently on a Octahedral O1280 grid (~9x~9km). This resolution is converted by ECMWF to a reduced Gaussian N640 grid (~16x~16km). Next a conversion of the N640 to a regular 0.25 x 0.25 degrees latitude longitude grid (OPE grid) is done.
 +
 
 +
Several height models at the regular 0.25 x 0.25 degrees latitude longitude exists:
 +
* the height model for the OPE is calculated in the same way as the data itself: first the Octahedral grid is converted to a Gaussian N640 reduced grid and next to the regular 0.25° OPE grid (~25x~25km).
 +
* in addition, the height model of a previous version of OPE model (prior to March 2016) is available. The previous OPE version was run on a Gaussian N640 reduced grid and the related height model was directly converted into the OPE grid.
 +
* in addition, the height model of a previous version of OPE model (2008-2010) is available. This OPE version was run on a Gaussian N400 reduced grid and the related height model was directly converted into the OPE grid
 +
 
 +
For the grid conversion, original software from ECMWF (EMOS-lib) is applied. The grid description is stored in table GRID_HIS including the elevation models originating from two previous OPE versions: ~16km (N640) and ~25km (N400).
 +
 
 +
[[File:gaussian_grid_n640_reduced.jpg|thumb|300px|none|Black dots: Gaussian N640 reduced grid (~16x~16km) to regular 0.25 x 0.25 degrees latitude longitude. Gray lines: 25x25km climate grid.|link=]]
 +
 
 +
====ENS ====
 +
All surface parameters of the ENS forecast are calculated on a Octahedral O640 grid (~18x~18km). This resolution is converted by ECMWF to a reduced Gaussian N200 grid. Next a conversion of the N200 to a regular 0.5 x 0.5 degrees latitude longitude grid (ENS grid) is done. The height model for the ENS is calculated in the same way as the data sets: first the Octahedral grid is converted to a Gaussian N200 reduced grid and next to the regular 0.5° ENS grid. In addition, the height model of a previous version of ENS model (prior to March 2016), ran on a N320 reduced Gaussian grid, is available. For the grid conversion original software from ECMWF (EMOS-lib) is applied. The grid description is stored in table GRID_ENS, the elevation of the previous ENS model (prior to March 2016) is stored in column ALTITUDE.
 +
 
 +
[[File:gaussian_grid_n320_reduced.jpg|thumb|300px|none|Black dots: Gaussian N320 reduced grid (~30x~30km) to regular 0.5 x 0.5 degrees latitude longitude. Gray lines: 25x25km climate grid.|link=]]
 +
 
 +
====SEAS====
 +
The ERA5 data are calculated for a 0320 octahedral grid (~36x~36km). The acquisition and processing of the SEAS data is done in a separate setup. Input data is downloaded from the Copernicus Climate Data Store (CDS) as netcdf formats at a spatial resolution of 0.4° by 0.4 degree. The data is being processed with Python and R scripts.
 +
 
 +
====ERA5====
 +
The ERA5 data are calculated for a Gaussian N320 reduced grid (~30x~30km). The ERA5 data is fetched from the Copernicus CDS API, which offers the dataset already pre-interpolated to the target grid in a spatial resolution of 0.25° x 0.25. The official ECMWF MIR interpolation package is used for the regridding, ensuring consistent datasets.
 +
 
 +
==Applied parameters from ECMWF grib deliveries ==
 +
In total, analysis and forecast for 35 parameters of the ECMWF re-analysis and forecasting suite is used for the various applications in MCYFS and the production of the static maps.
 +
{|class="collapsing_table collapsible collapsed"
 +
!List of meteorological indicators from ECMWF as used within MCYFS
 +
|-
 +
|
 +
{|class="wikitable"
 +
!ECMWF indicator name!! Description!! Temporal resolution of ECMWF data!! ERA5||OPE||ENS||SEAS||Used in MCYFS database||Map generation
 +
|-
 +
|10U||Eastward component of wind vector at 10m height (U-velocity) (m/s) ||+0..+72hrs 3-hourly, afterwards 6-hourly||x||x||x||x||x||x
 +
|-
 +
|10V||Northward component of wind vector at 10m height (V-velocity) (m/s) ||+0..+72hrs 3-hourly, afterwards 6-hourly||x||x||x||x||x||x
 +
|-
 +
|2D||Dew point temperature at 2m height (K)||+0..+72hrs 3-hourly, afterwards 6-hourly||x||x||x||x||x||x
 +
|-
 +
|2T||Air temperature at 2m height (K) ||+0..+72hrs 3-hourly, afterwards 6-hourly||x||x||x||x||x||x
 +
|-
 +
|TP ||Accumulated total precipitation (m)||6-hourly||||x||x||x||x||x
 +
|-
 +
|CP||Convective precipitation (m)||6-hourly||x|||||||||x||
 +
|-
 +
|LSP||Stratiform precipitation (m)||6-hourly||x|||||||||x||
 +
|-
 +
|SSRD ||Surface solar radiation downwards (J/m**2)||6-hourly||x||x||x||x||x||x
 +
|-
 +
|MX2T6 ||Maximum temperature at 2m (in the past 6 hours) (K)||6-hourly||||x||x||||x||x
 +
|-
 +
|MN2T6 ||Minimum temperature at 2m (in the past 6 hours) (K)||6-hourly||||x||x||||x||x
 +
|-
 +
|MX2T24 ||Maximum temperature at 2m (in the past 24 hours) (K)||24-hourly||||||||||x||x
 +
|-
 +
|MN2T24 ||Minimum temperature at 2m (in the past 24 hours) (K)||24-hourly||||||||||x||x
 +
|-
 +
|MX2T||Maximum temperature since previous post-processing (K)||3-hourly||x||||||||x||
 +
|-
 +
|MN2T||Minimum temperature since previous post-processing (K)||3-hourly||x||||||||x||
 +
|-
 +
|SD||Snow depth (Snow Water Equivalent) (m) ||6-hourly||x||x||x||x||x||x
 +
|-
 +
|RSN||Snow density (kg/m**3) ||6-hourly||x||x||x||x||x||x
 +
|-
 +
|TCC||Total cloud cover (0-1)||+0..+72hrs 3-hourly, afterwards 6-hourly||x||x||x||x||x||x
 +
|-
 +
|MSL||Sea level pressure (Pa) ||+0..+72hrs 3-hourly, afterwards 6-hourly||||x||x||||||x
 +
|-
 +
|GPH 500hPa||Geopotential height 500 hPa layer||+0..+72hrs 3-hourly, afterwards 6-hourly||||x||x||||||x
 +
|-
 +
|GPH 850 hPa||Geopotential height 850 hPa layer||+0..+72hrs 3-hourly, afterwards 6-hourly||||x||x||||||x
 +
|-
 +
|GPH 300 hPa||Geopotential height 300 hPa**||+0..+72hrs 3-hourly, afterwards 6-hourly||||x||||||||x
 +
|-
 +
|TAG4 ||Probability of 850 hPa temperature anomaly greater than +4K (%)||24-hourly||||||x||||||x
 +
|-
 +
|TAG8 ||Probability of 850 hPa temperature anomaly greater than +8K (%)||24-hourly||||||x||||||x
 +
|-
 +
|TALM4 ||Probability of 850 hPa temperature anomaly less than -4K (%)||24-hourly||||||x||||||x
 +
|-
 +
|TALM8 ||Probability of 850 hPa temperature anomaly less than -8K (%)||24-hourly||||||x||||||x
 +
|}
 +
|}
 +
 
 +
ECMWF disseminates the model results for the surface layer in WMO FM 92 GRIB format, according WMO specifications, Manual on Codes in WMO Publication Nr 306. To extract the required parameters from the ECMWF data package(s) and to decode the binary GRIB formats the ECMWF GRIB API application program interface for C is used.
 +
 
 +
As a next step after acquisition and scaling to the regular lat-lon-grids, derived elements and daily indicators are calculated
 +
 
 +
==Aggregation to daily data==
 +
First, aggregates of the 3- or 6-hourly data to daily means, extremes or sums are calculated. Total precipitation and global radiation are provided by ECMWF as accumulated values since the begin of the model runtime and therefore differences for the 24-hourly daily sums need to be computed. The box below summarizes the algorithms.
 +
 
 +
{|class="collapsing_table collapsible collapsed"
 +
!Algorithms for aggregation to daily data
 +
|-
 +
|Abbreviations for the elements in the following table refer to the original ECMWF naming as summarized in section [[#Applied parameters from ECMWF grib deliveries|Applied parameters from ECMWF grib deliveries]]. Sub-scripted numbers behind the indicator abbreviations indicate the (UTC)-time of the day. The abbreviations for the model sets refer to the internal naming within MCYFS as defined in section [[#Data acquisition from ECMWF|Data acquisition from ECMWF]]
 +
 
 +
====Aggregation areas====
 +
[[File:map_world_zones.jpg||none|250px|Aggregation areas West, Central and East on world map.]]<br>
 +
To consider the earth's different times zones, aggregation rules for 3 different areas (West, Central, East) have been defined. The aggregation rules for the model data align with the general report schedule of ground weather stations (e.g., maximum air temperature in Europe and Africa refers to the period between 06 and 18 UTC of the corresponding day).
 +
 
 +
The following table summarizes the rules for the different aggregation zones and data sets. Legend of characters used: p = previous day, f = following day. Temporal resolution of OPE is 3-hourly for the first 72 hours and 6-hourly afterwards. Thus algorithms for air temperature, dew point and wind speed of the OPE data set change when the aggregation includes forecast time step +72h. Temporal resolution of ENS and SEAS is 6-hourly. ERA-Interim is available every 3-hours.
 +
 
 +
{|class="wikitable"
 +
!Region !! West !!Centre!!East
 +
|-
 +
|Longitude||180W - 30W||30W - 60E||60E - 180E
 +
|-
 +
|Precipitation OPE, ENS, SEAS||TP<sub>12f</sub> – TP<sub>12</sub>||TP<sub>06f</sub> – TP<sub>06</sub>||TP<sub>24</sub> – TP<sub>00</sub>
 +
|-
 +
|Precipitation ERA||CP<sub>run00f+12h</sub> + CP<sub>run00+12h</sub> + LSP<sub>run00f+12h</sub> + LSP<sub>run00+12h</sub>  ||CP<sub>run00f+06h</sub> + CP<sub>run12+12h</sub> + CP<sub>00+12h</sub> – CP<sub>run00+06h</sub> + LSP<sub>run00f+06h</sub> + LSP<sub>run12+12h</sub> + LSP<sub>00+12h</sub> – LSP<sub>run00+06h</sub>||CP<sub>run12+12h</sub> + CP<sub>run00+12h</sub> + LSP<sub>run012+12h</sub> + LSP<sub>run12+12h</sub>
 +
|-
 +
|Mean temperature  (2T), Dew point (2D), Total cloud cover (TCC)  OPE until +72h, ERA||(X<sub>09</sub> + X<sub>12</sub> + X<sub>15</sub> + X<sub>18</sub> + X<sub>21</sub> + X<sub>24</sub> + X<sub>03f</sub> + X<sub>06f</sub>) / 8 *||(X<sub>03</sub> + X<sub>06</sub> + X<sub>09</sub> + X<sub>12</sub> + X<sub>15</sub> + X<sub>18</sub> + X<sub>21</sub> + X<sub>24</sub>) / 8 *||(X<sub>21p</sub> + X<sub>00</sub> + X<sub>03</sub> + X<sub>06</sub> + X<sub>09</sub> + X<sub>12</sub> + X<sub>15</sub> + X<sub>18</sub>) / 8 *
 +
|-
 +
|Mean temperature  (2T), Dew point (2D), Total cloud cover (TCC)  OPE after +72h, ENS, ENSEXT, SEAS||(X<sub>12</sub> + X<sub>18</sub> + X<sub>24</sub> + X<sub>06f</sub>) / 4 *||(X<sub>06</sub> + X<sub>12</sub> + X<sub>18</sub> + X<sub>24</sub>) / 4 *||(X<sub>00</sub> + X<sub>06</sub> + X<sub>12</sub> + X<sub>18</sub>) / 4 *
 +
|-
 +
|Maximum temperature OPE, ENS, ENSEXT||Maximum(MX2T6<sub>18</sub>, MX2T6<sub>24</sub>)||Maximum(MX2T6<sub>12</sub>, MX2T6<sub>18</sub>)||Maximum(MX2T6<sub>06</sub>, MX2T6<sub>12</sub>)
 +
|-
 +
|Maximum temperature ERA||Maximum(MX2T<sub>run12+00..03h</sub>, MX2T<sub>run12+03..06h</sub>, MX2T<sub>run12+06..09h</sub>, MX2T<sub>run12+09..12h</sub>)||Maximum(MX2T<sub>run00+06..09h</sub>, MX2T<sub>run00+09..12h</sub>, MX2T<sub>run12+00..03h</sub>, MX2T<sub>run12+03..06h</sub>)||Maximum(MX2T<sub>run00+00..03h</sub>, MX2T<sub>run00+03..06h</sub>, MX2T<sub>run00+06..09h</sub>, MX2T<sub>run00+09..12h</sub>)
 +
|-
 +
|Maximum temperature SEAS||MX2T24<sub>24</sub>||MX2T24<sub>24</sub>||MX2T24<sub>24</sub>
 +
|-
 +
|Minimum temperature OPE, ENS, ENSEXT||Minimum(MN2T6<sub>06</sub>, MN2T6<sub>12</sub>)||Minimum(MN2T6<sub>00</sub>, MN2T6<sub>06</sub>)||Minimum(MN2T6<sub>18p</sub>, MN2T6<sub>00</sub>)
 +
|-
 +
|Minimum temperature SEAS||MN2T24<sub>24</sub>||MN2T24<sub>24</sub>||MN2T24<sub>24</sub>
 +
|-
 +
|Minimum temperature ERA||Minimum(MN2T<sub>run00+00..03h</sub>, MN2T<sub>run00+03..06h</sub>, MN2T<sub>run00+06..09h</sub>, MN2T<sub>run00_09..12h</sub>)||Minimum(MN2T<sub>run12p+06..09h</sub>, MN2T<sub>run12p+09..12h</sub>, MN2T<sub>run00+00..03h</sub>, MN2T<sub>run00_03..06h</sub>)||Minimum(MN2T<sub>run12p+00..03h</sub>, MN2T<sub>run12p+03..06h</sub>, MN2T<sub>run12p+06..09h</sub>, MN2T<sub>run12p_09..12h</sub>)
 +
|-
 +
|Wind speed OPE until +72h, ERA||(√(10U<sub>09</sub><sup>2</sup> + 10V<sub>09</sub><sup>2</sup>) + √(10U<sub>12</sub><sup>2</sup> + 10V<sub>12</sub><sup>2</sup>) + √(10U<sub>15</sub><sup>2</sup> + 10V<sub>15</sub><sup>2</sup>) + √(10U18<sup>2</sup> + 10V18<sup>2</sup>) + √(10U<sub>21</sub><sup>2</sup>+ 10V<sub>21</sub><sup>2</sup>) + √(10U<sub>24</sub><sup>2</sup> + 10V<sub>14</sub><sup>2</sup>) + √(10U<sub>03f</sub><sup>2</sup> + 10V<sub>03f</sub><sup>2</sup>) + √(10U<sub>06f</sub><sup>2</sup> + 10V<sub>06f</sub><sup>2</sup>)) / 8||(√(10U<sub>03</sub><sup>2</sup> + 10V<sub>03</sub><sup>2</sup>) + √(10U<sub>06</sub><sup>2</sup> + 10V<sub>06</sub><sup>2</sup>) + √(10U<sub>09</sub><sup>2</sup> + 10V<sub>09</sub><sup>2</sup>) + √(10U<sub>12</sub><sup>2</sup> + 10V<sub>12</sub><sup>2</sup>) + √(10U<sub>15</sub><sup>2</sup> + 10V<sub>15</sub><sup>2</sup>) + √(10U<sub>18</sub><sup>2</sup> + 10V<sub>18</sub><sup>2</sup>) + √(10U<sub>21</sub><sup>2</sup> + 10V<sub>21</sub><sup>2</sup>) + √(10U<sub>24</sub><sup>2</sup> + 10V<sub>24</sub><sup>2</sup>)) / 8||(√(10U<sub>21p</sub><sup>2</sup> + 10V<sub>21p</sub><sup>2</sup>) + √(10U<sub>00</sub><sup>2</sup> + 10V<sub>00</sub><sup>2</sup>) + √(10U<sub>03</sub><sup>2</sup> + 10V<sub>03</sub><sup>2</sup>) + √(10U<sub>06</sub><sup>2</sup> + 10V<sub>06</sub><sup>2</sup>) + √(10U<sub>15</sub><sup>2</sup>+ 10V<sub>15</sub><sup>2</sup>) + √(10U<sub>12</sub><sup>2</sup> + 10V<sub>12</sub><sup>2</sup>) + √(10U<sub>15</sub><sup>2</sup> + 10V<sub>15</sub><sup>2</sup>) + √(10U<sub>18</sub><sup>2</sup> + 10V<sub>18</sub><sup>2</sup>)) / 8
 +
|-
 +
|Wind speed OPE after +72h, ENS, ENSEXT, SEAS||(√(10U<sub>12</sub><sup>2</sup> + 10V<sub>12</sub><sup>2</sup>) + √(10U<sub>18</sub><sup>2</sup> + 10V<sub>18</sub><sup>2</sup>) + √(10U<sub>24</sub><sup>2</sup> + 10V<sub>24</sub><sup>2</sup>) + √(10U<sub>06f</sub><sup>2</sup> + 10V<sub>06f</sub><sup>2</sup>)) / 4||(√(10U<sub>06</sub><sup>2</sup> + 10V<sub>06</sub><sup>2</sup>) + √(10U<sub>12</sub><sup>2</sup> + 10V<sub>12</sub><sup>2</sup>) + √(10U<sub>18</sub><sup>2</sup> + 10V<sub>18</sub><sup>2</sup>) + √(10U<sub>24</sub><sup>2</sup> + 10V<sub>24</sub><sup>2</sup>)) / 4||(√(10U<sub>00</sub><sup>2</sub> + 10V<sub>00</sub><sup>2</sup>) + √(10U<sub>06</sub><sup>2</sup> + 10V<sub>06</sub><sup>2</sup>) + √(10U<sub>12</sub><sup>2</sup> + 10V<sub>12</sub><sup>2</sup>) + √(10U<sub>18</sub><sup>2</sup> + 10V<sub>18</sub><sup>2</sup>)) / 4
 +
|-
 +
|Global radiation OPE, ENS, ENSEXT, SEAS, ERA||SSRD<sub>06f</sub> – SSRD<sub>06</sub>||SSRD<sub>24</sub> – SSRD<sub>00</sub>||SSRD<sub>18</sub> – SSRD<sub>18p</sub>
 +
|-
 +
|Global radiation ERA||SSRD<sub>run00f+06h</sub> + SSRD<sub>run12+12h</sub> + SSRD<sub>run00+12h</sub> - SSRD<sub>run00+06h</sub>||SSRD<sub>run00+12h</sub> + SSRD<sub>run12+12h</sub> ||SSRD<sub>run12+06h</sub> + SSRD<sub>run00+12h</sub> + SSRD<sub>run12p+12h</sub> - SSRD<sub>run12p+06h</sub>
 +
|-
 +
|Snow depth water equivalent, Snow density (SD, RSN) OPE, ENS, ENSEXT, SEAS, ERA||X<sub>12</sub> *||X<sub>06</sub> *||X<sub>00</sub> *
 +
|-
 +
|Surface pressure  (MSL), geopotential height of pressure levels (GH3<sub>00</sub>, GH5<sub>00</sub>, GH850)  OPE until +72h||(X<sub>00</sub> + X<sub>03</sub> + X<sub>06</sub> + X<sub>09</sub> + X<sub>12</sub> + X<sub>15</sub> + X<sub>18</sub> + X<sub>21</sub>) / 8 *||(X<sub>00</sub> + X<sub>03</sub> + X<sub>06</sub> + X<sub>09</sub> + X<sub>12</sub> + X<sub>15</sub> + X<sub>18</sub> + X<sub>21</sub>) / 8 *||(X<sub>00</sub> + X<sub>03</sub> + X<sub>06</sub> + X<sub>09</sub> + X<sub>12</sub> + X<sub>15</sub> + X<sub>18</sub> + X<sub>21</sub>) / 8 *
 +
|-
 +
|Surface pressure  (MSL), geopotential height of pressure levels (GH3<sub>00</sub>, GH5<sub>00</sub>, GH850)  OPE after+72h, ENS||(X<sub>00</sub> + X<sub>06</sub> + X<sub>12</sub> + X<sub>18</sub>) / 4 *||(X<sub>00</sub> + X<sub>06</sub> + X<sub>12</sub> + X<sub>18</sub>) / 4 *||(X<sub>00</sub> + X<sub>06</sub> + X<sub>12</sub> + X<sub>18</sub>) / 4 *
 +
|-
 +
|Probability of 850 hPa temperature anomaly (TAG4, TAG8, TALM4, TALM8) ENS||X<sub>24</sub> *||X<sub>24</sub> *||X<sub>24</sub> *
 +
|-
 +
|Anomalies (2TA, TPARA, MX2T6A, MN2T6A) ENSEXT||Weekly means provided by ECMWF X<sub>+0..168h</sub>, X<sub>+168..336h</sub>, X<sub>+336..504h</sub>, X<sub>+504..672h</sub> * ||Weekly means provided by ECMWF X<sub>+0..168h</sub>, X<sub>+168..336h</sub>, X<sub>+336..504h</sub>, X<sub>+504..672h</sub>* ||Weekly means provided by ECMWF X<sub>+0..168h</sub>, X<sub>+168..336h</sub>, X<sub>+336..504h</sub>, X<sub>+504..672h</sub>*  
 +
|}
 +
<nowiki>*</nowiki> ”X” as representative abbreviation for the ECMWF elements as listed in the first cell of the line
 +
 
 +
 
 +
The short range results of the subsequent, overlapping HRES model are processed as analysis of the previous day and added to the archive (as HIS), assuming this is the best estimator for weather indicators of that day. Details are described below. The ECMWF HRES model is initialized twice daily, using the observations of 00 and 12 UTC, respectively, as starting conditions. The first 12 hours of a particular run are not used for the analysis estimate, to avoid possible model spin-up effects. Such effects have been shown in the past e.g. for convective precipitation or wind. For consistency of the weather elements in the analysis, the first 12 hours of the particular runs are skipped for all elements. This results in a complex computation scheme for the analysis of a certain day:
 +
{|class="wikitable"
 +
!Region !! West !!Centre!!East
 +
|-
 +
|Longitude||180W - 30W||30W - 60E||60E - 180E
 +
|-
 +
|Precipitation ||TP<sub>run00+24h</sub> – TP<sub>run0+12h</sub> + TP<sub>run12+24h</sub> – TP<sub>run12+12h</sub>||TP<sub>run12p+24h</sub> – TP<sub>run12p+18h</sub> + TP<sub>run00+24h</sub> – TP<sub>run0+12h</sub> + TP<sub>run12+18h</sub> – TP<sub>run12+12h</sub> ||TP<sub>run12p+24h</sub> – TP<sub>run12p+12h</sub> + TP<sub>run00+24h</sub> – TP<sub>run0+12h</sub>
 +
|-
 +
|3-h</sub>ourly elements 2T, 2D, TCC, Wind|| (X<sub>run12p+21h</sub> + X<sub>run00+12h</sub> + X<sub>run00+15h</sub> + X<sub>run00+18h</sub>+ X<sub>run00+21h</sub> + X<sub>run12+12h</sub> + X<sub>run12+15h</sub> + X<sub>run12+18h</sub> ) / 8 *|| (X<sub>run12p+15h</sub> + X<sub>run12p+18h</sub> + X<sub>run12p+21h</sub> + X<sub>run00+12h</sub> + X<sub>run00+15h</sub> + X<sub>run00+18h</sub>+ X<sub>run00+21h</sub> + X<sub>run12+12h</sub>) / 8 *||(X<sub>run12p+9h</sub> + X<sub>run12p+12h</sub>+ X<sub>run12p+15h</sub> + X<sub>run12p+18h</sub> + X<sub>run12p+21h</sub> + X<sub>run00+12h</sub> + X<sub>run00+15h</sub> + X<sub>run00+18h</sub>) / 8 *
 +
|-
 +
|Maximum temperature ||Maximum(MX2T6 <sub>run00+18h</sub>, MX2T6 <sub>run00+24h</sub>)||Maximum(MX2T6 <sub>run12p+24h</sub>, MX2T6 <sub>run00+18h</sub>)||Maximum(MX2T6 <sub>run12p+18h</sub>, MX2T6 <sub>run12p+24h</sub>)
 +
|-
 +
|Minimum temperature ||Minimum(MN2T6 <sub>run12p+18h</sub>, MN2T6 <sub>run12p+24h</sub>)||Minimum(MN2T6 <sub>run12p+12h</sub>, MN2T6 <sub>run12p+18h</sub>)||Minimum(MN2T6 <sub>run12p+6h</sub>, MN2T6 <sub>run12p+12h</sub>)
 +
|-
 +
|Global radiation ||SSRD<sub>run12p+24h</sub> – SSRD<sub>run12p+18h</sub>+ SSRD<sub>run00+24h</sub> - SSRD<sub>run00+12h</sub> + SSRD<sub>run12+18h</sub> - SSRD<sub>run12+12h</sub>||SSRD<sub>run12p+24h</sub> – SSRD<sub>run12p+12h</sub> + SSRD<sub>run00+24h</sub> – SSRD<sub>run0+12h</sub>||SSRD<sub>run12p+24h</sub> – SSRD<sub>run12p+6h</sub>+ SSRD<sub>run00+18h</sub> - SSRD<sub>run00+12h</sub>
 +
|-
 +
|Snow SD RSN||X<sub>run00+12h</sub> *||X<sub>run12p+18h</sub> *||X<sub>run12p+12h</sub>*
 +
|}
 +
<nowiki>*</nowiki> ”X” as representative abbreviation for the ECMWF elements as listed in the first cell of the line
 +
|}
 +
 
 +
==Calculation of additional indicators==
 +
The following indicators are retrieved from other elements. These include:
 +
* Snow depth (thickness snow cover)
 +
* Climate water balance (for mapping purposes)
 +
 
 +
===Snow depth===
 +
The snow depth (thickness of the snow layer, Dsn) is derived from snow depth water equivalent and snow density.
 +
{{Hidden
 +
|Dsn equals (r_water/r_snow)*SD/c_snow
 +
|where:
 +
*'' r_water density of water in kg/m**3''
 +
*'' r_snow (RSN) density of snow in kg/m**3''
 +
*'' SD snow mass in m''
 +
*'' c_snow snow fraction, dimensionless''
 +
The ECMWF provides snow depth water equivalent SD (m<sup>3</sup>/m<sup>2</sup>) and snow density RSN (kg/m<sup>3</sup>). In ECMWF's model documentation snow mass is referred as “snow water equivalent”, and leads to parameter SD, snow depth. Snow fraction is not provided by ECMWF (is not in the catalogue). ECMWF assumes c_snow to be 1 for snow depth > 15 cm (average of the grid box) and <1 for a thinner snow cover.
 +
}}
 +
===Climatic water balance===
 +
Climatic water balance is calculated based on evapotranspiration calculated through the equation of Penman-Monteith (ET0) and the total precipitation of a day. This calculated ET0 is only used for mapping purposes. Note that in the downstream processing, and after spatial scaling operations, ET0 is calculated again (see [[Interpolation of forecasted weather#Calculation additional parameters|calculation of additional parameters after downscaling]]).
 +
 
 +
{{Hidden
 +
|CWB equals Rain – ET0
 +
|where:
 +
*''Rain : 24-hour amount of precipitation[mm*day-1]''
 +
*''ET0  : reference evapotranspiration [mm*day-1]''
 +
}}
 +
 
 +
==Calculation of extreme weather events==
 +
For the static map production (quicklooks) it is necessary to derive additional parameters out of the raw ECMWF data set. This especially concerns probabilities and aggregated counts of number of days where a special condition is met. To compute the probability for the exceedance of thresholds (e.g. probability of freezing days) first the daily value for each separate ensemble member is computed and then the amount of members which fit the corresponding constraint (p.e. exceed 20 mm of daily precipitation sum) is counted. To compute the number of days where a parameter exceed a threshold first the numbers for each separate ensemble member is calculated (from the daily values of each ensemble member). Afterwards the median is derived for presentation on map. The deterministic run and the ensemble control run are treated like any other ensemble member.
 +
Probabilities for anomalies require comparison with ECMWF model climate and are therefore only visualized where available in the ECMWF catalogue.
 +
 
 +
{|class="collapsing_table collapsible collapsed"
 +
!Derived probability and other threshold-dependent indicators
 +
|-
 +
|
 +
{|class="wikitable"
 +
!Type of map!! Indicator
 +
|-
 +
|Daily from ENS||1-day base Probability TempMin < 0°C
 +
|-
 +
|Daily from ENS||1-day base Probability TempMax > 30°C
 +
|-
 +
|Daily from ENS||1-day base Probability of daily precipitation > 20mm
 +
|-
 +
|Daily from ENS||10-day base Number of rainy days with precipitation > 1mm
 +
|-
 +
|Daily from ENS||10-day base Number of days with significant precipitation > 5mm
 +
|-
 +
|Daily from ENS||10-day base Number of hot days with TempMax > 30°C
 +
|-
 +
|Daily from ENS||10-day base Number of freezing days with TempMin < 0°C
 +
|}
 +
|}
 +
 
 +
==Aggregation to 10-daily and weekly data==
 +
For the production of the maps, as well an aggregation to 10-daily and weekly aggregates of the daily data takes place. Therefore the '''average''' of mean temperature, maximum temperature, minimum temperature, snow depth and the '''sum''' of precipitation, ET0, climatic water balance and global radiation is computed.
 +
 
 +
==Extraction of data into files==
 +
After processing data are exported as data files and static maps that can be distributed to users and other MCYFS processes.
 +
 
 +
A simple file naming scheme for the data files was adopted with the general format:
 +
<nowiki><ROI>_<model_code>_<yyyy><mm><dd>_<member>.dat</nowiki><br>
 +
 
 +
In which:
 +
* ROI = region (GLD)
 +
* model_code = ECMWF model (OPE, ENS)
 +
* yyyy = the year (four digits),
 +
* mm = the month number (two digits),
 +
* dd = the day in the month (two digits)
 +
* member = the member number (two digits)
 +
 
 +
The date in the filename links to the forecast day = 0 (FORECAST_OFFSET = 0). In case of OPE only member 00 is allowed; in case of ENS the member number runs from 0 to 50.
 +
 
 +
An example of a file name for each of the 4 models is:
 +
* GLO_OPE_20160715_00.dat OPE data issued July 15, 2016 (only member 00 allowed)
 +
* GLO_ENS_20160704_35.dat ENS data issued July 4, 2016, member 35
 +
 
 +
 
 +
An input file basically contains the following structure:
 +
* A header providing geo referencing information
 +
* Blocks of data for the first forecast date (for each variable)
 +
* Blocks of data for the second forecast date (for each variable)
 +
* etc.
 +
 
 +
For simplification purposes, below a simple example is given with a detailed explanation.
 +
 
 +
{|class="collapsing_table collapsible collapsed"
 +
!Explanation of file format
 +
|-
 +
| The example contains just rainfall and daily mean temperature for two forecast days for a grid ranging from 20 to 40 degrees longitude and from 50 to 60 degrees latitude, with a grid size of 5 degrees. The forecast is issued on 23 January 2009 and first day in the forecast (FORECAST_OFFSET=0) is linked to this date.
 +
 
 +
[[File:FormatECMWF.JPG|full|500px]]
 +
 
 +
The meaning of each of the lines is given in the following table:
 +
 
 +
{|class="wikitable"
 +
!Line number!! Meaning
 +
|-
 +
|1|| ignored
 +
|-
 +
|2|| nr of columns
 +
|-
 +
|2|| nr of rows
 +
|-
 +
|2|| latitude max
 +
|-
 +
|2|| longitude min
 +
|-
 +
|2|| latitude min
 +
|-
 +
|2|| longitude max
 +
|-
 +
|2|| cell size longitude direction
 +
|-
 +
|2|| cell size latitude direction (cell sizes should be equal)
 +
|-
 +
|3|| announce variable rainfall (see below for a list of variable abbreviations)
 +
|-
 +
|4|| announce first forecast date (start with 0)
 +
|-
 +
|5,6,7|| rainfall data starting with upper left most cell, as it would be laid out on a map (5 columns, 3 rows)
 +
|-
 +
|9|| announce daily mean temperature (see below for a list of variable abbreviations)
 +
|-
 +
|10|| announce first forecast date
 +
|-
 +
|11,12,13|| daily mean temperature data
 +
|-
 +
|15|| new block of data, but now for the second forecast date
 +
|}
 +
 
 +
The possible forecast offsets are given in the following table:
 +
{|class="wikitable"
 +
!Model!!First offset* !!Last offset
 +
|-
 +
|OPE||0||9
 +
|-
 +
|ENS||0||14
 +
|}
 +
<nowiki>*</nowiki>  = Day of ECMWF model initialization (“model run”). For instance if the model is initialized on the first October 2014 00 UTC the FORECAST OFFSET = 0 refers to Oct 01 2014. Data is always aggregated to daily values (see [[#Aggregation to daily data|rules]] for aggregation from 3- resp. 6-hourly data to daily values).
 +
 
 +
The provided grids are summarized in the following table:
 +
{|class="wikitable"
 +
!Model!!Nr columns!!Nr rows!!Latitude max!!Longitude min!!Latitude min!!Longitude max!!Cell size longitude direction !!Cell size latitude direction!!Nr of grid cells and land grid cells
 +
|-
 +
|OPE||1440||501||75.00°N||-179.75°E||-50.00°N||180.00°E||0.25°||0.25°||721440 / 254604
 +
|-
 +
|ENS||720||253||75.50°N||-179.50°E||-50.50°N||180.00°E||0.50°||0.50°||182160
 +
|}
 +
 
 +
During preparing the files some unit conversion is done:
 +
 
 +
{|class="wikitable"
 +
!Variable!! Unit before !! Unit after
 +
|-
 +
|T2M (Mean temperature)|| degrees Kelvin || degrees Celsius
 +
|-
 +
|TX (Maximum temperature)|| degrees Kelvin || degrees Celsius
 +
|-
 +
|TN (Minimum temperature)|| degrees Kelvin || degrees Celsius
 +
|-
 +
|TD (Dew point temperature)|| degrees Kelvin || degrees Celsius
 +
|-
 +
|RR (Precipitation)|| m.d-1 || mm.d-1
 +
|-
 +
|SN (Snow water equivalent)|| m || cm
 +
|-
 +
|SH (Snow depth)|| m || cm
 +
|-
 +
|TCC (Cloud cover)|| fraction || %
 +
|}
 +
 
 +
The variable abbreviations and their explanation are given in the following table:
 +
 
 +
{|class="wikitable"
 +
!Code!! Meaning !! Unit
 +
|-
 +
|T2M|| Mean air temperature || degrees Celsius, Numeric (3,1)
 +
|-
 +
|TX|| Maximum air temperature || degrees Celsius, Numeric (3,1)
 +
|-
 +
|TN|| Minimum air temperature || degrees Celsius, Numeric (3,1)
 +
|-
 +
|TD|| Dew point temperature || degrees Celsius, Numeric (3,1)
 +
|-
 +
|RR|| Precipitation || mm, Numeric (3,1)
 +
|-
 +
|SSRD|| Global radiation || J.m-2.d-1, Numeric (8,0)
 +
|-
 +
|SN|| Snow water equivalent || cm, Numeric (5,1)
 +
|-
 +
|SD|| Snow depth (thickness snow cover) || cm, Numeric (5,1)
 +
|-
 +
|FFM|| Mean wind speed at 10 m above ground|| ms<sup>-1</sup>, Numeric (3,1)
 +
|-
 +
|TCC|| Total cloud cover fraction || %, Numeric (3,0)
 +
|}
 +
All elements refer to the model surface. The temperatures refer to a level 2 meters above (model) ground, wind speed refers to a level 10 meters above (model) ground.
 +
|}
 +
 
 +
The data files are loaded in the MCYFS database, tables WEATHER_<MODEL>_GRID_RAW where <MODEL> is to be replaced by the abbreviation of one of the two ECMWF products (OPE, ENS). During loading two actions are executed:
 +
* additional unit conversion
 +
* plausible range checks
 +
 
 +
{|class="collapsing_table collapsible collapsed"
 +
!Unit conversion and range checking
 +
|-
 +
|
 +
{|class="wikitable"
 +
!Variable!! Unit before !! Unit after
 +
|-
 +
|SSRD (Global radiation)|| J.m-2.d-1 || kJ.m-2.d-1
 +
|-
 +
|TCC (Cloud cover)|| % || fraction
 +
|}
 +
 
 +
{|class="wikitable"
 +
!Variable!! Correction
 +
|-
 +
|RR (Precipitation)|| 0, when < 0
 +
|-
 +
|SN (Snow water equivalent)|| 0, when < 0
 +
|-
 +
|FFM (Wind speed at 10 m)|| 0, when < 0
 +
|-
 +
|SH (Snow depth)|| 0, when < 0
 +
|-
 +
|SSRD (Global radiation)|| 0, when < 0
 +
|}
 +
|}
 +
 
 +
The SEAS and the ERA5 data is being processed with separate processing lines, respectively. The resulting daily data is delivered as NetCDF.
 +
 
 +
==Extraction of data into maps==
 +
The static maps are exported as flat images and animated images with full layout and directly made available to analysts that use them during [[Analysis of weather indicators|analysis of weather indicators]]. The geographic extent of the static maps for Europe is defined by the upper-left corner at 75° North/25° West and the lower-right corner 20° North/70° East, the maps for the RUK domain cover a domain 65° North/25° West to 40° North/105° East. This production line includes GrADS mapping software which is able to create maps directly from GRIB files.
 +
 
 +
[[File:Quick_look_tmax_20110207_024.jpg|thumb|left|250px|Static map of maximum temperature on 7-feb-2011 with a spring breeze in Central and Western Europe.]]
 +
[[File:Quick_look_anim_rain_20101220_small.gif|frame|centre|Animated Rainfall, emitted 20-dec-2010 with the forecasted precipitation of low "Petra". Petra's snow masses retarded travel in many regions of Europe before Christmas 2010. [http://marswiki.jrc.ec.europa.eu/agri4castwiki/images/4/41/Quick_look_anim_rain_20101220.gif Large animation]]]
 +
 
 +
[[File:GLO1_ENS-NR.SIGNIFICANT-RAIN_20160720_216.jpg |thumb|left|500px|Static map with the forecasted number of days with significant rain (>5mm) within the next 10 days. Forecast issued 20 July 2016.]]
 +
[[File:GLO1_SEA-PROB-COLD2K_20160601_696.jpg |thumb|centre|500px|Static map with the forecasted probability for a cold anomaly > 2K in June 2016, forecasted by the SEAS run initialized 01 June 2016.]]
 +
 
 +
 
 +
{|class="collapsing_table collapsible collapsed"
 +
!Overview: Produced maps
 +
|-
 +
|
 +
The abbreviations for the various maps (including the animated) in the following tables are used for the directory structure on the ftp-server and the transmitted zip. The zip-name is extended by the day of the underlying ECMWF model set run.
 +
 
 +
The following table summarizes the map production as set up for the OPE and the ENS:
 +
{|class="wikitable"
 +
!Parameter!!Number of OPE maps!!Number of ENS maps!!Time period covered by each map!!EUR OPE!!EUR ENS!!RUK OPE!!RUK ENS
 +
|-
 +
|Sum Rain-24h||10+Animation||15+Animation||1 day||EUR_RAIN||EUR_ENS_RAIN||RUK_RAIN||RUK_ENS_RAIN
 +
|-
 +
|Tmax-24h||10+Animation||15+Animation||1 day||EUR_TMAX||EUR_ENS_TMAX||RUK_TMAX||RUK_ENS_TMAX
 +
|-
 +
|Tmean-24h||10+Animation||15+Animation||1 day||EUR_TAVG||EUR_ENS_TAVG||RUK_TAVG||RUK_ENS_TAVG
 +
|-
 +
|Tmin-24h||10+Animation||15+Animation||1 day||EUR_TMIN||EUR_ENS_TMIN||RUK_TMIN||RUK_ENS_TMIN
 +
|-
 +
|GPH 300 hPa||10+Animation||-||1 day||EUR_GPH300||-||RUK_GPH300||-
 +
|-
 +
|GPH 500 hPa||10+Animation||15+Animation||1 day||EUR_GPH500||EUR_ENS_GPH500||RUK_GPH500||RUK_ENS_GPH500
 +
|-
 +
|GPH 850 hPa||10+Animation||15+Animation||1 day||EUR_GPH850||EUR_ENS_GPH850||RUK_GPH850||RUK_ENS_GPH850
 +
|-
 +
|Sea level pressure||10+Animation||15+Animation||1 day||EUR_SLP||EUR_ENS_SLP||RUK_SLP||RUK_ENS_SLP
 +
|-
 +
|Sum CWB-24h||10||15||1 day||EUR_CWB||EUR_ENS_CWB||GLO1_CWB||RUK_ENS_CWB
 +
|-
 +
|Sum ET0-24h||10||15||1 day||EUR_ET0||EUR_ENS_ET0||GLO1_ET0||RUK_ENS_ET0
 +
|-
 +
|Sum Rg||10||15||1 day||EUR_SOL.RAD||EUR_ENS_SOL.RAD||RUK_SOL.RAD||RUK_ENS_SOL.RAD
 +
|-
 +
|Sum Snow-24h||10||15||1 day||EUR_SNOW||EUR_ENS_SNOW||RUK_SNOW||RUK_ENS_SNOW
 +
|-
 +
|Total cloud cover-24h||10||15||1 day||EUR_CLOUD||EUR_ENS_CLOUD||RUK_CLOUD||RUK_ENS_CLOUD
 +
|-
 +
|Probab. Cold Anomaly -4K (850hPa)||-||15||1 day||-||EUR_T850ANOM-4||-||RUK_T850ANOM-4
 +
|-
 +
|Probab. Cold Anomaly -8K (850hPa)||-||15||1 day||-||EUR_T850ANOM-8||-||RUK_T850ANOM-8
 +
|-
 +
|Probab. Rain > 20mm*||-||15||1 day||-||EUR_PROB-T 20MM20mm0||-||RUK_PROB-T 20MM20mm0
 +
|-
 +
|Probab. TempMax > 30C*||-||15||1 day||-||EUR_PROB-TX30||-||RUK_PROB-TX30
 +
|-
 +
|Probab. TempMin < 0C*||-||15||1 day||-||EUR_PROB-TN00||-||RUK_PROB-TN00
 +
|-
 +
|Probab. Warm Anomaly +4K (850hPa)||-||15||1 day||-||EUR_T850ANOM+4||-||RUK_T850ANOM+4
 +
|-
 +
|Probab. Warm Anomaly +8K (850hPa)||-||15||1 day||-||EUR_T850ANOM+8||-||RUK_T850ANOM+8
 +
|-
 +
|Avg Snow-10D||1||1||10 days||EUR_SNOW-10D||EUR_ENS_SNOW-10D||RUK_SNOW-10D||RUK_ENS_SNOW-10D
 +
|-
 +
|Nr Days with Significant Rain (Rain > 5mm)||1||1||10 days||EUR_NR.SIGNIFICANT-RAIN||EUR_ENS_NR.SIGNIFICANT-RAIN||RUK_NR.SIGNIFICANT-|-
 +
RAIN||GLO1_ENS_NR.SIGNIFICANT-RAIN
 +
|-
 +
|Nr Freezing days (Tn < 0C)||1||1||10 days||EUR_NR.TN00||EUR_ENS_NR.TN00||RUK_NR.TN00||RUK_ENS_NR.TN00
 +
|-
 +
|Nr Hot days (Tx > 30C)||1||1||10 days||EUR_NR.TX30||EUR_ENS_NR.TX30||RUK_NR.TX30||RUK_ENS_NR.TX30
 +
|-
 +
|Nr Rainy days (Rain > 1mm)||1||1||10 days||EUR_NR.RAINY||EUR_ENS_NR.RAINY||RUK_NR.RAINY||RUK_ENS_NR.RAINY
 +
|-
 +
|Sum CWB-10D||1||1||10 days||EUR_CWB-10D||EUR_ENS_CWB-10D||RUK_CWB-10D||RUK_ENS_CWB-10D
 +
|-
 +
|Sum ET0-10D||1||1||10 days||EUR_ET0-10D||EUR_ENS_ET0-10D||RUK_ET0-10D||RUK_ENS_ET0-10D
 +
|-
 +
|SumRain-10D||1||1||10 days||EUR_RAIN-10D||EUR_ENS_RAIN-10D||RUK_RAIN-10D||RUK_ENS_RAIN-10D
 +
|}
 +
 
 +
== Messages to the Project Management Board ==
 +
Information on successfull completion of the various processing steps is sent to the [[Software_Tools#Project_Management_Board|Project Management Board]] (PMB).
 +
 
 +
{|class="collapsing_table collapsible collapsed"
 +
!List of signals communicated to the Project Management Board (PMB) in connection to the processing of ECMWF model data.
 +
|-
 +
|
 +
 
 +
{| class="wikitable"
 +
!EVENT_ID!!Region!!FREQUENCY!!DELAY!!HOUR!!MINUTE!!THEME!!STEP!!RESOLUTION!!LOCATION
 +
|-
 +
|58||GLD||Daily||0||10||0||Weather - OPE||Acquired||0.25 degrees||FTP MG
 +
|-
 +
|59||GLD||Daily||0||10||15||Weather - OPE||Processed||0.25 degrees||filesystem MG
 +
|-
 +
|60||GLD||Daily||0||10||30||Weather - OPE||Delivered||0.25 degrees||FTP WENR
 +
|-
 +
|106||GLD||Daily||0||13||0||Weather - ENS||Acquired||0.5 degrees||FTP MG
 +
|-
 +
|107||GLD||Daily||0||14||0||Weather - ENS||Processed||0.5 degrees||filesystem MG
 +
|-
 +
|108||GLD||Daily||0||14||5||Weather - ENS||Delivered||0.5 degrees||FTP WENR
 +
|}
 +
 
 +
|}

Latest revision as of 10:24, 22 October 2021



General description

The ECMWF is one of the world's leading centres for numerical modelling. It runs a suite of global models and data assimilation systems for the dynamics, thermodynamics and composition of the Earth's fluid envelope and interacting parts of the Earth system. The data assimilation systems harmonise observations from ground stations, radiosondes, satellites and many other sources with the meteorological equations to form a physically valid state of the atmosphere. These data are used as initial conditions for the various forecast models.

To extend the analysis period and improve crop monitoring and yield forecasting, weather forecasts are integrated into the MCYFS. The data provide important information on the development of the most important meteorological phenomena on the mesoscale.

ECMWF model outputs are used to produce meteorological and derived agrometeorological parameters, which are then visualised in dynamic maps and diagrams in analyst viewers and in static maps quick-looks.

Data from the ECMWF's ensemble forecast system (ENS) and seasonal forecast model (SEAS) provide several forecast outputs. Since the atmosphere is a chaotic system, small differences in initial conditions can lead to large differences in the resulting forecasts. In 1992, ECMWF introduced an ensemble forecast system that provides information on the uncertainty of a weather forecast. Small perturbations of the initial condition are used to produce (nowadays) 50 different initial conditions. Together with the non-perturbed control run, this results in an ensemble of 51 model results.

Before the ECMWF predicted weather data can be fed into the MCYFS, the data must be pre-processed to obtain the required resolutions in time and space.

Pre-Processing of ECMWF model data

Data acquisition from ECMWF

Model results for surface and pressure levels is provided by ECMWF in FM-92 GRIB format which is specified in WMO Publication 306 Manual on Codes.

Data from six products of the ECMWF model suite is ingested into the MCYFS:

Model set with ECMWFs abbrevation Abbreviation within MCYFS Number of forecast days used for MCYFS Number of ensemble members Original ECMWF grid* Corresponding original horizontal model resolution* Acquired resolution in MCYFS** Delivery of data files and maps
ERA5 ERA 1 1 N320 reduced Gaussian grid ~30 km 0.28125° x 0.28125° in April for the previous year
Deterministic model as analysis HRES OPE 1 1 O1280 octahedral grid*** ~9 km *** 0.25° x 0.25° Daily (10.30 hr)
Deterministic forecast HRES OPE 10 1 O1280 octahedral grid ~9 km *** 0.25° x 0.25° Daily (12.00 hr)
Ensemble Prediction System ENS ENS 15 50+1 O640 octahedral grid *** ~18 km *** 0.5° x 0.5° Daily (14.00 hr)
Seasonal forecast system SEAS SEAS 183 50+1 0320 octahedral grid ~36 km 0.4° x 0.4° February - June and November, 13th of the month

* Grid in which the model simulates the weather indicators (state: 2021). Depending on the model subset, ECMWF uses for surface and pressure levels either a Octahedral grid or a Reduced Gaussian grid. The octahedral grid names start with ‘O’ followed by the number of latitude lines between the pole and equator. Gaussian grid names start with 'N' followed by number of lines by which latitude is divided.
** Spatial resolution in which the simulated indicators are acquired and loaded into the MCYFS. The simulated indicators are distributed over the earth using a WGS84 coordinate system.
*** HRES and ENS are run by ECMWF twice daily, based on 00 and 12 UTC observations. The SEAS is started by ECMWF each 01st of the month as 00 UTC-run. Depending on the forecast horizon it takes between 5.5 hours (+0 hours HRES) and nearly 9 days (last day SEAS) until the centre disseminates the results.

The short range results of the subsequent HRES model runs are processed as analysis of the previous day and added to the archive (as HIS), assuming this is the best estimator for weather indicators of that day. Details are described below.

The other data of the forecasting suite is replaced when a more recent forecast becomes available (OPE forecast, ENS, SEAS). As the delivery into the MCYFS databases needs to take place until 15.00 hours of each day in standard situation the 00 UTC model runs are used. In the rare case that the model dissemination is delayed as fallback the 12 UTC model result of the previous day is taken into account.

ECMWF’s reanalysis data set ERA5 is used to build a consistent archive of gridded model results from January 1979 onwards. Below, details are described.

Spatial representation

The ECMWF model computes surface parameters of HRES and ENS on octahedral grids, with different resolutions. The central MCYFS database however requires the initial data in a specific grid resolution with regular latitudes and longitudes, see section Data acquisition from ECMWF. Therefore, conversion is needed.

OPE

The deterministic forecast model, within MCYFS addressed as OPE, including the short range forecast which is used as analysis, produces forecast weather for grid cells currently on a Octahedral O1280 grid (~9x~9km). This resolution is converted by ECMWF to a reduced Gaussian N640 grid (~16x~16km). Next a conversion of the N640 to a regular 0.25 x 0.25 degrees latitude longitude grid (OPE grid) is done.

Several height models at the regular 0.25 x 0.25 degrees latitude longitude exists:

  • the height model for the OPE is calculated in the same way as the data itself: first the Octahedral grid is converted to a Gaussian N640 reduced grid and next to the regular 0.25° OPE grid (~25x~25km).
  • in addition, the height model of a previous version of OPE model (prior to March 2016) is available. The previous OPE version was run on a Gaussian N640 reduced grid and the related height model was directly converted into the OPE grid.
  • in addition, the height model of a previous version of OPE model (2008-2010) is available. This OPE version was run on a Gaussian N400 reduced grid and the related height model was directly converted into the OPE grid

For the grid conversion, original software from ECMWF (EMOS-lib) is applied. The grid description is stored in table GRID_HIS including the elevation models originating from two previous OPE versions: ~16km (N640) and ~25km (N400).

Black dots: Gaussian N640 reduced grid (~16x~16km) to regular 0.25 x 0.25 degrees latitude longitude. Gray lines: 25x25km climate grid.

ENS

All surface parameters of the ENS forecast are calculated on a Octahedral O640 grid (~18x~18km). This resolution is converted by ECMWF to a reduced Gaussian N200 grid. Next a conversion of the N200 to a regular 0.5 x 0.5 degrees latitude longitude grid (ENS grid) is done. The height model for the ENS is calculated in the same way as the data sets: first the Octahedral grid is converted to a Gaussian N200 reduced grid and next to the regular 0.5° ENS grid. In addition, the height model of a previous version of ENS model (prior to March 2016), ran on a N320 reduced Gaussian grid, is available. For the grid conversion original software from ECMWF (EMOS-lib) is applied. The grid description is stored in table GRID_ENS, the elevation of the previous ENS model (prior to March 2016) is stored in column ALTITUDE.

Black dots: Gaussian N320 reduced grid (~30x~30km) to regular 0.5 x 0.5 degrees latitude longitude. Gray lines: 25x25km climate grid.

SEAS

The ERA5 data are calculated for a 0320 octahedral grid (~36x~36km). The acquisition and processing of the SEAS data is done in a separate setup. Input data is downloaded from the Copernicus Climate Data Store (CDS) as netcdf formats at a spatial resolution of 0.4° by 0.4 degree. The data is being processed with Python and R scripts.

ERA5

The ERA5 data are calculated for a Gaussian N320 reduced grid (~30x~30km). The ERA5 data is fetched from the Copernicus CDS API, which offers the dataset already pre-interpolated to the target grid in a spatial resolution of 0.25° x 0.25. The official ECMWF MIR interpolation package is used for the regridding, ensuring consistent datasets.

Applied parameters from ECMWF grib deliveries

In total, analysis and forecast for 35 parameters of the ECMWF re-analysis and forecasting suite is used for the various applications in MCYFS and the production of the static maps.

ECMWF disseminates the model results for the surface layer in WMO FM 92 GRIB format, according WMO specifications, Manual on Codes in WMO Publication Nr 306. To extract the required parameters from the ECMWF data package(s) and to decode the binary GRIB formats the ECMWF GRIB API application program interface for C is used.

As a next step after acquisition and scaling to the regular lat-lon-grids, derived elements and daily indicators are calculated

Aggregation to daily data

First, aggregates of the 3- or 6-hourly data to daily means, extremes or sums are calculated. Total precipitation and global radiation are provided by ECMWF as accumulated values since the begin of the model runtime and therefore differences for the 24-hourly daily sums need to be computed. The box below summarizes the algorithms.

Calculation of additional indicators

The following indicators are retrieved from other elements. These include:

  • Snow depth (thickness snow cover)
  • Climate water balance (for mapping purposes)

Snow depth

The snow depth (thickness of the snow layer, Dsn) is derived from snow depth water equivalent and snow density.

Climatic water balance

Climatic water balance is calculated based on evapotranspiration calculated through the equation of Penman-Monteith (ET0) and the total precipitation of a day. This calculated ET0 is only used for mapping purposes. Note that in the downstream processing, and after spatial scaling operations, ET0 is calculated again (see calculation of additional parameters after downscaling).


Calculation of extreme weather events

For the static map production (quicklooks) it is necessary to derive additional parameters out of the raw ECMWF data set. This especially concerns probabilities and aggregated counts of number of days where a special condition is met. To compute the probability for the exceedance of thresholds (e.g. probability of freezing days) first the daily value for each separate ensemble member is computed and then the amount of members which fit the corresponding constraint (p.e. exceed 20 mm of daily precipitation sum) is counted. To compute the number of days where a parameter exceed a threshold first the numbers for each separate ensemble member is calculated (from the daily values of each ensemble member). Afterwards the median is derived for presentation on map. The deterministic run and the ensemble control run are treated like any other ensemble member. Probabilities for anomalies require comparison with ECMWF model climate and are therefore only visualized where available in the ECMWF catalogue.

Aggregation to 10-daily and weekly data

For the production of the maps, as well an aggregation to 10-daily and weekly aggregates of the daily data takes place. Therefore the average of mean temperature, maximum temperature, minimum temperature, snow depth and the sum of precipitation, ET0, climatic water balance and global radiation is computed.

Extraction of data into files

After processing data are exported as data files and static maps that can be distributed to users and other MCYFS processes.

A simple file naming scheme for the data files was adopted with the general format: <ROI>_<model_code>_<yyyy><mm><dd>_<member>.dat

In which:

  • ROI = region (GLD)
  • model_code = ECMWF model (OPE, ENS)
  • yyyy = the year (four digits),
  • mm = the month number (two digits),
  • dd = the day in the month (two digits)
  • member = the member number (two digits)

The date in the filename links to the forecast day = 0 (FORECAST_OFFSET = 0). In case of OPE only member 00 is allowed; in case of ENS the member number runs from 0 to 50.

An example of a file name for each of the 4 models is:

  • GLO_OPE_20160715_00.dat OPE data issued July 15, 2016 (only member 00 allowed)
  • GLO_ENS_20160704_35.dat ENS data issued July 4, 2016, member 35


An input file basically contains the following structure:

  • A header providing geo referencing information
  • Blocks of data for the first forecast date (for each variable)
  • Blocks of data for the second forecast date (for each variable)
  • etc.

For simplification purposes, below a simple example is given with a detailed explanation.

The data files are loaded in the MCYFS database, tables WEATHER_<MODEL>_GRID_RAW where <MODEL> is to be replaced by the abbreviation of one of the two ECMWF products (OPE, ENS). During loading two actions are executed:

  • additional unit conversion
  • plausible range checks

The SEAS and the ERA5 data is being processed with separate processing lines, respectively. The resulting daily data is delivered as NetCDF.

Extraction of data into maps

The static maps are exported as flat images and animated images with full layout and directly made available to analysts that use them during analysis of weather indicators. The geographic extent of the static maps for Europe is defined by the upper-left corner at 75° North/25° West and the lower-right corner 20° North/70° East, the maps for the RUK domain cover a domain 65° North/25° West to 40° North/105° East. This production line includes GrADS mapping software which is able to create maps directly from GRIB files.

Static map of maximum temperature on 7-feb-2011 with a spring breeze in Central and Western Europe.
Animated Rainfall, emitted 20-dec-2010 with the forecasted precipitation of low "Petra". Petra's snow masses retarded travel in many regions of Europe before Christmas 2010. Large animation
Static map with the forecasted number of days with significant rain (>5mm) within the next 10 days. Forecast issued 20 July 2016.
Static map with the forecasted probability for a cold anomaly > 2K in June 2016, forecasted by the SEAS run initialized 01 June 2016.