Talk:CMETEO

From Agri4castWiki
Revision as of 14:13, 30 June 2011 by Raymond (talk | contribs)
Jump to: navigation, search


Introduction

Cmeteo stands for CORINE-meteo. Cmeteo can be seen an application suite to aggregate weather indicators from grid resolution to a regional type of division. These indicators will be aggregated to spatial themas like NUTS or agri environmental regions, or translated/adjusted for landcovers of interest like crops, etc. Translation will be accompanied by aggregation. The cmeteo package is designed to operate in several environments which may differ in both input as output datasets. All these environments need to have the basic data (both input and output) available for the CMeteo process.

Software tools needed by cmeteo

Cmeteo uses functionality which is implemented in several other software tools. The major ones are listed in the following table.

tool remarks
REGLISTS supplies specific lists of regions directed by input parameters.
MRS_PROCESS contains common used functionality for processing more complex programs like cmeteo.
ADD_PROCESS_LOG procedure to send some info to a logtable.
ADD_PROCESS_METRICS procedure to send some data, retrieved during processing, to a logtable.
MRS_STATS generic tool to collect some metrics during processing.
MRS_HTTP generic tool to handle some messages.
DATE_GENERATOR generic tool to generate specific lists of dates according to the input paramaters.

Interface

Cmeteo uses many database objects. The objects that contain the primary datasets like weather data, landcover types and aggregation areas are listed in the table below:

object name Content Environment
#CMETEO_GRID_WEATHER Weather indicators per grid CGMS / CGFS / ASIA / GWSI
#CMETEO_EPS_GRID_WEATHER Weather indicators per grid (ECMWF EPS model) CGFS
#CMETEO_HIS_GRID_WEATHER Weather indicators per grid (ECMWF HIS model) CGFS
#CMETEO_OPE_GRID_WEATHER Weather indicators per grid (ECMWF OPE model) CGFS
CMETEO_NUTS_WEATHER Weather indicators per NUTS region CGMS
CMETEO_EPS_NUTS_WEATHER Weather indicators per NUTS region (ECMWF EPS model) CGFS
CMETEO_HIS_NUTS_WEATHER Weather indicators per NUTS region (ECMWF HIS model) CGFS
CMETEO_OPE_NUTS_WEATHER Weather indicators per NUTS region (ECMWF OPE model) CGFS
CMETEO_ZONAL_WEATHER Weather indicators per Agri-environmental region CGMS
CMETEO_EPS_ZONAL_WEATHER Weather indicators per Agri-environmental region (ECMWF EPS model) CGFS
CMETEO_HIS_ZONAL_WEATHER Weather indicators per Agri-environmental region (ECMWF HIS model) CGFS
CMETEO_OPE_ZONAL_WEATHER Weather indicators per Agri-environmental region (ECMWF OPE model) CGFS
CMETEO_REGION_WEATHER Weather indicators per administrative region CGMS / CGFS / ASIA / GWSI
CMETEO_AGGREGATION_AREAS Cultivated areas per crop for Administrative region per year CGMS / CGFS / ASIA / GWSI
CMETEO_GRID_LANDCOVER_AREAS Areas for intersections of grid and administrative region CGMS / CGFS / ASIA / GWSI
CMETEO_LANDCOVERS Landcovers types or crops to be evaluated CGMS / CGFS / ASIA / GWSI
CMETEO_GRID_NUTS_LCV_AREAS Areas for intersections of grid and NUTS region CGMS
CMETEO_GRID_ZONAL_LCV_AREAS Areas for intersections of grid and Agri-environmental region CGMS
CMETEO_REJECTED_WEATHER Weather indicators per region that could not be stored via CMETEO_REGION_WEATHER CGMS / CGFS / ASIA / GWSI
CMETEO_REGION_MAPPINGS Administrative regions and their mappings (relations) CGMS / CGFS / ASIA / GWSI

Supporting objects that are required by Cmeteo:

object name Content Environment
CMETEO_PROCESS CGMS / CGFS / ASIA / GWSI
CMETEO CGMS / CGFS / ASIA / GWSI
CMETEO_HIS_NUTS_WEATHER_IO CGFS
CMETEO_HIS_ZONAL_WEATHER_IO CGFS
CMET_REGION_WTH ASIA / GWSI
CMET_NUTS_WTH CGMS
CMET_ZONAL_WTH CGMS
PRCMN_PARAMETERS CGMS / CGFS / ASIA / GWSI
PRCMN_PROCEDURES CGMS / CGFS / ASIA / GWSI
PRCMN_PROCESS_OBJECTS CGMS / CGFS / ASIA / GWSI
PRCMN_PROCESS_RUNS CGMS / CGFS / ASIA / GWSI
PRCMN_PROCESSES CGMS / CGFS / ASIA / GWSI
PROCMAN CGMS / CGFS / ASIA / GWSI

CMETEO_GRID_WEATHER

CMETEO_GRID_WEATHER is the object that contains the weather indicators in grid resolution that are needed as input for Cmeteo in a unified structure and with a uniform object name. In each environment (cgms / cgfs / asia / gwsi) the weather indicators in grid resolution are stored in tables with different names and structures. Also the collection of the attributes may vary. Cmeteo requires that the weather indicators in grid resolution are stored in an object with a specific structure and specific object name. Therefore some logic must be applied to transform the sets from various environments into a unified structure. This transformation is implemented by using views and/or synonyms on the original datasets while renaming the attributes and eventually suppliyng neutral or valuable data for missing attributes. The unified object CMETEO_GRID_WEATHER is composed of the most wide combination of attributes of the various underlying datasets.

CMETEO_EPS_GRID_WEATHER

CMETEO_EPS_GRID_WEATHER is a view to convert the structure of the primary data source into a unified structure

CMETEO_HIS_GRID_WEATHER

CMETEO_HIS_GRID_WEATHER

CMETEO_OPE_GRID_WEATHER

CMETEO_OPE_GRID_WEATHER

Below a summary of some sets in various schemas and the definition of cmeteo_grid_weather

Object name domain
Environment CGMS CGFS ASIA GWSI
dataset: grid_weather ecmwf_his_downscaled_data ecmwf_eps_downscaled_data ecmwf_downscaled_data cmeteo_grid_weather
attributes: grid_no grid_no grid_no ecmwf_grid_no grid_no NN number(10)
day mdate mdate mdate day NN date
- 1) - 1) date_offset - 1) day_offset NN number(10)
- 2) - 2) member_no - 2) member_no NN number(10)
maximum_temperature temperature_max temperature_max temperature_max max_temperature NN number(3,1)
minimum_temperature temperature_min temperature_min temperature_min min_temperature NN number(3,1)
- 3) temperature_mean temperature_mean temperature_mean mean_temperature NN number(3,1)
- 4) temperature_dew temperature_dew temperature_dew dew_temperature NN number(3,1)
vapour_pressure vapour_pressure vapour_pressure vapour_pressure vapour_pressure NN number(4,2)
windspeed wind_speed wind_speed wind_speed wind_speed NN number(5,1)
rainfall precipitation precipitation precipitation precipitation NN number(4,1)
e0 e0 e0 e0 e0 NN number(4,2)
es0 es0 es0 es0 es0 NN number(4,2)
et0 et0 et0 et0 et0 NN number(4,2)
calculated_radiation radiation_global radiation_global radiation_global global_radiation NN number(6)
snow_depth snow_depth snow_depth snow_depth snow_depth number(6,2)

1) If an attribute for the offset of the day isn't available, the day-offset in cmeteo grid weather will be filled with a neutral value (0). This value doesn't influence the processing.
2) For sets that doesn't contain an attribute for members, a member_no: 1 will be supplied in cmeteo grid weather.
3) If an attribute for the mean or daily temperature doesn't exist, this value will be estimated as the mean value of minimum and maximum temperature of the day. Cmeteo will process this value and produces a result for it.
4) A dummy value (0) for the dew temperature wil be supplied to cmeteo grid weather for sets lacking such an attribute. Cmeteo will process this value and produces a result for it, so precautions must be taken to supply these results to the output table.
|}




Examples