Difference between revisions of "Calibration"

From Agri4castWiki
Jump to: navigation, search
(Data sets)
(Calibrated crops)
 
(35 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
{{scientific}}
 
{{scientific}}
==General description==
+
===Calibration tools===
The (re)calibration of crops for WOFOST and LINGRA are performed using different calibration tools and agropheno datasets.
+
Different tools are available to calibrate crop parameters. Some tools are more suitable for local calibration, other tools are more suitable for regional calibrations. Sometimes crop parameters can be calculated or estimated using other tools.
  
===Tools===
 
 
# [[Software_Tools#WOFOST_Control_Centre|WOFOST Control Centre]]: user interface to run wofost crop model and interactive selection of crop-, soil-, weather-files. Changes interactively model parameters. Analyse results in table and graphical format. Used for manually local calibrations.  
 
# [[Software_Tools#WOFOST_Control_Centre|WOFOST Control Centre]]: user interface to run wofost crop model and interactive selection of crop-, soil-, weather-files. Changes interactively model parameters. Analyse results in table and graphical format. Used for manually local calibrations.  
 
# [[Software_Tools#Calplat|Calplat]]. Optimization platform to create zonations and execute automatic calibrations.   
 
# [[Software_Tools#Calplat|Calplat]]. Optimization platform to create zonations and execute automatic calibrations.   
# [[Software_Tools#Calibration_Manager|Calibration Manager]]. Python script that combines Python wofost with open optimizer NLopt to automatically calibrate multiple zones and multiple parameters.  
+
# [[Software_Tools#Calibration_Manager|Calibration Manager]]. Python script that combines Python wofost with open optimizer NLopt to automatically calibrate multiple zones and multiple parameters.
 +
# Various tools (e.g. xls, scripts, gis,...)
  
===Data sets===
+
===AgroPheno database===
* AETS: Data for Ukraine and Turkey. Added in 2016.
+
The agropheno data are stored in a relational database that contains observations from experimental sites, expert knowledge and regional calendars with their metadata. The metadata can be used to select sources or types of data to be included in the calibration. XY locations of experimental sites and regional calendars are mapped to grid numbers of the regular target agro climatic grids that are defined for each [[Regional_Windows|regional window]]. The database contains the following data sets:
* Bilateral Austria. Added in  2016.
 
* Bilateral Germany. Added in  2016.
 
* Bilateral Slovakia. Added in  2016.
 
* Bilateral Slovenia. Added in  2016.
 
* Bilateral Ukraine. Added in  2017.
 
* Bilateral Russia/Kazakhstan. Added in ?
 
* Boons-Prins study. Added in  2005.
 
* Crop-KUL: crop parameters, including Kc coefficients, created with the KUL University. Added in 2006.
 
* Geosys/ASEMARS. Added  in 2006 and 2007.
 
* MARS Activity-B-2001. Added in 2016.
 
* MOCA: crop data from (at that time) candidate member states. Added in 2005.
 
* MOCCASIN project. Added in 2017.
 
* PASK (Pasture Knowledge base) DB which collects the most recent pasture data on new Member States. This DB was released in 2003.
 
* Zentralanstalt fur meteorologie und geodynamik. Added in 2008.
 
* MARSOP4 - general target values for LAI and HI. Added in 2017.
 
  
XY locations of are mapped to grid numbers of the regular target agro climatic that each [[Regional_Windows|regional window]] has.
+
<pre>
 +
1  PASK: pasture data from candidate member States
 +
2  Boons-Prins study, inserted in 2005
 +
3  MOCA: crop data from candidate member states, inserted in 2005
 +
4  Crop-KUL: crop parameters, inserted in 2006
 +
5  GEOSYS/ASEMARS, inserted in 2006 and 2007
 +
6  ZAMG (Zentralanstalt fur meteorologie und geodynamik), inserted in 2008
 +
7  AETS: Data for Ukraine and Turkey, inserted in 2016
 +
9  MARS Activity-B-2001, inserted in 2016
 +
10 Bilateral Austria, inserted in 2016
 +
11 Bilateral Germany, inserted in 2016
 +
12 Bilateral Slovakia, inserted in 2016
 +
13 Bilateral Slovenia, inserted in 2016
 +
14 Bilateral Russia/Kazakhstan, inserted in 2016
 +
15 MOCCASIN project, inserted in 2017
 +
16 MARSOP4 - general targets for LAI and HI, inserted in 2017
 +
17 GLOBAM, inserted in 2009
 +
18 Huabei CGMS, inserted in 2009
 +
19 RUBKA, inserted in 2009
 +
20 Asia CGMS (I. Savin), inserted in 2009
 +
21 FAO crop calendars
 +
</pre>
 +
 
 +
===Calibration levels===
 +
The following calibration levels are identified for regional and local calibrations. Most calibrations start with level 1, optionally followed by 2 or 3 and/or 4. They are executed in this order, gradually further optimizing results. Level 0 is not considered an agro phenological calibration. In this case parameters are calculated or estimated, using causal relationships other than with agropheno data.
 +
 
 +
{|class="wikitable"
 +
!Level                              !! Regional          !! Local
 +
|-
 +
|0: calculate/estimate              || e.g. TSUM1, TSUM2, VERNSAT, VERNBASE, DLO,... || e.g. TSUM1, TSUM2, VERNSAT, VERNBASE, DLO,...
 +
|-
 +
|1: Phenology                      || TSUM1, TSUM2      || TSUMEM, TBASEM, TSUM1, TSUM2, DLO, DLC, TEFFMX
 +
|-                                                                     
 +
|2: Potential yield level - simple  || AMAXTB            || AMAXTB, SLATB, SPAN
 +
|-                                                                     
 +
|3: Potential yield level - complex || SLATB, SPAN, FOTB || AMAXTB, SLATB, SPAN, RGRLAI, LAIEM, TDWI, FLTB, FRTB, FOTB, TMPFTB, RDRRTB
 +
|-                                                                     
 +
|4: Water limited yield level      || CFET, RDMCR      || CFET, RDMCR, PERDL, DEPNR
 +
|}
 +
 
 +
Required agropheno data for the respected levels and resolutions:
 +
{|class="wikitable"
 +
!Level                              !! Regional !! Local
 +
|-
 +
|0: calculate/estimate              || depending on causal relation || depending on causal relation
 +
|-
 +
|1: Phenology                      || Regional calendars or observations of sowing, emergence, flowering, maturity and harvest  || observations of sowing, emergence, flowering, maturity and harvest for different years
 +
|-                                                                     
 +
|2: Potential yield level - simple  || Observations of total biomass under optimal conditions for locations or regions || observations of LAI-max and total biomass under optimal conditions
 +
|-                                                                     
 +
|3: Potential yield level - complex || Observations of LAI-max, total biomass, storage organs and/or harvest index under optimal conditions for locations or regions || observations of LAI, total biomass, weights of leaves, stems, storage organs and roots over time during the growth period under optimal conditions
 +
|-                                                                     
 +
|4: Water limited yield level      || Observations of total biomass, storage organs and/or harvest index under rainfed conditions for locations or regions || observations of LAI, total biomass, weights of leaves, stems and storage organs and possibly crop transpiration, evaporation and rooting depth over time during the growth period under water-limited conditions
 +
|}
 +
 
 +
===Calibration steps===
 +
The calibration consist in the following subtasks:
 +
* Consistency check of the datasets (area of interest, agropheno data).
 +
* Select calibration tool
 +
* Select or create zonation and crop mask
 +
* Select default crop from which to start calibration.
 +
* Calibrate phenology (level 1)
 +
* Analyse calibration results: WRMSE's, TSUM1, TSUM2, TSUM1+TSUM2, TSUM1/TSUM2, outliers
 +
* Optionaly correct input data (e.g. zonation, crop mask, agropheno data , weather data,...) and restart calibration if needed
 +
* Implement calibrated TSUMS and simulate full archive over full geographic extent
 +
* Calculate metrics (long term average crop simulation characteristics) over full archive and full geographic extent
 +
* Calculate yield forecast
 +
* Compare metrics and forecast with operational crop
 +
* Validation with sub data sets.
 +
 
 +
Optionally continue calibration:
 +
* start calibration at the next level (e.g. 2 or 3 and/or 4)
 +
* Implement calibrated parameters and simulate full archive over full geographic extent
 +
* Calculate metrics
 +
* Calculate yield forecast
 +
* Compare metrics and forecast with operational crop
 +
* Validation with sub data sets.
 +
 
 +
===Calibrated crops===
  
 
{|class="wikitable"
 
{|class="wikitable"
!Crop name !! Crop number !! Data sets used !! Calibration tool !! Status !! MODEL
+
! WINDOW !! MODEL      !! Status          !! Crop name                 !! Crop_no !! Data sets !! Calibration tool !! Level   
 +
|-
 +
| rowspan="27" | Europe (EUR) || rowspan="23" | WOFOST || rowspan="9" | Operational || Winter Wheat || 1 || 2-4 || ? || 1       
 +
|-
 +
| Grain maize                || 2      || 2-6        || Calplat          || 1       
 +
|-
 +
| Spring Barley              || 3      || 2-6        || Calplat          || 1, 3   
 +
|-
 +
| Rye                        || 4      || 2-5        || Calplat          || 1       
 +
|-
 +
| Sugar beet                || 6      || 2-4        || ?                || 1 + SPAN
 +
|-
 +
| Potato                    || 7      || 2-4        || ?                || 1 + SPAN
 +
|-
 +
| Field beans                || 8      || 3          || ?                || -       
 
|-
 
|-
|Winter Wheat || 1 || Boons-Prins, Crop-KUL, MOCA || Calplat || Operational || WOFOST
+
| Winter Rapeseed            || 10      || 2-6        || Calplat         || 1, 2, 3 
 
|-
 
|-
|Grain maize || 2 || Boons-Prins, Crop-KUL, MOCA || Calplat || Operational || WOFOST
+
| Sunflower                  || 11      || 2-4        || ?                || 1 + SPAN
 
|-
 
|-
|Spring Barley || 3 || Boons-Prins, Crop-KUL, MOCA || Calplat || Operational || WOFOST
+
| rowspan="8" | Under revision || Winter Wheat Vernalisation || 90 || 2-14, 16 || Calibration Man. || 0, 1, 3 
 
|-
 
|-
|Rye || 4 || MOCA || Calplat || Operational || WOFOST
+
| Winter Wheat              || 91      || 2-5        || Calplat         || 0 + SPAN
 
|-
 
|-
|Rice || 5 || ? || ? || Operational || WARM/BLAST
+
| Field beans                || 92      || 2-5        || Calplat          || 1       
 
|-
 
|-
|Sugar beet || 6 || Boons-Prins, Crop-KUL, MOCA || - || Operational || WOFOST
+
| Sunflower                  || 93      || 2-5        || Calplat          || 1       
 
|-
 
|-
|Potato || 7 || Boons-Prins, Crop-KUL, MOCA || - || Operational || WOFOST
+
| Winter Rapeseed            || 94      || 2-5        || Calplat          || 1       
 
|-
 
|-
|Field beans || 8 || Boons-Prins, Crop-KUL, MOCA || ? || Operational || WOFOST
+
| Spring Barley              || 95      || 2-6        || Calplat + WCC    || 1, 3   
 
|-
 
|-
|Winter Rapeseed || 10 || Boons-Prins, Crop-KUL, MOCA || Calplat || Operational || WOFOST
+
| Spring Barley Ukraine      || 96      || 2-7, 15-16 || Calibration Man. || 1, 3   
 
|-
 
|-
|Sunflower || 11 || Boons-Prins, Crop-KUL, MOCA || Calplat || Operational || WOFOST
+
| Grain maize Ukraine        || 97      || 2-7, 15-16 || Calibration Man. || 1, 3   
 
|-
 
|-
|Grain maize Russia/Kazakhstan || 89 || Bilateral Russia/Kazakhstan || Calibration Manager || Under revision || WOFOST
+
| rowspan="6" | Not operational || Field Peas || ? || 3 || ? ||         
 
|-
 
|-
|Winter Wheat Vernalisation || 90 || All except MOCA, MOCCASIN & PASK || Calibration Manager || Under revision || WOFOST
+
| Oat                        || ?      || 3          || ?                ||        
 
|-
 
|-
|Winter Wheat || 91 || ? || ? || Under revision || WOFOST
+
| Winter Barley              || 13      || 2-4        || ?               || -       
 
|-
 
|-
|Field beans || 92 || ? || ? || Under revision || WOFOST
+
| Spring Rape seed          || ?      || 2-4        || ?               ||        
 
|-
 
|-
|Sunflower || 93 || ? || ? || Under revision || WOFOST
+
| Soy Bean                  || ?      || 3          || ?               ||        
 
|-
 
|-
|Winter Rapeseed || 94 || ? || ? || Under revision || WOFOST
+
| Rice                      || ?      || ?         || ?               ||        
 
|-
 
|-
|Spring Barley || 95 || Boons-Prins, Crop-KUL, MOCA || WCC || Under revision || WOFOST
+
| rowspan="2" | LINGRA || rowspan="2" | Not operational || Rye Grass || ? || 1 || ? ||
 
|-
 
|-
|Spring Barley Ukraine || 96 || AETS, Bilateral Ukraine, Boons-Prins, Crop-KUL, MOCA || Calibration Manager || Under revision || WOFOST
+
| Alfalfa                    || ?      || 1          || ?                ||        
 
|-
 
|-
|Grain maize Ukraine || 97 || AETS, Bilateral Ukraine, Boons-Prins, Crop-KUL, MOCA || Calibration Manager || Under revision || WOFOST
+
| WARM || Operational    || Rice                      || 5      || ?          || ?                || ?       
 
|-
 
|-
 
+
| ?          || Not operational || Tomato                    || ?      || ?          || ?                ||         
 
+
|-
 
+
| rowspan="6" | Russia Kazakhstan (RUK) || rowspan="6" | WOFOST || rowspan="5" | Operational || Winter wheat 2008 || 1 || 19-20 || rowspan="5" | Calplat || 1, 3   
|Field Peas || ? || MOCA || ? || Not operational || WOFOST
+
|-
 +
| Winter wheat 2012 || 2      || 19-20      || 1, 3   
 +
|-
 +
| Spring wheat 2008 || 3      || 19-20      || 1       
 
|-
 
|-
|Oat || ? || MOCA || ? || Not operational || WOFOST
+
| Spring wheat 2012 || 4      || 19-20      || 1       
 
|-
 
|-
|Winter Barley || 13 || Boons-Prins, Crop-KUL, MOCA || ? || Not operational || WOFOST
+
| Grain maize 2008  || 5      || 21        || 1       
 
|-
 
|-
|Spring Rape seed || ? || Boons-Prins, Crop-KUL, MOCA || ? || Not operational || WOFOST
+
| Under revision  || Grain maize Rus/Kaz || 89 || 14 || Calibration Man. || 1, 3       
 
|-
 
|-
|Soy Bean || ? || Boons-Prins, Crop-KUL, MOCA || ? || Not operational || WOFOST
+
| rowspan="5" | China (CHN) || rowspan="2" | WOFOST || rowspan="5" | Not operational || Winter wheat || 1 || ? || rowspan="5" | Calplat || 1 ,3   
 
|-
 
|-
|Rice || ? || Boons-Prins, Crop-KUL || ? || Not operational || WOFOST
+
| Grain maize        || 2      || 21    || 1 ,3   
 
|-
 
|-
|Rye Grass || ? || LINGRA & PASK DB || ? || Not operational || LINGRA
+
| rowspan="3" | WARM || Rice early season || 3 || 21 || 1
 
|-
 
|-
|Alfalfa || ? || PASK DB || ? || Not operational || LINGRA
+
| Rice middle season || 4      || 21    || 1
 
|-
 
|-
|Tomato || ? || No data available || ? || Not operational || CGMS SYTEM
+
| Rice late season  || 5      || 21    || 1
 
|}
 
|}
  
The calibration consist in the following subtasks:
 
* Consistency check of the datasets (area of interest, make decisions how to calibrate the models and which part of the DBs to exploit).
 
* Coherent recalibration from EU15 to EU25 with the results of the consistency check of the existing crops.
 
* Calibration of new crops at EU25 level. This includes verifications of the consistency of the CGMS output by runnin simulations up to level 3 in order to verify the output obtained using the new crop parameters.
 
*Validation with sub data sets.
 
 
The calibration and the validation can be done according to one of the following strategy/approaches based on the data availability:
 
*Strong: Based on complete sets of crop parameters from experimental fields.
 
*Medium: Based exploiting as much as possible the crop parameters data available in the DBs.
 
*Light: Based on TSUM derived from CGMS level 1 and basic crop calendars. As the information of crop start-emergence/flowering/end-of-maturity at grid level are the basic information available in the system, the main tables which are analyzed are the {{Object|WEATHER_OBS_GRID}} and the {{Object|WEATHER_OBS_GRID_LTA}} to relate meteo data with calendar day to calculate crop TSUM.
 
 
[[Category:Crop Simulation]]
 
[[Category:Crop Simulation]]

Latest revision as of 12:07, 12 April 2018



Calibration tools

Different tools are available to calibrate crop parameters. Some tools are more suitable for local calibration, other tools are more suitable for regional calibrations. Sometimes crop parameters can be calculated or estimated using other tools.

  1. WOFOST Control Centre: user interface to run wofost crop model and interactive selection of crop-, soil-, weather-files. Changes interactively model parameters. Analyse results in table and graphical format. Used for manually local calibrations.
  2. Calplat. Optimization platform to create zonations and execute automatic calibrations.
  3. Calibration Manager. Python script that combines Python wofost with open optimizer NLopt to automatically calibrate multiple zones and multiple parameters.
  4. Various tools (e.g. xls, scripts, gis,...)

AgroPheno database

The agropheno data are stored in a relational database that contains observations from experimental sites, expert knowledge and regional calendars with their metadata. The metadata can be used to select sources or types of data to be included in the calibration. XY locations of experimental sites and regional calendars are mapped to grid numbers of the regular target agro climatic grids that are defined for each regional window. The database contains the following data sets:

1  PASK: pasture data from candidate member States
2  Boons-Prins study, inserted in 2005
3  MOCA: crop data from candidate member states, inserted in 2005
4  Crop-KUL: crop parameters, inserted in 2006
5  GEOSYS/ASEMARS, inserted in 2006 and 2007
6  ZAMG (Zentralanstalt fur meteorologie und geodynamik), inserted in 2008
7  AETS: Data for Ukraine and Turkey, inserted in 2016
9  MARS Activity-B-2001, inserted in 2016
10 Bilateral Austria, inserted in 2016
11 Bilateral Germany, inserted in 2016
12 Bilateral Slovakia, inserted in 2016
13 Bilateral Slovenia, inserted in 2016
14 Bilateral Russia/Kazakhstan, inserted in 2016 
15 MOCCASIN project, inserted in 2017
16 MARSOP4 - general targets for LAI and HI, inserted in 2017
17 GLOBAM, inserted in 2009
18 Huabei CGMS, inserted in 2009
19 RUBKA, inserted in 2009
20 Asia CGMS (I. Savin), inserted in 2009
21 FAO crop calendars

Calibration levels

The following calibration levels are identified for regional and local calibrations. Most calibrations start with level 1, optionally followed by 2 or 3 and/or 4. They are executed in this order, gradually further optimizing results. Level 0 is not considered an agro phenological calibration. In this case parameters are calculated or estimated, using causal relationships other than with agropheno data.

Level Regional Local
0: calculate/estimate e.g. TSUM1, TSUM2, VERNSAT, VERNBASE, DLO,... e.g. TSUM1, TSUM2, VERNSAT, VERNBASE, DLO,...
1: Phenology TSUM1, TSUM2 TSUMEM, TBASEM, TSUM1, TSUM2, DLO, DLC, TEFFMX
2: Potential yield level - simple AMAXTB AMAXTB, SLATB, SPAN
3: Potential yield level - complex SLATB, SPAN, FOTB AMAXTB, SLATB, SPAN, RGRLAI, LAIEM, TDWI, FLTB, FRTB, FOTB, TMPFTB, RDRRTB
4: Water limited yield level CFET, RDMCR CFET, RDMCR, PERDL, DEPNR

Required agropheno data for the respected levels and resolutions:

Level Regional Local
0: calculate/estimate depending on causal relation depending on causal relation
1: Phenology Regional calendars or observations of sowing, emergence, flowering, maturity and harvest observations of sowing, emergence, flowering, maturity and harvest for different years
2: Potential yield level - simple Observations of total biomass under optimal conditions for locations or regions observations of LAI-max and total biomass under optimal conditions
3: Potential yield level - complex Observations of LAI-max, total biomass, storage organs and/or harvest index under optimal conditions for locations or regions observations of LAI, total biomass, weights of leaves, stems, storage organs and roots over time during the growth period under optimal conditions
4: Water limited yield level Observations of total biomass, storage organs and/or harvest index under rainfed conditions for locations or regions observations of LAI, total biomass, weights of leaves, stems and storage organs and possibly crop transpiration, evaporation and rooting depth over time during the growth period under water-limited conditions

Calibration steps

The calibration consist in the following subtasks:

  • Consistency check of the datasets (area of interest, agropheno data).
  • Select calibration tool
  • Select or create zonation and crop mask
  • Select default crop from which to start calibration.
  • Calibrate phenology (level 1)
  • Analyse calibration results: WRMSE's, TSUM1, TSUM2, TSUM1+TSUM2, TSUM1/TSUM2, outliers
  • Optionaly correct input data (e.g. zonation, crop mask, agropheno data , weather data,...) and restart calibration if needed
  • Implement calibrated TSUMS and simulate full archive over full geographic extent
  • Calculate metrics (long term average crop simulation characteristics) over full archive and full geographic extent
  • Calculate yield forecast
  • Compare metrics and forecast with operational crop
  • Validation with sub data sets.

Optionally continue calibration:

  • start calibration at the next level (e.g. 2 or 3 and/or 4)
  • Implement calibrated parameters and simulate full archive over full geographic extent
  • Calculate metrics
  • Calculate yield forecast
  • Compare metrics and forecast with operational crop
  • Validation with sub data sets.

Calibrated crops

WINDOW MODEL Status Crop name Crop_no Data sets Calibration tool Level
Europe (EUR) WOFOST Operational Winter Wheat 1 2-4  ? 1
Grain maize 2 2-6 Calplat 1
Spring Barley 3 2-6 Calplat 1, 3
Rye 4 2-5 Calplat 1
Sugar beet 6 2-4  ? 1 + SPAN
Potato 7 2-4  ? 1 + SPAN
Field beans 8 3  ? -
Winter Rapeseed 10 2-6 Calplat 1, 2, 3
Sunflower 11 2-4  ? 1 + SPAN
Under revision Winter Wheat Vernalisation 90 2-14, 16 Calibration Man. 0, 1, 3
Winter Wheat 91 2-5 Calplat 0 + SPAN
Field beans 92 2-5 Calplat 1
Sunflower 93 2-5 Calplat 1
Winter Rapeseed 94 2-5 Calplat 1
Spring Barley 95 2-6 Calplat + WCC 1, 3
Spring Barley Ukraine 96 2-7, 15-16 Calibration Man. 1, 3
Grain maize Ukraine 97 2-7, 15-16 Calibration Man. 1, 3
Not operational Field Peas  ? 3  ?
Oat  ? 3  ?
Winter Barley 13 2-4  ? -
Spring Rape seed  ? 2-4  ?
Soy Bean  ? 3  ?
Rice  ?  ?  ?
LINGRA Not operational Rye Grass  ? 1  ?
Alfalfa  ? 1  ?
WARM Operational Rice 5  ?  ?  ?
 ? Not operational Tomato  ?  ?  ?
Russia Kazakhstan (RUK) WOFOST Operational Winter wheat 2008 1 19-20 Calplat 1, 3
Winter wheat 2012 2 19-20 1, 3
Spring wheat 2008 3 19-20 1
Spring wheat 2012 4 19-20 1
Grain maize 2008 5 21 1
Under revision Grain maize Rus/Kaz 89 14 Calibration Man. 1, 3
China (CHN) WOFOST Not operational Winter wheat 1  ? Calplat 1 ,3
Grain maize 2 21 1 ,3
WARM Rice early season 3 21 1
Rice middle season 4 21 1
Rice late season 5 21 1