# Difference between revisions of "Improvement of MCYFS forecasts"

Line 68: | Line 68: | ||

|Overall || 26.59 || 36.36 || 8.50 || | |Overall || 26.59 || 36.36 || 8.50 || | ||

|} | |} | ||

− | Note: Bold values indicate significant cases at the 0.05 level. | + | '''Note: Bold values indicate significant cases at the 0.05 level.''' |

The RMSPE in 1998-2002 for Durum wheat is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in May, June and August is considered statistically significant. Moreover, the p-values of April, July and October are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Durum wheat yield after 1998. The contents of the table are displayed in the following graph: | The RMSPE in 1998-2002 for Durum wheat is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in May, June and August is considered statistically significant. Moreover, the p-values of April, July and October are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Durum wheat yield after 1998. The contents of the table are displayed in the following graph: | ||

Line 135: | Line 135: | ||

|Overall || 4.46 || 5.74 || 1.91 || | |Overall || 4.46 || 5.74 || 1.91 || | ||

|} | |} | ||

− | Note: Bold values indicate significant cases at the 0.05 level. | + | '''Note: Bold values indicate significant cases at the 0.05 level.''' |

The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in June, August and October is considered statistically significant. Moreover, the p-values of April, May and July are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Grain maize yield after 1998.The contents of the table are presented in the following diagram: | The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in June, August and October is considered statistically significant. Moreover, the p-values of April, May and July are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Grain maize yield after 1998.The contents of the table are presented in the following diagram: | ||

[[File:linechart_monthly_rmspe_grain_maize.jpg|Linechart of monthly RMSPEs for Grain maize]] | [[File:linechart_monthly_rmspe_grain_maize.jpg|Linechart of monthly RMSPEs for Grain maize]] | ||

+ | |||

+ | RMSPEs after 1998 are definitely smaller than those before 1998. The improvement is slightly smaller in the second half of the year than in the first. | ||

|} | |} | ||

{|class="collapsing_table collapsible collapsed" | {|class="collapsing_table collapsible collapsed" | ||

Line 170: | Line 172: | ||

|} | |} | ||

− | The RMSPE in 1998-2002 is greater than the respective RMSPE of 1993-1997 from April until July, and smaller thereafter. No statistically significant improvement in 1998-2002 is detected | + | The RMSPE in 1998-2002 is greater than the respective RMSPE of 1993-1997 from April until July, and smaller thereafter. No statistically significant improvement in 1998-2002 is detected. |

[[File:linechart_monthly_rmspe_rape_seed.jpg|Linechart of monthly RMSPEs for Rape seed]] | [[File:linechart_monthly_rmspe_rape_seed.jpg|Linechart of monthly RMSPEs for Rape seed]] | ||

+ | |||

+ | The figure shows that RMSPEs after 1998 are greater than those before 1998 for all months up to July. The only month where RMSPEs denote improvement after 1998 is September. | ||

|} | |} | ||

{|class="collapsing_table collapsible collapsed" | {|class="collapsing_table collapsible collapsed" | ||

Line 202: | Line 206: | ||

|Overall || 5.26 || 6.80 || 2.32 || | |Overall || 5.26 || 6.80 || 2.32 || | ||

|} | |} | ||

− | Note: Bold values indicate significant cases at the 0.05 level. | + | '''Note: Bold values indicate significant cases at the 0.05 level.''' |

The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in August and October is considered statistically significant. Moreover, the p-values of May, June, July and September are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Potato yield after 1998. | The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in August and October is considered statistically significant. Moreover, the p-values of May, June, July and September are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Potato yield after 1998. |

## Latest revision as of 10:35, 19 June 2012

The purpose of this section is to examine whether the performance of MCYFS in the period 1998-2002 improved compared to its performance in the period 1993-1997. Performance is assessed in terms of average error size and more specifically in terms of RMSPE.

Separately for each crop monthly RMSPE have been computed averaging the MCYFS errors, for the given month, during the two periods in question. Errors refer to EU-total forecasts. EU-total denotes EU12 until 1995 and EU15 from 1996 onwards.

Moreover, a Wilcoxon test on each month's absolute percentage errors is applied to test the null hypothesis (H 0) that absolute percentage errors have not improved (i.e. have not decreased) during the period 1998-2002 as opposed to the period 1993-1997. Therefore small p-values (less than 0.05 in this document) reject the null hypothesis and show improvement (reduction) of errors and hence better performance of MCYFS.

Soft wheat | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Soft wheat and the p-values of the respective Wilcoxon tests are reported in the following table:
The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months; the differences however are not statistically significant. The lack of significance is partly due to the sparseness of the data from which these figures are derived. However, there are strong indications that MCYFS has improved in the forecasting of Soft wheat yield after 1998. The contents of the table are presented graphically in the following diagram: |

Durum wheat | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Durum wheat and the p-values of the respective Wilcoxon tests are the following:
The RMSPE in 1998-2002 for Durum wheat is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in May, June and August is considered statistically significant. Moreover, the p-values of April, July and October are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Durum wheat yield after 1998. The contents of the table are displayed in the following graph: |

Barley | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Barley and the p-values of the Wilcoxon tests are reported in the following table:
The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months; the improvements however are not considered statistically significant. Data sparseness may be partly responsible for this outcome. There are however indications that MCYFS has improved in the forecasting of Barley yield after 1998. The contents of the table are presented in the following graph: |

Grain maize | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Grain maize and the p-values of the Wilcoxon tests are the following:
The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in June, August and October is considered statistically significant. Moreover, the p-values of April, May and July are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Grain maize yield after 1998.The contents of the table are presented in the following diagram: RMSPEs after 1998 are definitely smaller than those before 1998. The improvement is slightly smaller in the second half of the year than in the first. |

Rape seed | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Rape seed and the p-values of the Wilcoxon tests are the following:
The RMSPE in 1998-2002 is greater than the respective RMSPE of 1993-1997 from April until July, and smaller thereafter. No statistically significant improvement in 1998-2002 is detected. The figure shows that RMSPEs after 1998 are greater than those before 1998 for all months up to July. The only month where RMSPEs denote improvement after 1998 is September. |

Potato | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Potato and the p-values of the Wilcoxon tests are the following:
The RMSPE in 1998-2002 is smaller than the respective RMSPE of 1993-1997 in all months. The improvement in August and October is considered statistically significant. Moreover, the p-values of May, June, July and September are small. Therefore, there are very strong indications that MCYFS has improved in the forecasting of Potato yield after 1998. |

Sugar beet | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Sugar beet and the p-values of the Wilcoxon tests are the following:
The RMSPE in 1998-2002 is greater than the respective RMSPE of 1993-1997 in all months except June and September. No statistically significant improvement in 1998-2002 is detected. The graphical representation of the table is shown below: RMSPEs after 1998 are greater than those before 1998 for all months, except June and September. Especially in August, after 1998 RMSPEs are much worse than before 1998. |

Sunflower | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|

The monthly RMSPEs of MCYFS in the forecasting of Sunflower and the p-values of the Wilcoxon tests are the following:
The RMSPE in 1998-2002 is greater than the respective RMSPE of 1993-1997 from June until August. No statistically significant improvement in 1998-2002 is detected. The p-value of May however is quite small. |