Wiki source code of S2S sub-project on verification and products

Hide line numbers
  1: //**Highlight:**// The [[WWRP/WGNE Joint Working Group on Forecast Verification Research (JWGFVR)>>url:http://www.wmo.int/pages/prog/arep/wwrp/new/Forecast_Verification.html]] is pleased to announce the **[[7^^th^^ International Verification Methods Workshop (7IVMW)>>url:https://www.wmo.int/pages/prog/arep/wwrp/new/documents/FirstAnnouncementJWGFVR_v3.pdf]]**, which will be held in Berlin, Germany, 8-11 May 2017, preceded by a tutorial on forecast verification methods, 3-6 May 2017.
  2: 
  3: **The workshop will have a dedicated session on S2S verification.** The S2S community is cordially invited to submit abstracts on S2S verification methodologies to the workshop. Abstract submission is open at the workshop website **[[http:~~/~~/www.7thverificationworkshop.de/>>url:http://www.7thverificationworkshop.de/]]**
  4: 
  5: Please note the following deadlines: 
  6: - January 31 for tutorial application (open)
  7: - February 27 for abstract submission (open)
  8: - March 31 for registration (to be open soon)
  9: 
 10: ----
 11: 
 12: The S2S community is cordially invited to enter the [[**Challenge to Develop and Demonstrate the Best New User-Oriented Forecast Verification Metric**>>url:http://www.wmo.int/pages/prog/arep/wwrp/new/FcstVerChallenge.html]] launched by the [[WWRP/WGNE Joint Working Group on Forecast Verification Research (JWGFVR)>>url:http://www.wmo.int/pages/prog/arep/wwrp/new/Forecast_Verification.html]]  
 13: 
 14: 
 15: The aim of this challenge is to promote user-oriented verification, that is, quantitative assessment of forecast quality in terms that are meaningful to particular forecast users. The scope includes all applications of meteorological and hydrological forecasts. The user-oriented verification metrics contest will help support the WWRP/WCRP projects on High Impact Weather ([[HIWeather>>url:https://www.wmo.int/pages/prog/arep/wwrp/new/high_impact_weather_project.html]]), Subseasonal to Seasonal Prediction ([[S2S>>url:http://s2sprediction.net/]]), and Polar Prediction ([[PPP>>url:http://polarprediction.net/]]).
 16:  
 17: The deadline for entries is 31 October 2016. Click [[here>>url:http://www.wmo.int/pages/prog/arep/wwrp/new/FcstVerChallenge.html]] to find out more, or contact [[verifchallenge@ucar.edu>>path:mailto:verifchallenge@ucar.edu]].
 18: 
 19: ----
 20: 
 21: **This S2S verification and products wiki page has the following content:**
 22: 
 23: **1) Objectives**
 24: 
 25: **2) Membership**
 26: 
 27: **3) Linkages with coordinated WMO operational activities**
 28: 
 29: **~    3.1) Collaboration between S2S and WMO**
 30: 
 31: **~    3.2) The pilot real-time sub-seasonal MME prediction in WMO LC-LRFMME**
 32: 
 33: **4) List of published literature on verification methods of relevance to S2S verification**
 34: 
 35: **~    4.1) Books and technical reports**
 36: 
 37: **~    4.2) Scientific papers**
 38: 
 39: **5) List of published literature on S2S verification**
 40: 
 41: **~    5.1) Assessment of S2S systems forecast skill**
 42: 
 43: **~    5.2) Assessment of MJO/ISO forecast skill**
 44: 
 45: **~    5.3) Assessment of monsoon systems forecast skill and associated characteristics**
 46: 
 47: **~    5.4) Applications**
 48: 
 49: **~    5.5) Seamless verification**
 50: 
 51: **6) Available reference verification datasets for assessing S2S forecast quality**
 52: 
 53: **~    6.1) Atmospheric parameters (e.g. geopotential height, temperature, SLP, wind, etc)**
 54: 
 55: **~    6.2) Oceanic parameters**
 56: 
 57: **~    6.3) Surface parameters**
 58: 
 59: **~    6.4) Datasets accessible via the KNMI Climate Explorer**
 60: 
 61: **7) S2S project models**
 62: 
 63: **7.1) Accessing S2S models data**
 64: 
 65: **7.2) Visualizing S2S forecast products**
 66: 
 67: 
 68: ----
 69: 
 70: **1) Objectives**
 71: 
 72: * Recommend verification metrics and datasets for assessing forecast quality of S2S forecasts
 73: * Provide guidance for a potential centralized verification effort for comparing forecast quality of different S2S forecast systems, including the comparison of multi-model and individual ensemble systems and consider linkages with users and applications
 74: 
 75: The [[//S2S verification science plan//>>url:http://s2sprediction.net/resources/documents/sub-projects/Verification.pdf]] provides more detailed information about this sub-project.
 76: 
 77: **2) Membership**
 78: 
 79: Caio Coelho (CPTEC/INPE, Brazil)
 80: 
 81: Andrew Robertson (IRI, USA)
 82: 
 83: Richard Graham (UKMO, UK)
 84: 
 85: Yuhei Takaya (JMA, Japan)
 86: 
 87: Debra Hudson (BoM, Australia)
 88: 
 89: Joanne Robbins (UKMO, UK)
 90: 
 91: Angel Muñoz (GFDL, USA)
 92: 
 93: 
 94: **3) Linkages with coordinated WMO operational activities**
 95: 
 96: 
 97: **3.1) Collaboration between S2S and WMO**
 98: 
 99: The research performed in S2S has strong linkages with WMO operational activities, particularly with the CBS/CCl Expert Team on Operational Prediction from Sub-seasonal to Longer time-scale ([[ET-OPSLS>>url:http://www.wmo.int/pages/prog/wcp/ccl/opace/opace3/ET-OPSLS.php]]) and the WMO Lead Centre for Long Range Forecast Multi-Model Ensemble ([[LC-LRFMME>>url:https://www.wmolc.org/]]). The S2S project in collaboration with WMO is therefore bridging research and operation activities to drive science and technology forward for producing better weather/climate information for a number of application sectors.
100: 
101: As part of this collaboration between S2S and WMO the S2S sub-project on verification and products has been conducting the following activities:
102: 
103: - Preparation of questionnaire on subseasonal verification practices in operational centres (both in operations and research) to help identify gaps and guide novel developments. This questionnaire was sent to the 12 designated [[WMO Global Producing Centres of Long-Range Forecasts (GPCs)>>url:http://www.wmo.int/pages/prog/wcp/wcasp/gpc/gpc.php]], the results were discussed with the ET-OPSLS and are summarized in [[this document>>url:http://www.wmo.int/pages/prog/www/DPFS/Meetings/ET-OPSLS_Beijing2016/documents/Doc_6.3.4.doc]].
104: 
105: - Preparation of [[document on S2S application-oriented activities and operational needs>>url:http://www.wmo.int/pages/prog/www/DPFS/Meetings/ET-OPSLS_Beijing2016/documents/Doc-6-3-5_OPSLS_S2S_applications_input_Final.doc]] as input for the ET-OPSLS
106: 
107: 
108: 
109: 
110: **3.2) The pilot real-time sub-seasonal MME prediction in WMO LC-LRFMME**
111: 
112: 
113: The WMO Lead Centre for Long Range Forecast Multi-Model Ensemble ([[LC-LRFMME>>url:https://www.wmolc.org/]]) has recently developed a pilot system for real-time multi-model subseasonal forecasts using real-time forecasts (and hindcasts) from a subset of models contributing to the WWRP/WCRP S2S research project accessible via ECMWF data archive. **//Following [[this link>>url:http://s2sprediction.net/file/documents_reports/Report_on_subseasonal_MME_in_LC-LRFMME_MAY2016.pdf]] the S2S research community has the opportunity to see the initial developments conducted by the LC-LRFMME and [[provide feedback>>path:mailto:cks0716@korea.kr]] for future developments and improvements in this pilot under development system.//** Subseasonal models from four GPCs are currently used: ECMWF, Exeter, Tokyo and Washington. A range of forecast products has been developed including probabilities for tercile categories of weekly averages of 2m temperature and rainfall as well as the MJO and BSISO indices. Verification has also been generated using ROC curves and scores as well as anomaly pattern correlation for a few case studies.
114: 
115: 
116: 
117: **4) List of published literature on verification methods of relevance to S2S verification**
118: 
119: Below in sections 4.1 and 4.2 is a selected list of published literature (including books, technical reports and scientific papers) on verification methodologies of relevance for S2S forecast verification. A more comprehensive list and additional information on forecast verification is available at [[http:~~/~~/www.cawcr.gov.au/projects/verification/>>url:http://www.cawcr.gov.au/projects/verification/]] a website of the [[//WWRP/WGNE Joint Working Group on Forecast Verification Research.//>>url:http://www.wmo.int/pages/prog/arep/wwrp/new/Forecast_Verification.html]]
120: 
121: Please note that further down on this wiki page Section 5 provides a list of published literature on S2S verification including in section 5.1 papers on the assessment of S2S systems forecast skill, in section 5.2 papers on the assessment of MJO/ISO forecast skill, in section 5.3 papers on the assessment of monsoon systems forecast skill and associated characteristics, in section 5.4 papers on applications and in section 5.5 on seamless verification.
122: 
123: **4.1) Books and technical reports**
124: 
125: Jolliffe IT, Stephenson DB (2012) //Forecast Verification: A Practitioner's Guide in Atmospheric Science. 2nd Edition//.  Wiley and Sons Ltd, 274 pp.
126: 
127: Stanski HR, Wilson LJ, Burrows WR (1989) //Survey of common verification methods in meteorology//. World Weather Watch Tech. Rept. No.8, WMO/TD No.358, WMO, Geneva, 114 pp. Available [[here>>url:http://www.cawcr.gov.au/projects/verification/Stanski_et_al/Stanski_et_al.html]].
128: 
129: Wilks DS (2011) //Statistical Methods in the Atmospheric Sciences. 3rd Edition//.  Elsevier, 676 pp.
130: 
131: 
132: **4.2) Scientific papers**
133: 
134: Bradley AA, Hashino T, Schwartz SS (2003) Distributions-oriented verification of probability forecasts for small data samples. //Wea. Forecasting//, **18**, 903-917. [[http:~~/~~/dx.doi.org/10.1175/1520-0434(2003)018%3C0903:DVOPFF%3E2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0434(2003)018%3C0903:DVOPFF%3E2.0.CO;2]]
135: 
136: Bradley AA, Schwartz SS, Hashino T (2008) Sampling uncertainty and confidence intervals for the Brier score and Brier skill score. //Wea. Forecasting//, **23**, 992-1006. doi: [[http:~~/~~/dx.doi.org/10.1175/2007WAF2007049.1>>url:http://dx.doi.org/10.1175/2007WAF2007049.1]]
137: 
138: Brier GW (1950) Verification of forecasts expressed in terms of probability. //Mon. Wea. Rev.//, **78**, 1-3. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493%281950%29078%3C0001:VOFEIT%3E2.0.CO;2]]
139: 
140: Epstein ES (1969) A scoring system for probability forecasts of tanked categories. J. App. Met. Vol 8. No 6, 985-987. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0450(1969)008<0985:ASSFPF>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0450%281969%29008%3C0985:ASSFPF%3E2.0.CO;2]]
141: 
142: Ferro CAT (2007) Comparing probabilistic forecasting systems with the Brier score. //Weather and Forecasting// 22, 1076-1088. doi: [[http:~~/~~/dx.doi.org/10.1175/WAF1034.1>>url:http://dx.doi.org/10.1175/WAF1034.1]]
143: 
144: Ferro CAT, Richardson DS, Weigel AP (2008) On the effect of ensemble size on the discrete and continuous ranked probability scores. //Meteorol. Appl.//, **15**, 19-24. [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/met.45/epdf>>url:http://onlinelibrary.wiley.com/doi/10.1002/met.45/epdf]]
145: 
146: {{id name="Ferro_Stephenson_2011"/}}Ferro CAT, Stephenson DB (2011) Extremal Dependence Indices: improved verifiation measures for deterministic forecasts of rare binary events. //Wea. Forecasting//, **26**, 699-713. doi: [[http:~~/~~/dx.doi.org/10.1175/WAF-D-10-05030.1>>url:http://dx.doi.org/10.1175/WAF-D-10-05030.1]]
147: 
148: Ferro CAT, Fricker TE (2012) A bias-corrected decomposition of the Brier score. //Quarterly Journal of the Royal Meteorological Society//, 138, 1954-1960, doi:10.1002/qj.1924. [[pdf>>url:http://empslocal.ex.ac.uk/people/staff/ferro/Publications/ferro-fricker2012copyright.pdf]]
149: 
150: Ferro CAT (2014) Fair scores for ensemble forecasts. //Quarterly Journal of the Royal Meteorological Society//, 140, 1917-1923, [[http:~~/~~/dx.doi.org/10.1002/qj.2270>>url:http://dx.doi.org/10.1002/qj.2270]]
151: 
152: Gneiting T,  Raftery AE (2007) Strictly Proper Scoring Rules, Prediction, and Estimation. //Journal of the American Statistical Association//, **102**, Issue 477, // //359-378. doi**:** 10.1198/016214506000001437 [[http:~~/~~/www.eecs.harvard.edu/cs286r/courses/fall12/papers/Gneiting07.pdf>>url:http://www.eecs.harvard.edu/cs286r/courses/fall12/papers/Gneiting07.pdf]]
153: 
154: Hamill TM (2001) Interpretation of rank histograms for verifying ensemble forecasts. //Mon. Wea. Rev.//, **129**, 550-560. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(2001)129<0550:IORHFV>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493%282001%29129%3C0550:IORHFV%3E2.0.CO;2]]
155: 
156: Hersbach H (2000) Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather and Forecasting, 15, 559-570. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0434(2000)015<0559:DOTCRP>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0434%282000%29015%3C0559:DOTCRP%3E2.0.CO;2]]
157: 
158: Hsu W-R., Murphy AH (1986) The attributes diagram: A geometrical framework for assessing the quality of probability forecasts. //Int. J. Forecasting//, **2**, 285-293. [[http:~~/~~/dx.doi.org/10.1016/0169-2070(86)90048-8>>url:http://dx.doi.org/10.1016/0169-2070(86)90048-8]]
159: 
160: Jolliffe IT (2007) Uncertainty and inference for verification measures. //Wea. Forecasting//, **22**, 637-650. doi: [[http:~~/~~/dx.doi.org/10.1175/WAF989.1>>url:http://dx.doi.org/10.1175/WAF989.1]]
161: 
162: Jupp TE, Lowe R, Coelho CAS, Stephenson DB (2012): On the visualization, verification and recalibration of ternary probabilistic forecasts. Phil. Trans. R. Soc. A, 370, 1100-1120. doi:10.1098/rsta.2011.0350
163: 
164: Mason I (1982) A model for assessment of weather forecasts. //Aust. Met. Mag.//, **30**, 291-303. [[http:~~/~~/www.nssl.noaa.gov/users/brooks/public_html/feda/papers/mason82.pdf>>url:http://www.nssl.noaa.gov/users/brooks/public_html/feda/papers/mason82.pdf]]
165: 
166: Mason SJ, Weigel AP (2009) A generic forecast verification framework for administrative purposes. //Mon. Wea. Rev.//, **137**, 331-349. doi: [[http:~~/~~/dx.doi.org/10.1175/2008MWR2553.1>>url:http://dx.doi.org/10.1175/2008MWR2553.1]]
167: 
168: Mason SJ, Graham NE (2002) Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Quarterly Journal of the Royal Meteorological Society Volume 128, Issue 584, pages 2145–2166, July 2002 Part B. DOI: 10.1256/003590002320603584 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1256/003590002320603584/pdf>>url:http://onlinelibrary.wiley.com/doi/10.1256/003590002320603584/pdf]]
169: 
170: Mason SJ (2008) Understanding forecast verification statistics. //Meteorol. Appl.//, **15**., 31-34. DOI: 10.1002/met.51 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/met.51/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1002/met.51/abstract]]
171: 
172: Murphy AH (1970) The ranked probability score and the probability score: A comparison. UDC 551.509.314. Vol. 98, No. 12. 917-924 [[http:~~/~~/citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.395.1780&rep=rep1&type=pdf>>url:http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.395.1780&rep=rep1&type=pdf]]
173: 
174: Murphy AH (1973) A new vector partition of the probability score. //J. Appl. Meteor.//, **12**, 595-600. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0450%281973%29012%3C0595:ANVPOT%3E2.0.CO;2]]
175: 
176: Murphy AH (1988) Skill scores based on the mean square error and their relationships to the correlation coefficient. //Mon. Wea. Rev.//, **116**, 2417-2424. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(1988)116<2417:SSBOTM>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493%281988%29116%3C2417:SSBOTM%3E2.0.CO;2]]
177: 
178: {{id name="Murphy1993"/}}Murphy AH (1993) What is a good forecast? An essay on the nature of goodness in weather forecasting. //Wea. Forecasting//, **8**, 281-293. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0434(1993)008<0281:WIAGFA>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0434%281993%29008%3C0281:WIAGFA%3E2.0.CO;2]]
179: 
180: Murphy AH (1995) The coefficients of correlation and determination as measures of performance in forecast verification. //Wea. Forecasting//, **10**, 681-688. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0434(1995)010<0681:TCOCAD>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0434%281995%29010%3C0681:TCOCAD%3E2.0.CO;2]]
181: 
182: Murphy AH (1996) General decompositions of MSE-based skill scores: Measures of some basic aspects of forecast quality. //Mon. Wea. Rev.//, **124**, 2353-2369. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(1996)124<2353:GDOMBS>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493%281996%29124%3C2353:GDOMBS%3E2.0.CO;2]]
183: 
184: Murphy AH, Epstein ES (1989) Skill scores and correlation coefficients in model verification. //Mon. Wea. Rev.//, **117**, 572-581. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(1989)117<0572:SSACCI>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493%281989%29117%3C0572:SSACCI%3E2.0.CO;2]]
185: 
186: Richardson DS (2000) Skill and relative economic value of the ECMWF ensemble prediction system. //Quart. J. Royal Met. Soc.//, **126**, 649-667. DOI: 10.1002/qj.49712656313 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/qj.49712656313/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.49712656313/abstract]]
187: 
188: Roulston MS, Smith LA (2002) Evaluating probabilistic forecasts using information theory. //Mon. Wea. Rev.//, **130**, 1653-1660. DOI: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(2002)130<1653:EPFUIT>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493(2002)130%3c1653:EPFUIT%3e2.0.CO;2]]
189: 
190: Stephenson DB, Casati C, Ferro CAT, Wilson CA (2008) The extreme dependency score: a non-vanishing measure for forecasts of rare events. //Meteorol. Appl.//, **15**, 41-50. DOI: 10.1002/met.53 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/met.53/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1002/met.53/abstract]]
191: 
192: Stephenson DB, Coelho CAS, Jolliffe IT (2008) Two extra components in the Brier Score Decomposition, //Wea. Forecasting//, **23**, pp 752-757. doi: [[http:~~/~~/dx.doi.org/10.1175/2007WAF2006116.1>>url:http://dx.doi.org/10.1175/2007WAF2006116.1]]
193: 
194: Taylor KE (2001) Summarizing multiple aspects of model performance in a single diagram. //J. Geophys. Res.//, **106** (D7), 7183-7192. DOI: 10.1029/2000JD900719 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1029/2000JD900719/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1029/2000JD900719/abstract]]
195: 
196: Weigel AP, Liniger MA, Appenzeller C (2007) The discrete Brier and ranked probability skill scores. //Mon. Wea. Rev.//, **135**, 118–124. doi: [[http:~~/~~/dx.doi.org/10.1175/MWR3280.1>>url:http://dx.doi.org/10.1175/MWR3280.1]]
197: 
198: Weigel AP, Liniger MA, Appenzeller C (2007) Generalization of the Discrete Brier and Ranked Probability Skill Scores for Weighted Multimodel Ensemble Forecasts. //Mon. Wea. Rev.//, **135**, 2778-2785. doi: [[http:~~/~~/dx.doi.org/10.1175/MWR3428.1>>url:http://dx.doi.org/10.1175/MWR3428.1]]
199: 
200: Weigel AP, Mason SJ (2011) The generalized discrimination Score for ensemble forecasts. //Mon. Wea. Rev.,//, **139**, 3069-3074. doi: [[http:~~/~~/dx.doi.org/10.1175/MWR-D-10-05069.1>>url:http://dx.doi.org/10.1175/MWR-D-10-05069.1]]
201: 
202: Wilson LJ, Burrows WR, Lanzinger A (1999) A strategy for verification of weather element forecasts from an ensemble prediction system. //Mon. Wea. Rev.//, **127**, 956-970. doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0493(1999)127<0956:ASFVOW>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0493%281999%29127%3C0956:ASFVOW%3E2.0.CO;2]]
203: 
204: 
205: **5) List of published literature on S2S verification**
206: 
207: 
208: **5.1) Assessment of S2S systems forecast skill**
209: 
210: Hudson D, Alves O, Hendon HH, Marshall AG (2011) Bridging the gap between weather and seasonal forecasting: Intraseasonal forecasting for Australia. Quart. J. Roy. Meteor. Soc., 137,673–689, doi:10.1002/qj.769 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/qj.769/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.769/abstract]]
211: 
212: Hudson D, Marshall AG, Yin Y, Alves O, Hendon HH (2013) Improving intraseasonal prediction with a new ensemble generation strategy. Mon Wea Rev//,// 141, 4429-4449. doi: [[http:~~/~~/dx.doi.org/10.1175/MWR-D-13-00059.1>>url:http://dx.doi.org/10.1175/MWR-D-13-00059.1]]
213: 
214: Hudson D, Marshall AG, Alves O, Shi L, Young G (2015) Forecasting upcoming extreme heat on multi-week to seasonal timescales: POAMA experimental forecast products. Bureau Research Report, No. 1. Bureau of Meteorology, Australia ([[http:~~/~~/www.bom.gov.au/research/research-reports.shtml>>url:http://www.bom.gov.au/research/research-reports.shtml]]).
215: 
216: Hudson D, Marshall AG, Alves O, Young G, Jones D, Watkins A (2015) Forewarned is forearmed: Extended range forecast guidance of recent extreme heat events in Australia. //Weather and Forecasting//. doi: [[http:~~/~~/dx.doi.org/10.1175/WAF-D-15-0079.1>>url:http://dx.doi.org/10.1175/WAF-D-15-0079.1]]
217: 
218: Jung T, Miller MJ, Palmer TN (2010) Diagnosing the Origin of Extended-Range Forecast Errors. //Mon. Wea. Rev.//, **138**, 2434–2446. doi: [[http:~~/~~/dx.doi.org/10.1175/2010MWR3255.1>>url:http://dx.doi.org/10.1175/2010MWR3255.1]]
219: 
220: Koster RD, Mahanama SPP, Yamada TJ, Balsamo G, Berg AA, Boisserie M, Dirmeyer PA, Doblas-Reyes FJ, Drewitt G, Gordon CT, Guo Z, Jeong J.-H, Lawrence DM, Lee W.-S, Li Z, Luo L, Malyshev S, Merryfield WJ, Seneviratne SI, Stanelle T, van den Hurk BJJM, Vitart F, Wood EF (2010) Contribution of land surface initialization to subseasonal forecast skill: First results from a multi-model experiment. Geophysical Research Letters, Vol. 37, L02402, doi:10.1029/2009GL041677, 2010 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1029/2009GL041677/full>>url:http://onlinelibrary.wiley.com/doi/10.1029/2009GL041677/full]]
221: 
222: Kumar A, Chen M, Wang W (2011) An analysis of prediction skill of monthly mean climate variability. Clim. Dyn., 37, 1119-1131. [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-010-0901-4>>url:http://link.springer.com/article/10.1007%2Fs00382-010-0901-4]]
223: 
224: Li S, Robertson AW (2015) Evaluation of Submonthly Precipitation Forecast Skill from Global Ensemble Prediction Systems. //Monthly Weather Review// **143**:7, 2871-2889. doi:[[http:~~/~~/dx.doi.org/10.1175/MWR-D-14-00277.1>>url:http://dx.doi.org/10.1175/MWR-D-14-00277.1]]
225: 
226: Marshall AG, Hudson D, Wheeler MC, Hendon HH, Alves O. (2012) Simulation and prediction of the Southern Annular Mode and its influence on Australian intra-seasonal climate in POAMA. Climate Dynamics. 38:2483-2502, doi:10.1007/s00382-011-1140-z. [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-011-1140-z>>url:http://link.springer.com/article/10.1007%2Fs00382-011-1140-z]]
227: 
228: Marshall AG, Hudson D, Wheeler MC, Alves O, Hendon HH, Pook MJ, Risbey JS (2013) Intra-seasonal drivers of extreme heat over Australia in observations and POAMA-2. //Climate Dynamics//, doi: 10.1007/s00382-013-2016-1 [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-013-2016-1>>url:http://link.springer.com/article/10.1007%2Fs00382-013-2016-1]]
229: 
230: Marshall AG, Hudson D, Hendon HH, Pook MJ, Alves O, Wheeler MC (2014) Simulation and prediction of blocking in the Australian region and its influence on intra-seasonal rainfall in POAMA-2. Clim. Dyn., 42, 3271-3288, DOI: 10.1007/s00382-013-1974-7 [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-013-1974-7>>url:http://link.springer.com/article/10.1007%2Fs00382-013-1974-7]]
231: 
232: Mastrangelo D, Malguzzi P, Rendina C, Drofa O, Buzzi A (2012) First Outcomes from the CNR-ISAC monthly forecasting system Adv. Sci. Res., 8, 77–82, 2012 [[www.adv-sci-res.net/8/77/2012/>>url:http://www.adv-sci-res.net/8/77/2012/]] doi:10.5194/asr-8-77-2012
233: 
234: Vitart F (2014): Evolution of ECMWF sub-seasonal forecast skill scores. Quarterly Journal of the Royal Meteorological Society. Volume 140, Issue 683, pages 1889–1899, July 2014 Part B. DOI: 10.1002/qj.2256 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/qj.2256/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.2256/abstract]]
235: 
236: Vitart F (2013) Evolution of ECMWF sub-seasonal forecast skill scores over the past 10 years . ECMWF Technical report [[http:~~/~~/www.ecmwf.int/sites/default/files/elibrary/2013/12932-evolution-ecmwf-sub-seasonal-forecast-skill-scores-over-past-10-years.pdf>>url:http://www.ecmwf.int/sites/default/files/elibrary/2013/12932-evolution-ecmwf-sub-seasonal-forecast-skill-scores-over-past-10-years.pdf]]
237: 
238: Weigel A, Baggenstos D, Liniger MA, Vitart F, Appenzeller C. (2008) Probabilistic verification of monthly temperature forecasts.  //Mon. Weather Review// **136**: 5162–5182. doi: [[http:~~/~~/dx.doi.org/10.1175/2008MWR2551.1>>url:http://dx.doi.org/10.1175/2008MWR2551.1]]
239: 
240: White CJ, Hudson D, Alves O (2013) ENSO, the IOD and the intraseasonal prediction of heat extremes across Australia using POAMA-2. //Climate Dynamics//. doi:10.1007/s00382-013-2007-2 [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-013-2007-2>>url:http://link.springer.com/article/10.1007%2Fs00382-013-2007-2]]
241: 
242:  
243: 
244: **5.2) Assessment of MJO/ISO forecast skill**
245: 
246: Gottschalck J, Wheeler M, Weickmann K, Vitart F, Savage N, Lin H, Hendon H, Waliser D, Sperber K, Nakagawa M, Prestrelo C, Flatau M, Higgins W (2010) A Framework for Assessing Operational Madden–Julian Oscillation Forecasts: A CLIVAR MJO Working Group Project. //Bull. Amer. Meteor. Soc.//, **91**, 1247–1258. doi: [[http:~~/~~/dx.doi.org/10.1175/2010BAMS2816.1>>url:http://dx.doi.org/10.1175/2010BAMS2816.1]]
247: 
248: Jiang X, Waliser DE, Wheeler  MC, Jones C, Lee M.-I, Schubert SD (2008) Assessing the skill of an all-season statistical forecast model for the Madden-Julian oscillation. //Mon. Wea. Rev.//, 136, 1940-1956.
249:  doi: [[http:~~/~~/dx.doi.org/10.1175/2007MWR2305.1>>url:http://dx.doi.org/10.1175/2007MWR2305.1]]
250: 
251: Jones C, Waliser DE, Schemm JKE, Lau WKM (2000) Prediction skill of the Madden and Julian oscillation in dynamical extended-range forecasts. Clim. Dyn. 16: 273–289. [[http:~~/~~/link.springer.com/article/10.1007/s003820050327>>url:http://link.springer.com/article/10.1007/s003820050327]]
252: 
253: Kim H, Webster PJ, Toma VE, Kim D (2014) Predictability and prediction skill of the MJO in two operational forecasting systems, J. Climate, 27 (14), 5364‐5378. doi: [[http:~~/~~/dx.doi.org/10.1175/JCLI-D-13-00480.1>>url:http://dx.doi.org/10.1175/JCLI-D-13-00480.1]]
254: 
255: Lee S-S, Wang B, Waliser DE, Neena JM, Lee J-Y (2015) Predictability and prediction skill of the boreal summer intraseasonal oscillation in the Intraseasonal Variability Hindcast Experiment. //Climate Dynamics// **45**, 2123-2135. [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-014-2461-5>>url:http://link.springer.com/article/10.1007%2Fs00382-014-2461-5]]
256: 
257: Liess S, Waliser DE, Schubert S. 2005. Predictability studies of the intraseasonal oscillation with the ECHAM5 GCM. J. Atmos. Sci. 62: 3320–3336. doi:  [[http:~~/~~/dx.doi.org/10.1175/JAS3542.1>>url:http://dx.doi.org/10.1175/JAS3542.1]]
258: 
259: Lin H, Brunet G, Derome J (2008) Forecast Skill of the Madden–Julian Oscillation in Two Canadian Atmospheric Models. //Mon. Wea. Rev.//, **136**, 4130–4149. doi: [[http:~~/~~/dx.doi.org/10.1175/2008MWR2459.1>>url:http://dx.doi.org/10.1175/2008MWR2459.1]]
260: 
261: Lin H, Brunet G, Fontecilla JS (2010) Impact of the Madden-Julian Oscillation on the intraseasonal forecast skill of the North Atlantic Oscillation. Geophys. Res. Lett.,37,L19803, doi:10.1029/2010GL044315 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1029/2010GL046131/pdf>>url:http://onlinelibrary.wiley.com/doi/10.1029/2010GL046131/pdf]]
262: 
263: MacLachlan, C., Arribas, A., Peterson, K. A., Maidens, A., Fereday, D., Scaife, A. A., Gordon, M., Vellinga, M., Williams, A., Comer, R. E., Camp, J., Xavier, P. and Madec, G. (2015) Global Seasonal forecast system version 5 (GloSea5): a high-resolution seasonal forecast system. Q.J.R. Meteorol. Soc., 141: 1072–1084. doi: 10.1002/qj.2396 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/qj.2396/abstract>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.2396/abstract]]
264:  
265: Maharaj EA//,// Wheeler MC (2005) Forecasting an index of the Madden-Oscillation. //Int. J. Climatol. //**25**: 1611–1618 (2005) DOI: 10.1002/joc.1206 [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/joc.1206/full>>url:http://onlinelibrary.wiley.com/doi/10.1002/joc.1206/full]]
266: 
267: Marshall AG, Hudson D, Wheeler MC, Hendon HH, Alves O (2010) Assessing the simulation and prediction of rainfall associated with the MJO in the POAMA seasonal forecast system. Climate Dynamics, 37, 2129-2141, doi: 10.1007/s00382-010-0948-2 [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-010-0948-2>>url:http://link.springer.com/article/10.1007%2Fs00382-010-0948-2]]
268: 
269: Marshall AG, Hudson D, Wheeler MC, Alves O, Hendon HH, Pook MJ, Risbey JS (2014) Intra-seasonal drivers of extreme heat over Australia in observations and POAMA-2. Climate Dynamics, 43, 1915-1937, DOI: 10.1007/s00382-013-2016-1 [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-013-2016-1>>url:http://link.springer.com/article/10.1007%2Fs00382-013-2016-1]]
270: 
271: Neena JM, Lee JY, Waliser D, Wang B, Jiang X (2014): Predictability of the Madden–Julian Oscillation in the Intraseasonal Variability Hindcast Experiment (ISVHE). //J. Climate//, **27**, 4531–4543. doi: [[http:~~/~~/dx.doi.org/10.1175/JCLI-D-13-00624.1>>url:http://dx.doi.org/10.1175/JCLI-D-13-00624.1]]
272: 
273: Rashid HA, Hendon HH, Wheeler MC, Alves O (2011) Prediction of the Madden–Julian oscillation with the POAMA dynamical prediction system. Climate Dynamics. Volume 36, Issue 3-4, pp 649-661 [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-010-0754-x>>url:http://link.springer.com/article/10.1007%2Fs00382-010-0754-x]]
274: 
275: Vitart F, Molteni F (2010) Simulation of the Madden- Julian Oscillation and its teleconnections in the ECMWF forecast system. //Quarterly Journal of the Royal Meteorological Society// **136**:10.1002/qj.v136:649, 842-855. [[http:~~/~~/onlinelibrary.wiley.com/doi/10.1002/qj.623/pdf>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.623/pdf]]\\
276: 
277: 
278: **5.3) Assessment of monsoon systems forecast skill and associated characteristics**
279: 
280: Drosdowsky W, Wheeler MC (2014): Predicting the onset of the north Australian wet season with the POAMA dynamical prediction system. //Wea. Forecasting//, 29, 150-161. doi: [[http:~~/~~/dx.doi.org/10.1175/WAF-D-13-00091.1>>url:http://dx.doi.org/10.1175/WAF-D-13-00091.1]]
281: 
282: Jones C, Carvalho LMV, Liebmann B (2012) Forecast Skill of the South American Monsoon System. //J. Climate//, **25**, 1883–1889. doi: [[http:~~/~~/dx.doi.org/10.1175/JCLI-D-11-00586.1>>url:http://dx.doi.org/10.1175/JCLI-D-11-00586.1]]
283: 
284: Jones C, Carvalho LMV (2002) Active and Break Phases in the South American Monsoon System. J. Climate,15, 905–914 doi: [[http:~~/~~/dx.doi.org/10.1175/1520-0442(2002)015<0905:AABPIT>2.0.CO;2>>url:http://dx.doi.org/10.1175/1520-0442%282002%29015%3C0905:AABPIT%3E2.0.CO;2]]
285: 
286: Lo F, Wheeler MC, Meinke H, Donald A (2007) Probabilistic Forecasts of the Onset of the North Australian Wet Season. //Mon. Wea. Rev.//, **135**, 3506–3520. doi: [[http:~~/~~/dx.doi.org/10.1175/MWR3473.1>>url:http://dx.doi.org/10.1175/MWR3473.1]]
287: 
288: Moron V, Robertson AW, Boer R (2009) Spatial Coherence and Seasonal Predictability of Monsoon Onset over Indonesia. //J. Climate//, 22, 840–850. doi: [[http:~~/~~/dx.doi.org/10.1175/2008JCLI2435.1>>url:http://dx.doi.org/10.1175/2008JCLI2435.1]]
289: 
290: Muñoz ÁG, Goddard L, Mason SJ, Robertson AW (2016) Cross-timescale interactions and rainfall extreme events in South East South America for the austral summer. Part II: Predictive skill. //J. Climate.// doi: [[http:~~/~~/dx.doi.org/10.1175/JCLI-D-15-0699.1>>url:http://dx.doi.org/10.1175/JCLI-D-15-0699.1]]
291: 
292: Vellinga M, Arribas A, Graham R (2013) Seasonal forecasts for regional onset of the West African monsoon. Climate Dynamics. Volume 40, Issue 11, pp 3047-3070. [[http:~~/~~/link.springer.com/article/10.1007%2Fs00382-012-1520-z>>url:http://link.springer.com/article/10.1007%2Fs00382-012-1520-z]]
293: 
294: 
295: **5.4) Applications**
296: 
297: Calanca P, Bolius D, Weigel AP, Liniger MA (2011) Application of long-range weather forecasts to agricultural decision problems in Europe. //The Journal of Agricultural Science// **149**, 15-22. [[http:~~/~~/dx.doi.org/10.1017/S0021859610000729>>url:http://dx.doi.org/10.1017/S0021859610000729]]
298: 
299: Hirschi M, Spirig C, Weigel AP, Calanca P, Samietz J, Rotach MW (2012) Monthly Weather Forecasts in a Pest Forecasting Context: Downscaling, Recalibration, and Skill Improvement.// J. Appl. Meteor. Climatol.//, **51**, 1633–1638. doi: [[http:~~/~~/dx.doi.org/10.1175/JAMC-D-12-082.1>>url:http://dx.doi.org/10.1175/JAMC-D-12-082.1]]
300: 
301: Lynch KJ, Brayshaw DJ, Charlton-Perez A (2014) Verification of European Subseasonal Wind Speed Forecasts. //Mon. Wea. Rev.//, **142**, 2978–2990. 
302: doi: [[http:~~/~~/dx.doi.org/10.1175/MWR-D-13-00341.1>>url:http://dx.doi.org/10.1175/MWR-D-13-00341.1]]
303: 
304: Spillman CM, Hartog JR, Hobday AJ, Hudson DA (2015) Predicting environmental drivers for prawn aquaculture production to aid improved farm management. Aquaculture. 447: 56-65. doi:10.1016/j.aquaculture.2015.02.008
305: 
306:  
307: 
308: **5.5) Seamless verification**
309: 
310:  Zhu H, Wheeler MC, Sobel AH, Hudson D (2014) Seamless Precipitation Prediction Skill in the Tropics and Extratropics from a Global Model. //Mon. Wea. Rev.//, **142**, 1556–1569. doi: [[http:~~/~~/dx.doi.org/10.1175/MWR-D-13-00222.1>>url:http://dx.doi.org/10.1175/MWR-D-13-00222.1]]
311: 
312: 
313: **6) Available reference verification datasets for assessing S2S forecast quality**
314: 
315: 
316: **6.1) Atmospheric parameters (e.g. geopotential height, temperature, SLP, wind, etc)**
317: 
318: (% height="407" width="767" %)
319: |**Reanalysis**|**Source**|**References**
320: |[[20CR>>url:http://www.esrl.noaa.gov/psd/data/20thC_Rean/]]
321:  [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.ESRL/.PSD/.rean20thcent/.V2/.six-hourly/]]|NOAA CIRES|[[Compo et al. (2006)>>url:http://dx.doi.org/10.1175/BAMS-87-2-175]]
322: |[[ERA-Interim>>url:http://apps.ecmwf.int/datasets/data/interim-full-daily/]]|ECMWF|[[Dee et al. (2011)>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.828/abstract]]
323: |[[ERA-20C>>url:http://apps.ecmwf.int/datasets/data/era20c-daily/]]|ECMWF|[[Poli et al. (2015)>>url:http://www.ecmwf.int/sites/default/files/elibrary/2015/11700-era-20c-deterministic.pdf]]
324: |[[ERA-20CM>>url:http://www.ecmwf.int/en/research/climate-reanalysis/era-20cm-model-integrations]]|ECMWF|[[Hersbach et al. (2015)>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.2528/abstract]]
325: |[[JRA-55>>url:http://jra.kishou.go.jp/]]|JMA|[[Kobayashi et al. (2015)>>url:https://www.jstage.jst.go.jp/article/jmsj/93/1/93_2015-001/_article]]
326: |[[MERRA>>url:http://gmao.gsfc.nasa.gov/merra/]]
327:  [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NASA/.GSFC/.MERRA/]]|NASA|[[Rienecker et al. (2011)>>url:http://journals.ametsoc.org/doi/pdf/10.1175/JCLI-D-11-00015.1]]
328: |[[MERRA-2>>url:http://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/]]
329:  [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NASA/.GSFC/.MERRA2/.Anl_MonoLev/]]|NASA|[[Bosilovich et al. (2015)>>url:http://gmao.gsfc.nasa.gov/pubs/tm/docs/Bosilovich803.pdf]]
330: |(((
331: [[NCEP R1>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis.html]]
332: 
333: [[Access via IRI Data Library>>url:https://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP-NCAR/.CDAS-1/]]
334: )))|NCEP NCAR|[[Kalnay et al. (1996)>>url:http://dx.doi.org/10.1175/1520-0477(1996)077%3C0437:TNYRP%3E2.0.CO;2]]
335: |(((
336: [[NCEP R2>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis2.html]]
337: 
338: [[Access via IRI Data Library>>url:https://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP-DOE/.Reanalysis-2/]]
339: )))|NCEP NCAR|[[Kanamitsu et al. (2002)>>url:http://dx.doi.org/10.1175/BAMS-83-11-1631]]
340: |[[NCEP CFSR>>url:http://cfs.ncep.noaa.gov/cfsr/]]|NCEP NCAR|[[Saha et al. (2010)>>url:http://dx.doi.org/10.1175/2010BAMS3001.1]]
341: 
342: Additional information about all reanalysis listed above is available at theWeb-based Reanalysis Intercomparison Tools ([[WRIT>>url:https://reanalyses.org/atmosphere/writ]])
343: 
344:  
345: 
346: **6.2) Oceanic parameters**
347: 
348: |**Variable**|**Name**|**Source**|**Characteristics**|**References**
349: |Sea Surface temperature|(((
350: [[ERSSTv4>>url:http://www1.ncdc.noaa.gov/pub/data/cmb/ersst/v4/netcdf/]]
351: 
352: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCDC/.ERSST/.version4/?sem=iridl%3AAir-Sea-Interface]]
353: )))|NOAA NCDC|Monthly (2^^ ^^x 2 degrees in lat and lon)|(((
354: [[Huang et al. (2015)>>url:http://dx.doi.org/10.1175/JCLI-D-14-00006.1]]
355: 
356: [[Liu et al. (2015)>>url:http://dx.doi.org/10.1175/JCLI-D-14-00007.1]]
357: )))
358: |Sea Surface temperature|(((
359: [[ERSSTv3>>url:https://www.ncdc.noaa.gov/data-access/marineocean-data/extended-reconstructed-sea-surface-temperature-ersst-v3b]]
360: 
361: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCDC/.ERSST/.version3b/]]
362: )))|NOAA NCDC|Monthly (2^^ ^^x 2 degrees in lat and lon)|(((
363: [[Smith et al. (2008)>>url:https://www.ncdc.noaa.gov/sites/default/files/attachments/Improvements-NOAAs-Historical-Merged-land-Ocean-Temp-Analysis-1880-2006_0.pdf]]
364: 
365: [[Xue et al. (2003)>>url:https://www.ncdc.noaa.gov/sites/default/files/attachments/Interdecadal-Changes-30-Yr-SST-Normals-1871-2000.pdf]]
366: )))
367: |Sea Surface temperature|(((
368: [[OISSTv2>>url:http://www.emc.ncep.noaa.gov/research/cmb/sst_analysis/]]
369: 
370: [[Acess via ESRL>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.noaa.oisst.v2.html]]
371: 
372: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.EMC/.CMB/.GLOBAL/.Reyn_SmithOIv2/?sem=iridl%3AAir-Sea-Interface]]
373: )))|NOAA NCEP|Weekly/Monthly (1^^ ^^x 1 degree in lat and lon)|[[Reynolds et al. (2002)>>url:ftp://ftp.emc.ncep.noaa.gov/cmb/sst/papers/oiv2.pdf]]
374: |Sea Surface temperature|(((
375: [[AVHRR>>url:ftp://eclipse.ncdc.noaa.gov/pub/OI-daily-v2/README]]
376: 
377: [[Access via ESRL>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.noaa.oisst.v2.highres.html]]
378: 
379: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCDC/.OISST/.version2/.AVHRR/.sst/]]
380: )))|NOAA NCDC|Daily 0.25 x 0.25 degree in lat and lon)|(((
381: [[Reynolds et al. (2007)>>url:http://dx.doi.org/10.1175/2007JCLI1824.1]]
382: 
383: [[Reynolds (2009)>>url:https://www.ncdc.noaa.gov/sites/default/files/attachments/Reynolds2009_oisst_daily_v02r00_version2-features.pdf]]
384: )))
385: |Sea Surface temperature|(((
386: [[ERA-Interin-SST>>url:http://apps.ecmwf.int/datasets/data/interim-full-daily/]]
387: 
388:  
389: )))|ECMWF|Daily 0.7 x 0.7 degree in lat and lon)|[[Dee et al. (2011)>>url:http://onlinelibrary.wiley.com/doi/10.1002/qj.828/abstract]]
390: |Sub-surface ocean parameters|(((
391: [[GODAS>>url:http://www.cpc.ncep.noaa.gov/products/GODAS/]]
392: 
393: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.EMC/.CMB/.GODAS/]]
394: )))|NCEP|Monthly 0.333 x 1.0 degree in lat and lon)|See [[this link>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.godas.html]]
395: 
396: **6.3) Surface parameters**
397: 
398: (% height="1074" width="767" %)
399: |**Variable**|**Name**|**Source**|**Characteristics**|**References**
400: |Surface air temperature|(((
401: [[GHCN_CAMS>>url:ftp://ftp.cpc.ncep.noaa.gov/wd51yf/GHCN_CAMS/]]
402: 
403: [[Access via ESRL>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.ghcncams.html]]
404: 
405: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.CPC/.GHCN_CAMS/.gridded/.deg0p5/]]
406: )))|NOAA NCEP CPC|Monthly (0.5^^ ^^x 0.5 degrees in lat and lon)|[[Fan and van Den Dool (2008)>>url:http://onlinelibrary.wiley.com/doi/10.1029/2007JD008470/abstract]]
407: |Surface air temperature|(((
408: [[UDelawarev4.01>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.UDel_AirT_Precip.html]]
409: 
410:  
411: )))|Univ. Delaware|Monthly (0.5^^ ^^x 0.5 degrees in lat and lon)|See [[this link>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.UDel_AirT_Precip.html]]
412: |Surface air temperature|(((
413: [[GHCN_Daily>>url:https://www.ncdc.noaa.gov/data-access/land-based-station-data/land-based-datasets/global-historical-climatology-network-ghcn]]
414: 
415: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCDC/.GHCN_Daily/.version1/?sem=iridl%3ADCAtmosphere]]
416: )))|NOAA-NCDC/WMO|(((
417: Daily : 33147 stations (max, mean, min)
418: 
419:  
420: )))|[[Vose et al. (1992)>>url:http://cdiac.ornl.gov/epubs/ndp/ndp041/ndp041.html]]
421: |Precipitation|(((
422: [[CPC-daily-analysis>>url:ftp://ftp.cpc.ncep.noaa.gov/precip/CPC_UNI_PRCP/GAUGE_GLB/DOCU/]]
423: 
424: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.CPC/.UNIFIED_PRCP/.GAUGE_BASED/.GLOBAL/.v1p0/]]
425: )))|(((
426: NOAA NCEP
427: 
428: CPC
429: )))|Daily 0.5 x 0.5 degree in lat and lon)|(((
430: [[Chen et al. (2008)>>url:ftp://ftp.cpc.ncep.noaa.gov/precip/CPC_UNI_PRCP/GAUGE_GLB/DOCU/Chen_et_al_2008_Daily_Gauge_Anal.pdf]]
431: 
432: [[Chen et al. (2008)>>url:ftp://ftp.cpc.ncep.noaa.gov/precip/CPC_UNI_PRCP/GAUGE_GLB/DOCU/Chen_et_al_2008_JGR_Gauge_Algo.pdf]]
433: )))
434: |Precipitation|(((
435: [[CMORPH>>url:http://www.cpc.ncep.noaa.gov/products/janowiak/cmorph.shtml]]
436: 
437: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.CPC/.CMORPH/?sem=iridl%3ADCAtmosphere]]
438: )))|(((
439: NOAA NCEP
440: 
441: CPC
442: )))|3hr/Daily 0.25 x 0.25 degree in lat and lon)|[[Joyce et al. (2004)>>url:http://dx.doi.org/10.1175/1525-7541(2004)005%3C0487:CAMTPG%3E2.0.CO;2]]
443: |Precipitation|(((
444: [[CHIRPSv2>>url:http://pubs.usgs.gov/ds/832/]]
445: 
446: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.UCSB/.CHIRPS/.v2p0/]]
447: )))|UCSB|Daily/dekad/monthly 0.25 x 0.25 degree in lat and lon)|[[Funk et al. (2014)>>url:http://dx.doi.org/10.3133/ds832]]
448: |Precipitation|(((
449: [[UDelawarev4.01>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.UDel_AirT_Precip.html]]
450: 
451:  
452: )))|Univ. Delaware|Monthly (0.5^^ ^^x 0.5 degrees in lat and lon)|See [[this link>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.UDel_AirT_Precip.html]]
453: |Precipitation|(((
454: [[GHCN_Daily>>url:https://www.ncdc.noaa.gov/data-access/land-based-station-data/land-based-datasets/global-historical-climatology-network-ghcn]]
455: 
456: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCDC/.GHCN_Daily/.version1/?sem=iridl%3ADCAtmosphere]]
457: )))|NOAA-NCDC/WMO|(((
458: Daily : 33147 stations (max, mean, min)
459: 
460:  
461: )))|[[Vose et al. (1992)>>url:http://cdiac.ornl.gov/epubs/ndp/ndp041/ndp041.html]]
462: |Precipitation|(((
463: [[CMAP>>url:http://www.esrl.noaa.gov/psd/data/gridded/data.cmap.html]]
464: 
465: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.CPC/.Merged_Analysis/]] 
466: )))|(((
467: NOAA NCEP
468: 
469: CPC
470: )))|Pentad/Monthly (2.5 x 2.5 degrees in lat and lon)|[[Xie and Arkin (1997)>>url:http://dx.doi.org/10.1175/1520-0477(1997)078%3C2539:GPAYMA%3E2.0.CO;2]]
471: |Precipitation|(((
472: [[GPCC>>url:ftp://ftp-anon.dwd.de/pub/data/gpcc/html/download_gate.html]]
473: 
474: [[Access via IRI Data Library>>url:http://iridl.ldeo.columbia.edu/SOURCES/.WCRP/.GCOS/.GPCC/index.html?Set-Language=en]]
475: )))|DWD|Daily/Monthly (1.0 x 1.0 degrees in lat and lon)|(((
476: [[Schamm et al. (2013)>>url:http://dx.doi.org/10.5676/DWD_GPCC/FG_D_100]]
477: 
478: [[Schamm et al. (2015)>>url:http://dx.doi.org/10.5676/DWD_GPCC/FD_D_V1_100]]
479: )))
480: |Precipitation|(((
481: [[CAMS-OPI>>url:http://www.cpc.ncep.noaa.gov/products/global_precip/html/wpage.cams_opi.html]]
482: 
483: [[Access via IRI Data Library>>url:https://iridl.ldeo.columbia.edu/SOURCES/.NOAA/.NCEP/.CPC/.CAMS_OPI/]] 
484: )))|NOAA NCEP 
485: CPC|Monthly (2.5 x 2.5 degrees in lat and lon)|[[Xie and Arkin (1997)>>url:http://dx.doi.org/10.1175/1520-0477(1997)078%3C2539:GPAYMA%3E2.0.CO;2]]
486: 
487: **6.4) Datasets accessible via the KNMI Climate Explorer**
488: 
489: (% height="201" width="869" %)
490: |[[Daily station data>>url:https://climexp.knmi.nl/selectdailyseries.cgi?id=someone@somewhere]]
491: |[[Monthly station data>>url:https://climexp.knmi.nl/selectstation.cgi?id=someone@somewhere]]
492: |[[Daily gridded fields>>url:https://climexp.knmi.nl/selectdailyfield2.cgi?id=someone@somewhere]]
493: |[[Monthly gridded observations>>url:https://climexp.knmi.nl/selectfield_obs2.cgi?id=someone@somewhere]]
494: |[[Monthly reanalysis fields>>url:https://climexp.knmi.nl/selectfield_rea.cgi?id=someone@somewhere]]
495: |
496: \\\\(((
497: **7) S2S project models**
498: 
499: A total of 11 models are currently contributing to the S2S project data archive hosted at ECMWF ([[see documentation)>>url:https://software.ecmwf.int/wiki/display/S2S/Home]]. The main features of the forecasts and re-forecasts of these 11 models are included in the table below:
500: 
501: |**Model and Target forecast range**|**Resolution**|(((
502: **Number of**
503: 
504: **Real time ensemble members**
505: )))|(((
506: **Real time initial dates (freq)**
507: 
508: **From 1 jan 2015**
509: )))|**Re-forecasts**|(((
510: **Reforecast  period**
511: 
512: **~ **
513: )))|(((
514: **Reforecast initial dates**
515: 
516: **~ **
517: )))|(((
518: **Number of**
519: 
520: **Reforecast ensemble members**
521: )))
522: |(((
523: [[BoM>>url:https://software.ecmwf.int/wiki/display/S2S/BoM+Model+Description]]
524: 
525: (Coupled ocean-atmosphere)
526: 
527:  
528: 
529: Target
530: 
531: forecast range: 62 days
532: )))|(((
533: T47L17
534: 
535: (~~250 Km)
536: )))|33 (1 ctrl)|Twice a week: On Sundays and Thursdays|Fixed|(((
537: 1981-2013
538: 
539: (33 years)
540: )))|1, 6, 11, 16, 21, 26|33 for each initial date (1 ctrl)
541: |(((
542: [[CMA>>url:https://software.ecmwf.int/wiki/display/S2S/CMA+Model+Description]]
543: 
544: (Coupled ocean-atmosphere)
545: 
546:  
547: 
548: Target
549: 
550: forecast range: 60 days
551: )))|(((
552: T106L40
553: 
554: (~~110 Km)
555: )))|4 (1 ctrl)|Daily|Fixed|(((
556: 1994-2014
557: 
558: (21 years)
559: )))|Daily|4 for each initial date (1 ctrl)
560: |(((
561: [[CNR-ISAC>>url:https://software.ecmwf.int/wiki/display/S2S/ISAC-CNR+Model+Description]]
562: 
563: (Atmospheric with slab ocean)
564: 
565:  
566: 
567: Target
568: 
569: forecast range: 31 days
570: )))|0.75 x 0.56 L54|41 (1 ctrl)|Once a week: On Mondays|Fixed|1981-2010 (30 years)|Starting on 1 Jan 1981 in intervals of 5 days until 27 Dec 2010|1 for each initial date
571: |(((
572: [[CNRM>>url:https://software.ecmwf.int/wiki/display/S2S/Meteo-France+Model+Description]]
573: 
574: (Coupled ocean-atmosphere)
575: 
576:  
577: 
578: Target
579: 
580: forecast range: 32 days
581: )))|(((
582: T255L91
583: 
584: (~~80 Km)
585: )))|51 (1 ctrl)|Once a week: On Thursdays|Fixed|(((
586: 1993-2014
587: 
588: (22 years)
589: )))|1, 15|(((
590: 15 for each initial date
591: 
592: (1 ctrl)
593: )))
594: |(((
595: [[ECCC>>url:https://software.ecmwf.int/wiki/display/S2S/ECCC+Model+Description]]
596: 
597: (Atmospheric)
598: 
599:  
600: 
601: Target
602: 
603: forecast range: 32 days
604: )))|0.45 x 0.45 L40|21 (1ctrl)|Once a week: On Thursdays|On the fly|(((
605: 1995-2014
606: 
607: (20 years)
608: )))|Once a week: On corresponding date to Thursday real time forecasts|4 for each initial date (1 ctrl)
609: |(((
610: [[ECMWF>>url:https://software.ecmwf.int/wiki/display/S2S/ECMWF+Model+Description+CY41R2]] (Coupled ocean-atmosphere)
611: 
612:  
613: 
614: Target
615: 
616: forecast range: 46 days
617: )))|(((
618: Tco639/319 L91
619: 
620: (~~16 Km up to day 15, ~~32 Km after day 15)
621: )))|51 (1 ctrl)|Twice a week: On Mondays and Thursdays|On the fly|(((
622: 1996-2015
623: 
624: 1995-2014
625: 
626: (Past 20 years)
627: )))|Twice a week: On Mondays and Thursdays|11 for each initial date (1 ctrl)
628: |(((
629: [[HMCR>>url:https://software.ecmwf.int/wiki/display/S2S/HMCR+Model+Description]]
630: 
631: (Atmospheric)
632: 
633:  
634: 
635: Target
636: 
637: forecast range: 61 days
638: 
639:  
640: )))|1.1x1.4 L28|20 (1 ctrl)|Once a week: On Wednesdays|On the fly|(((
641: 1985-2010
642: 
643: (26 years)
644: )))|Once a week: On corresponding date to Wednesday real time forecasts|10 for each initial date (1 ctrl)
645: |(((
646: [[JMA>>url:https://software.ecmwf.int/wiki/display/S2S/JMA+Model+Description]] (Atmospheric)
647: 
648:  
649: 
650: Target
651: 
652: forecast range: 33 days
653: )))|(((
654: T319L60
655: 
656: (~~55 Km)
657: )))|(((
658: 25 (1 ctrl)
659: 
660:  
661: )))|Twice a week: On Tuesdays and Wednesdays|Fixed|1981-2010 (30 years)|10, 20 and end of month|5 for each initial date (1 ctrl)
662: |(((
663: [[KMA>>url:https://software.ecmwf.int/wiki/display/S2S/KMA+Model+Description]] (Coupled ocean-atmosphere)
664: 
665:  
666: 
667: Target
668: 
669: forecast range: 60 days
670: )))|(((
671: N216L85
672: 
673: (~~60 Km)
674: )))|4 (1 ctrl)|Daily|On the fly|(((
675: 1996-2009
676: 
677: (14 years)
678: 
679:  
680: )))|1, 9, 17, 25|3 for each initial date (1 ctrl)
681: |(((
682: [[NCEP>>url:https://software.ecmwf.int/wiki/display/S2S/NCEP+Model+Description]] (Coupled ocean-atmosphere)
683: 
684:  
685: 
686: Target
687: 
688: forecast range: 44 days
689: )))|(((
690: T126L64
691: 
692: (~~100 Km)
693: )))|16 (1 ctrl)|Daily|Fixed|1999-2010
694:  (12 years)|Daily|4 for each initial date (1 ctrl)
695: |(((
696: [[UKMO>>url:https://software.ecmwf.int/wiki/display/S2S/UKMO+Model+Description]]
697: 
698: (Coupled ocean-atmosphere)
699: 
700:  
701: 
702: Target
703: 
704: forecast range: 60 days
705: )))|(((
706: N216L85
707: 
708: (0.83 x 0.56
709: 
710: ~~60 Km in mid-latitudes)
711: )))|4 (1 ctrl)|Daily|On the fly|(((
712: 1996-2009
713: 
714: (14 years)
715: 
716: 1996-2015
717: 
718: (20 years)
719: )))|1, 9, 17, 25|3 for each initial date (1 ctrl)
720: 
721:  
722: 
723: **7.1) Accessing S2S models data**
724: 
725:  S2S forecast and re-forecast data are available through [[ECMWF>>url:http://s2s.ecmwf.int/]] and [[CMA>>url:http://s2s.cma.cn/index]].
726: 
727: |(((
728: ECMWF provides two alternatives for accessing S2S model data (both forecasts and re-forecasts):
729: 
730: 1)      [[Via a web data portal>>url:http://apps.ecmwf.int/datasets/data/s2s]] (grib format only)
731: 
732: 2)      Via a webAPI interface (with Python capability for downloading files). For this see these [[instructions>>url:https://software.ecmwf.int/wiki/display/WEBAPI/Access+ECMWF+Public+Datasets]] and [[examples>>url:https://software.ecmwf.int/wiki/display/WEBAPI/Python+S2S+examples]]. Additional information including information on how to extract data for specific regions and in netcdf format is available in [[this page>>url:https://software.ecmwf.int/wiki/display/WEBAPI/WebAPI+FAQ]] and also in these two presentations ([[pages 6 to 16 of this presentation>>url:http://indico.ictp.it/event/a14264/session/9/contribution/22/material/0/0.pdf]] and [[this presentation>>url:http://indico.ictp.it/event/a14264/session/3/contribution/6/material/0/0.pptx]]).
733: )))
734: |CMA provides access to S2S model data (both forecasts and re-forecasts) [[via a web data portal>>url:http://s2s.cma.cn/dataset]].
735: |A subset of these data (currently from ECMWF, NCEP and CMA models) is also available through the [[IRI Data Library>>url:http://iridl.ldeo.columbia.edu/home/.mbell/.ECMWF/.S2S/]] in various file formats including OpenDAP access. An introduction to the IRI Data Library is available in [[this presentation>>url:http://indico.ictp.it/event/a14264/session/6/contribution/13/material/0/0.pdf]].
736: 
737: **7.2) Visualizing S2S forecast products**
738: 
739: S2S forecast products from 6 S2S models (BoM, CMA, NCEP, UKMO, ECMWF, JMA) generated every Thursday since 7 January 2016 are available through the [[ECMWF forecast products page>>url:http://www.ecmwf.int/en/research/projects/s2s/charts/s2s/]].
740: The currently available products include:
741:  - 2 metre temperature, precipitation and 500 hPa geopotential anomalies
742:  - Extreme Forecast Index (EFI)
743:  - Hovmoller diagrams of 200 hPa and 850 hPa zonal winds and Outgoing Longwave Radiation (OLR)
744:  - Madden and Julian Oscillation (MJO) Wheeler and Hendon (WH) diagram
745: 
746:  
747: 
748: Additional forecast products are available at the [[S2S Museum>>url:http://gpvjma.ccs.hpcc.jp/S2S/]] operated for the promotion of utilization of S2S data by [[Dr. Mio Matsueda>>url:http://gpvjma.ccs.hpcc.jp/%7Emio/index.html]] (University of Tsukuba and University of Oxford).
749: 
750: The currently available products include ensemble forecasts for specific atmospheric phenomena such as:
751: 
752: - Artic/Antartic Oscillation index
753: - Sea level pressure anomaly
754: - North Atlantic Oscillation index
755: - Pacific North America index
756: - Western Pacific pattern index
757: - Eurasian pattern index
758: - 500 hPa geopotential anomaly
759: - 200 hPa wave activity flux
760: - Sudden stratospheric warming
761: - Temperature at 10 hPa
762: - Madden and Julian Oscillation
763: - Sea surface temperature
764: - Sea-ice cover  
765: 
766:   
767: 
768:  
769: 
770: 
771: 
772: \\
773: )))
Applications

Quick Links

Sandbox
My Recent Modifications

This wiki is licensed under a Creative Commons 2.0 license
XWiki Enterprise 6.2.2 - Documentation