170 likes | 186 Views
This seminar discusses the integration of judgmental and quantitative forecasting methods at the USDA to improve accuracy. It explores the challenges faced, alternative approaches, and the importance of combining different forecasting techniques for optimal results.
E N D
Integrating Judgmental and Quantitative Forecasts Stephen MacDonald, ERS/USDA Research Center on Forecasting Seminar January 17, 2007
Introduction • Futures markets often find USDA’s forecasts crucial • Resource constraints have reduced the staff-years USDA has for forecasting • Quantitative methods can be used to supplement USDA’s traditionally judgmental forecasts • Example: international commodity trade
Overview of USDA Forecasts • National Agricultural Statistics Service (NASS) estimates U.S. production of more than 100 commodities • 7 of these commodities have been legislatively deemed “market sensitive” • Wheat, corn, soybeans, cotton, citrus, cattle, and hogs • Since 1973, USDA has published demand forecasts as well • Interagency Commodity Estimates Committees
Interagency Commodity Estimates Committee (ICEC) • ICEC comprised of: Economic Research Service (ERS) Foreign Agricultural Service (FAS) Farm Service Agency (FSA) Agricultural Marketing Service (AMS) World Agricultural Outlook Board (WAOB) ,chair • Methodology of the ICEC: “A consensus…approach is used to arrive at supply and demand estimates. Consensus forecasts employ ‘models’ of all types, formal and informal.”
February 2007 example: India 2006/07 cotton exports • Forecasts available from several sources: • 4.2 million bales (mb): U.S. embassy (Delhi) • 3.9 mb: India Cotton Advisory Board • 4.1 mb: International Cotton Advisory Committee • “USDA forecast too high”: personal communication from industry analysts • No actual data was available—Indian official trade data is significantly lagged • USDA’s forecast: 5 mb
January 2008: India exports • 10 months of marketing year data published • Averaged 437,000 bales per month • Compared to 2006, Aug-May trade is: • 1.3 m. bales higher • 44 % higher • During previous 4 years: • Aug-May was 84% of year Thousand bales 2006 2005 Data available through May 2007
Changing Forecasting Environment • A consensus (Delphi) approach is resource-intensive: expertise– or labor–intensive • Falling cost of data-processing and acquisition can offset reduced staffing • Timely international commodity trade data commercially available • replacing embassy reports
Empirical confidence intervals • Assume future errors distributed same as past • Assume errors are normally distributed, with mean of zero • Calculate a 90 percent confidence interval for each forecast using estimated variance and t distribution • Variance estimated with past forecasts errors
Alternative forecasts for India exports • Weight forecasts by inverse of confidence interval • Analysis of trade data corroborates USDA • But: international organization has forecast outside of 90% confidence interval
Forecasting after structural change • Past error variances may be poor guide • Genetically modified cotton increases exports • Convert confidence limits to percentages of past Indian exports: Thousand bales Forecasts • Example • 100,000 / 837,000 = 12 % • 0.12 * 5.0 mb = 0.6 mb, alternative confidence limit 837,000 bales = 99-05 average
Forecasts: adjusted confidence limits • Proportional confidence limit suggests ICAC forecast is not incompatible with published trade data • However, actual exports totaled 4.4 mb already • Alternative adjustments may be more appropriate
Integration with judgmental forecasts • Confidence intervals expand compatibility of quantitative estimates with market intelligence from embassies and industry • Also provide weights for combining forecasts—add intuitive appeal • Can be incorporated into rules of thumb to guide judgmental decision-making
Conclusion • USDA forecasting is increasingly substituting “capital” for labor • We are exploring how to most efficiently exploit the growing availability of data • We are determining how best to integrate these quantitative forecasts into USDA’s judgment-based system