New Methods for Comparing the Forecasts Accuracy

Bratu (Simionescu) Mihaela^1,

¹Department of Statistics and Econometrics, Faculty of Cybernetics, Statistics and Economic Informatics, Bucharest, Romania

Cite this paper:
Bratu (Simionescu) Mihaela. New Methods for Comparing the Forecasts Accuracy. American Journal of Applied Mathematics and Statistics. 2013; 1(1):1-5. doi: 10.12691/ajams-1-1-1

Abstract

The main purpose of this research is to show the diversity of statistical methods that could be used to assess and compare forecasts accuracy. Some of the statistical approaches were not used before in literature to evaluate the forecasts accuracy. The different methods applied to compare the accuracy of the USA inflation forecasts on the horizon 1976-2012 started from the predictions provided by Survey of Professional Forecasters (SPF), Congressional Budget Office (CBO), Blue Chips (BC), and Administration, determining different results. According to U1 Theil’s statistic, non-parametric tests and a new indicator proposed by us (RRSSE- ratio of radicals of sum of squared errors), the best forecasts were provided by Administration and the less accurate by SPF. The Spearman’s and Kendall’s coefficients of correlation and the ranks method gavea hierarchy of institutions performance regarding the accuracy that starts with BC and finished with SPF. The logistic regression computed by the author and the relative distance to the maximal performance method considered CBO as the best institution. Some methods of improving the forecasts accuracy were applied, getting more accurate predictions for the combined forecasts of BC and CBO using optimal scheme of combination. The smoothed predicted values based on Hodrick-Prescott filter outperformed all the initial predictions and the combined ones.

Keywords:
forecasts accuracy logistic regression combined forecasts non-parametric tests filtersmulti-criteria ranking

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]	Abreu I., “International organizations’ vs. private analysts’ forecasts: an Evaluation”, Banco de Portugal Papers, 29-34, 2011.
[2]	Bates, J., and C. W. J. Granger, “The Combination of Forecasts”, Operations Research Quarterly, 20(4): 451-468, Jul. 1969.
[3]	Bratu, M. (2012). Strategies to Improve the Accuracy of Macroeconomic Forecasts in USA, LAP LAMBERT Academic Publishing, 2012, 6-28.
[4]	Bratu (Simionescu) M.,“Filters or Holt Winters technique to improve the forecasts for USA inflation rate ?”, ActaUniversitatisDanubius. Œconomica, 9(1): 23-45, 2013.
[5]	Christiano, L. J. and Fitzgerald, T.J., “The Band Pass Filter”,International Economic Review, 44(2): 435-465, 2003.
[6]	Conovor W.J., Practical nonparametric statistics, Wiley series in probability and statistics, New York: Wiley, 1999, 56-78.
[7]	Edge R.M., Kiley M.T. and Laforte J.-P., “A comparison of forecast performance between Federal Reserve Staff Forecasts simple reduced-form models and a DSGE model”,Finance and Economics Discussion Series, 85-89, 2009.
[8]	Hodrick R. and Prescott, E.C., Postwar U.S. Business Cycles: An empirical investigation,Journal of Money, Credit and Banking, 1(16): 84-90, 2003.
[9]	Österholm, P., “The limited usefulness of macroeconomic Bayesian VARs when estimating the probability of a US recession”, Journal of Macroeconomics, Elsevier, vol. 34(1): 76-86, 2012.
[10]	RazzakW.,The Hodrick-Prescott technique: A smoother versus a filter: An application to New Zealand GDP, Economics Letters, 57(2), 163-168, 1997.
[11]	http://www.cbo.gov/sites/default/files/cbofiles/ftpdocs/115xx/doc11553/forecastingaccuracy.pdf.