How Well Do Economists Forecast Recessions?
  • 1 0000000404811396https://isni.org/isni/0000000404811396International Monetary Fund

Contributor Notes

We describe the evolution of forecasts in the run-up to recessions. The GDP forecasts cover 63 countries for the years 1992 to 2014. The main finding is that, while forecasters are generally aware that recession years will be different from other years, they miss the magnitude of the recession by a wide margin until the year is almost over. Forecasts during non-recession years are revised slowly; in recession years, the pace of revision picks up but not sufficiently to avoid large forecast errors. Our second finding is that forecasts of the private sector and the official sector are virtually identical; thus, both are equally good at missing recessions. Strong booms are also missed, providing suggestive evidence for Nordhaus’ (1987) view that behavioral factors—the reluctance to absorb either good or bad news—play a role in the evolution of forecasts.

Abstract

We describe the evolution of forecasts in the run-up to recessions. The GDP forecasts cover 63 countries for the years 1992 to 2014. The main finding is that, while forecasters are generally aware that recession years will be different from other years, they miss the magnitude of the recession by a wide margin until the year is almost over. Forecasts during non-recession years are revised slowly; in recession years, the pace of revision picks up but not sufficiently to avoid large forecast errors. Our second finding is that forecasts of the private sector and the official sector are virtually identical; thus, both are equally good at missing recessions. Strong booms are also missed, providing suggestive evidence for Nordhaus’ (1987) view that behavioral factors—the reluctance to absorb either good or bad news—play a role in the evolution of forecasts.

1. Introduction

Recessions are not rare: economies are in a state of recession 10–12 percent of the time. What is rare is a recession that is forecast in advance. This is shown in Figure 1, which is based on data for 63 countries from 1992 to 2014. The bars in the figure show the average forecasts for real GDP growth made in the year before a recession—the first two bars in the figure—and in the year of the recession, the next two bars. In April of the year before the recession, the forecasts— both from the private sector (Consensus Forecasts) and the official sector (IMF) are for 3 percent growth. While the forecast is marked down by October, it remains far from signaling a recession. In the year of the recession, forecasters do call for a recession by April but one that is much milder than what transpires. It is only as the year is ending that forecasts catch up with reality, shown in the figure by the solid black line.

Figure 1:
Figure 1:

Evolution of Forecasts in the Run-up to Recessions

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

In this paper, we describe the evolution of forecasts during recessions for advanced and emerging market economies using two sources of forecasts—Consensus Forecasts and the IMF’s World Economic Outlook. Our main finding, as illustrated above, is that while forecasters are generally aware that recession years will be different from other years, they miss the magnitude of the recession by a wide margin until the forecast horizon has drawn to a close. We show that forecast revisions during non-recession years are subject to a considerable amount of rigidity. In recession years, forecasts are revised much more rapidly than in non-recession years but not quickly enough to be able to avoid large forecast errors. Our second finding is that this pattern of behavior is shared by forecasters from the private sector and the official sector.

Other papers have found comparable results. On the first finding that recessions are difficult to forecast, Lewis and Pain (2014) also point to “a common failing to predict downturns and to predict their size” and add that “these difficulties have been found across forecasters, across countries and over longer periods of time (Zarnowitz, 1991; Loungani, 2001; Abreu, 2011; González Cabanillas and Terzi, 2012).” Dovern and Jannsen (2017) also analyze how the systematic growth forecast errors in advanced economies depend on the business cycle, and document the fact that “growth forecasts for recessions are subject to large negative systematic errors, while forecasts for recoveries are subject to small positive systematic errors.”1

On the second finding, Abreu (2011) studies a sample of nine advanced economies over the period from 1991 to 2009, and finds that “[…] the forecasting performance of the international organisations is broadly similar to that of the surveys of private analysts. By and large, current-year forecasts present desirable features and clearly outperform year-ahead forecasts for which evidence is more mixed both in terms of quantitative and qualitative accuracy.”

In the remainder of the paper, we describe the forecast data in Section 2 and the evolution of forecasts in recession and non-recession years in Section 3. The comparison between official sector and private sector forecasts is in Section 4.

2. Data

The event being forecast is the annual real GDP growth. We refer to the year for which the forecast is being made as the target year. Forecasts made in the year before the target year are called year-ahead forecasts and those made during the target year are called current-year forecasts.

The private sector forecasts are taken from Consensus Economics. Each month, this source provides year-ahead and current-year output forecasts for a large group of countries. The first year-ahead forecast is made in the January before the target year and the last current-year forecast is made in the December of the target year. Hence, for any target year, there is a sequence of 24 forecasts. We use ‘h’ to denote this forecasting horizon, with ‘h’ taking values from 1 to 24.

The structure of the data is illustrated with a couple of concrete examples in Figure 2. The top panel shows forecasts made for the United States for the target year 2009. The horizontal axis shows the horizon and the vertical axis shows the forecast (and realization) for output growth. Each dot shows the forecast made by an individual forecaster and the solid line through these dots is the arithmetic average of these forecasts or the ‘consensus’. In this paper, we use these consensus forecasts rather than the individual forecasts.2 The solid line shows the realization of output growth, which in this case was about -3 percent. As shown, the year-ahead forecast made in January of 2008 (corresponding to h=24) is about 3 percent. Over the remainder of the forecasting horizon, the consensus inches down from 3 percent to -3 percent. The bottom panel shows forecasts for Argentina for the target year 2001. Here the initial forecast is for about 4 percent growth and it moves down slowly towards the outcome of about -4 percent,

Figure 2.
Figure 2.

Consensus Forecasts for USA (2009) and Argentina (2001)

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

Source: Consensus Forecasts.

The official sector forecasts are taken from the IMF, which provides output year-ahead and current-year forecasts every April and October. Hence, the IMF forecasts are available for 4 of the 24 horizons: (1) April(t-1), corresponding to h=21; (2) Oct(t-1); h=15; (3) Apr(t); h=9; (4) Oct(t); h=3.

Our sample consists of 63 countries (29 advanced economies and 34 emerging economies). The longest period over which we have forecasts is 1992 to 2014; for some countries, the forecasts start later. Table A1 in the Appendix provides the list of countries and time periods.3

Data on (actual) real GDP growth are taken from the IMF. A recession is defined as a year when output growth was negative.4 Tables A2 and A3 in the Appendix list the recessions in our sample. There are 153 recessions (86 in advanced economies and 67 in emerging markets), which are listed in the table by country (Table A2) and by year (Table A3). Of the 1306 country-year observations, economies are in recession in 153 years or 12 percent of the time. A recession is defined here simply as a year in which output fell (i.e. output growth was negative). In April of the year before the recession, forecasters expected output to fall in only 5 of these 153 cases. The performance gets better over time: by October of the year of the recession, forecasts were for a fall in output in 118 of the 153 cases.

Table 1.

Recessions in Actual and Consensus Forecasts

article image
Source: IMF World Economic Outlook and Consensus Forecasts

3. The evolution of forecasts

3.1 Type 1 vs. Type 2 error

We begin our description of the evolution of forecasts by providing some evidence on the extent of type 1 error (a recession happened but was not forecast) and type 2 error (a recession did not happen but was falsely forecasted).

The first row of Table 2 shows the type 1 error at various horizons; these are the number of recessions missed in the sense that the forecasts were for positive growth. As already noted in the introduction, 148 of 153 recessions are missed in April(t-1); this declines over the subsequent months but even by Oct(t), 35 recessions are missed. Over the subsequent months, forecasters steadily revised down their forecasts; the number of instances are given in the second row of the table.

Table 2.

Performance During Recessions

article image
Sources: IMF World Economic Outlook and Consensus Forecasts.

This indicates that even though forecasters failed to predict recessions in most of the cases, they started to realize the potential trouble ahead. Despite the downward revisions in forecasts, however, the forecast errors—provided in the remaining rows of the table—remain quite large. Hence, while forecasts are moving in the right direction, the extent to which they are marked down is too small. The Consensus and IMF forecasts are quite similar in this regard, as can be seen by comparing the left and right panels of Table 2.

Table 3 compares the performance pre- and post- Great Recession. The performance was somewhat better over the latter period: a larger proportion of recessions was successfully forecasted and the mean forecast error was smaller (except for the year-ahead forecast for emerging economies).

Table 3.

Performance During Recessions, Pre- and Post-Great Recession

article image
Sources: IMF World Economic Outlook and Consensus Forecasts.

Table 4 shows the type 2 error. The first row shows the number of episodes where a forecasted recession did not happen. The number is small relative to the type 1 error. Though the number tends to increase over time, many of these are cases where the forecast may be for growth just below zero while the realization ends up just above zero. Hence, despite the increase in the number of falsely forecasted recessions, the mean forecast error decreases with time. Once again, there is not much difference between the behavior of the Consensus and IMF forecasts.

Table 4.

Falsely Forecasted Recessions (Out of 1153 Non-Recession Episodes)

article image
Sources: IMF World Economic Outlook, Consensus Forecasts, and authors’ estimates.

To summarize, type 1 error – the failure to forecast a recession – is a much more common error than type 2 error, falsely forecasting a recession.

3.2 Comparing Recessions and Non-Recession Years

Figure 3 shows the evolution of Consensus Forecasts (Panel A) and IMF forecasts (Panel B) in recession years and compares them with the overall or unconditional evolution of forecasts (that is the evolution of forecasts for all years, recession as well as non-recession). Advanced economies and emerging markets are shown separately (left and right panels, respectively).

Figure 3.
Figure 3.

Evolution of Forecasts during Recessions

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

Each panel has three pieces of information. First, the solid line is the actual GDP growth, on average, across the recessions; this average is about -2 percent for advanced and -3 percent for emerging economies. Second, the dashed line shows the evolution of unconditional real GDP forecasts on average, that is, including both the recession and non-recessions years. These forecasts start out at about 3 percent for advanced and 4.5 percent for emerging economies and are slowly revised down over the subsequent 24 months. Third, the bars show the evolution of forecasts for recession years on average; hence these bars provide the sort of information provided in figure 1 for the US and Argentina for selected recession years but these bars now show the average across all countries and all recession years.

What does the figure reveal? Forecasts for recession years start out very close to the unconditional average in the year preceding the recession, but they begin to depart from it around the middle of that year. This indicates that forecasters are already becoming aware that the coming year is probably going to be a departure from the norm. This is important as it shows that forecasters are alert to incoming information about potentially negative prospects for the coming year. However, the magnitudes of the revisions are much smaller than what would be needed to forecast recessions accurately and there is clear indication of forecast smoothing: changes are made in a serially correlated fashion. By December of the year of the recession, forecasts have essentially caught up to both the reality and the magnitude of the recessions. For both Consensus and IMF forecasts, we find similar patterns of smooth downward forecast revisions, and for both advanced and emerging economies.

The evidence thus far suggests that forecasters either do not have the information or the incentives to forecast recessions. Lack of information could arise for various reasons. First, data on the economy may only became available with long lags or be of poor quality. Second, economic models may not be good enough to be able to predict outlier events, Third, recessions may occur because of events which are themselves difficult to predict. Lack of incentives could also arise for various reasons. For instance, the reputational loss from being wrong may be higher than the gain from being right.

Sorting out why this forecasting failure occurs is beyond the scope of this paper. However, we present some additional results that might provide clues in the search for an answer. As noted, one reason for the failure might be that recessions occur following events, such as economic crises, which are themselves difficult to predict. Figure A1 in the Appendix is like Figure 2 except that we exclude recessions that follow a crisis (either a currency or a debt crisis). The results are very similar to those shown above. Hence, distinguishing between crisis and non-crisis cases does not seem to be useful in finding reasons for the forecasting failure.

Another reason could be that forecasters have trouble with outliers, whether they are recessions or booms. We can shed light on this by seeing how well forecasters are able to predict episodes of economic boom. A boom is defined here as a year in which economic growth is greater than one standard deviation above the country average. Tables A4 and A5 in the Appendix gives the list of booms by country and year, respectively.

Figure 4 shows the evolution of forecasts in economic boom episodes. Forecasts for the boom years start out from the unconditional average in the year preceding the economic boom, but begin to depart from it around the middle of that year. However, even by December of the year of the economic boom, forecasts are still about 1.5 percent lower than actual growth. Hence, we find a similar pattern to the one we found in the case of recessions. This finding is consistent with the view, sometimes expressed in the aftermath of the Global Financial Crisis, that economic models are not capable of generating big swings in outcomes away from some steady state level; to the extent that some forecasters rely on such models, they too will tend to have difficulty when outcomes depart strongly from normal. To some extent, therefore, our evidence supports the view that it is lack of information rather than lack of incentives that accounts for the forecasting failure during recessions.

Figure 4.
Figure 4.

Evolution of Forecasts during Economic Booms

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

Nordhaus (1987) argued that slow forecast revisions could also occur for behavioral reasons. He presented evidence from a variety of sources that “people tend to smooth their forecasts too much. That is, we break the good or bad news to ourselves slowly, taking too long to allow surprises to be incorporated into our forecasts.”

3.3 Information rigidity around turning points

The evidence presented in the previous sub-section suggest forecast smoothing, which Nordhaus (1987) noted as a property of an inefficient forecast. Under the null hypothesis of full information rational expectations, a sequence of forecasts for the same target should follow a martingale: forecast revisions should be serially uncorrelated.5 We can test for efficiency by regressing forecast revisions on past forecast revisions:

Revit,h=αh+βhRevit,h+k+μi,h+εit,h(1)

where Revit,h is the forecast revision for country i in target year t with forecast horizon h; αh and βh are the coefficients of constant term and previous forecast revision; μi,h and εit,h represents the country fixed effect and error term. Under the null hypothesis of full information rational expectations, βh = 0. A positive and significant βh indicates the existence of information rigidity. Since Figure 2 shows that the largest forecast revisions occur after the mid-year of the year-ahead forecasts, we use the revision between October and April of the current-year forecast as the dependent variable, and the revision between April of the current year and October of the previous year as the explanatory variable.

Table 5 presents the results for all countries, advanced economies, and emerging economies based on Consensus Forecasts and IMF forecasts. The coefficient estimates are positive and significantly different from zero for all country groups for both sources of forecasts. The null hypothesis of full information rational expectations can thus be rejected. Comparing the coefficients between advanced and emerging economies, the serial correlation is higher for emerging economies than those for the advanced economies. This indicates that forecasting for emerging economies exhibits a higher level of information rigidity. The serial correlation is also higher for Consensus than for IMF forecasts.

Table 5.

Information Rigidity – Nordhaus (1987)

article image
Source: IMF World Economic Outlook, Consensus Forecasts, and authors’ estimates.Note: The dependent variable is the forecast revision made between Oct[t] and Apr[t]. The independent variables are the forecast revision made between Apr[t] and Oct[t-1], dummy variable for recession, and their interaction. Country fixed effects are included but omitted for reasons of parsimony. Robust standard errors are reported in parentheses. *, **, *** denote statistical significance at the10, 5 and 1 percent levels, respectively.

To test for the extent of information rigidity around the turning point, we include a dummy variable for recessions and a variable that interacts the forecast revision with the dummy variable for recessions:

Revit,h=αh+βhRevit,h+k+γhRecit+θhRevit,h+k*Recit+μi,h+εit,h(2)

A negative and significant θh indicates a relatively lower level of information rigidity during recession years than other years. We also test if βh + θh = 0; a positive and significant βh + θh indicates the existence of information rigidity even if recession years.

Table 6 shows the results of the estimation of equation (2). The coefficients on the interaction variable are all negative, indicating a lower level of information rigidity during recession episodes relative to the other years.6 The p-values reported in each column are associated with the hypothesis test of βh + θh = 0. For all the six tests, we fail to reject the hypothesis and conclude that there is no information rigidity during recessions.7

Table 6.

Information Rigidity during Recession Episodes – Nordhaus (1987)

article image
Source: IMF World Economic Outlook, Consensus Forecasts, and authors’ estimates.Note: The dependent variable is the forecast revision made between Oct[t] and Apr[t]. The independent variables are the forecast revision made between Apr[t] and Oct[t-1], dummy variable for recession, and their interaction. Country fixed effects are included but omitted for reasons of parsimony. Robust standard errors are reported in parentheses. *, **, *** denote statistical significance at the10, 5 and 1 percent levels, respectively.

4. Comparing Consensus and IMF Forecasts

The analysis in the previous sections shows that Consensus Forecasts and the IMF forecasts are similar in their inability to predict recessions. Figure 5 compares forecast errors of Consensus and IMF forecasts for all years, recession as well as non-recession. The correlations between the forecast errors of two sources exceed 0.9.

Figure 5.
Figure 5.

Consensus Forecast Errors and IMF Forecast Errors

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

To do a more stringent test of the relative predictive accuracy of the two sources of forecasts, we use the test proposed by Diebold and Mariano (1995). The comparison statistic, DM, is defined as:

DM=H1/2Σj=1HdjσdN(0,1)

where

dj=g(e1j)g(e2j)

g is the loss function of interest, e.g. the quadratic loss g(e) = e2 (DMS) or absolute loss g(e) = |e| (DMA), eij and e2j are the errors from the two competing forecasts, and σd is the standard deviation of d. If the DM statistic is positive, the loss associated with the first model (Consensus Forecasts) is larger than that associated with the second one (IMF Forecasts). Diebold and Mariano (1995) suggest estimating σd with spectral-based techniques but, given the small sample available and the non-correlation of dj for almost all cases, we use the standard formula:

σ^d=1H1Σj=1H(dj1HΣi=1Hdi)2

The test is conducted for each country. Figure 6 shows the summary of test results based on quadratic loss function for the total number of 63 countries. For each horizon, the left bar shows the number of countries for which Consensus Forecasts are more accurate; the right bar shows the number of countries for which IMF forecasts are more accurate. In each bar, the lower part shows the proportion that is better but statistically insignificant; the upper part shows the proportion that is better and statistically significant.

Figure 6.
Figure 6.

Summary of Accuracy Test Results – Diebold and Mariano (1995)

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

Consensus Forecasts tend to be more accurate than IMF forecasts in a larger proportion of countries in our sample group. For instance, by October of the year before the recession (forecast horizon = 15 months), Consensus Forecasts are more accurate for 47 countries, and 14 of them are significant; in contrast, IMF forecasts are more accurate for 16 countries, and significant for only 3 countries. For current-year forecasts, Consensus forecasts are again more accurate for a larger proportion of countries.

Figure 7 shows similar results for advanced and emerging economies. For the advanced economies, IMF forecasts made in April in the year-ahead and current-year are more accurate for more countries. For the emerging economies, Consensus Forecasts are more accurate for more countries.

Figure 7.
Figure 7.

Summary of Accuracy Test – By Country Group

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

5. Conclusion

This paper describes the evolution of private and public sector forecasts in the run up to recessions. We find that the ability to predict turning points is limited. While forecasts in recession years are revised each month, they do not capture the onset of recessions in a timely way and the extent of output decline during recessions is missed by a wide margin. This holds true for both private sector and official sector forecasts.

Our work does not provide an explanation for why recessions are not forecasted ahead of time. We suggest three classes of theories, which are not mutually exclusive, which could explain our findings.8 One class says that forecasters do not have enough information to reliably call a recession. Economic models are not reliable enough to predict recessions, or recessions occur because of shocks (e.g. political crises) that are difficult to anticipate. A second class of theories says that forecasters do not have the incentive to predict a recession. Included in this class are explanations that rely on asymmetric loss functions: there may be greater loss – reputational and other kinds – for incorrectly calling a recession than benefits from correctly calling one. The third class stresses behavioral reasons for why forecasters hold on to their priors and only revise them slowly and insufficiently in response to incoming information (Nordhaus, 1987). Regardless of the explanation for why recessions fail to be forecasted, we think that users of these forecasts need to be aware of this feature.

Appendix

Table A1.

Data Coverage of Consensus Forecasts

article image
article image
Table A2.

List of Recessions: Advanced Economies (86 Recession Episodes)

article image
article image
Note: Bold year indicates a crisis associated recession. Crisis data based on Laeven and Valencia (2008).
Table A3.

List of Recessions: By Year

article image
Table A4.

List of Booms: Advanced Economies (82 Boom Episodes)

article image
article image
Table A5.

List of Boom: By Year

article image
Figure A1.
Figure A1.

Evolution of Forecasts for Recession Episodes without Crisis

Citation: IMF Working Papers 2018, 039; 10.5089/9781484344873.001.A001

References

  • Abreu, I. (2011), “International Organisations’ vs. Private Analysts’ Forecasts: An Evaluation”, Banco de Portugal Working Paper, 21/2011.

    • Search Google Scholar
    • Export Citation
  • Batchelor, R. and P. Dua (1995), “Forecaster Diversity and the Benefits of Combining Forecasts”, Management Science, 41 (1), 6875.

    • Search Google Scholar
    • Export Citation
  • Coibion, O. and Y. Gorodnichenko (2015), “Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts”, American Economic Review, 105, 26442678.

    • Search Google Scholar
    • Export Citation
  • Coibion, O. and Y. Gorodnichenko (2012), “What can survey forecasts tell us about informational rigidities?Journal of Political Economy 120(1) 116159.

    • Search Google Scholar
    • Export Citation
  • Diebold, F.X. and R.S. Mariano (1995), “Comparing Predictive Accuracy,” Journal of Business and Economic Statistics, 13, 253263.

  • Dovern, J. (2013), “When Are GDP Forecasts Updated? Evidence from a Large International Panel”, Economics Letters, 120 (3), 521523.

    • Search Google Scholar
    • Export Citation
  • Dovern, J., U. Fritsche, and J. Slacalek (2012), “Disagreement among Forecasters in G7 Countries”, Review of Economics and Statistics, 94 (4), 10811096.

    • Search Google Scholar
    • Export Citation
  • Dovern, J., U. Fritsche, P. Loungani, and N. Tamirisa (2015), “Information Rigidities: Comparing Average and Individual Forecasts for a Large International Panel”, International Journal of Forecasting, 31 (1), 144154.

    • Search Google Scholar
    • Export Citation
  • Dovern, J. and N. Jannsen (2017), “Systematic Errors in Growth Expectations over the Business Cycle”, International Journal of Forecasting, 33 (4), 760769.

    • Search Google Scholar
    • Export Citation
  • Fintzen, D. and H.O. Stekler (1999), “Why Did Forecasters Fail to Predict the 1990 Recession,” International Journal of Forecasting, 15 (3), 309323.

    • Search Google Scholar
    • Export Citation
  • González Cabanillas, L. and A. Terzi (2012), “The accuracy of the European Commission’s forecasts re-examined”, European Economy, Economic Papers 476. Brussels: European Commission.

    • Search Google Scholar
    • Export Citation
  • IMF, Independent Evaluation Office (2014), “IMF Forecasts: Process, Quality and Country Perspectives”.

  • Laeven L. and F. Valencia (2008), “Systemic Banking Crises: A New Database”, IMF Working Paper, WP/08/224.

  • Lewis, C. and N. Pain (2015), “Lessons from OECD Forecasts during and after the Financial Crisis”, OECD Journal: Economic Studies, 2014 (1), 939.

    • Search Google Scholar
    • Export Citation
  • Loungani, P. (2001), “How Accurate are Private Sector Forecasts? Cross-country Evidence from Consensus Forecasts of Output Growth”, International Journal of Forecasting, 17 (3), 419432.

    • Search Google Scholar
    • Export Citation
  • Loungani, P., H. Stekler, and N. Tamirisa (2013), “Information Rigidity in Growth Forecasts: Some Cross-country Evidence”, International Journal of Forecasting, 29 (4), 605621.

    • Search Google Scholar
    • Export Citation
  • Mankiw, G., and R. Reis (2002), “Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve.” Quarterly Journal of Economics, 117 (4), 12951328.

    • Search Google Scholar
    • Export Citation
  • McNees, S.K. (1991), Forecasting Cyclical Turning Points: The Record in the Past Three Recessions. In K. Lahiri and G.H. Moore, Leading Economic Indicators: New Approaches and Forecasting. New York: Cambridge University Press.

    • Search Google Scholar
    • Export Citation
  • Nordhaus, W. (1987), “Forecasting Efficiency: Concepts and Applications”, Review of Economics and Statistics, 69 (4), 667674.

  • Sims, C. A. (2010), “Rational Inattention and Monetary Economics.” In Handbook of Monetary Economics, edited by B. Friedman and M. Woodford. Elsevier-North Holland, Vol. 3A, chapter 4, 155181.

    • Search Google Scholar
    • Export Citation
  • Sinclair, T. M., F. Joutz, and H. Stekler (2010), “Can the Fed Predict the State of the Economy?”, Economics Letters, 108 (1), 2832.

    • Search Google Scholar
    • Export Citation
  • Woodford, M. (2003), “Interest and Prices: Foundations of a Theory of Monetary Policy”, Princeton: Princeton University Press, 2003.

    • Search Google Scholar
    • Export Citation
  • Zarnowitz, V. (1991), “Has Macro-Forecasting Failed?,” NBER Working Paper No. 3867.

*

The authors are also grateful to Hites Ahir for assistance on an earlier version of the paper. The opinions expressed herein are those of the authors and do not necessarily reflect those of the IMF, its member states or its policy. The usual disclaimer applies.

2

While individual private sector forecasts may be subject to various behavioral biases (Batchelor and Dua, 1992), many of these are likely to be eliminated by averaging across several forecasters.

3

Given that starting dates are varied across countries, most of results in this paper are based on an unbalanced panel (i.e., countries enter the sample at different dates) to make use of all available information.

4

For a smaller set of countries, Loungani, Stekler and Tamirisa (2013) use a more elaborate way to define recessions based on quarterly data and a business cycle dating methodology. However, forecast assessments are fairly similar to those based on this simpler definition of a recession.

5

Subsequent work on the ‘sticky information model’ by Mankiw and Reis (2002) accounts for this inefficiency as due to fixed costs of updating information, whereas in the ‘noisy information model’ of Sims (2003) and Woodford (2003) the departure from efficiency occurs because people have limited ability to distinguish information from noisy signals.

6

Coibion and Gorodnichenko (2012, 2015) find that the degree of information rigidity declines significantly during US’ recessions. Using a large international panel, Dovern (2013) also finds that the degree of information rigidity is significantly lower during economic downturns.

7

The signs of the coefficients on the recession dummy are all negative and significant: forecast revisions are relatively larger for the recession years than those for normal years. Dovern et al. (2012) find that disagreement in growth forecasts significantly increases in recession years.

8

Another explanation could be that forecasters simply do not update their forecasts often enough to be alert to the onset of recessions? However, as shown in Figure 2, the consensus forecasts in recession years are revised every month; they just are not revised down enough to capture the onset of recessions. Related work by one of us, which looks at the behavior of individual forecasters rather than just the consensus, also finds that forecasts are updated quite often (Dovern, Fritsche, Loungani, Tamirisa, 2015).