Journal Issue

Fiscal Expectations Under the Stability and Growth Pact

Marcos Poplawski-Ribeiro, and Jan-Christoph Rülke
Published Date:
March 2011
  • ShareShare
Show Summary Details

I. Introduction

The signal and credibility gain that fiscal rules convey to financial markets are two main economic arguments for their implementation (Kopits, 2001; Braun and Tommasi, 2004; Drazen, 2004). A related proposition is that such rules provide guidance to market experts, increasing their awareness of adverse fiscal developments, and contributing to more transparency in the fiscal accounts (Manganelli and Wolswijk, 2007; Leeper, 2009).

In Europe, however, skepticism about the impacts of the Stability and Growth Pact (SGP) on the credibility of Europe’s fiscal institutions has been an issue since its inception (Beetsma and Uhlig, 1999; Beetsma, 2001). After the success of the Maastricht Treaty’s fiscal framework in the run-up to adoption of the euro, questions about enforcement and countries’ commitment to continued fiscal discipline were raised during the implementation of the SGP.1 Over time, with several European Union (EU) countries breaching the rules of the Pact, such concerns spiraled, generating an intense debate about its effectiveness and reliability.2 Eventually, the annulations of the excessive deficit procedures for France and Germany at the end of 2003 led to a reform of the SGP in 2005. The main objectives of the reform were to improve the fiscal rules and increase “the legitimacy of the EU fiscal framework” (European Commission, 2005).3

This paper assesses how the introduction and reform of the SGP changed fiscal expectations of financial market experts for the four largest European economies: France, Germany, Italy, and the United Kingdom (UK) between May 1993 and December 2007. Although the UK did not adopt the euro and, therefore, is not subject to the sanctions under the Pact, it is included in the sample as a benchmark to the other three countries, which are members of the euro area.

First, we check whether the introduction and reform of the Pact reduced inaccuracy and bias of market expert forecasts, using the Consensus Economics Forecasts monthly survey of professional economists’ deficit forecasts as a proxy for fiscal expectations. Second, we investigate whether convergence between those expert fiscal forecasts and the ones from the European Commission or from each country’s national fiscal authority (NFA) increased after the SGP.

To the best of our knowledge this is the first time fiscal rules have been analyzed using market expectations.4 Such an exercise is not straightforward. National budgets and fiscal policy are not always direct subjects of market speculation. They are usually planned once a year, with little real-time updating or monitoring of actual behavior during the budget period. Thus, the possibility exists that the forecasting of annual budgets until the crisis was not an exercise of great importance to market experts. When answering the fiscal part of their Consensus survey before the crisis, they could have ignored the SGP.

This could lead to divergences in the forecasts of market experts and national authorities. Different from more independent institutions, fiscal authorities may also be influenced by factors (e.g. political) other than technical issues when making their forecasts (Auerbach, 2007; and Leal and others, 2007). This may affect the accuracy and convergence between the forecasts of those two agents. Another more technical issue is related to the different definitions of fiscal deficits (e.g. net lending, cash basis, cyclically adjusted etc.). Market experts may have a different definition in mind when answering the survey than that used by the national authorities.5

Nonetheless, survey data as proxy for expectations has already been used in fiscal policy (see, for example, Heppke-Falk and Hüfner, 2004; and Allers, de Haan, and de Kam, 1998).6 Moreover, survey data and market expectations have been extensively employed in other economic fields, particularly in monetary and international economics. In monetary economics most papers use agents’ expectations to study policy credibility (Cukierman and Meltzer, 1986; Rogoff, 1987; Cukierman, 1992) and the impacts of imperfect knowledge, learning, and expectation formation on monetary policy.7 Another common application of this data is to assess the quality of international organization forecasts. But, most of these analyses focus on other macroeconomic variables (such as growth and inflation rates) rather than on fiscal variables.8

The main findings of this paper show that accuracy of deficit forecasts by market specialists increased in France after the SGP implementation. Moreover, convergence between market experts and the European Commission fiscal forecasts seems to have increased for France, Italy, and the United Kingdom. Nevertheless, such convergence seems not to have happened to the French, German, and Italian national fiscal authorities’ forecasts. These results suggest scope for further improvements in the forecasting accuracy of national and EU institutions to better anchor fiscal expectations.

The rest of the paper is structured as follows. Section II presents the dataset and preliminary tests on unbiasedness and efficiency of financial experts’ forecasts. Section III focuses on changes in expert forecast accuracy and bias owing to the introduction and reform of the SGP. Section IV tests whether the Pact affected the convergence and bias of market’s fiscal expectations compared to those of the European Commission or NFAs. Section V concludes.

II. Dataset and Descriptive Statistics

A. The Data Sample

Consensus Economics Forecasts (CEF) disaggregated monthly survey data on professional economic forecasts is used as a proxy for fiscal deficit expectations during the sample period of May 1993 to December 2007, summing up to 171 months.9 In the EMU, the fiscal survey is done for Germany, France, and Italy, covering two different forecast horizons: one for the end of the same year (same-year) and one for the end of the year ahead (year-ahead).

The CEF dataset has several advantages over other surveys and is less subject to some of the weaknesses often associated with survey data. First, individual forecasts are published together with the names of their companies. This makes those forecasts more accountable. It prevents a participant from reproducing others’ forecasts, limiting the possibility of herding behavior (Trueman, 1994). Moreover, because analysts are bound in their survey answers by their recommendations to clients, an analyst may find it difficult to justify why he or she gave a recommendation different from the one in the survey (Keane and Runkle, 1990).

Second, unlike some other surveys, professional economists who participate in the CEF poll not only take a stance on the direction of the expected change of a macroeconomic variable but also forecast the level of the macroeconomic variable. Third, the survey data is readily available to the public.10

Table 1 displays the average of the surveyed and actual values for: (i) the government general budget deficit; (ii) the real GDP growth rate; (iii) the three-month interest rate; (iv) the inflation rate (change in CPI); and (v) the interest rate on treasury bonds (T-bills).11 Averages of those variables are presented for the entire sample period (May 1993 to December 2007), and for the period before the implementation of the SGP (May 1993 to December 1998) and the subsequent period (January 1999 to December 2007). In turn, Figures 1 to 4 show the development of the expected same-year, year-ahead, and the actual budget balances for France, Germany, Italy, and the United Kingdom.12

Figure 1.France: Actual and Forecasted Budget Deficit, May 1993–December 2007

Source: Consensus Economics (2008), IMF (2008b), and authors’ calculations.

Figure 2.Germany: Actual and Forecasted Budget Deficit, May 1993–December 2007

Source: Consensus Economics (2008), IMF (2008b), and authors’ calculations.

Figure 3.Italy: Actual and Forecasted Budget Deficit, May 1993–December 2007

Source: Consensus Economics (2008), IMF (2008b), and authors’ calculations.

Figure 4.United Kingdom: Actual and Forecasted Budget Deficit, May 1993–December 2007

Source: Consensus Economics (2008), IMF (2008b), and authors’ calculations.

Table 1.Average of the Key Variables, May 1993––Dec 2007

(in percent, unless otherwise specified)a

CountryFranceGermanyItalyUnited Kingdom
Time period93–9899–0793–0793–9899–0793–0793–9899–0793–0793–9899–0793–07
Total budget deficit forecast (annual)b
Actual budget deficitc4.442.603.312.752.612.665.902.593.773.871.462.15
Real GDP growth forecast (annual)
Actual growth ratec1.702.141.971.431.501.471.351.471.423.132.792.93
Three-month interest rate forecast
Actual interest rated5.303.223.894.543.223.653.038.244.956.394.925.50
CPI growth rate forecast (annual)
Actual CPI growthc1.382.071.681.451.781.733.432.592.722.071.681.97
T-Bill forecast (annual)
Actual T-Billc6.234.395.167.054.545.608.774.566.407.334.805.84
Sources: Consensus Economics (2008); cIMF (2008b), and dOECD (2008).Notes: a Actual values corresponds to yearly averages between 1993 and 2007. b Values in percent of GDP. For France and Germany, total deficit is accounted in the calendar year. The revenues of the German government in 2000 (50 billion euros) were dropped out since they are not recorded in the total deficit. For Italy, budget deficit is accounted for in the fiscal year. For the United Kingdom, budget Public Sector Net Cash Requirements (PSNCR) in the fiscal year. Moreover, the revenues of the government’s auction of third-generation mobile telecommunications licences are included in the PSNCR for the UK (£19.5 billion).

The proximity of the forecasted and actual values in Table 1 and Figures 1 through 4 suggests at first glance that the expectations on macroeconomic variables are a good predictor for the actual value. Germany, for instance, has an average forecast between May 1993 and December 2007 for the budget deficit (inflation rate) of 2.71percent of GDP (1.80 percent), while the actual value is 2.66 percent of GDP (1.73 percent). Italy has an average forecast for the budget balance (interest rate) of 3.94 percent of GDP (4.94 percent), whereas the realized average value is 3.77 percent of GDP (4.95 percent).

B. Forecast Accuracy and Bias for the Whole Sample

As addition descriptive statistics, we test for the absence of bias and informational efficiency in the expert fiscal forecasts during the overall time period. For that, the same-year forecast error on government annual total deficit as a percent of GDP (ei,t,mt) for a particular country is defined as:

where the subscripts identify the forecaster i, year t, and month m of the forecast; while the superscripts identify the year t forecasted. Thus, di,t,mt is the forecast (or expectation) of a financial specialist i at the beginning of a given month13 1 m 12 of a year 1993 t 2007 for the total annual budget deficit as a percent of GDP in the end of the same year t. In turn, d2008t defines the realized annual deficit (in percent of GDP) as measured by the World Economic Outlook, March 2008 (IMF, 2008b) for a year t (see Table 2 for the list of all variables used in the paper).14

Table 2.List of Variables for the Estimations (in alphabetical order)
ΔyEC,t,10t+1Year-ahead real GDP growth forecast of the European Commission for a particular country in a year t.
Δyi,t,mt+h(Same-year or year-ahead) forecast of growth rate of real output (∆y) in month m of year t.
Δyj,t,1t+1Year-ahead real GDP growth forecast of a national fiscal authority for a particular country (or countries median) in a year t.
cpiEC,t,10t+1Year-ahead CPI inflation forecast of the European Commission for a particular country in a year t.
cpij,t,mt+hForecasted inflation rate for year t+h in month m of year t.
cpij,t,1t+1Year-ahead CPI inflation forecast of a national fiscal authority for a particular country (or countries median) in a year t.
d2008t+hActual (realized) total annual deficit in a year t (h=0) or t+1 (h=1).
dEC,t,10t+1Year-ahead deficit forecast of the European Commission for a particular country in a year t.
dEC,t1,10tPrevious-year deficit forecast of the European Commission for a particular country for year t.
di,t,mt+hSame-year or year-ahead forecast of total deficit (as a percentage of GDP) in month m of year t.
di,t,m1t+hLagged (same-year or year-ahead) forecast of total deficit in previous month (m-1) of year t.
di,t1,mt+hLagged (same-year or year-ahead) forecast of total deficit in previous year (t-1) in a particular month m.
dj,t,1t+1Year-ahead deficit forecast of a national fiscal authority for a particular country (or countries median) in a year t.
di,t1,1tPrevious-year deficit forecast of a national fiscal authority for a particular country (or countries median) for a year t.
ei,t,mt+hSame-year (h=0) or year-ahead (h=1) forecast error of annual total deficit in month m of year t.
ei,t,m1t+hLagged total deficit (same-year or year-ahead) forecast error of forecaster i in month m-1 of year t.
eletYear dummy equaling 1 in years of parliamentary elections and 0 otherwise.
ilongi,t,mt+hForecasted long-term (10-year bond) interest rate in month m of year t for the end of year t+h.
ishorti,t,mt+hForecasted short-term (3-month) interest rate in month m of year t for the end of year t+h.
I(Δyi,t,mt+h)Indicator function that equals 1 whenever fi,t,mΔyt(fi,t,mΔyt+1) is below its sample average; and 0 otherwise.
montht, mMonth trend, assuming value 1 for January up to 12 for December of a year t.
sgp1t, mMonth dummy corresponding to the old version of the SGP: equals 1 from July 1998 to June 2005; and 0 otherwise.
sgp2t, mMonth dummy covering the period of the reformed SGP: 1 between July 2005 and December 2007; and 0 otherwise.

Similarly, for each country, year-ahead (t+1) forecast errors of the budget deficit (as a percent of GDP) are written as:

where di,t,mt+1 is the forecast for the annual budget deficit (as a percent of GDP) for the end of the subsequent year t+1 (year-ahead) made by a specialist i at the beginning of a given month 1m12 of a year 1993t2007.

Bias is defined as the tendency to produce significant positive or negative errors. Hence, for each country, the Unbiasedness test is run by the following regression:

where h represents the forecast horizon, equaling 0 or 1 depending on whether forecast errors are for the same-year (h=0, or t) or year-ahead (h=1, or t+1), respectively; and εi, t,m is an error term. Unbiasedness prevails when α0 equals zero in (3).

Further, the difference between the forecast biases in “good” or “bad” economic times is also tested. Market expert forecasts might have been biased owing to difficulties in predicting turning points and economic downturns, as in the early 2000s in Europe (see Strauch, Hallerberg, and von Hagen, 2004). This test is then performed by estimating the following equation for each country in the sample:

where Δyi,t,mt(Δyi,t,mt+1) is the forecasted real GDP growth rate, Δy, for year t (year-ahead t+ 1); and I (·) is an indicator function that equals 1 whenever Δyi,t,mt(Δyi,t,mt+1) is below its sample average or 0 otherwise. In economic terms, the coefficient β1 allows us to trace out how the correlation between the forecast error of the expected budget deficit and the real GDP growth rate differs in times of economic downturns and booms.

A third test checks for informational efficiency. Forecasts are considered efficient if all information available at the time of the forecasts is used. Thus, we follow Mincer and Zarnowitz (1969) and Melander, Sismanidis, and Grenouilleau (2007) and estimate the following equation:

Weak efficiency requires that α2 = 0 and β2= 1 and that the error term is uncorrelated in time (Artis and Marcellino, 2001).15

Table 3 shows the results of the estimations of equations (3), (4), and (5) for the same-year (h= 0) and the year-ahead (h= 1) horizons. We use the Newey-West Panel estimator (Newey and West, 1987) to control for the autocorrelation of the forecasts. Regarding the Unbiasedness test (3), the highly significant and negative coefficient of α0 for France conveys that, on average, French financial experts underestimated the total French budget deficit between May 1993 and December 2007. This is particularly the case before the SGP (Table 1 and Figure 1), reflecting in part the substantial unexpected effect that a recession in Europe had on the actual French fiscal revenues in the early 1990s.16

Table 3.Tests for Unbiasedness, Nonlinear Unbiasedness, and Weak Efficiency, May 1993–Dec 2007
Same-Year ForecastsYear-Ahead Forecasts
Unbiasedness test








Nonlinear unbiasedness test
















Weak efficiency test
















β2 = 1b0.
Notes: Equations (3), (4), and (5) are estimated using New ey-West Panel estimator with cross-fixed effects. Values in parentheses report t-statistics. ***, **, and * indicate significance at 1, 5 and 10 percent respectively. at-Test under the null hypothesis that α1+ β1< 0. bt-Test under the null hypothesis that β2 = 1.

In Italy and the United Kingdom, same-year market forecasts were also negatively biased as their significant and negative values of α0 convey. In accordance with Figures 3 and 4, this “negative” bias suggests that during the entire sample period, market specialists made consistently optimistic forecasts about the budget deficit that did not materialized. In Germany, in turn, same-year expert deficit forecasts seem to be marginally pessimistic, which is in accordance with Figure 2. For one year-ahead forecasts only, market deficit forecasts for France appear to be biased and optimistic over the entire sample period.

The Non-Linear Unbiasedness test in Table 3 shows a negative α1 for all countries and specifications, except Germany in the same-year and Italy in the year-ahead. This finding implies that experts were overconfident in times of expected economic boosts for most of our sample countries. Conversely, they became overly pessimistic whenever an economic downturn was expected (positive coefficient for β1 in all specifications, except in France in the same-year version).

Regarding the weak efficiency test, for both horizons the null hypotheses that α2= 0 and β2 = 1 can be rejected. This suggests either that the information was not efficiently used by specialists when making their forecasts during the whole sample period; or could point to econometrics issues related to the estimation of equation (5).17 The coefficient β2 is lower in

the year ahead compared to the same year (except for Italy), indicating that forecast accuracy is lower for longer forecast horizons (see section III).

In sum, these findings suggest the presence of a forecast bias and the lack of weak informational efficiency in forecasts for the four large European countries during the entire sample period. In the following sections we will analyze these issues in more detail, focusing especially on the periods of the implementation and reform of the SGP.

III. Forecast Accuracy and Bias during the SGP

This section investigates the effects of the SGP on market expert forecast accuracy and bias. The introduction of the SGP in July 1998 led to more monitoring of the European national fiscal policies via two main channels: (i) the Stability and Convergence Programme (SCP) reports and medium-term objectives (MTOs); and (ii) the assessment of those reports by the European Commission.

The reform of the Pact aimed at introducing more flexibility and at strengthening the economic underpinnings and the national ownership of the EU’s fiscal framework. Thus, the two SGP versions could have helped market experts to make more accurate and less biased forecasts. This hypothesis is first tested by computing the root mean squared error (RMSE) of expected budget deficits (in terms of GDP) for each country:

where N is the total number of forecasters for a particular country, and ei,t,mt+h, is again the forecast error on budget deficit for either the same-year (h = 0), or year-ahead (h = 1) horizons.

Figures 5 and 6 show the development of the RMSEs for same-year- and year-ahead forecasts in the four European countries under analysis. As expected, RMSEs for same-year forecasts are much lower than those for year-ahead forecasts, showing a lower accuracy for longer-horizon forecasts. For both forecast horizons, the RMSEs also fell considerably between 1996 and 1999 compared to their initial values. This time span coincides with the run-up for entry in the euro area, indicating that in the years close to the adoption of the euro forecast accuracy improved among market participants.18 For the same-year forecasts the peak of the RMSE for the United Kingdom in 2000 can be attributed to unexpected revenues based on the government’s auction of third-generation mobile telecommunications licenses.19

Figure 5.RMSE for the Same-Year Forecasts of Budget Deficit, May 1993–December 2007

Source: Consensus Economics (2008), IMF (2008b), and authors’ calculations.

Figure 6.RMSE for the Year-Ahead Forecasts of Budget Deficit, May 1993–December 2007

Source: Consensus Economics (2008), IMF (2008b), and authors’ calculations.

In addition, Tables 4 and 5 show the average RMSE for same-year and year-ahead forecasts for different months throughout the time span of January 1994 to December 2007. Table 4 shows that the RMSE decreases over the course of each year for same-year forecasts (see also Figure 5). RMSEs often have the highest values in January, falling during the year to their lowest values in December owing to the smallest forecast horizon in that month. RMSEs of year-ahead forecasts, instead, exhibit a stepwise pattern without a pronounced month effect (see Table 5).

Table 4.RMSE of the Same-Year Forecast for Budget Deficit, 1994–2007
Notes: RMSE here is defined by Equation (6) for h = 0. TheilU=RMSE¯may1993jun1998RMSE¯jul1998dec2007 for a particular country. A value higher than 1 indicates that the RMSE is lower for the time period after the SGP introduction.
Table 5.RMSE of the Year-Ahead Forecast for Budget Deficit, 1994–2007
Notes: RMSE here is defined by Equation (6) for h = 1. TheilU=RMSE¯may1993jun1998RMSE¯jul1998dec2007for a particular country. A value higher than 1 indicates that the RMSE is lower for the time period after the SGP introduction.

The Theil’s-U statistics in Tables 4 and 5, in turn, indicate that RMSEs were lower for both forecast horizons during the SGP period (except for Germany for the year-ahead forecasts). This statistic compares average RMSEs (RMSE¯) between the time periods before and after the introduction of the SGP in July 1998 (i.e., TheilsU=RMSE¯1993,51998,6/RMSE¯1998,72007,12)) for each country in the sample.

A more formal econometric test of the SGP impact on forecast accuracy and bias in year-ahead deficit forecasts is performed along the same lines as Berger, Ehrmann, and Fratzscher (2009). It includes other explanatory variables to control for unobserved heterogeneities that are not accounted for the previous RMSE analysis. The test estimates the following equation:20

where ei,t,m1t+1 is the lagged year-ahead forecast error on budget deficit of forecaster i in month m−1 of year t; and xi,t,mt+1 is a vector of forecast errors on relevant economic variables. These are: (i) the year-ahead forecast error on real GDP growth rate (Δyi,t,mt+1Δy2008t+1); the year-ahead forecast error on inflation (cpii,t,mt+1cpi2008t+1); the year-ahead forecast error on the short-term (3-month) interest rate (i_shorti,t,mt+1i_short2008t+1); and the year-ahead forecast error on the long-term (10-year bond) interest rate (i_longi,t,mt+1i_long2008t+1).21

Further, elet is a dummy set equal to 1 in years of parliamentary elections and 0 otherwise.22 In turn, monthtt, m is a month trend, assuming value 1 for January up to 12 for December of a year t. The variables related to the SGP are the dummies sgp 1t, m and sgp2t, m. sgp 1t, m corresponds to the first phase of the SGP, set equal to 1 from July 1998 to June 2005 and 0 otherwise. In turn, sgp2t, m covers the reform of the SGP, equaling 1 between July 2005 and December 2007, and 0 otherwise. Finally, εi, t, m is an i.i.d. error term.

According to Auerbach (1995) and Leal and others (2007) three types of forecast errors may exist: policy, economic, and technical (behavioral) errors. Policy errors are due to errors regarding the course of fiscal policy, owing to the implementation of new, not yet announced by the forecast cut-off date, fiscal policy measures or cancellation of previously announced measures. Economic errors are those that can be explained by incorrect forecasts of macroeconomic variables used in the budget projections (for example, GDP). Finally, technical errors are due to other remaining factors, which may derive from behavioral responses as well as from model mis-specification on the fiscal side.23

The lagged dependent variable in equation (7) checks for persistency in the forecast errors (technical error). Growth forecast error is included because it could be negatively correlated with the forecast error on the budget deficit measured in percentage of GDP (economic error). Inflation forecast error is another variable that may affect the deficit forecast error, in particular when the tax indexation system is not perfect (Artis and Marcellino, 2001). Forecast error on interest rates may also affect forecasts on budget deficits owing to incorrect predictions on the debt service. The dummy for elections captures the effects of potential political budget cycles on forecast errors of market participants (policy error).24 Finally, the dummy montht, m controls for the monthly trend of forecast error as previously discussed (technical error).

After controlling for those variables, we test for the effects of the two SGP versions on the deficit forecast error via the dummies sgp1t, m and sgp2t, m, given the changes in the preventive arm that the reform of the Pact in 2005 promoted (see Morris, Ongena, and Schuknecht, 2006).

We perform two tests with equation (7). First, the regressions for our four sample countries are run using the absolute values of forecast errors of all variables in (7). In line with the analysis employing RMSEs, such test allows us to check whether accuracy in fiscal forecasts increased throughout the period of the SGP. In the second test, we estimate the regressions using instead the levels of the forecast errors. With such a specification, we can test the direction of the bias in the expert fiscal forecasts and whether the SGP led to overly optimistic or pessimistic forecasts.

Table 6 reports the results using individual fixed effects for each market specialist and the Newey-West Panel estimator.25 The first four columns display the results using the absolute values of the forecast errors (accuracy test), whereas the other columns show the estimations using forecast levels (Unbiasedness test).

Table 6.Impact of SGP on the Errors of the Year-Ahead Forecasts, May 1993–December 2007
Absolute Forecast ErrorForecast Error








Lagged dependent variable (ei,t,m1t)0.87***








Output forecast error0.08***








Inflation forecast error0.10***








Interest rate forecast error0.01**








Bond forecast error0.00








Month trend-0.01***








Election dummy0.01








SGP phase I dummy (sgp1i,t,m)-0.06***








Reformed SGP dummy (sgp2i,t,m)-0.05**








Observations (no. of groups)1,954 (31)2,939 (41)1,359 (28)3,021 (56)1,954 (31)2,939 (41)1,359 (28)3,021 (56)
Test statistic: Fixed effects (F-value)a2.68***1.49**1.40*1.32**3.54***1.71***2.24***1.87***
Goodness of fit: within0.93680.96190.84640.94960.96640.97480.93420.9788
Notes: Equation (7) is estimated using Newey-West Fanel estimator with cross-fixed effects. Values in parentheses report t-statistics. ***, **, and * indicate significance at 1, 5 and 10 percent respectively.a The null hypothesis of a common constant for all forecasters of the Fixed-effects test can be rejected in all specifications.

The positive and significant value of the constant in the first four columns shows a divergence (inaccuracy) between year-ahead deficit forecasts and realized values in all sample countries during the pre-SGP period. The positive and significant coefficient of the lagged dependent variable (ei,t,m1t+1) in all countries, in addition, corroborates the result of strong persistence in year-ahead forecast errors discussed in the analysis of RMSEs.

As expected, inaccuracy of real GDP growth forecasts significantly increased inaccuracy in markets’ year-ahead deficit forecasts in all countries except Italy. In Italy, the opposite sign of the coefficient could suggest that market experts have been overly pessimistic about year-ahead deficits. Italian specialists only forecasted deficits correctly when they were more optimistic about GDP growth. As for growth, higher forecasts errors for inflation also led experts to be significantly less accurate on deficit forecasts in all countries.

As discussed in the RMSEs analysis, the significant and negative coefficient for montht, m shows that year-ahead deficit forecast inaccuracy fell with the shrinking of the forecast-horizon for all countries. Moreover, forecast accuracy on year-ahead deficit was significantly boosted in election years in Germany. Accordingly, Strauch, Hallerber, and von Hagen (2004) find that fiscal plans became sounder during election years in Germany.26 The SGP introduction, in turn, seems to have improved market experts’ accuracy only in France (negative coefficient of sgp1t, m for that country). During the SGP reformed period, forecast accuracy remained high in France and worsened in Germany and Italy.

Turning to the analysis of forecast unbiasedness, the negative values for the constant in the last four columns of Table 6 suggest that market experts were optimistic in the United Kingdom and pessimistic in Italy pre-SGP (May 1993 to June 1998). The significant and positive coefficient of the lagged dependent variable (ei,t,m1t+1) for all countries reflects the persistence of deficit forecast errors over time.

Further, the coefficient on the GDP growth forecast error is also significant and negative for all countries. As expected, forecasters tended to predict higher deficits whenever growth forecasts were overly pessimistic. For example, a positive difference of 1 percent between the expected and realized growth rates led to a negative difference of -0.11 percent (overly optimistic) year-ahead forecast error on deficit in France. High inflation forecasts significantly boosted deficit forecasts in all countries. The same happened with higher short-term interest rate forecasts in France and Italy, while in the United Kingdom a higher short-term interest rate forecast made expert deficit forecasts fall. Hence, in the United Kingdom when experts predicted a high short-term interest rate they may have also expected a lower inflation rate, and, therefore, a deficit forecast. In turn, higher long-term interest rate forecasts were associated with higher deficits in France and the United Kingdom.

The dummy for election years is significant for all countries in the sample (except France), suggesting relevant effects of political budget cycles in markets’ fiscal expectations.27 In Italy and in the United Kingdom the coefficient of that variable is positive, suggesting the expectation of higher year-ahead deficits in those countries during election years.

During its first version, the Pact seems to have induced higher year-ahead deficit expectations in France and the United Kingdom, as suggested by their significant and positive coefficients of sgp1t, m. During the reformed SGP, this pessimism seems to have also appeared in Germany and Italy.

In summary, the findings in this section suggest a positive impact of the SGP in terms of expert fiscal forecast accuracy in France. However, the increase in fiscal policy monitoring on account of the SGP appears not to have increased accuracy of market experts in the other three big economies of the EU in any of its two versions.

IV. The Convergence of European Commission and NFAs Fiscal Forecasts with Market Forecasts

This section tests whether the European fiscal institutions forecasts and those of market experts converged after the introduction and reform of the SGP. The Convergence tests are applied for the two levels of European fiscal authorities involved in the SGP’s implementation: (i) the European Commission (EC), which is the supranational body responsible for enforcing the rules of the Pact and preparing the fiscal forecasts for the region; and (ii) the national fiscal authorities (NFAs) or countries’ treasuries, who run the national fiscal policies and prepare the national forecasts, MTOs, and SCP reports for assessment by the commission.

A. European Commission

We first examine the relationship between expert and commission fiscal forecasts. As in the previous section, here the focus is on the year-ahead forecasts, which provide a better idea of expectations over the medium term.

Figure 7 displays the EC and market expert year-ahead deficit forecasts. Commission data comes from its autumn (end of October/beginning of November) forecasts,28 whereas expert data corresponds to their forecasts at the beginning of November of each year. In the figure some correlation between EC and expert forecasts can be observed.

Figure 7.European Commission and Market Experts Year-Ahead Forecasts of Budget Deficit, May 1993 – December 2007

Sources: European Commission (2006) and (2007), Melander et al. (2007), and Consensus Economics (2008).

Such correlation is more formally analyzed by the following test (encompassing test) for each country in our sample:29

where di,t,11t+1 is the year-ahead deficit forecast among market specialists in November (m= 11) of year t; and dEC,t,10t+1 is the EC year-ahead deficit forecast for a particular country made in the autumn (end of October, or m= 10) of a year t. 30

Coefficient ß40 in (8) tests whether specialists encompassed commission deficit forecasts before the SGP (1993–1998).31 In turn, coefficients ß41 and ß42 measure the extent to which expert encompassing of EC forecasts changed during the old and reformed SGP period.

Table 7 displays the results of this test. The coefficient for dEC,t,10t+1, significant in all columns and robust for same-year forecasts, shows that market experts indeed encompassed EC forecasts in all sample countries and for their median pre-SGP (1993–1998). The value for Germany, for example, implies that German market experts enlarged their year-ahead deficit forecasts by 1.07 percent of GDP when the commission forecast went up by 1 percent of GDP. During both periods of the SGP, encompassing of commission forecasts increased significantly in Italy, but fell in Germany and for the median of all countries (in the latter, only during the first SGP).

Table 7.Encompassing Test for the European Commission: Year-Ahead Expected Deficit, 1993–2007




















Observations (no. of Groups)254 (33)338 (43)173 (33)363 (61)60 (4)
Test: Fixed effects (F-value)b2.63**2.00***0.872.50***2.84**
Goodness of fit: within0.93160.94050.96040.94740.8327
Notes: Equation (8) is estimated using New ey-West Panel estimator with cross-fixed effects. Values in parentheses report t-statistics.***, **, and * indicate significance at 1, 5 and 10 percent respectively. a Estimation using the median value of all countries. b The null hypothesis of a common constant for all forecasters of the Fixed-effects test can be rejected in all specifications.

The next test (convergence test) checks whether market and commission year-ahead forecasts converged over time. For that, the following regression is estimated:

where dEC,t1,10t is the EC previous-year deficit forecast for a particular country at the end of October (m= 10) for a year t; di,t1,11t is the market expert previous-year deficit forecast (in November, m= 11) for a year t; ΔyEC,t,10t+1 is the EC year-ahead real GDP growth forecast for a particular country in year t; and cpiEC,t,10t+1 is the EC year-ahead inflation forecast for a particular country in year t.

Equation (9) is estimated using two different versions of the differences between the commission and specialist forecasts. First, those differences are estimated in absolute values, testing for convergence between the two types of forecasters over time.32 Second, equation (9) is estimated with the differences in levels, checking for the direction of the bias between market and Commission forecasts33

Table 8 displays the results of the Convergence tests. The first five columns correspond to the estimation of the differences in (9) in absolute values. In those columns, the coefficients of the constant show that for all countries divergence between the Commission and market expert deficit forecasts were highly significant pre-SGP.

Table 8.Convergence Test: Difference of Specialists’ and European Commission’s Year-Ahead Forecasts for Budget Deficit, 1993–2007
Difference in Absolute ValuesDifference in Levels








































sgp1t, 11-0.07










sgp2t, 12-0.14**










Observations (no. of Groups)205 (30)260 (40)125(28)256 (52)56(4)205 (30)260 (40)125(28)256 (52)56(4)
Test: Fixed effects (F-value)b1.201.220.971.130.132.14**1.79***
Goodness of fit: within0.7590.4560.3970.4680.1880.8360.6560.6360.7590.294
Notes: Equation (9) is estimated using New ey-West estimator with cross-fixed effects. Values in parentheses report t-statistics. ***, **, and * indicate significance at 1, 5 and 10 percent respectively.a Estimation using the median value of all countries. b The null hypothesis of a common constant for all forecasters of the Fixed-effects test can be rejected in all specifications.

The coefficient of the differences in absolute values of the lagged deficit forecasts between the two forecasters is significant for France, the United Kingdom, and the countries’ median, indicating inertia in the divergence between the EC and market expert deficit forecasts in those countries. As expected, an increase in the divergence of real GDP growth forecasts between specialists and the commission augmented the divergence in the deficit forecasts for Germany, the United Kingdom, and the median of the countries.

The SGP dummies suggest that convergence in year-ahead deficit forecasts between markets and the commission during the first SGP went up in Italy but remained unaltered in the other countries. Thus, the commission and Italian market experts’ fiscal forecasts seem to have increased convergence during the first phase of the SGP. During the reformed-SGP, convergence increased in France, Italy, and the United Kingdom. In Germany, the over optimism of market experts in those periods seems to have deterred convergence.34

The last five columns of Table 8 show the estimates of the differences of (9) in levels. The significantly positive constant for the United Kingdom indicates a bias (optimistic) of expert forecasts toward lower deficits in percent of GDP than those forecasted by the commission pre-SGP. Germany is the only country where this bias is significantly negative (pessimistic), suggesting that during that period experts consistently predicted higher year-ahead deficits than the commission (see also Figure 7). For France, Italy, and for the median of countries no significant difference between market expert and commission forecasts is observed, indicating no bias among forecasters.

The differences in level of real GDP growth forecasts are significantly negative for all countries, except France. As expected, this finding indicates that when the commission was more optimistic about growth than experts, it also forecasted significantly lower year-ahead deficits.

The dummy for the first phase of the SGP conveys that optimism among market experts (relative to the commission) increased in Germany in that period. In contrast, in France, Italy, and the United Kingdom, previous market optimism pre-SGP seems to have turned to pessimism (compared to the forecasts of the commission). With the SGP reform, a (significant) optimistic bias is found again only in Germany, while in France and Italy, Wald tests (not shown here) indicate no significant differences (bias) between the two forecasters. As discussed above, this might be due to the higher convergence of their forecasts during this period in those two countries.

In sum, the results presented in this section suggests that the SGP led to an increase in the convergence between the commission fiscal forecasts and market experts in Italy during both periods and in France and the United Kingdom after its reform. Moreover, the Pact seems to have caused an increase in optimism of market expert forecasts compared to those of the commission in Germany.

B. National Fiscal Authorities

This section contrasts year-ahead forecasts of market experts with those of the national fiscal authorities or treasuries of our sample countries.35 We retrieve the country authorities’ forecasts (publicly available since 1999) from their Stability and Convergence Programme reports sent yearly to the European Commission36

Figure 8 displays a first comparison of those forecasts. The expert year-ahead deficit predictions appear to be correlated with those of the NFAs. Yet, expert forecasts are visually higher than those of the NFAs for the three countries in the euro area, indicating already overly optimistic forecast biases of those treasuries (compared to market expert forecasts).37

Figure 8.National Fiscal Authorities and Market Experts Year-Ahead Forecasts of Budget Deficit, May 1993–December 2007

Sources: 1 French, 2 German, 3 Italian, and 4 British Stability and Convergence Programme reports (several years); Consensus Economics (2008); and authors’ calculations.

As in the previous section, this issue is analyzed in more detail by first running an encompassing test, now using NFA (instead of Commission) year-ahead deficit forecasts for the reduced time sample between 1999 and 2007:

In (10) j = [France, Germany, Italy, United Kingdom, NFA¯] identifies each country’s NFA and the median of all countries (NFA);¯; dj,t,1t+1 corresponds to the year-ahead deficit forecast provided by an NFA j in January (m = 1) of a particular year 1999 ≤t≤2007.38 We also interact dj,t,1t+1 with the dummy for the reformed period of the SGP (sgp2t, 1) to check whether experts changed their encompassing of NFA deficit forecasts after the reform of the Pact.

The results of this test are shown in Table 9. For all countries as well as for their median, the significant coefficient of dj,t,1t+1 suggests that market experts have encompassed NFA deficit forecasts during the first version of the SGP (1999-2005). The encompassing value of NFA deficit forecasts by market experts seems to have fallen significantly only in Germany during the reformed SGP, but remained the same in all other countries.39

Table 9.Encompassing Test for the National Fiscal Authorities: Year-Ahead Expected Deficit, 1999–2007















Observations (no. of groups)98 (22)174 (35)92 (26)153 (44)32 (4)
Test: Fixed effects (F-value)b1.081.43*0.842.65***0.78
Goodness of fit: within0.89110.87850.69260.89720.2264
Notes: Equation (10) is estimated using New ey-West Panel estimator with cross-fixed effects. Values in parentheses report t-statistics. ***, **, and * indicate significance at 1, 5 and 10 percent respectively. a Estimation using the median value of all countries. b The null hypothesis of a common constant for all forecasters of the Fixed-effects test can be rejected in all specifications

Next, the Convergence and Unbiasedness tests are applied for the NFA’ forecasts as follows:

where t covers again the time span between 1999 and 2007; dj,t1,1t is the j NFA previous-year deficit forecast for a year t; di,t1,1t is the market expert previous-year deficit forecast (in January, m =1) for a year t; Δyj,t,1t+1 the j NFA year-ahead (t + 1) real GDP growth forecast in year t; and cpij,t,1t+1 is the j NFA year-ahead inflation forecast for a particular country in year t.

Again, we estimate (11) in two ways: one with the differences in absolute values (Convergence test); and the other using their levels (Unbiasedness test). The results of both tests are found in Table 10. The coefficient of the constant in the first four columns is highly significant and positive for all countries, indicating a significant divergence between the year-ahead deficit forecasts of those countries’ NFAs and market experts during SGP’s first version.

Table 10.Convergence Test: Difference of Specialists’ and National Fiscal Authorities’ Year-Ahead Forecasts for Budget Deficit, 1999–2007
Difference in Absolute ValuesDifference in Levels


















































Observations (no. of groups)76 (20)136 (30)65 (20)101 (31)32 (4)76 (20)136 (30)65 (20)101 (31)32 (4)
Test: Fixed effects (F-value)b5.75***0.610.681.612.60*2.87*1.311.231.141.65
Goodness of fit: within0.4330.1120.6170.5580.1900.9030.4910.7480.7110.388
Notes: Equation (11) is estimated using New ey-West estimator with cross-fixed effects. Values in parentheses report t-statistics. ***, **, and * indicate significance at 1, 5 and 10 percent respectively.a Estimation using the median value of all countries.b The null hypothesis of a common constant for all forecasters of the Fixed-effects test can be rejected in all specifications.

In addition, only in the United Kingdom, where the sanctions of the SGP are not applicable, the convergence of their NFA fiscal forecasts with the market forecasts seems to have significantly increased during the reformed Pact. For the other countries, the results remain statistically unaltered with a significant divergence between deficit forecasts of their respective NFAs and of market experts.

Regarding the estimation with the differences of (11) in levels, the constant is significant and negative for France, Germany, Italy, and the median of all countries. This suggests that during the first version of the SGP (1999–2005) market specialists in those countries significantly predicted higher year-ahead deficits than the NFAs (markets’ pessimistic bias). In the United Kingdom no bias is observed between the NFA and expert forecasts.

In turn, an increase in the (positive) difference of real GDP growth forecasts between the NFAs of France, Italy, the United Kingdom, and the countries’ median and that of market experts marginally pushed the pessimistic bias of market expert fiscal forecasts up (compared to those of the respective NFAs). This again indicates that the higher optimism about growth for the NFAs partially explains the lower year-ahead deficit forecasts of those authorities relative to the market forecasts.40

In addition, the positive and significant coefficient of sgp2t, 1 for France and Germany conveys that the magnitude of market forecast bias was significantly smaller in those countries during the reformed Pact. However, even though the bias coefficients statistically change in France and Germany during that period, no significant bias is found for any of the countries in the sample.41

Overall, the analysis in this section suggests a divergence between the NFA year-ahead deficit forecasts and the market experts forecasts in most of the countries in our sample. A significant convergence is, however, obtained for the median of all countries during both periods of the SGP. Moreover, during the reformed SGP, the convergence between Her Majesty’s (HM) Treasury fiscal forecasts and those of the British market experts increased, even though the United Kingdom is not subject to the sanctions under the Pact.

V. Conclusion

Economic literature on fiscal rules argues that one of the main motivations for their implementation is the information and signal they provide to financial markets on a fiscal authority’s commitment to fiscal discipline. This paper investigates the issue by analyzing how the introduction and reform of the Stability and Growth Pact have changed market experts’ expectations on fiscal policies of the four largest European economies: France, Germany, Italy, and the United Kingdom between 1993 and 2007 (pre-crisis period).

More specifically, Consensus Economic Forecast survey data on budget deficit forecasts is used to test whether the SGP increased accuracy and reduced bias among market forecasters compared to the realized values. In addition, convergence among market expert fiscal forecasts and those of the European Commission and the national fiscal authorities are tested during the two periods of the SGP.

Overall, the analysis suggests that in France accuracy of deficit forecasts by market experts significantly increased after the implementation of the SGP. Yet, the heightened monitoring of fiscal figures on account of SGP requirements seems not to have been sufficient to make market forecasts more accurate in the other countries analyzed.

In turn, convergence between the European Commission and the market experts deficit forecasts have increased in most of the countries (France, Italy, and the United Kingdom) during the SGP, particularly after the SGP reform in 2005. Nevertheless, with the exception of the United Kingdom, our findings indicate that convergence between the national fiscal authorities (NFA) fiscal forecasts and market experts did not increase during the Pact. Market experts were also more pessimistic than the NFAs on fiscal figures, mainly owing to the overly optimistic predictions of those authorities (Strauch, Hallerberg, and von Hagen, 2004, and Jonung and Larch, 2006).

These findings call for adoption of additional measures by the European (national and supranational) fiscal authorities to strengthen their fiscal planning and make forecasts more accurate. In this sense, accurate projections on growth and inflation are important. In addition, projections could also present a menu of the more interesting and relevant adjustments and show how other aspects of the macroeconomy are likely to evolve under each adjustment (Leeper, 2009). Particularly for the forecasts at the national level, independent and nonpartisan government agencies also could be established or enhanced (see Jonung and Larch, 2006; IMF, 2008a; IMF 2010; Debrun, Hauner, and Kumar, 2009).

This analysis offers various other possibilities for further research. For example, the signaling effects of SGP implementation could be tested in more detail. It would also be interesting to compare how forecasts of fiscal variables by market participants have changed in other OECD countries when compared to our sample countries. That would give a broader perspective to the European experience with the SGP, and show whether the improvement in fiscal forecasts was indeed an SGP effect or just a trend among advanced economies in the period investigated.


Calculation of the Forecasted Total Deficit as a Percentage of GDP

The expected nominal GDP forecast of forecaster i is calculated at month m and year t given its GDP and CPI forecasts. For the same-year forecast, the expected nominal GDP is computed at the end of the respective year as:42

The forecast horizon decreases over the course of the year as m increases (m= 1, 2,…, 12). The realized nominal GDP (ytnom) is obtained from the IMF (2008b). As a robustness check, the nominal GDP known at year t − 1 is also used to account for different time horizons and the real-time database of the OECD to account for different vintages of the GDP. The results, however, do not change and are available upon request.

In the next step, the same-year expected total deficit in terms of GDP, di,t,mt,, is constructed as:43

where defi,t,mt is the nominal total deficit in terms of local currency for a particular year t. Analogously, for the year-ahead forecast, the GDP and CPI forecasts for the current and the next year are employed to calculate the expected nominal GDP at the end of the next year.


    AfonsoAntónio2008Ricardian Fiscal Regimes in the European UnionEmpiricaVol. 35No. 3 pp. 313334.

    AllersMaartenJakobDe Haan and FlipDe Kam1998Using Survey Data to Test for Ricardian EquivalencePublic Finance ReviewVol. 26No. 6 pp. 565582.

    ArtisMichael and MassimilianoMarcellino2001Fiscal Forecasting: the Track Record of the IMF, OECD, and ECThe Econometrics JournalVol. 4No. 1S20S36.

    AuerbachAlan1995Tax Projections and the Budget: Lessons from the 1980sAmerican Economic ReviewVol. 85No. 2 pp. 165169.

    BatchelorRoy2001How Useful Are the Forecasts of Intergovernmental Agencies? The IMF and OECD versus the ConsensusApplied EconomicsVol. 33 pp. 225235.

    BayoumiTamimMorrisGoldstein and GeoffreyWoglom1995Do Credit Markets Discipline Sovereign Borrowers? Evidence from U.S. StatesJournal of Money Credit and BankingVol. 27 pp. 104659.

    BeetsmaRoel2001Does EMU Need a Stabiltiy Pact?” in The Stability and Growth Pact: the Architecture of Fiscal Policy in EMUed. by AnneBrunilaMarcoButi and DanieleFranco (New York: Palgrave).

    BeetsmaRoel and XavierDebrun2007The New Stability and Growth Pact: A first AssessmentEuropean Economic ReviewVol. 51No. 2 pp. 453477.

    BeetsmaRoel and HaraldUhlig1999An Analysis of the Stability and Growth PactEconomic JournalVol. 109No. 458 pp. 239258.

    BeetsmaRoelMassimoGiuliodoriMarkWalschot and PeterWierts2010Fifty Years of Fiscal Planning and Implementation in the NetherlandsDNB Working Paper No. 260August (Amsterdam: Dutch Central Bank).

    BergerHelgeMichaelEhrmann and MarcelFratzscher2009. “Forecasting ECB monetary policy: Accuracy is a matter of geographyEuropean Economic ReviewVol. 53 pp. 10281041.

    BlixMartenJoachimWadefjordUlrikaWienecke and MartinAdahl2001How Good Is the Forecasting Performance of Major Institutions?Penning-och valutapolitikVol. 3.

    BraunMiguel and MarianoTommasi2004Subnational Fiscal Rules: a Game Theoretical Approach” in Rules-based Fiscal Policy in Emerging Markets: Background Analysis and Prospectsed. by GeorgeKopits(New York: Palgrave).

    ButiMarcoSylvesterEijffinger and DanieleFranco2005The Stability Pact Pains: a Forward-Looking Assessment of the Reform DebateCentER Working Paper 2005-101Tilburg University.

    ButiMarco and Paulvan den Noord2003Discretionary Fiscal Policies and Elections: the Experience of the Early Years of EMUOECD Working Paper 351 (Paris: Organisation for Economic Co-operation and Development).

    CabralAntónio J.2001Main aspects of the Working of the SGP” in The Stability and Growth Pact: the Architecture of Fiscal Policy in EMUed. by AnneBrunilaMarcoButi and DanieleFranco(New York: Palgrave).

    CarrollChristopher D.2003Macroeconomic Expectations of Households and Professional ForecastersThe Quarterly Journal of EconomicsVol. 118No. 1 pp. 269298.

    ChangMichele2006Reforming the Stability and Growth Pact: Size and Influence in EMU PolicymakingJournal of European IntegrationVol. 28No. 1 pp. 107120.

    ChristodoulakisGeorge A. and Emmanuel C.Mamatzakis2009Assessing the Prudence of Economic Forecasts in the EUJournal of Applied Econometrics24 pp. 583606.

    CimadomoJacopo2007Fiscal Policy in Real TimeCEPII Working Paper 2007-10CEPII Research Center.

    ClementsMichael P.1995Rationality and the Role of Judgment in Macroeconomic ForecastingEconomic JournalVol. 105 pp. 410420.

    ClementsMichael P.2008Explanations of the Inconsistencies in Survey Respondents’ ForecastsWarwick Economic Research Papers 870Warwick University.

    CroweChristopher2010Consensus Forecasts and Inefficient Information AggregationIMF Working Paper 10/178 (Washington: International Monetary Fund).

    CukiermanAlex1992Central Bank Strategy Credibility and Independence (Cambridge, MA: MIT Press).

    CukiermanAlex and Allan H.Meltzer1986A Theory of Ambiguity, Credibility and Inflation under Discretion and Asymmetric InformationEconometricaVol. 54No. 5 pp. 10991128.

    DebrunXavierDavidHauner and Manmohan S.Kumar2009Independent Fiscal AgenciesJournal of Economic Surveys23 pp. 4481.

    DovernJonas and JohannesWeisser2008Are They Really Rational? Assessing Professional Macroeconomic Forecasts from the G7 CountriesKiel Working Paper 1447Kiel Institute for the World Economy.

    DrazenAllan2004Fiscal Rules from a Political Economy Perspective” in Rules-based Fiscal Policy in Emerging Markets: Background Analysis and Prospectsed. by GeorgeKopits(New York: Palgrave).

    European Commission2005Improving the Implementation of the Stability and Growth Pact. Presidency conclusions, Council of the European Union 7619/05, Annex II. European Commission 2006European Economy5autumn.

    European Commission2007European Economy 7autumn.

    GalíJordi and RobertoPerotti2003Fiscal Policy and Monetary Integration in EuropeEconomic Policy37 pp. 533572.

    Heppke-FalkKirsten and FelixHüfner2004Expected Budget Deficits and Interest Rate Swap Spreads: Evidence for France, Germany and ItalyDeutsche Bundesbank Discussion Paper 40/2004 (Frankfurt: Deutsche Bundesbank).

    HoldenKen and David A.Peel1990On Testing for Unbiasedness and Efficiency of ForecastsThe Manchester SchoolVol. 58No. 2 pp. 517533.

    IMF2008aFiscal Policy as a Countercyclical Tool” in World Economic OutlookOctober2008Chapter 5 pp. 159196 (Washington).

    IMF2008bWorld Economic Outlook DatabaseMarch.

    IMF2010Fiscal Consolidation in G-20 countries: the Role of Budget InstitutionsIMF Policy Noteforthcoming.

    JonungLars and MartinLarch2006Improving Fiscal Policy in EU: the Case for Independent ForecastsEconomic PolicyVol. 21No. 47 pp. 491534.

    JuhnGrace and PrakashLoungani2002Further Cross-Country Evidence on the Accuracy of the Private Sectors Output ForecastsStaff Papers International Monetary FundVol. 49No. 1 pp. 4964.

    KeaneMichael P. and David E.Runkle1990Testing the Rationality of Price Forecasts: New Evidence from Panel DataAmerican Economic ReviewVol. 80 pp. 714735.

    KeeremanFilip2003External Assumptions, the International Environment and the Track Record of the Commission’s ForecastsEconomic Papers 189 (Brussels: European Commission).

    KopitsGeorge2001Fiscal Rules: Useful Policy Framework or Unnecessary Ornament?IMF Working Paper 01/145 (Washington: International Monetary Fund).

    LealTeresaJavierPérezMikaTujula and Jean-PierreVidal2007Fiscal Forecasting: Lessons from the Literature and ChallengesECB Working Paper 843December (Frankfurt: European Central Bank).

    LeeperEric2009Anchoring Fiscal ExpectationsNBER Working Paper 15269.

    ManganelliSimone and GuidoWolswijk2007Market Discipline, Financial Integration and Fiscal Rules: What Drives Spreads in the Euro Area Government Bond Market?ECB Working Paper 745April (Frankfurt: European Central Bank).

    MankiwGregory and RicardoReis2002Sticky Information versus Sticky Prices: a Proposal to Replace the New Keynesian Phillips CurveQuarterly Journal of EconomicsVol. 117No. 4 pp. 12951328.

    MelanderAnnikaG.Sismanidis and DanielGrenouilleau2007The Track Record of the Commission’s Forecasts—an UpdateEconomic Papers291 (Brussels: European Commission).

    MincerJacob and VictorZarnowitz1969The Evaluation of Economic Forecasts” in Economic Forecasts and Expectations: Analyses of Forecasting Behaviour” NBER Studies in Business Cycles19.

    MorrisRichardHedwigOngena and LudgerSchuknecht2006The Reform and Implementation of the Stability and Growth PactECB Occasional Paper Series47June (Frankfurt: European Central Bank).

    NeweyWhitney and KennethWest1987A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelation Consistent Covariance MatrixEconometricaVol. 55No. 3 pp. 703708.

    Organisation for Economic Co-operation and Development (OECD)2008Economic Outlook DatabaseNo. 83June.

    OrphanidesAthanasios and John C.Williams2005The Decline of Activist Stabilization Policy: Natural Rate Misperceptions, Learning, and ExpectationsJournal of Economic Dynamics and ControlVol. 29No. 11 pp. 19271950.

    OrphanidesAthanasios and John C.Williams2006Monetary Policy with Imperfect KnowledgeJournal of the European Economic Association4 pp. 366375.

    OrphanidesAthanasios and John C.Williams2008Learning, Expectations Formation, and the Pitfalls of Optimal Control Monetary PolicyJournal of Monetary EconomicsVol. 55No. 1S80S96.

    van der PloegFrederick2007Prudent Budgetary Policy: Political Economy of Precautionary TaxationCESifo Working Paper 1973April (Munich: Ifo Institute for Economic Research).

    Poplawski-RibeiroMarcos2009New Evidence on the Effectiveness of Europe’s Fiscal RestrictionCEPII Working Paper 2009-13CEPII Research Center.

    Poplawski-RibeiroMarcos and RoelBeetsma2008The Political Economy of Structural Reforms under a Deficit RestrictionJournal of MacroeconomicsVol. 30 pp. 179198.

    PowerJohn and PeterAndrews2001Explaining the Difference between the Growth of M4 Deposits and M4 Lending: Implications of Recent Developments in Public FinancesBank of England quarterly bulletinsummer.

    ReitzStefanGeorgStadtmann and Mark P.Taylor2009The effects of Japanese Interventions on fx-Forecast HeterogeneityMPRA paper 15603July.

    RogoffKenneth1987Reputational Constraints on Monetary PolicyCarnegie-Rochester Conference Series on Public PolicyVol. 26 pp. 141182.

    StrauchRolfMarkHallerberg and Juergenvon Hagen2004Budgetary Forecasts in Europe: the Track Record of Stability and Convergence ProgrammesECB Working Paper 307February (Frankfurt: European Central Bank).

    TimmermannAllan2006An Evaluation of the World Economic Outlook ForecastsIMF Working Paper 06/59 (Washington: International Monetary Fund).

    TruemanBrett1994Analyst Forecasts and Herding BehaviorThe Review of Financial StudiesVol. 7 pp. 97124.

We thank Bernardin Akitoby, Carol Baker, Agnès Bénassy-Quéré, Helge Berger, Thiess Buettner, Martine Carré-Tallon, Jacopo Cimadomo, Christopher Crowe, Luc Everaert, Kevin Fletcher, Davide Furceri, Marc Gerard, Massimo Giuliodori, Manmohan Kumar, Jacques Mélitz, Ad van Riet, and the participants at the Centre d’Etudes Prospectives et d’Informations Internationales (CEPII), CESifo group, European Central Bank (ECB), Otto Beisheim School of Management (WHU), and University of Basque Country seminars and workshops for helpful comments. We are also grateful to Jenny Kletzin DiBiase for excellent editorial review.

International Monetary Fund.

WHU: Otto Beisheim School of Management.

The European fiscal framework is enshrined in the Maastricht Treaty of February of 1992. Further, to make the Treaty provisions more precise and operational, in June 1997 the European Council accepted a draft resolution of the SGP. In its first draft, the Pact comprised two main branches, one aimed at surveillance of fiscal policy and one aimed at dissuasion of fiscal profligacy. Enforcement of the surveillance part began on July 1, 1998, whereas enforcement of the dissuasive arm began on January 1, 1999 (see Cabral, 2001).

For an empirical analysis of the effectiveness of the SGP see Galí and Perotti (2003) and, more recently, Poplawski-Ribeiro (2009).

In an extraordinary meeting in March 2005, the EU finance ministers reached a deal on reforms to the SGP that were made official in the EU summit of heads of state in June of that year. The reform changed several items of the previous pact’s preventive and corrective arms. For a description and analysis of the reformed SGP, see, among others, Buti, Eijffinger and Franco (2005); Chang (2006); Morris, Ongena, and Schuknecht (2006); and Beetsma and Debrun (2007).

Some papers already tested the enforcement effects of credit markets on fiscal rules and discipline (see, for example, Bayoumi, Goldstein, and Woglom, 1995; and Manganelli and Wolswijk, 2007). Those papers, however, check this issue indirectly via changes in bond spreads instead of using straight market expectations.

Political influences can lead to biases in the fiscal authorities’ forecasts in both directions, pessimistic and optimistic. On one hand, the authorities may optimistically forecast GDP growth and fiscal figures (Jonung and Larch, 2006). On the other hand, the minister of finance may deliberately underestimate tax revenues to alleviate spending pressures (van der Ploeg, 2007; Beetsma and others, 2010). On the different deficit definitions used by market experts to answer the fiscal survey see further footnote 13 of this paper.

Heppke-Falk and Hüfner (2004) use survey data to investigate the relationship between interest rate swap spreads and budget deficits in three countries of the European Monetary Union (EMU)—France, Germany, and Italy—showing that, with the implementation of the SGP, hikes in expected deficits led to a fall in interest rate swap spreads in Germany and France. In turn, Allers, de Haan, and de Kam (1998) conducted a survey in the Netherlands with newspaper readers on their knowledge of government indebtedness and behavior in response to the fiscal policy stance, finding no significant evidence of Ricardian Equivalence on their sample.

The literature in this field is extensive. See among others: Clements (1995) and (2008); Mankiw and Reis (2002); Carroll (2003); Orphanides and Williams (2005), (2006), (2008); and Berger, Ehrmann, and Fratzscher (2009). In international economics, see, for example, Reitz, Stadtmann, and Taylor (2009).

CEF conducts the survey during the first week of each month and publishes the forecasts at the beginning of the second week of the respective month. Its participants are professional economists working for universities and financial institutions such as international economic research institutes and investment and commercial banks. The number of participants varies from country to country with the United Kingdom having the highest number of forecasters (66) and Italy the lowest (29). Further information on how the survey is conducted is available via the Internet:

Batchelor (2001) shows that Consensus Economics’ forecasts of six economic variables (the growth rates in real GDP, consumer expenditure, business investment, industrial production, the rate of consumer price inflation, and the unemployment rate) are less biased and more accurate in terms of mean absolute error and root mean square error than the OECD and IMF forecasts. Dovern and Weisser (2008) also find that the participants in the CEF poll provide rational and unbiased inflation and growth forecasts for the G7 countries.

For France and Germany, specialists forecast the government general budget balance (GTB) for the calendar year. For Italy, the forecast corresponds to the general budget balance for the fiscal year. For the United Kingdom, the fiscal variable forecasted is the public sector net cash requirements (PSNCR). For France, Germany, and Italy the variables are transformed to budget deficit figures. See notes on Table 1 for further information. Moreover, these forecasts are collected by Consensus Economics in local currency. Hence, we rewrite the forecasts in terms of GDP by combining real GDP and CPI forecasts. We compute the “forecasted” nominal GDP in the same way as in Heppke-Falk and Hüfner (2004). See the Appendix for more details on this calculation.

Given that this dataset forms an unbalanced panel, a minimum participation frequency for each forecaster is applied. Only those forecasters who participated at least ten times in the poll are included in the sample. Other minimum participation rates are also used, but the results (available upon request) do not change qualitatively.

Notice again that budget deficits are shown as positive values, that is, if a country increases (decreases) its debt position this is registered as a positive (negative) budget deficit. We use recently released data as a measure for the realized values (see notes on Table 1); using different cohorts of ex post data for the realized values does not alter the results significantly. These results are available upon request to the authors.

This null hypothesis of joint α = 0 and β = 1 is also a sufficient (but not necessary) condition for unbiasedness (Holden and Peel 1990).

Since this effect can also be due to a lower growth rate than expected in the period, we have double-checked this effect by estimating the unbiasedness test (3) also with the nominal value of deficit besides its ratio over GDP. We found again that the fiscal forecasts were too optimistic for that particular period.

The residuals may be serially correlated, or the coefficient β2 may be downward biased since the regression pools across different forecasters for the same underlying forecast. For a given forecast country and period, the dependent variable d2008t+h is fixed, so that the right hand side variable di,t,mt+h and the error term εi, t, m are negatively correlated by construction. See Crowe (2010) for a discussion on econometric issues of estimations using survey data.

Strauch, Hallerberg, and von Hagen (2004) find the same dynamics for fiscal authorities’ forecasts of EU member states.

In the 2000 budget the government forecasted an overall central government net cash requirement (CGNCR) of -£4.1 billion for the financial year 2000/2001. But the actual cash requirement for that year was far lower, at -£35.2 billion (3.7 percent of GDP). Of this extra cash, -£19.5 billion arose from proceeds of the third-generation mobile telecommunications licenses, with the rest owing to a generally more favorable fiscal position than expected (Power and Andrews, 2001).

We use year-ahead instead of same-year forecasts in (7) given that this horizon reflects better medium-term expectations of market specialists. Moreover, the longer the forecast horizon the higher the uncertainty and, therefore, the more their expectations could depend on the credibility of the SGP.

As a robustness check, we also estimate equation (7) excluding the long-term interest rate. Results do not change qualitatively and are available upon request.

The parliamentary election variable is constructed with the dataset of the website of the International Institute for Democracy and Electoral Assistance (IDEA) available at combined with information available at See also Poplawski-Ribeiro (2009).

In the particular case of Europe, Leal and others (2007) claim that judgment is an important ingredient in fiscal forecasting because policy measures are not always well specified in the relevant government documents.

Strauch, Hallerberg, and von Hagen (2004) discuss two reasons incumbent governments may want to issue biased forecasts on budget deficits in election years, which could induce errors in market experts’ predictions. First, incumbents may try to provide a picture of a healthy economy and fiscal discipline to their electorate (see also Jonung and Larch, 2006). Second, they may seek to boost the economy with a fiscal expansion before elections in order to improve their chances of reelection.

We perform the same analysis using same-year forecast errors (results are available upon request). The main difference is that for same-year forecasts, besides France, market experts in Italy and in the United Kingdom also became more accurate during the second version of the SGP.

These authors argue that German governments may put a premium on ‘getting the house in order’ during the election year. Alternatively, authorities may want to tie in the fiscal options of their successor if they face only a small probability of reelection (Strauch, Hallerber, and von Hagen, 2004).

Several authors have discussed the importance of political budget cycles for the SGP and European fiscal policies (see, among others, Buti and van den Noord, 2003; Afonso, 2008; Poplawski-Ribeiro and Beetsma, 2008; Poplawski-Ribeiro, 2009).

Data on the European Commission forecasts are obtained from Melander, Sismanidis, and Grenouilleau (2007) and augmented with European Commission (2006) and (2007). We thank Annika Melander and coauthors for sharing their dataset.

The encompassing test is also performed using OECD forecasts from Cimadomo (2007), who we thank for sharing the data. Some authors argue that the OECD is freer from political pressures from member states’ fiscal authorities than the EC (Artis and Marcellino, 2001), which could affect forecast encompassing by the markets. Our main results, however, are robust to the use of OECD data.

Given that annual (and not monthly) data frequency is used in (8), the number of observations is reduced by the factor twelve compared to those in the previous analyses. Moreover, sixty observations are available for the median of budget deficit forecasts covering each of the four countries in the sample between 1993 and 2007.

Yet, in the case of strong persistence of market forecasts, the coefficient may simply suggest that they are highly correlated with the ECB forecasts given that both forecasters are estimating the same underlying variable.

In monetary economics Cukierman and Meltzer (1986) and Cukierman (1992) interpret more convergence between the forecasts of the central bank and those of private agents as a gain in credibility. Cukierman (1992), for example, defines policy credibility as “…a continuous measure that is inversely related to the absolute value of the difference between the central bank’s (policymaker’s) plan and the public’s beliefs about those plans.” [pp. 207]. For him, the smaller this difference, the higher the credibility of a planned policy.

Christodoulakis and Mamatzakis (2009) show that European Commission tends to display optimistic year-ahead fiscal forecasts for government balance, while same-year forecasts tend to be pessimistic. Further, Leal and others (2007) find that this optimistic bias occurs in periods of deficit increases, whereas the pessimistic bias happens in periods in which the budget balance improves. The cause is the poor record by the commission in anticipating turning points in economic activity. Another factor that may explain commission forecast errors is the realism of the assumptions about the international economic environment (Melander, Sismanidis, and Grenouilleau, 2007). Keereman (2003) shows that the last reason may explain up to about 60 percent of the forecast error in EU year-ahead forecasts for GDP and inflation.

This result may also suggest that the Commission has improved its forecasting methodologies owing to closer monitoring of countries after the reform of the SGP, or simply to learning by doing.

These national fiscal authorities (NFAs) are the following: (i) Ministère de l’Economie, de l’Industrie et de l’EmploiMinefe (France); (ii) German Bundesministerium der Finanzen (Germany); (iii) Ministero dell’Economia e delle Finanze (Italy); and (iv) HM Treasury (United Kingdom).

These reports are usually sent to the European Commission at the end of the previous year (December) or the beginning of January of the year in analysis. Then, the European Commission analyzes the programs and makes its evaluations public around February of the same year. The sample period in this section, thus, spans from January 1999 to January 2007. Both reports—the SCP and commission assessments-are available at policy/sgprogrammes9147en.htm.

Accordingly, Strauch, Hallerberg, and von Hagen (2004) analyze the performance of budgetary balance and economic growth forecasts made in 126 SCPs between 1991 and 2002. They conclude that in different countries the budget surpluses and economic growth forecasts are marked by optimistic biases, which were more apparent during the Maastricht convergence process. Moreover, the need for convergence to reach the budgetary reference value of the Maastricht Treaty was associated with more restrictive fiscal projections in program starting before 1998, whereas election cycles played a stronger role thereafter.

For example, dFrance,t,1t+1 represents then the year-ahead deficit forecast provided by the French Minefe in its SCP report for the European Commission in January (m = 1) of a year 1999 ≤ t ≤ 2007. In turn, dNFA¯,t,1t+1 corresponds to the median of year-ahead deficit forecasts of the fiscal authorities of all four countries our sample in a particular year t.

A Wald test of significance of coefficients (not shown here) indicates that the sum of dj,t,1t+1+dj,t,1t+1×sgp2t,1 significantly different from zero for all countries.

Accordingly, Jonung and Larch (2006) find that in three of the four largest EU countries the ex ante assessment of potential GDP growth has generally been more optimistic than on an ex post basis (particularly in Germany and Italy). In Jonung and Larch’s estimations, only the United Kingdom Treasury appears to have followed a somewhat more prudent approach when assessing the medium-term growth outlook of its economy.

This finding comes from a Wald test of coefficient restrictions (not shown here) testing whether α7+β74sgp2t, 1≠0.

The same procedure has been applied by Heppke-Falk and Hüfner (2004).

By doing this calculation, deft is assumed not to be correlated with yt+knomfor k > 0.

Other Resources Citing This Publication