Do IMF-Supported Programs Help Make Fiscal Adjustment More Durable?
Author:
Soojin Moon https://isni.org/isni/0000000404811396 International Monetary Fund

Search for other papers by Soojin Moon in
Current site
Google Scholar
Close
and
Mr. Ales Bulir
Search for other papers by Mr. Ales Bulir in
Current site
Google Scholar
Close

Contributor Notes

Author’s E-Mail Address: abulir@imf.org; smoon@ucla.edu

This paper investigates fiscal developments in 112 countries during the 1990s. It finds that, while the overall fiscal balance improved in most of them, the composition of this improvement differed. In nonprogram countries, revenues increased modestly and expenditure declined sharply, while in program countries both revenue and expenditure declined. However, in countries with programs that included structural conditions the adjustment was effected primarily through sharp expenditure compression. We did not find evidence of a statistically significant impact of IMF conditionality. Morever, fiscal improvements are strongly influenced by cyclical factors

Abstract

This paper investigates fiscal developments in 112 countries during the 1990s. It finds that, while the overall fiscal balance improved in most of them, the composition of this improvement differed. In nonprogram countries, revenues increased modestly and expenditure declined sharply, while in program countries both revenue and expenditure declined. However, in countries with programs that included structural conditions the adjustment was effected primarily through sharp expenditure compression. We did not find evidence of a statistically significant impact of IMF conditionality. Morever, fiscal improvements are strongly influenced by cyclical factors

I. Introduction

What determines the composition of fiscal adjustment and does it differ between countries with IMF-supported programs and those without such arrangements? Does participation in IMF-supported programs lower the overall cost of adjustment? Moreover, how effective is IMF conditionality? This paper attempts to answer these questions by investigating fiscal developments in 112 countries during the 1990s, some with and some without IMF-supported programs.

A central objective of IMF-supported programs has typically been to reduce external imbalances.2 The cornerstone of most IMF-supported programs has in most cases been fiscal adjustment: first, current account deficits are often caused by fiscal profligacy and, second, even if the initial budgetary position is sustainable, additional fiscal tightening may be needed if the domestic currency comes under pressure (International Monetary Fund, 1996 and Ghosh et al., 2002). This adjustment has been part of broader medium-term macroeconomic programs that also encompass selected supply-side-oriented structural reforms relevant for external stability.

This paper examines the medium-term pattern of fiscal adjustment in countries with and without an IMF-supported program. It finds significant differences in the composition of adjustment between these two groups of countries as well as large differences among program countries. In nonprogram countries, revenue increased modestly and expenditure declined sharply, while in program countries both revenue and expenditure declined. Moreover, in IMF-supported programs that included structural conditions, the adjustment was effected primarily through sharp expenditure compression in order to offset revenue declines. We did not find any evidence that revenue-related structural conditions improved revenue performance after the end of the program. However, the structural content of an IMF-supported program is not exogenous; the choice of structural conditions generally reflects the underlying macroeconomic and structural weaknesses in the country in question, and these factors also influence the fiscal outturn. Moreover, fiscal developments were strongly affected by the business cycle.

The paper is organized as follows. First, we review the stylized facts and define the sample. Second, we describe the techniques used in our estimations. Third, we present and discuss our results. The fourth section concludes.

II. IMF Programs and Fiscal Developments

A. How to Measure the Impact of IMF-Supported Programs?

What is the impact of IMF-supported programs on fiscal adjustment? In the literature, three different influences have been construed. One view is that those programs provide external resources in countries with financing needs possibly going beyond the financing provided by the IMF itself to the extent that they have a catalytic effect—thus permitting needed adjustments to take place at lower costs than in the absence of such an arrangement. This description is close to the official IMF view of its role.3 A second view is that, those programs prescribe faster (according to the writers, too fast) adjustment on developing countries than would take place in their absence, by uniformly requiring monetary tightening, expenditure cuts, and higher taxes, hurting both the poor and businesses in the process. A third view is that IMF-supported programs permit countries to postpone wider adjustments, merely treating the symptoms of financing needs by repeated lending to crisis-prone and structurally unstable countries (see, for example, Bird, 1996).

Which view is the closest to reality? Empirical assessments of the impact of IMF-supported programs are notoriously complex. Countries’ macroeconomic performance is influenced by secular forces, external shocks, structural reforms (with or without the involvement of the IMF), and temporary availability of IMF-linked financing. The initial conditions and exogenous shocks need to be separated from the effects of IMF-supported arrangements, because countries that do not undertake such programs are not an appropriate control group for IMF-program countries (Krueger, 1998).4 An appropriate technique is the General Evaluation Estimator (GEE), due to Goldstein and Montiel (1988), which constructs the counterfactual of economic policies first and then tests the importance of IMF-supported programs. This approach has been successfully tested, inter alia, by Khan (1990), Conway (1994), and Dicks-Mireaux et al. (2000).

The major problem in the GEE studies is how to control for political economy and conditionality effects that are difficult to quantify and yet may be crucial for macroeconomic adjustment. First, the eventual success of IMF-supported programs may be determined by domestic political economy conditions that influence society’s willingness to reform (Ivanova et al., 2003; Khan and Sharma, 2001; or Boughton and Mourmouras, 2002) as opposed to the technical design of the program or the amount of money borrowed. Intuitively, IMF-supported programs tend to be more successful in countries where they augment home-grown reform than in countries where the Fund (and other donors) try to impose reform on unwilling authorities. Second, it is possible that the effectiveness of IMF conditionality, and structural conditionality in particular, affects the success of individual programs. For example, some authors have argued that the impact of Fund conditionality is governed by a “Laffer-curve” relationship, whereby a few, well-targeted conditions have a positive impact on economic performance under the program, but too many or too intrusive conditions may hinder such performance (Collier et al., 1997 and Goldstein, 2000). Both effects are difficult to measure and, until recently, limited data have been available to test their impact empirically (see International Monetary Fund, 2001).

B. What Is IMF Conditionality?

Conditionality is an explicit link between the approval (or continuation) of the Fund’s financing and the implementation of certain aspects of the authorities’ policy program (Guitián, 1981). The conditions may be either quantitative (say, a limit on reserve money growth) or structural (say, the introduction of a value-added tax).5 In general, conditionality is designed to encompass policy measures that are critical to program objectives or key internal data targets that sound warning bells if policies veer off track. Whereas in the mid-1980s structural conditionality in IMF-supported arrangements was rare, by the mid-1990s most programs included some structural conditions. In quantitative terms, the average number of structural conditions per program year increased from two in 1987 to more than 16 in 1997.6

These developments were the result of several forces. First, the IMF has over time placed more emphasis on economic growth and supply-side reforms as compared to demand management. Second, the IMF’s involvement in low-income and transition countries focused the overall policy package on the alleviation of the structural imbalances and rigidities prevalent in these economies. Finally, the past experience with monetary and fiscal policies indicates that their success depends critically on structural conditions. Indeed, the need to underpin macroeconomic policies is reflected in the fact that most structural conditions have been in the core area of IMF expertise.

In this paper, we focus on three main types of structural conditions (Table A1-2): (i) prior actions, which are stipulated as preconditions to an IMF-supported program (Thomas, forthcoming), (ii) structural performance criteria, fulfillment of which is a formal precondition for program continuation, and (iii) structural benchmarks, which are agreed with the authorities and monitored by the IMF staff, but are not a formal precondition for program continuation. However, if donor-favored structural benchmarks had not been observed, they were in some cases upgraded into either prior action or performance criteria in the subsequent program reviews.7 In some sense, the extent of structural conditionality was determined endogenously—countries with a history of poor performance tended to get more conditions. Quantitatively, the majority of structural conditions were structural benchmarks, while structural performance criteria were the least numerous conditions.

All but two IMF-supported programs with structural conditionality contained at least one condition in the fiscal area. Indeed, fiscal structural conditionality has been the most frequent area of IMF structural conditionality (International Monetary Fund, 2001). Narrowly defined, fiscal structural conditions comprised about 30 percent of all structural conditions in 1987-99, but their share rose to more than 50 percent when they were defined more broadly as all structural measures with revenue or expenditure implications. Typically, the frequency of fiscal structural conditionality was highly correlated with overall structural conditionality. While many fiscal structural conditions were designed as neutral vis-à-vis the overall fiscal balance, most conditions—both narrowly and broadly defined—were geared toward higher revenue or lower expenditure. We classify all those measures according to their expected revenue or expenditure impact and present their summary in Table 1.8

Table 1.

Distribution of Structural Fiscal Conditionality

article image
Source: MONA; authors’ calculations. See Table A1-2 for the sample countries and areas.

Only fiscal sector conditions as classified by MONA and International Monetary Fund (2001).

Conditions with a clear fiscal impact (tariff reform, privatization, enterprise reform, and so on).

Adjusted for the length of the program.

Implemented conditions/total conditions.

Conditions with an identified impact on the overall balance.

Revenue and expenditure conditions without a clear impact on the overall balance.

C. Some Stylized Facts About the Fiscal Developments in the 1990s

The fiscal stance is affected by the business cycle, debt sustainability, and political economy factors. First, the overall balance is influenced by cyclical conditions, namely falls and rises in revenue and expenditure during in economic contractions and expansions.9 Second, the choice of the fiscal stance is bounded: it may not be possible to finance the deficit preferred by the public or the impact of the revenue/expenditure mix may have side effects that would render the balance unsustainable (Tanzi and Schuknecht, 1995). Third, the components of the overall fiscal balance are public choice variables and voters decide how much tax they want to pay and how they want the proceeds to be spent (Drazen, 2000).

The fiscal position improved in the 1990s across the board. Although the motivation for fiscal consolidation differed across countries—in some the improvement was cyclical in nature, in others it was stimulated by crowding out of the private sector, and in a few it was the result of unsustainable debt levels—the overall fiscal balance improved markedly during a seven-year period between the early and late 1990s. The magnitude of the fiscal adjustment was not uniform and nonprogram countries improved their fiscal balances by more that those with IMF-supported programs.10

On average, the actual overall balance improved between 1993 and 1999 by almost 2 percentage points of GDP (Table 2 and Figures 1 and 2).11 Although the improvement was much larger in nonprogram countries than in countries with IMF-supported programs (3 percentage points and ½ of a percentage point, respectively), large differences prevailed among program countries. For example, program countries without any structural measures worsened their balances by some 2 percentage points, while those with structural conditionality improved it by more than 3 percentage points (Table 2). Transition countries, which were evenly split between structural and nonstructural programs, show surprisingly little change in their fiscal balances. All these findings are robust to the choice of the end-period observation: our results change little whether we assess them one, two, or three years after the end of the program.

Figure 1.
Figure 1.

Three-year Changes in Fiscal Indicators, Summary 1/, 2/

(In percent of GDP, 97 countries)

Citation: IMF Working Papers 2003, 038; 10.5089/9781451845716.001.A001

Source: World Economic Outlook; author’s calculations.1/ Three years after the end of the IMF-supported program(s) or 1999 for nonprogram countries. The median initial observation is 1993 and the median end-period observation is 1999.2/ The significance of the slope coefficient at the 95 and 99 percent levels is denoted by ‘*’ and ‘**’, respectively.
Figure 2.
Figure 2.

Three-year Changes in Fiscal Indicators, By Program Type 1/, 2/

(In percent of GDP)

Citation: IMF Working Papers 2003, 038; 10.5089/9781451845716.001.A001

Source: World Economic Outlook; author’s calculations.1/ Three years after the end of the IMF-supported program(s) or 1999 for nonprogram countries. The median initial observation is 1993 and the median end-period observation is 1999.2/ The significance of the slope coefficient at the 95 and 99 percent levels is denoted by ‘*’ and ‘**’, respectively.3/ IMF-supported programs without fiscal structural conditionality.
Table 2.

Fiscal Outcomes for Program and Nonprogram Countries in the 1990s 1/

(In percent of GDP)

article image
Source: World Economic Outlook; authors’ calculations.

Three years after the end of the IMF-supported program(s) or 1999 for nonprogram countries. The median initial observation is 1993 and the median end-period observation is 1999.

How was the fiscal adjustment effected? First, we find that revenue adjustment was typically much weaker than expenditure adjustment. Second, the expenditure adjustment was very strong in structural program countries, while in nonstructural program countries expenditure actually expanded after the programs had ended.

Revenue and grants, taking the sample as a whole, declined by about ¼ percentage point of GDP, remained unchanged in nonprogram countries, and declined by 1 percentage point of GDP in program countries. The decline was more pronounced in structural conditionality countries than in program countries without those conditions: being 2 percentage points of GDP and ⅓ percentage point of GDP, respectively.12 The difference could be partly explained by a decline in aid receipts, because aid as a percentage of GDP declined in those countries by some 5 percentage points and 3 percentage points, respectively. This is not likely to be the complete explanation, however: grants, which are here counted as a part of revenue, are typically one-third of total aid in aid recipient countries (see Bulíř and Hamann, forthcoming). Hence, the decline in total aid would imply a grant contribution to the revenue decline of only 2 percentage points of GDP and 1 percentage point of GDP, respectively.

Expenditure and net lending, taking the sample as a whole, declined by 2 percentage points of GDP—the figure being rather higher in nonprogram countries and somewhat lower in program countries. As before, we found large differences in the latter group. Expenditure and net lending increased in nonstructural program countries by more than 1 ½ percentage point of GDP, while it declined by about 5 percentage points in structural conditionality countries. The latter result seems consistent with the hypothesis that the initial level of spending in structural conditionality countries was too high and its decline brought it to a more appropriate level (Gupta et al., 2002).

Some of the above results are puzzling and suggest that we need to control for exogenous and program-specific factors. First, the initial overall deficits in nonstructural program countries were smaller than those in structural program countries and presumably did not pose such a threat to macroeconomic stability. Second, the sample contains several transition countries, whose fiscal situation worsened in the mid- and late-1990s, and countries that were hit hard by the 1997-98 crisis in Asia. Third, the nature of the initial disequilibrium differed across countries: in countries without structural conditions, GDP had declined more sharply prior to the program, and their rates of inflation were higher (Table 3). Fourth, programs containing structural conditionality had a higher incidence of program interruption.13 Finally, programs that did not include structural conditions were mostly short-term in nature, that is, Stand-By Arrangements (SBA) and these countries were comparatively richer. In contrast, the IMF-supported programs with heavy structural content were mostly low-income countries, supported by the Enhanced Structural Adjustment Facility (ESAF) and the Poverty Reduction and Growth Facility (PRGF). The last finding seems to be consistent with the professed goal of structural conditionality: to deal with structural weaknesses limiting growth potential. All these caveats suggest that the selection of countries (program vs. nonprogram, with vs. without structural conditions) is nonrandom and that this sample attribute has to be addressed empirically and in a systematic fashion.

Table 3.

Selected Characteristics of Program and Nonprogram Countries

article image
Source: World Economic Outlook, authors’ calculations.

Average for 1993-94.

In 1995 US dollars.

In percent of GDP.

Percentage change.

Program stoppage occurs if either: (i) the last scheduled program review was not completed; or (ii) all scheduled reviews were completed but the subsequent annual arrangement was not approved in ESAF/PRGF arrangements. If a country had more than one program during this period, one stoppage overrides one or more successes.

Average for 1997-99.

III. Specification of the Model

In previous sections we argued that fiscal developments are affected by various exogenous and country-specific effects and, hence, a simple averaging may conceal important relationships. Therefore, we will reexamine the results in multivariate panel and cross-country regressions.

The econometric investigation of the role of IMF-supported programs has traditionally been motivated by the following question (Dicks-Mireaux, et al., 2000): “Did the involvement of the IMF significantly improve the macroeconomic outcomes relative to what they would have been in the absence of an IMF-supported program?” Most researchers have answered this question in a model in which macroeconomic outcomes, such as inflation, external balance, and so on, y, are described as a function of: (a) macroeconomic policies that would have been observed in the absence of an IMF-supported program, x; (b) exogenous variables, such as terms-of-trade shocks or wars, and political economy variables, such as the stability of the government, w; (c) the existence of an IMF-supported program (usually a dummy variable, dIMF, equal to one if a Fund program is in place and zero otherwise); (d) random shocks, ε:

( 1 ) y i j = β 0 j + β j k x i k + α j h w i h + ϕ j d i I M F + ε i j ,

where yij is the j-th target variable in country i, and xik and wih are k- and h-element vectors, respectively. For the j-th target variable, βjk and αjh are kx1 and hx1 vectors, respectively, of fixed parameters.

This model is then estimated using either pooled or cross-section data drawn from countries and periods with and without IMF-supported programs, with the aim of establishing the “independent effect” of Fund programs on the relevant variables. If the parameter ϕj is found to be statistically significant, then it is said that IMF-supported programs have macroeconomic effects.14 The interpretation of the additive dummy, diIMF, is not unique, however, because it captures the total of four channels through which Fund-supported programs are assumed to affect the macroeconomic outturns: (i) the confidence effect of a program (in some countries the exchange rate is said to appreciate upon the arrival of the IMF team); (ii) the introduction of policies that are different from what they would have been without a program; (iii) cumulative changes in the impact of any given isolated set of policies and IMF financing, that is, the so-called catalytic effect of Fund programs; and (iv) changes in the structure of the economic system through structural reforms.

The simple model has two obvious drawbacks. First, “macroeconomic policies in the absence of an IMF-supported program” is an unobservable variable that has to be constructed in an ad hoc fashion. Second, the simple additive character of the IMF program dummy can result in observational equivalence. For example, an identical macroeconomic outturn can be achieved because a country received a bigger loan, implemented better policies or far-reaching structural reforms, or a combination of all of the above. We will address these issues in turn.

The key empirical issue in (1) is obviously the formulation of policies adopted in the absence of Fund involvement (xik). These policies can be observed only for nonprogram countries or nonprogram periods in countries with previous/subsequent Fund-supported programs and a counterfactual has to be estimated for program periods. Goldstein and Montiel (1986) suggested constructing a policy reaction function linking the annual changes in macroeconomic policies, Δxik, to the deviations of observed lagged outcomes, yij(−1) from their target values, yij*. An enhanced policy reaction function, such as the one suggested in Dicks-Mireaux et al. (2000), may also contain some lagged exogenous variables, wih, that the authorities would take into account in designing their policies:

( 2 ) Δ x i k = γ k j [ y i j * y i j ( 1 ) ] + δ i h w i h ( 1 ) + η i k ,

where matrix γkj describes the speed of adjustment of policy instruments to disequilibria in the target variables. In estimating such a policy reaction function, researchers make two simplifying assumptions. First, the program countries’ counterfactual policies are identical to the set of policies of nonprogram countries. Second, the program countries are faced with shocks identical to those observed by nonprogram countries.

In reality, IMF-supported programs can be associated with either smaller or larger fiscal adjustment than in nonprogram countries. On the one hand, IMF financing is designed to bring about stabilization at lower overall cost, hence, the initial improvement in the overall balance could be smaller in program countries than in nonprogram countries. On the other hand, the initial imbalances and credibility problems may be such that a comparatively larger adjustment in the fiscal balance is designed for credibility reasons. For example, the program may target a 5 percent surplus knowing that a 3 percent surplus is more realistic based on past performance. Ultimately, the longer the period under consideration, the less relevant becomes the issue of the initial adjustment: the size of the initial adjustment ought to be irrelevant two or three years after the end of the program.

Substituting (2) into (1) to eliminate the unobservable values of xik and subsuming yij* in the constant, the usual specification of the GEE becomes:

( 3 ) Δ y i j = β 0 j ( β j k γ k j + 1 ) y i j ( 1 ) + β j k x i k ( 1 ) + α j h w i h + β j k δ i h w i h ( 1 ) + ϕ j d i IMF + ( ε i j + β j k η i k ) .

Our modification of the simple GEE is threefold. We attempt to separate the impact of: (i) structural conditionality, (ii) the country’s performance under the program, and (iii) “too many” structural conditions.

First, we try to separate the role of structural conditionality, and fiscal structural conditionality in particular, from the other effects of IMF-supported programs. We test whether the presence and implementation of Fund fiscal structural conditionality, leads to fiscal outcomes that are statistically different from those without such conditionality. In this extension of the GEE model, we do not see a need to establish counterfactual structural policies: fiscal and other structural reforms are introduced—often with technical assistance from IMF or World Bank staff—irrespective of the presence of an IMF-supported program or without specific conditionality. Hence, the permissible set of fiscal reforms, say, the introduction of a value added tax, an expenditure monitoring system, and so on, ought to be identical for both program and nonprogram countries.

To this end, we introduce a set of variables, c, into equation (3) to test the significance of fiscal structural conditionality, FSC. These variables can be defined either as a duration-adjusted count of fiscal structural conditionality, CiFC=iFSCiduration; as a share of implemented structural conditions, FSCiI, vis-à-vis all fiscal structural conditions, iiFC=iFSCiIiFSCi, or as a simple dummy variable. In line with the breakdown of fiscal structural conditions in Table 1, these dummy variables can be specified as revenue increasing or expenditure lowering, and so on.

Second, we augment the Fund-program dummy to reflect the compliance with all program conditions in an interactive dummy, d˜iIMF. Successful programs are defined as those that either disbursed all committed resources without interruption or those which were designed and executed as precautionary arrangements (following the narrowest definition of program success in Ivanova et al., 2003).

Third, we experiment also with a simple count of all structural conditions, tjkTC to test for the argument that too many structural conditions are counterproductive: it is increasingly believed that economic reforms are implemented only to the extent of their support by the people of the country itself (Khan and Sharma, 2001 and Boughton and Mourmouras, 2002). In countries where “reform ownership” is low, a large number of structural conditions may indicate that IMF staff tried to substitute the lack of a reform drive with additional, detailed conditionality and vice versa.15 There could be some exceptions: for example, a country may insist on a detailed specification of structural conditionality in order to avoid unnecessary domestic political confrontation about the design of reforms, such as in Bulgaria in 1997 (International Monetary Fund, 2001).

Formally, the reduced GEE equation becomes:

( 4 ) Δ y i j = β 0 j ( β j k γ k j + 1 ) y i j ( 1 ) + β j k x i k ( 1 ) + α j h w i h + β j k δ i h w i h ( 1 ) + ϕ j d ˜ i I M F + ψ j c i S C + θ j t i T C + ( ε i j + β j k η i k ) .

What are the expected signs of the variables pertaining to IMF conditionality? First, ϕ is indeterminate, that is, IMF-supported programs can be associated with either smaller or larger fiscal adjustment than that in nonprogram countries. Second, ψ should be associated with an improvement in the fiscal balance: we have identified structural measures that—if implemented properly—would either increase revenue or lower expenditure. Structural measures to lower revenue and increase expenditure were rare and most conditions targeted an improvement in the overall balance. Finally, the expected sign of θ is negative: an excessive number of conditions would hinder the fiscal effort through the “ownership” nexus by overwhelming the authorities and possibly distracting them from their ultimate goal of fiscal adjustment.

IV. Sample Selection and Estimation

The model is estimated in three steps. First, using data for 48 nonprogram countries only, we estimate the policy reaction function (equation 2) for the relevant macroeconomic variables, and the coefficients of the policy reaction function are saved.16 Second, using the estimated parameters of the policy reaction function, macroeconomic policies in 64 program countries during 1993-96 are simulated to reflect what those policies would have been in the absence of an IMF-supported program. Hence, the vector of policies, xik, in equation (1) comprises actual observed policies in countries without Fund programs and counterfactual policies in countries with Fund programs. Third, the GEE equation (equation 4) is estimated for both program and nonprogram countries (112 observations), capturing the impact of IMF-supported programs and structural conditionality residually.

The 1993-96 period was selected because of three considerations. First, this four-year period followed the IMF membership of transition economies in 1991-92, but preceded the “Asian” crisis of 1997-98. Second, during this period the IMF was deeply involved in structural reforms in less developed economies through its Enhanced Structural Adjustment Facility (ESAF). Third, we need three years of after-program data for the GEE estimation, which makes 1996 the latest permissible cutoff point in our sample.

A. The Policy Reaction Function

The policy reaction function determines endogenously the stance of monetary, external, and incomes policies, respectively, as a function of the intended fiscal adjustment. Three endogenously determined variables, xik, following the procedures established by previous researchers, are used: (i) the ex post real interest rate (the representative nominal interest rate minus the CPI); (ii) the nominal effective exchange rate (NEER); and (iii) the current account balance as a percentage of GDP (see Table 4 for definitions). The estimation is for the period 1992-97 with data for 48 countries (Table A1-1). Countries in the sample used to estimate the policy reaction function did not have a Fund-supported program during the 1991-97 period, or two years prior to 1991. The sample is fairly heterogeneous and captures two extremes of IMF membership. On the one hand, it contains a group of industrialized countries that graduated from Fund programs in the early 1970s. On the other hand, it contains a group of small economies that either obtain external financing outside of the Fund or do not need it.

Table 4.

Definitions of Variables

article image

The abbreviations stand for the following data sources, respectively: World Economic Outlook; World Development Indicators; Database of Political Institutions, Version 3.0; Ivanova et al. (2003); International Financial Statistics; and the Monitoring of Fund Arrangements Database.

The endogenous policy variables were initially regressed on a wide vector of explanatory variables that was—using the general-to-specific approach—narrowed eventually to five variables: (i) the change in the overall fiscal balance in percent of GDP (Δyij); (ii) the terms-of-trade index; (iii) the oil price (the international crude oil price in U.S. dollars); (iv) the political cohesion index (a measure of political stability); and (v) an OECD intercept dummy (unity for countries that are members of the Organization for Economic Cooperation and Development, and zero otherwise). Table 5 summarizes these results. Needless to say, the estimated coefficients are statistically significant and correspond to the usual priors: higher fiscal deficits are associated with higher current account deficits, improvements in the terms of trade with narrower current account deficits, and so on

Table 5.

The Estimates of the Policy Reaction Function

(Heteroscedasticity-consistent, feasible GLS regression estimates, t-statistics in parentheses) 1/

article image
Source: Authors’ estimates. Note: All variables, except the OECD dummy, are in first differences.

The superscripts ***, **, and * denote the rejection of the null hypothesis that the estimated coefficient is zero at the 1 percent, 5 percent, and 10 percent significance levels, respectively.

The fiscal targets, yij*, were derived from one-year-ahead World Economic Outlook (WEO) projections. Those projections are based on the annual policy discussions between the authorities and IMF staff and reflect the authorities’ desired policy stance for the period ahead.17 The difference between this projection and the current fiscal outturn, yij(−1), then measures the fiscal disequilibrium to which the authorities react with changes in policy instruments in the coming year. We save the estimated coefficients from the policy reaction function, γ^ and μ^, and use them to simulate the changes in policy instruments in program countries during 1993-96. In doing so, we obtain an estimate of what the policies in program countries would have been, at given fiscal disequilibrium, in the absence of an IMF-supported program.

B. The Generalized Evaluation Estimator

We consider three target variables (yij) measuring fiscal developments: (i) the overall central government balance; (ii) central government revenue and grants; and (iii) central government expenditure and net lending, with all variables expressed in percent of GDP, in 64 countries that operated under IMF-supported programs and 48 nonprogram countries during 1993-96. While the first target might be intuitively preferable to the other variables as a measure of the fiscal stance, revenue and expenditure regressions are useful checks: programs do not target automatically an improvement in the overall balance. For example, the domestic financing constraint may be relieved either through medium-term aid commitments or through access to international capital markets. Consequently, some IMF-supported programs may target an improvement in revenue collection or changes in the structure of fiscal expenditure, without any change in the overall balance or, indeed, with a worsening thereof.18 While the endogenous variables are derived from the policy reaction function, the exogenous variables are two-year averages, lagged one period: the terms of trade, GDP per capita in constant U.S. dollars, foreign aid in percent of GDP, the rate of inflation, and real GDP growth.

This paper is primarily interested in the long-term effects of IMF-supported programs. In the short run, during the program period, fiscal developments can be affected by temporary tightening, with little or no long-term fiscal consequences.19 We want to measure the impact of IMF-supported programs beyond the initial, short-term impact of the program and, hence, we consider fiscal variables one, two, and three years after the initial program ended, with 112, 109, and 97 observations, respectively. For example, if a country had a three-year program from January 1993 to December 1995, our fiscal variables in the one-, two-, and three-year GEE estimation would be dated 1997, 1998, and 1999, respectively.20 For nonprogram countries, we use 1997-99 data and a two-year average for the “pre-program” period in 1991-92.

C. The Results in the Full Sample

In general, we find that the fiscal developments are driven mostly by cyclical variables as opposed to macroeconomic policy variables (Tables A2-1 through A2-3).21 In all cases, the robust estimators are the autoregressive terms and GDP growth; in some cases, we also found inflation, the real rate of interest, and certain conditionality variables to be significant. In contrast, the role of the endogenously determined macroeconomic policies is relatively small and the overall contribution of the policy reaction function is minimal. The dummy measuring program participation is statistically insignificant. This implies that the presence of an IMF program does not make the fiscal adjustment softer—on average, program countries seem to adjust as much as nonprogram countries for given initial conditions. Countries in programs without interruptions seem to adjust even more, but these results are not statistically significant at the usual level.

The lack of in-sample variability in the structural conditionality variables and their overall substitutability—it does not really matter whether we use simple count, duration-adjusted count, or implementation ratio—suggest that these variables operate more like an intercept dummy variable as opposed to a slope coefficient. Unlike Ivanova et al. (2003) or Thomas (forthcoming) we did not find any statistically significant impact of the political stability variables. Also, we did not find any systematic impact of the type of IMF-supported program and location of the country: the dummy for the Stand-By or ESAF/PRGF Arrangements, the “transition dummy,” and the dummy for country locations were typically insignificant. The only statistically significant regional dummy was the sub-Saharan African dummy.

The overall balance

We find that the change in the overall balance is predicted reasonably well by the pre-program overall balance (a bigger initial deficit is associated with a bigger improvement), lagged GDP growth (faster growth improves the balance), and the level of development (countries with higher GDP per capita improved their overall balance by more than countries with low GDP per capita), see Table A2-1. These three variables account for almost all of the explained variance of the dependent variable.

Several other variables are either marginally significant or their significance is found only in certain regressions. One of them is the aid-to-GDP ratio, indicating some stabilizing impact of aid inflows.22 While moderate inflation is associated with improvements in the overall balance, countries with average inflation of more than 50 percent worsened their fiscal position; this may in part reflect tax collection lags (the Tanzi-Oliveira effect). Although we experimented with various versions of the high-inflation variable, the simple dummy yielded the most consistent results. The evidence on the effect of terms-of-trade and nominal exchange rate shocks is mixed. Finally, countries with tighter monetary policies seem to have a more pronounced improvement in their overall balance.

The IMF program performance variables are statistically insignificant, although the signs of their parameters are intuitive. For example, countries with program stoppages did worse than the average, and countries with uninterrupted IMF-supported programs did better than the average. The conditionality variables were all insignificant, even though the signs seem to tell a relatively consistent story: more structural conditions were associated with below-average performance, while their implementation was associated with better-than-average performance.

Revenue and grants

Revenue regressions explained much less of the variance of the dependent variable, even though the results were also dominated by the pre-program revenue levels and cyclical effects (Table A2-2). This ratio worsened in countries with a larger-than-average initial revenue-to-GDP ratio and, moreover, it was inversely related to real GDP growth. Both results are intuitive: on the one hand, the tax burden may have peaked in some countries in the late 1980s and, on the other hand, fast-growing economies have less need to increase their tax-to-GDP ratio.

The role of the aid, inflation, and interest variables was surprising. The aid-to-GDP ratio was statistically insignificant in all but the one-year-after-the-program version, however, the sign was consistently positive in all regressions. An increase in aid was associated with an increase in the revenue-and-aid-to-GDP ratio, albeit the elasticity was much less than one.23 Hence, the observed decline in aid receipts does not explain fully the decline in revenue and grants. Inflation worsened revenue in most regressions and no nonlinearity in the inflationary impact was found. The real interest rate was significant in all versions of the equation indicating that countries with tight monetary conditions did worse in revenue collection, although the quantitative impact of high real interest rates was small.

We did not find any statistically significant impact of Fund-supported programs with the exception of revenue three years after the program. The sign was consistently negative for all programs, suggesting that the availability of IMF financing (and other financing linked to an IMF-supported program) led to a post-program relaxation of the revenue effort. Also good performance under the program did not seem to contribute to improved revenue collection beyond the first or second year after the program. All but one variable describing the quantity of structural measures were statistically insignificant, although they all came with a negative sign, suggesting the presence of the ownership nexus. In summary, these results suggest that revenue enhancing measures, and perhaps also technical assistance provided to program countries, failed to provide a sustainable increase in the revenue-to-GDP ratio.

Expenditure and net lending

The behavior of the expenditure-to-GDP ratio was mostly explained by pre-program expenditure levels, the real rate of growth, and the real rate of interest, at levels of statistical significance comparable to the overall balance regressions (Table A2-3). Unlike in previous regressions, where the relationships were linear in nature, however, we found strong nonlinearity vis-à-vis past expenditure-to-GDP ratios. A simple quadratic representation worked fine: the expenditure-to-GDP ratio declined in countries with low pre-program expenditure ratios, but increased in countries with high levels thereof. This result is consistent with our initial findings from Tables 1 and 2: program countries without structural conditions, which had comparatively higher initial expenditure-to-GDP ratios, increased those ratios somewhat.24 In contrast, structural conditionality countries lowered their already low expenditure-to-GDP ratios even further. Countries that grew faster lowered their expenditure-to-GDP ratio, owing to the GDP increase, and the expenditure-to-GDP ratio also declined in countries with tighter monetary policies.

We did not find any statistically significant impact of IMF-supported programs on expenditure developments. However, the signs of the estimated coefficients were consistently negative for the all-program dummy and positive for the successful-program dummy. The structural conditionality dummy and all other conditionality variables were negative and statistically significant, irrespective of what the variables measured, suggesting significant expenditure compression in countries with structural conditionality.

In the GEE model, we cannot pinpoint the driving forces behind expenditure developments. In particular, it is difficult to distinguish whether expenditures that were cut were wasteful (Gupta et al., 2002) or whether, as claimed by some critics, the expenditure compression was excessive. We can only conjecture that the increasing value of the estimated coefficients points to the former explanation, as expenditure compression tends to accelerate after the end of the Fund arrangement. This observation is also consistent with a substantial body of evidence that social and capital spending is protected in low-income program countries (Abed et al., 1998).

D. Are Countries with Programs Containing Structural Conditionality “Different”?

We found the estimated coefficients of the conditionality variables to be insignificant for all but the expenditure regressions, with virtually no differences as regards the construction of the variable. In some cases the parameters were marginally significant, but with the wrong sign: for example, a higher implementation ratio of revenue measures seemed to be associated with lower revenue and grants, and so on. In addition, the impact of IMF programs was statistically insignificant, but those countries where the program proceeded successfully seemed to be doing better in terms of the overall balance and partly in revenue collection.

We do not see a unique explanation for these findings, as they can be justified by different relationships. First, these results may imply that historically poor performance, owing to deep-rooted structural weaknesses, persistent shocks, or a lack of a reform drive, was compensated with additional conditionality. As predicted by the “ownership” literature, without addressing the causes of the past performance, additional conditions would not affect the fiscal performance. Second, the positive effect of revenue measures may be only short-lived and IMF conditionality in the fiscal area fails to bring about sustained fiscal improvements.

To highlight the developments in structural conditionality countries, we reestimated our regressions for the program countries only (Table 6).25 We found that the overall balance improvement was larger in countries with structural conditionality than in other program countries by about 1½ and 3 percentage points of GDP in the two- and three- years-after-the-program samples, but that these results were statistically significant only for the last sample period. Revenue and grants declined by more than 2 percentage points of GDP more in structural conditionality countries. However, these results are only marginally significant. Contrary to what we observed in Table 2 using simple averages, controlling for the change in aid inflows does not explain revenue underperformance in structural conditionality countries. Finally, the expenditure and net lending decline in structural conditionality countries was increasing over time—from about 2 percentage points one year after the program to 8 percentage points of GDP three years after the program—and these results were statistically significant.

Table 6.

Fiscal Adjustment in Countries with Structural Conditionality Relative to Countries Without Structural Conditionality1/

(Heteroscedasticity-consistent OLS Regression estimates of the structural conditionality and Africa dummies, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The superscripts ***, **, and * denote the rejection of the null hypothesis that the estimated coefficient is zero at the 1 percent, 5 percent, and 10 percent significance levels, respectively.

The estimated parameters for the Africa dummy are consistent with earlier findings of a high risk of fiscal reversals in low-income countries (Gupta et al., 2002). While African countries started with a better-than-average post-program overall balance of more than 3 percent of GDP, this result disappeared in the second year after the end of the program period. On the expenditure side, the African average was statistically indistinguishable from the rest initially, but by the third year expenditure was 7 percentage points of GDP higher than predicted. In contrast, revenue performance was better than predicted, although not sufficiently to offset the expenditure increase.

These results seem to suggest that countries with structural conditionality are indeed different from the rest of the sample. Countries with structural conditionality have been subject to more pronounced shocks than other countries. For example, they are more likely to have negative terms-of-trade shocks and their terms of trade are twice as volatile. The effort to address deep-rooted fiscal weaknesses in those countries through extensive structural conditionality failed, most likely because conditionality is a poor substitute for homegrown reform. Post-program fiscal performance in those countries was driven by accelerating expenditure compression, which may not be a bad thing, provided, for example, the pre-program level of spending was wasteful or that a statist budget was replaced with a less intrusive one.

V. Concluding Remarks

This paper presents empirical tests of the relevance of structural conditionality for fiscal performance in a large sample of countries during the 1990s. Although the overall fiscal balance improved in most countries, the impact of IMF-supported programs was not statistically significant, owing to the large variance in the sample of program countries. In programs with structural conditionality, revenue declined slightly and expenditure declined significantly. In contrast, in programs without structural conditionality, revenue remained stable and expenditure increased somewhat. The statistical insignificance of IMF-supported programs indicates that program participation does not make the fiscal adjustment automatically softer—on average, program countries adjust as much as nonprogram countries. In general, all fiscal variables were strongly influenced by the business cycle.

Our results highlight the difficulty in identifying the impact of structural conditionality. Several effects seem to be in play. First, we find some evidence that programs with too many structural conditions have worse results than those with fewer conditions (the “ownership nexus”). Second, we find no quantitative evidence that structural conditionality aimed at raising revenue was successful. Third, post-program expenditure compression clearly was much stronger in countries with structural conditionality, but the risk of reversal was higher too, especially in sub-Saharan Africa. The choice of having structural conditions is nonrandom and it reflects the underlying conditions and shocks faced by the country prior to the program. Countries with structural programs are typically poorer than the rest and more exposed to external shocks, and have deep-rooted imbalances and a problematic track record of economic reforms.

The findings in this paper are not definitive and the possibilities for further research are extensive. First, more work is needed to examine the role of initial shocks, structural weaknesses, and regime-specific effects, such as the choice of the exchange rate regime. Second, the policy reaction function can be specified differently, reflecting, for example, policies that would stabilize the debt-to-GDP ratio or that would be based on “fiscal rules.” Third, it could be worth attempting to identify empirically the impact of “reform ownership.” Finally, some of the issues, such as the appropriateness of the initial revenue and expenditure levels, cannot be addressed adequately in a cross-country model and need to be investigated in case studies.

ANNEX I

Table A1-1.

List of Countries and Areas Used for the Estimation of the Policy Reaction Function

article image
Table A1-2.

Structural Conditionality in IMF-Supported Programs During 1993-96

article image
article image

ANNEX II

Table A2-1.

The Overall Balance One Year After the Program: Estimates of the GEE (continued)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy takes value of 1 if the lagged, two-year average inflation was higher than 50 percent per annum; and 0 otherwise.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

Includes all structural measures with fiscal implications.

Table A2-1.

The Overall Balance Two Years After the Program: Estimates of the GEE (continued)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy takes value of 1 if the lagged, two-year average inflation was higher than 50 percent per annum; and 0 otherwise.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

Includes all structural measures with fiscal implications.

Table A2-1.

The Overall Balance Three Years After the Program: Estimates of the GEE (completed)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy takes value of 1 if the lagged, two-year average inflation was higher than 50 percent per annum; and 0 otherwise.

The dummy is equal to 1 if cither all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

Includes all structural measures with fiscal implications.

Table A2-2.

Revenue and Grants One Year After the Program: Estimates of the GEE (continued)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

Includes all structural measures with revenue improving implications.

Table A2-2.

Revenue and Grants Two Years After the Program: Estimates of the GEE (continued)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

Includes all structural measures with revenue improving implications.

Table A2-2.

Revenue and Grants Three Years After the Program: Estimates of the GEE (completed)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

Includes all structural measures with revenue improving implications.

Table A2-3.

Expenditure and Net Lending One Year After the Program: Estimates of the GEE (continued)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

The dummy takes value of 1 if the IMF-supported program included any structural conditions; and 0 otherwise.

Includes all structural measures with expenditure implications.

Table A2-3.

Expenditure and Net Lending Two Years After the Program: Estimates of the GEE (continued)

(Heteroscedasticity-consistent OLS, t-statistics in parentheses)

article image
Source: Authors’ estimates.

The dummy is equal to 1 if either all committed resources were disbursed or if the program was precautionary; and 0 otherwise.

The dummy takes value of 1 if the IMF-supported program included any structural conditions; and 0 otherwise.

Includes all structural measures with expenditure implications.