How Volatile and Unpredictable Are Aid Flows, and What Are the Policy Implications?

Contributor Notes

Author’s E-Mail Address: Abulir@imf.org and Ahamann@imf.org

This paper examines empirical evidence on the volatility and uncertainty of aid flows, and the main policy implications. Aid is found to be more volatile than fiscal revenues- particularly in highly aid-dependent countries-and mildly procyclical in relation to activity in the recipient country. These findings imply that the current pattern of aid disbursements is welfare-reducing. We also find that uncertainty about aid disbursements is large and that the information content of commitments made by donors is either very small or statistically insignificant. Policies to cope with these features of aid, as well as broader international efforts to reduce the volatility and procyclicality of aid, are briefly discussed.

Abstract

This paper examines empirical evidence on the volatility and uncertainty of aid flows, and the main policy implications. Aid is found to be more volatile than fiscal revenues- particularly in highly aid-dependent countries-and mildly procyclical in relation to activity in the recipient country. These findings imply that the current pattern of aid disbursements is welfare-reducing. We also find that uncertainty about aid disbursements is large and that the information content of commitments made by donors is either very small or statistically insignificant. Policies to cope with these features of aid, as well as broader international efforts to reduce the volatility and procyclicality of aid, are briefly discussed.

I. Introduction

This paper documents key cyclical properties of external aid flows from the point of view of the recipient country: their degrees of volatility and predictability, and the way in which they covary with domestic economic activity. Why the focus on the cyclical properties of aid? First, available estimates of the welfare cost of business fluctuations in developing countries suggest that they are significantly larger than those in industrial economies.1

Developing countries tend to be subject to more frequent and larger external shocks and are less able to cope with them due to pervasive liquidity constraints and the lack of effective countercyclical policy tools. A direct implication of this result is that advice to developing countries should pay more attention to reducing volatility. Second, these countries are also likely to be recipients of large volumes of aid disbursements of foreign aid, which have been found to be very volatile themselves (see below). This feature of aid can indirectly offset some of its direct beneficial effects by, for example, complicating the conduct of fiscal and monetary policy or exacerbating exchange rate variability (Edwards and van Wijnbergen, 1989). In particular, the negative welfare effects of volatile aid flows will be larger the higher the covariance between domestic output fluctuations and aid disbursements.2

In principle, the problem of aid volatility is analogous to that of volatility of commodity prices in countries that rely heavily on revenues from the exports of a single commodity. However, only a few, recent empirical studies have focused on the magnitude and consequences of aid volatility (and on best practices to deal with them) in contrast with the case of export price instability, where the main issues have been dealt with extensively in the economic literature.3 Lensink and Morrisey (2000) find that the effect of aid on growth is insignificant unless some measure of aid uncertainty is included in the regression, and that uncertainty about aid is detrimental to growth. Gemmell and McGillivray (1998) find that shortfalls in aid are most frequently followed by reductions in government spending, and sometimes by increases in taxes, or both. In other words, the typical aid-receiving country is unable to offset an unexpected non-disbursement of aid by borrowing, and has to resort to costly, and possibly inefficient, swift fiscal adjustment.4 Gemmell and McGillivray (1998) also find that aid is significantly more volatile than revenue and that, on average, aid tends to be procyclical (that is, countries tend to receive more aid in years when economic activity is on the rise; this, in turn, may imply a positive correlation between aid and fiscal revenues). These results are corroborated by Pallage and Robe (2001a) and suggest that the typical pattern of aid disbursement (highly volatile and procyclical) is likely to be welfare reducing.5 To the best of our knowledge, Collier (1999) is die only study that finds aid (in Sub-Saharan Africa) to be less volatile than tax revenues, and countercyclical.6

In this paper we re-examine these issues using a broader database than that used in the studies cited above (we use both publicly available time-series data as well as a cross- section of detailed data provided by IMF desk-officers of countries receiving aid). In line with the studies of Gemmell and McGillivray (1998) and Pallage and Robe (2001a), we find, first, that aid is substantially more volatile than either fiscal revenue or GDP and, further, that this relative volatility increases with the degree of aid dependency as measured by the aid-to- revenue ratio. We also find that aid tends to be mildly procyclical, and that countries that suffer from relatively high revenue volatility also exhibit higher volatility in aid receipts. These results suggest that aid tends to enhance budgetary and overall economic instability.

Second, time-series data show that commitments by donors exceed disbursements systematically and that aid cannot be predicted reliably on the basis of donors’ commitments alone. Cross-sectional data from IMF-supported programs reveal that commitment-based projections tend to overestimate project and, to a much higher degree, program aid. In addition, intra-year disbursements of program aid differ significantly from projections. Despite their poor track record as a predictor of disbursements, commitments continue to be used in budgetary exercises in aid recipient countries mainly as a result of pressures from donor countries and/or agencies.

Since the economic effects of aid are largely determined by the recipient country’s budgetary practices, we stress the need to account properly for aid volatility when designing adjustment programs in aid receiving countries—particularly when it comes to planning against the possibility of delays and/or shortfalls in aid disbursements vis-à-vis commitments. Finally, we discuss briefly measures that can be taken by both donors and aid-recipients— mainly in the areas of compliance with program objectives, program design, coordination among donors and improved disbursement procedures in donor countries—in order to reduce the volatility, procyclicality and unpredictability of aid and, thus, enhance its welfare effects.

The paper is organized as follows. Section II discusses briefly our data sources, as well as some problems posed by the need to select a common unit of measurement for several variables and the limitations of using aggregate data on aid. Section III looks at various measures of the relative instability of foreign aid and fiscal revenues. Section IV deals with the issue of predictability of aid flows and the information content of commitments made by donors. This section also looks at the accuracy of predictions of aid made at various stages of a program supported by the donor community. Finally, Section V concludes with a discussion of the main policy implications of our findings.

II. Data Sources and Measurement Issues

Before turning to the assessment of the relative volatility and predictability of foreign aid, in this section we discuss the origin and scope of our data, as well as some problems associated with their measurement. These problems relate to the limitations of any empirical analysis based on aggregate aid estimates; problems linked to the selection of a common unit of measurement (denominator) for aid and domestic revenues; and the time-series properties of aid and revenue and the need to take them into account in order to measure volatility and predictability properly.

A. The Data Set

The data on aid used in this study were taken from the World Bank’s World Development Indicators (WDI), which, in turn, are based on raw data compiled by the OECD and grouped under the heading of “Official Development Assistance” (ODA). The time series of commitments and actual disbursements of aid correspond to the line “Long-term funds by official and private donors, excluding IMF financing”. In principle, aid data are available for more than 100 countries, however, not all aid recipients represent relevant cases for the purposes of this study.

The pool of aid recipients changes over time. Within our sample period some former aid recipients became donors, others experienced a substantial change in their composition of aid, and several former communist countries joined the pool of aid recipients in the early 1990s, Thus, to compile a consistent database, we considered only cases that meet the following selection criteria: (i) at least eight annual observations available; (ii) presence of IMF-supported program(s) during the sample period; and (iii) population of at least 500,000.

The second criterion was intended to capture the mobilizing impact of IMF programs on aid flows and their composition.7 The third criterion was aimed at eliminating the small-country bias. These three criteria narrowed the potential sample to 72 countries for which aid data were available for the period 1975-1997 or some portion thereof.

Fiscal data used in the paper—total revenue in the local currency—were drawn from two sources. For the majority of countries (60), the series were obtained from the IMF’s International Financial Statistics (IFS). For the remaining 12 countries, mostly from sub- Saharan Africa and Asia, we used internal IMF data: in 10 cases we relied on the IMF’s African Department fiscal database, and in the other two the data were provided by IMF desk officers.8 Even with these additions, we were able to complete 1975-97 revenue series for only 47 countries; the available series are shorter for the other 25 countries (see Appendix Table A2).

B. The Composition of Aid

The OECD definition of ODA aggregates balance-of-payments support, capital projects, food aid, debt and emergency relief, peacemaking efforts, technical cooperation, concessional funding to multilateral development funds, and some other small categories of aid. More than 90 percent of the value of aid falls in the first two categories: some 50-60 percent is disbursed in the form of untied balance-of-payment support (the so-called program aid), while the remainder comes in the form of tied, project-related aid. These averages, however, may be affected by the presence of a few large recipients of program aid (say, Mexico in 1995 or Indonesia in 1998). Poor, aid-dependent countries generally have above-average proportions of project aid.

Given the high degree of heterogeneity among the components of aid, the use of an aggregate concept of aid is problematic, particularly when aid volatility is at the center of the discussion (Box 1 discusses the key macroeconomic differences between the two main categories of aid). For one thing, certain categories of aid are bound to be more volatile than others—for example, food aid is disbursed only during disaster periods—and, therefore, higher aggregate aid volatility may simply reflect shifts in the composition of total aid. In fact, aggregate volatility of aid may be high (low), even though the volatility of aid components may be low (high) when the covariance between the components is positive (negative) and relatively large (Box 2 illustrates this point in the case of Malawi).

Components of Aid and Their Economic Impact

Foreign aid is not a homogeneous variable, even though a popularly held view assumes that the fungibility of its various components makes it homogeneous. For example, aid earmarked for the construction of schools could free, ceteris paribus, financial resources for, say, military buildup. But what if aid is not fungible because the preferences of donors and aid recipients differ? The available evidence shows that the economic consequences of various forms of aid are not identical, see Lancaster (1999) for a review.

First, consider aid tied to specific investment projects. If donors’ and recipients’ preferences are identical, the effect of project aid would be some increase in investment, imports, and budgetary spending on either tradables or nontradables— with the composition being decided by the preferences of domestic agents—as domestic fiscal resources earmarked for a project are replaced with aid. However, if aid is financing projects that the government would otherwise not have undertaken, the effect of aid would be simply the associated increase in investment and imports of tradables, with little or no impact on the domestic currency or absorption.

The second major category of aid is program aid. These funds could be considered totally fungible: additional program aid could finance higher spending, lower taxes, a reduction in debt, or a combination of all three, with the authorities deciding the composition. However, program aid finances typically additional spending on nontradable goods and, as such, that it has a strong impact on interest and exchange rates, often crowding out domestic absorption and hindering exports (Younger, 1992).

Volatility and Composition of Aid: Malawi in the 1990s

Malawi is a good example of the complexity of aid flows. Aid, albeit significantly volatile, has been more stable on aggregate than two of its components (as suggested by the coefficients of variation shown below). Numerically, the lowest total aid receipts in any year have been 40 percent of maximum total aid receipts during that period and 62 percent of the average. However, the same ratios for program aid have been 35 percent and 56 percent and for project aid 29 percent and 44 percent, respectively. The ratios for total revenue have been much higher at 77 percent and 88 percent, respectively.

Table 1.

Malawi: Various Types of Aid Flows, 1992/93-1998/99

(In percent of GDP)

article image
Sources: Malawian authorities; and Fund staff estimates and projections.Note: ‘I’ indicate interruptions in the ESAF arrangement that affected disbursements during the whole fiscal year.

Aid is volatile also in the very short term. For example, during a period of less than two months in 1998/99, Malawi received about US$150 million of balance-of-payment support. This inflow of foreign exchange, which was more than twice as large as total disbursements during the previous 18 months, was equivalent to more than 150 percent of programmed reserve money or 11 percent of GDP. As a result, the Reserve Bank of Malawi had to undertake massive liquidity operations in order to prevent a triple-digits expansion of the monetary stock.

But there is an additional dimension to the aid heterogeneity problem: different forms of aid have different conditionality. For example, some aid is disbursed if an IMF-supported program is considered to be “on track”, others may have sector-specific conditionality and their disbursements depend on complex donor-recipient interactions. As a result, increased aid volatility may also reflect, to varying degrees, problems with project implementation, compliance with macroeconomic conditionality, or disruptions to the normal disbursement process originating in the donor country.

The literature offers little evidence on the empirical relevance of the points discussed above. On the one hand, insufficient data prevent comprehensive cross-country studies from differentiating among categories of aid. On the other hand, the few small-scale studies that have tried to decompose aid into various subcategories have either rejected parameter constancy across regions (White, 1992 and Mosley et al., 1987 and 1992) or found the impact of aid to be insignificant in a cross-country set up (Mosley et al., 1992). Individual country studies are similarly inconclusive (see, for example, Pack and Pack, 1990 and 1993, for Indonesia and the Dominican Republic, respectively). In light of these results, we use the OECD composite definition of aid in Sections III and IV. A and investigate aid volatility and predictability separately for project and program aid in Section IV.B.

C. Common Denominator for Aid and Fiscal Revenue

Statistical measures of relative volatility are affected by the choice of a common denominator for aid and revenue. We use two alternative denominators for aid and revenue: percentages of GDP and current U.S. dollars in per-capita terms. From a domestic policy point of view, the percent-of-GDP denominator is more relevant as aid-receiving governments generally do their financial programming either in domestic currency or in percentages of GDP rather than in U.S. dollars per capita. Moreover, the percent-of-GDP denominator captures better the impact of aid flows on exchange rate than the U.S. dollars per capita denominator. WDI data on GDP in local currency units, annual average market exchange rates, and population were used.

Why does the choice of a common denominator matter? Since our series for aid are denominated in U.S. dollars and those for revenues in domestic currency units, our comparisons of volatility of aid and revenue are affected by another variable, namely the exchange rate.9 On the one hand, when expressing aid and revenue in U.S. dollars per capita, the volatility of domestic revenue becomes a composite measure of volatility of revenue in local currency terms and volatility of the exchange rate. On the other hand, when expressing the variables in percent of GDP, the volatility of aid becomes a composite measure of volatility of aid in U.S. dollars, volatility of the exchange rate, and the impact of those variables on GDP.10 Thus, measures of relative volatility of aid tend to be lower when the series are expressed in U.S. dollars per capita, as compared to percentages of GDP. However, the implicit bias varies from country to country, as the volatility of the exchange rate between the domestic currency and the U.S. dollar tends to be larger in aid-receiving countries with floating exchange rates. As a result, due to the lack of a preferred scale variable for aid and revenue, we use both transformations, and keep in mind the biases that each of them are likely to introduce when interpreting our results.

D. The Time Series Properties of Aid and Revenue

Augmented Dickey-Fuller tests (not reported here but available upon request) indicate that the series for aid and revenue are generally nonstationary (or, in a few cases, stationary around a deterministic trend), and this finding is robust to the choice of the denominator. What are the implications of trends for measuring volatility? The standard statistics (variance, the standard deviation, and the coefficient of variation) are designed for variables that revert to a constant mean and their application to trended data may result in serious biases. To avoid this problem, we detrended our aid and revenue series using the Hodrick- Prescott filter, and only then applied the usual measures of volatility.11

III. Measuring the Relative Variability of Aid and Revenue

This section reviews our findings on the relative volatility of aid and domestic fiscal revenue. We calculate “trend-corrected” variances for aid and revenue, θA and θR, respectively, and a measure of relative volatility defined as the ratio of the two, Φ = θAR.

In the rest of this section we examine the properties of the measure of relative volatility, Φ. In particular, we: (i) calculate Φ for each country; (ii) look at the frequency distribution of individual country Φ’s and test the significance of averages and medians across countries;12 (iii) test the relationship of Φ’s vis-à-vis other variables, such as the correlation coefficients between (detrended) aid and revenue (i.e., cyclically of aid) and the ratio of (not detrended) aid to revenue (i.e., aid dependency); and (iv) in order to check the robustness of our results, we arrange countries into two sub-groups according to their degree of aid dependency, and compare the results for the full sample with those obtained for the smaller samples. Thus, we carry out our calculations not only for the full sample of 72 countries, but also for a sub-sample of countries with aid-to-revenue ratios of 10 percent or more (57 and 55 countries when measured in percent of GDP and U.S. dollars per capita, respectively) and also for a sub-sample of countries with aid-to-revenue ratios of 50 percent or more (33 and 29 countries when measured in percent of GDP and U.S. dollars per capita, respectively). The first cutoff point eliminates the more developed Latin American and Asian countries from the sample, while the second cutoff point defines a group of highly aid- dependent countries, mostly from Sub-Saharan Africa. The results are presented in Table 1.

Table 1.

Relative Volatility of Aid and Revenue (Φ)

article image
Source: Table A1 in Appendix [1].

The null hypotheses that Φ > 1 is tested for averages with the F-test and for medians with the “runs test”; ‘*’ and ‘**’ indicate statistical significance at the 5 and 1 percent level, respectively.

Our first finding is that aid is more volatile than revenue, particularly in countries with a high aid-to-revenue ratio. On the one hand, when variables are expressed in percent of GDP, aid is on average more volatile than revenue in all samples, and this result is statistically significant (the F-test fails to reject the null hypothesis that the average Φ ‘s are larger than one at the 1 percent level of significance in every case).13 Furthermore, the relative volatility of aid grows with aid dependence: the average value of Φ increases from 3.94 to 7.42 as the sample is narrowed down to the most aid-dependent countries (the results for the median values of Φ follow a similar pattern). On the other hand, when the variables are expressed in U.S. dollars per capita, the average Φ is bigger than one in the full sample, but the difference from one is statistically insignificant. In the other two samples, aid is on average relatively more volatile than revenue and the results are statistically significant; again, the average value of Φ increases with aid dependency (from 11/3 to 3). The estimated medians also grow as the sample is restricted to more aid-dependent countries, but they are not significantly different from one.14

We look also at the frequency of cases in which aid is more (or less) volatile than revenue and find stronger evidence in favor of a higher incidence of countries where aid is more volatile than revenue (Φ > 1). When variables are expressed in percent of GDP, the share of countries with more volatile aid grows from about half in the full sample to about 2/3 in the middle sample, and well over 4/5 in the sample of the most aid-dependent countries. In the case of variables denominated in dollar-per-capita terms, there are more cases of aid being relatively less variable that revenues in the full and middle samples. In contrast, in the last sample, countries with higher relative aid volatility outnumber those with higher volatility of revenue by a margin of 5 to 2.

Second, we find that the relationship between the relative volatility of aid and aid dependency is robust.15 The first column of Table 2 shows the correlation coefficients between Φ and aid dependency in each of the three samples. The common denominator makes little difference in this case: the simple correlation coefficients between Φ and the aid-to-revenue ratio are of the order of 0.5-0.6 in the full sample, 0.5 in the middle sample, and a much lower 0.1-0.2 in the sample with aid-to-revenue ratios of 50 percent or more. The rank correlation coefficients (Spearman’s ρ) are about 0.7-0.9 in the full and middle samples and about 0.2-0.5 in the most aid dependent group. The positive correlation between the relative volatility of aid and aid dependency is statistically significant for all but the smallest sample. The lack of statistical significance in the smallest sample may reflect the fact that, by eliminating countries with a low aid-to-revenue ratio, we lower substantially the variance of the aid-to-revenue ratio series. In any case, we would stress that the average O is about 20 times higher in the 10 most aid-dependent countries than in the 10 least aid-dependent countries.

Table 2.

Interdependence Between Aid and Revenue Flows

(Aid and revenue arc measured as differences from its Hodrick-Prescott filter)

article image
Source: IFS, World Development Indicators, AFR fiscal database; and Fund staff calculations.Note: ‘*’ and ‘**’ indicate statistical significance at the 95 percent and 99 percent level, respectively.

Correlation coefficient between each country’s Φ and its aid-to-revenue ratio.

Average of individual countries’ correlation coefficients between detrended aid and revenue.

Correlation coefficient of each country’s aid and revenue variances (θ).

Third, we find that, if anything, aid is modestly procyclical (second column of Table 2). The full-sample averages of individual correlation coefficients of detrended aid and revenue are positive, of similar size in all samples, but statistically insignificant in all but one case. However, a look at the distribution of correlation coefficients (Figure 1) reveals that they are concentrated to the right of zero and that only a small number of countries exhibit pronounced countercyclical pattern of aid. Furthermore, the share of countries with a correlation coefficient smaller than –0.3 falls between 5 percent and 10 percent, whereas the share of countries with a correlation coefficient larger than 0.3 is 35-40 percent depending on whether the variables are expressed in percent of GDP or in U.S. dollars per capita. Thus, although the average results provide only weak support for the hypothesis that aid is procyclical, aid is found to be countercyclical only in a very small number of countries.

Figure 1.
Figure 1.

Frequency Distribution of the Cyclical Character of Aid 1/

(Relative frequency)

Citation: IMF Working Papers 2001, 167; 10.5089/9781451858181.001.A001

Source: Table A2.1/ Measured by the correlation coefficient of aid and domestic fiscal revenue.

Finally, we find that shocks to domestic revenue are correlated with those to foreign aid (last column of Table 2). The correlation coefficients between the variances of aid (θ A) and revenue (θ R) are stable at about 1/3 for the variables in percent of GDP and grow from 0.2 to 0.9 when the variables are denominated in dollars per capita. While the sign of the correlation coefficient might have been expected, the size of the correlation coefficients and their stability across different samples are surprising. These results further undermine the notion that aid tends to smooth out shocks to revenue.

We summarize our main results graphically in Figure 2, where the top panel corresponds to variables expressed in percent of GDP and the bottom panel to variables denominated in dollars per capita. Each panel captures three dimensions: on the horizontal axis we plot the relative volatility of aid, Φ; on the vertical axis the correlation coefficient of aid and revenue (cyclically of aid); and each observation is represented by a bubble whose size indicates the country’s aid-to-revenue ratio. First, we observe that aid is more volatile than revenue in countries with high aid dependency, as most of the “larger” bubbles are to the right of the vertical line Φ = 1. Second, aid appears to be procyclical, as the majority of bubbles are above the horizontal line corresponding to a zero correlation between aid and revenue. Moreover, in only a few aid-dependent countries, that is, those with “larger” bubbles, aid is countercyclical. This pattern of cyclically is more pronounced in the bottom panel, where aid and revenue are measured in dollar-per-capita terms.

Figure 2.
Figure 2.

Characteristics of Aid: Volatility, Cyclicality, and Dependency

(The size of the bubble indicates the aid-to-revenue ratio)

Citation: IMF Working Papers 2001, 167; 10.5089/9781451858181.001.A001

Source: Table A2.

IV. Predictability of Aid

In this section we establish some stylized facts regarding the predictability of aid both, in general, and in the context of IMF-supported programs. To this end, we carry out two separate exercises. The first one is based on time-series data on aid disbursements and commitments in current U.S. dollars, and seeks to assess the information content of commitments in the context of a simple auto-regressive model for aid disbursements. Available time series were typically longer in this case, as there was no need to compute them as a percentage of GDP, or constrain them to be of equal length as revenue series. The second exercise is based on responses to a questionnaire by IMF country desk economists. The results of this questionnaire allow us to test whether there are systematic differences between commitments made by donors, projections prepared in the context of IMF-supported programs, and actual disbursements.

A. The Time Series Evidence

Before turning to the estimation of the marginal contribution of commitments, C, to the prediction of disbursements, D, we would like to provide some basic information on these two variables for our sample of 72 countries. A simple look at individual-country plots of their C and D series (available upon request) reveals two salient features: (i) several episodes of spikes in commitments that, generally, were not followed by increased disbursements; and (ii) a systematic tendency for commitments to exceed disbursements.

The first point reflects a propensity for donors to react, in terms of large increases in commitments but not necessarily in disbursements, to positive changes in recipient countries, such as in the Central African Republic following the end of Bokassa’s regime in the early 1990s or the end of the civil war in Mozambique in the mid-1990s. The exception to the second point are mainly (but not exclusively) a relatively small number of instances within our sample in which a country has received some form of financial help following an unforeseen balance of payments crisis. These cases, however, are concentrated among countries with relatively higher levels of income per capita and capital mobility, and low aid dependency. For the other countries in our sample, the C-to-D ratio was larger than one (i.e., commitments exceed disbursements), with the implicit average overprediction of disbursements reaching up to 20 percent.16

While the simple calculations discussed above reveal that commitments tend to overestimate disbursements by a relatively wide margin, they do not say much about the information value of a commitment figure for predicting aid for the budget. In order to assess the marginal value of aid commitments in predicting aid disbursements, we estimated the following equation for the same sample of countries as in the previous section:

Dt=β0+i=1kβtDti+γCt+δT+εt,(1)

where T is a time trend and K represents the lag length. The ability of commitments to help predict the future course of disbursements is tested through the statistical significance of y in this very simple forecasting equation for disbursements.17 We would expect that y should be not only statistically significant but also positive and close to one if commitments contained high marginal information value. Of course, there are no simple a priori interpretations for the possible failure of γ to be significantly different from zero. Potential reasons for the failure of commitments to materialize include, inter alia, non-compliance by the receiving country with conditions attached to committed aid, delays associated with administrative problems in donor countries, or simply changes in underlying economic and/or political developments. Whatever the case, though, we think that it is important to document the predictive power of a variable that is widely used in fiscal programming exercises mainly in response to pressure from donors.

Given the nonstationarity of Ct and Dh the parameter γ was estimated by running equation (1) in first differences. The estimation process was carried out in two steps. In a first step, two alternative values of K were selected from a version of equation (1) that did not include Ct: those that minimized the Akaike Information Criterion (AIC) and the Schwartz- Bayes Information Criterion (SBIC). The value of γ was then estimated by adding Ct as a regressor in the resulting equations.18 The results obtained using the AIC are summarized in Table 3; there are no substantial differences between the results obtained under the AIC and those obtained under the SBIC.

Table 3.

Commitments are Poor Predictors of Actual Disbursements

(Estimated values of γ in italics)

article image

Countries where aid represents more than 10 percent of government revenues.

Countries where aid represents more than 50 percent of government revenues.

In general, the estimated γ’s are not statistically significant, especially in countries with higher aid-dependency ratios. When all countries are considered, γ is significant at the 5 percent level in about 1/3 of the regressions.19 In these cases, the average value of γ is about 0.4; however, the median value is smaller (about 1/3), reflecting the fact that the estimated value of γ was quite large for only a few countries: γ was higher than 0.7 in 5 higher-incomc countries with very low aid-to-revenue ratios (Argentina, Mexico, Panama, Turkey, and Venezuela).20 The estimated values of γ decreased (and the difference between their average and median values narrowed significantly) when the sample of countries was reduced to cases in which aid represents at least 10 percent of revenues. The estimated value of γ did not change further when the sample was reduced to countries where aid represents at least 50 percent of revenues, but the share of regressions with γ’s significant at the 5 percent level fell from about 1/3 in the full sample to about 1/5. When the level of statistical significance is lowered to 10 percent, none of the conclusions described above changes significantly.

Two main conclusions can be drawn from Table 3. First, the marginal predictive power of commitments made by donors is statistically significant only in a relatively small fraction of the countries in our sample, and this fraction falls as the sample is reduced to countries where aid is relatively important. Second, even among countries where commitments contain statistically significant information about future disbursements, the results suggest that commitments should not be taken at face value, but instead should be discounted heavily.

Finally, in line with the results of section III, we explored the relationship between predictability of aid, as measured by γ, and a few other variables. The top two panels of Figure 2 plot the estimated values of γ against the aid-to-revenue ratio and GDP per capita, respectively (the panels show also a fitted regression line and the estimated regression coefficient). The relationship is negative in the first case, positive in the second case, and the estimated regression coefficients are statistically significant at the 1 percent level. These results show quite clearly that the predictive power of donors’ commitments tends to be lower in poorer and in more aid-dependent countries. The bottom two panels of Figure 3 plot the estimated γ’s against the two measures of relative aid volatility (Φ). In both cases, the relationship is negative, albeit not statistically significant, indicating only a weak correlation between volatility and unpredictability.

Figure 3.
Figure 3.

Aid-Dependent, Poor Countries And Countries With Volatile Aid Have Also Less Predictable Aid

Citation: IMF Working Papers 2001, 167; 10.5089/9781451858181.001.A001

Source: Authors’ own estimates.Notes: The slope of the regression line is denoted by β. ‘*’ and ‘**’ indicate statistical significance at the 5 and 1 percent level, respectively.

B. How Good are Aid Projections in IMF-Supported Programs?

The Survey

The results in this section are based on responses by 37 IMF desk economists to a questionnaire sent in late 1999 (see Appendix Table A4 for a list of the countries). The questionnaire requested information on project and program aid for the most recent program period. The majority of the 37 countries in the sample drew financial support from the IMF under the Enhanced Structural Adjustment Facility (ESAF) and a few under General Resource Account facilities. It must be stressed that, although the definition of aid employed in this questionnaire was intended to be as close as possible to that used by the OECD, in many cases the IMF estimates of aid inflows are somewhat smaller. This discrepancy mostly reflects the asymmetric nature of information on aid between donors and recipients: data on such components as technical assistance, peacemaking efforts, and other smaller categories of aid are often not reported to the recipient country and, hence, are not recorded in the countries’ fiscal and balance of payments accounts (on which the responses to our questionnaires are based).

We received data on project aid at four different junctures related to the life of a program, and recorded them under the following labels: (1) “Original projections”, prepared by the IMF staff about a year ahead of the start of the program. These projections are based on information on past disbursements as well as preliminary and heavily discounted donor commitments.21 (2)”Budget projections,” that is, the authorities’ projection at the time of the budget presentation, which usually takes updated commitments by donors at face value. (3) “IMF-program projection,” that is, the IMF staff estimate embedded in the financial program. Staff of the IMF generally incorporates some 90-95 percent of updated project aid commitments into their fiscal projections. (4) “Disbursements”, as recorded by the authorities.

Regarding program aid, we received data at the same junctures as in the case of project aid, cxcept for the budget estimates, which are generally identical to IMF projections.

Specifically, we have data for: (1) “Original projections” (one-year-ahead projections prepared by IM F staff, conditional on past disbursements and heavily discounted preliminary donor commitments); (2) “IMF-program projections” (non-discounted, updated commitments provided by donors);22 and (3) “Disbursements”. Unlike in the case of project aid, for program aid we were able to obtain also a quarterly breakdown of each of the three annual projections.

Not all low-income countries with IMF-supported programs receive both project and program aid, and in some cases the distinction between the two is not made.23 Also, a few country desks did not report data that correspond to the definitions of “Original projections” or “Budget projections” described above. As a result, we do not have a balanced data set. For project aid we obtained: 27 observations for Original projections, 32 for IMF-program projections, 24 for Budget projections and 32 for Disbursements. For program aid, we obtained: 23 observations for Original projections, 28 for IMF-program projections and 28 for Disbursements. In order to have a common denominator, all data were expressed in percentages of the IMF-program projections.

Results for project aid

The average Disbursements of project aid fall short of all types of projections (Table 4).24 The ranking of errors in projections vis-à-vis Disbursements is unambiguous: Budget projections are the worst with an average error of 15 percent; IMF-program projections are the most accurate, with an average error of 5 percent; while Original projections come, quite surprisingly, in the middle with an average error of almost 8 percent.25 Interruptions in IMF programs appear to have no statistically significant impact on project-aid Disbursements. The fact that Budget projections fare the worst even though they are prepared relatively late in the process—and, presumably, with updated commitments—reflects the pressure exerted by donors for aid recipient countries not to discount their commitments.

Table 4.

How good are short-term aid projections?

(In percent of IMF program projections, sample averages)

article image

Data for 27 countries for original projections, 24 countries for budget projections, and 31 countries for actual outturns.

Data for 4 countries. In one country, no program aid was committed and none was disbursed.

Data for 23 countries for original projections and 26 countries for actual outturns.

Because some country data do no have breakdown for grant and loans, the sum of grants and loans does not equal to the total program aid.

Grant and loan data arc available for 19 and 24 countries, respectively.

Averages are not reported, because only one observation was available.

Average deviation from the quarterly IMF-program projection.

A closer look at the distribution of Disbursements as percentages of IMF-program projections (Figure 4, top panel) reveals that, while all projections overestimated Disbursements on average, there were plenty of cases in which Disbursements were actually underestimated. Out of the 32 countries for which we had data on IMF-program projections and Disbursements, 18 countries had their project aid Disbursements fall short of IMF- program projections by about 20 percent of program projections, while 14 countries had project aid Disbursements that exceeded IMF-program projections by roughly the same magnitude.

Figure 4.
Figure 4.

Frequency Distribution of Aid Disbursements 1/

(In percent of program projections)

Citation: IMF Working Papers 2001, 167; 10.5089/9781451858181.001.A001

Source: IMF questionnaire; authors’ calculations.1/ The samples contain 33, 28, and 23 countries, respectively. Excluding countries with no disbursements and countries with program interruptions.2/ Average deviation from the quarterly projection.

Results for program aid

Program aid shortfalls vis-à-vis IMF projections are more marked: both Original and IMF-program projections overestimated Disbursements on average by more than 30 percent (despite some variations in individual cases, original and program projections are practically identical on average) 26 The explanation for the much larger prediction errors in program aid projections as compared to project aid lies in the different nature of conditionality associated with the two types of aid. Unlike project aid, which flows gradually according to multiple-year disbursement schedules and entails direct monitoring by donors of some large projects, program aid is generally disbursed only if the IMF-supported macroeconomic program is on-track (it is held back if the program is off-track). For this reason, in the case of program aid, it may be useful to look separately at programs with and without interruptions due to breaches in conditionality.

The difference in type of conditionality, however, does not account fully for the much more pronounced over-projections in the case of program aid. While countries with program interruptions (Central African Republic, Republic of Congo, Zambia, and Papua New Guinea) received, on average, only about one-third of program aid commitments, successful, uninterrupted programs received still only three-quarters of program aid commitments.27 So, what explains the substantial shortfall vis-a-vis program projections in programs that remained officially “on track”? There are three possible explanations: (i) program-aid shortfalls originated in donor countries and are not related to recipient countries’ compliance

donor conditionality; (ii) aid recipient countries breached donor conditionality, but not that associated with the IMF-supported program; or (iii) the overcstimation reflects strategic behavior by the IMF, given its unique role as arbiter of external assistance. Unfortunately, we do not have information to assess the relative importance of these hypotheses.

The average result of excessively optimistic projections at all junctures is more representative in the case of program aid than for project aid (Figure 4, middle panel). Out of the 28 countries for which we received data on IMF-program projections and outcomes, 24 countries saw their Disbursements fall short of IMF-program projections (by an average of 42 percent of IMF-projected program aid), while only 4 countries recorded program aid Disbursements in excess of IMF-program projections (by an average of 14 percent). The overestimation of Disbursements exceeded 20 percent in only two countries.

Yet another way of dissecting our results is to compare prediction errors for program loans and program grants separately. Aside from differentiating aid that is debt neutral (grants) from aid that contributes to debt creation (loans),28 this analysis allows us to compare prediction errors vis-a-vis bilateral and multilateral donors. The differentiation in our data is not perfect, however. On the one hand, only bilateral donors disburse grants. On the other hand, loans are disbursed both by bilateral and multilateral donors. Still, the results show that bilateral aid in the form of program grants—which comprise about one-third of total program aid—has a much smaller prediction error than program loans, both bilateral and multilateral (bottom part of Table 4). While grant disbursements are lower that program projections by almost 13 percent, the corresponding estimate for loan disbursements is almost 40 percent. Also the shortfall vis-a-vis the original projection is much smaller for grants than for loans. We should mention, however, that the sample size is much smaller than in previous cases (19 and 24 countries for grants and loans, respectively), primarily because the breakdown of program aid is not available for some countries.

Program aid not only falls significantly short of the programmed level, but its quarterly distribution also differs substantially from the programmed path (Figure 4, bottom panel). On average, actual quarterly outturns deviate by about 50 percent from the quarterly path estimated at the beginning of the program period. In other words, if, according to the program, a country expects to rcceive 10 million dollars in a given quarter, it gets, on average, either 5 million or 15 million. Out of 23 countries for which quarterly data are available, only 2 countries received program aid with prediction errors lower than 20 percent (using the previous numerical example, only 2 countries could expcct to get either 8 or 12 millions of U.S. dollars per quarter).29

Unlike the case of donors’ commitments in the context of our “naive” prediction model (Section IV.A), the IMF-program projections of aid do not exhibit any systematic relationship vis-a-vis either aid dependency or the level of development. Figure 5 plots differences between IMF-program projections and Disbursements (expressed in percent of the former), against those two variables, separately for project aid and program aid, the latter in annual and quarterly frequencies. Although project and annual program aid prediction errors seem to be smaller in countries with lower aid-to-revenue ratios, the correlation is not statistically significant (top two left panels). Second, project and annual program aid prediction errors appear to be completely unrelated to the level of development—the slopes of the fitted lines on the right, top two panels are flat and their values are statistically insignificant. Finally, the quarterly prediction errors (bottom panels) appear to be declining with the aid-to-revenue ratio, and increasing with the level of development, but, again, these results are not statistically significant.

Figure 5.
Figure 5.

Prediction Errors of Aid in IMF Programs

(In percent of program projections)

Citation: IMF Working Papers 2001, 167; 10.5089/9781451858181.001.A001

Source: Authors’ calculations.Note: The slope of the regression line is denoted by β.

The results from our questionnaire suggest that official projections of aid (including those of the IMF) are subject to large errors and that, particularly in the case of program aid, they seem to exhibit a substantial upward bias. It is somewhat ironic that even with the heavy discount of preliminary donors’ commitments embedded in the IMF staffs Original projections, for which the IMF staff is often criticized, those projections tend to overestimate Disbursements significantly. Original and IMF-program projections have, on average, practically identical forecast errors and, hence, it appears that the additional information that should in principle be provided by updated commitments at the beginning of the program period, adds in fact very little to the Original projections. The intra-year volatility of program aid was found to be remarkably high.

V. Conclusions and Policy Recommendations

In this paper we assess empirically various aspects of the cyclical behavior of aid flows. Although the welfare implications of highly volatile and unpredictable aid flows can be substantial—especially in countries that receive large volumes of aid—the issue has not received enough attention in the literature. Our findings suggest that the typical pattern of disbursement of aid tends to enhance budgetary and, possibly, overall economic instability, and reduce welfare. Before summarizing these findings, however, we would like to stress our hope that this paper will stimulate further research, particularly in assessing the robustness of our results to changes in detrending methods, the specific definition of aid flows or even the units of measurement. We also hope that the paper will help in focusing the attention of policymakers on policies aimed at reducing economic instability in poor countries.

We find that aid is substantially more volatile than domestic revenues, that this relative volatility grows with the degree of aid dependency, and that these results are robust. We also find that aid tends to be mildly procyclical, and that countries that suffer from revenue volatility also exhibit higher volatility in aid receipts, perhaps because both revenue and aid fluctuations are driven by domestic policy instability.

We also show that aid cannot be predicted reliably on the basis of donors’ commitments. There seems to be a tendency for all parties involved (donors, the local authorities and the IMF itself) to systematically overestimate aid disbursements in aid- receiving countries with IMF-supported programs. Given the economic inefficiencies and financing difficulties associated with implementing swift fiscal measures to compensate for large unexpected shortfalls in aid, our findings suggest that fiscal programming in aid receiving countries should rely on cautious assumptions about the availability of committed funds and that projections of aid disbursements should be based on past experience rather than on promises by donors. Of course, budgets can be designed to accommodate aid disbursements in excess of the conservative baseline, but this should be done in a way that ensures that domestic-currency funds are released to spending agencies only after the equivalent foreign-currency denominated aid has been deposited at the central bank.

Given the relatively high volatility of aid, we find the procyclicality of aid flows particularly worrisome, as the two results combined imply that aid is being currently disbursed in a welfare-reducing manner. While our results in this regard apply to total aid, similar findings for separate components of aid have been obtained in other studies. Grants and technical assistance have been found to be procyclical, particularly in Sub-Saharan Africa (Pallage and Robe, 2001a). Furthermore, U.S. food aid (PL480)—one category of aid that one would expect to be highly countercyclical—has also been found to be mildly procyclical (Barrett, 2001). The procyclicality of aid is likely to reflect a variety of factors. At the theoretical level, Svensson (2000) shows that when donors are unable to monitor the recipient country’s reform effort, a second-best outcome arises in which aid disbursements are tied to economic performance, thus rendering aid procyclical. In practice, compliance with conditionality from multilateral agencies, and thus timely disbursements of aid, are less likely when countries are hit by an unforeseen adverse shock.

There is no presumption that our estimates of aid volatility, predictability, and procyclicality must be taken as given. In fact, there seems to exist significant room for both aid-recipients and donors to improve the pattern of aid disbursements. For example, a higher degree of compliance with conditions attached to aid is likely to lead to a smoother path of aid disbursements. However, there are also factors that lead to disruptions in aid disbursements over which the recipient country has less control. A country hit by an external shock may have its aid flows temporarily suspended because it has delayed the necessary adjustment, for example, owing to domestic politics. This necessary adjustment may be eventually undertaken, perhaps at a more opportune time, but disbursements would be missed and their macroeconomic impact felt long afterward. This is essentially an avoidable problem that can be addressed through improved program design.30 Furthermore, as explained by Barrett in the case of U.S. food aid, the procyclicality of aid can be corrected through the development of reliable early warning systems to anticipate emergencies and allow donors to disburse aid in when it is needed most, or through improved budgetary practices in the donor country. The recent emergence of Poverty Reduction Strategy Papers (PRSP) is a positive development in this regard.31 The PRSPs are not only expected to lead to better design and stronger ownership of the programs supported by multilateral agencies and, thus, to higher compliance, but they are also expected to play an important role in coordinating the actions of other donors.

APPENDIX TABLE

Table A1.

Volatility of Aid and Revenue and the Aid-to-Revenue Ratio

(Aid and revenue are measured as differences from its Hodrick-Prescott filter)

article image
Source: IFS, World Development Indicators, AFR fiscal database; and authors’ calculations.

Variances of detrended variables.

In percent.

Table A2.

Volatility of Aid and Revenue; Country Data

article image
Table A3.

Statistical Significance of Commitments in Forecasting Actual Disbursements

article image

: Significant at the 1 percent level.

: Significant at the 5 percent level.

Table A4.

List of Countries Used in the Survey

article image

References

  • Barrett, Christopher, 2001, “Does Food Aid Stabilize Food Availability?”, Economic Development and Cultural Change, Vol. 49, No. 2 (January), pp. 335-49.

    • Search Google Scholar
    • Export Citation
  • Branson, William and Naggy Hanna, 2000, “Ownership and Conditionality”, World Bank Operations Evaluation Department Working Paper No. 8, Summer (Washington: The World Bank).

    • Search Google Scholar
    • Export Citation
  • Collier, Paul, 1999, “Aid ‘Dependency’: A Critique,”Journal of African Economies, Vol. 8, No. 4, pp. 528-45.

  • Edwards, Sebastian and Sweder Van Wijnbergen, 1989, “Disequilibrium and Structural Adjustment”, in Handbook of Development Economics, Vol. II, ed. by H. Chenery and T.N. Srinivasan (Amsterdam: Elsevier Science Publishers).

    • Search Google Scholar
    • Export Citation
  • Engel, Eduardo and Patricio Meller, 1993, External Shocks and Stabilization Mechanisms (Washington: Inter-American Development Bank).

  • Gemmell, Norman and Mark McGillivray, 1998, “Aid and Tax Instability and the Government Budget Constraints in Developing Countries,” CREDIT Working Paper No. 98/1, (University of Nottingham Centre for Research in Economic Development and International Trade).

    • Search Google Scholar
    • Export Citation
  • Hadjimichael, Michael, and others, 1995,Sub-Saharan Africa: Growth, Savings, and Investment, 1986-93, IMF Occasional Paper No, 118 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Hansen, Henrik and Finn Tarp, 2000, “Aid Effectiveness Disputed”, Journal of International Development Economics, Vol. 12, No. 3 (April), pp. 375-398.

    • Search Google Scholar
    • Export Citation
  • Hansen, Henrik and Finn Tarp, 2001, “Aid and Growth Regressions”, Journal of Development Economics, Vol. 64, No. 2 (April), pp. 547-70.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2000, The IMF Poverty Reduction and Growth Facility (PRGF’): A Factsheet. Available in www.imf.org/external/np/exr/facts/prgf.htm.

    • Search Google Scholar
    • Export Citation
  • Lancaster, Carol, 1999, “Aid Effectiveness in Africa: the Unfinished Agenda”, Journal of African Economies, Vol. 8, No. 4, pp. 487-503.

    • Search Google Scholar
    • Export Citation
  • Lensink, Robert and Oliver Morrisey, 2000, “Aid Instability as a Measure of Uncertainty and the Positive Impact of Aid on Growth,” Journal of Development Studies, Vol. 36, No. 3 (February) pp. 31-49.

    • Search Google Scholar
    • Export Citation
  • Mosley, Paul, John Hudson, and Sara Horrell, 1987, “Aid, the Public Sector and the Market in Less Developed Countries,” Economic Journal, Vol.97, September, pp. 616-41.

    • Search Google Scholar
    • Export Citation
  • Mosley, Paul, John Hudson, and Sara Horrell, 1992, “Aid, the Public Sector and the Market in Less Developed Countries: A Return to the Scene of the Crime,” Journal of International Development, Vol.4, No.2, pp. 139-50.

    • Search Google Scholar
    • Export Citation
  • Pack, Howar and Janet Rothenbcrg Pack, 1990, “Is Foreign Aid Fungible? The Case of Indonesia”, The Economic Journal, Vol. 100, No. 3, March, pp. 188-94.

    • Search Google Scholar
    • Export Citation
  • Pack, Howar and Janet Rothenbcrg Pack, 1993, “Foreign Aid and the Question of Fungibility”, The Review of Economics and Statistics, Vol. 75, No. 2 (May), pp. 258-65.

    • Search Google Scholar