Emerging Market Sovereign Bond Spreads
Estimation and Back-testing

Contributor Notes

Author’s E-Mail Address: fcomelli@imf.org.

We estimate sovereign bond spreads of 28 emerging economies over the period January 1998-December 2011 and test the ability of the model in generating accurate in-sample predictions for emerging economies bond spreads. The impact and significance of country-specific and global explanatory variables on bond spreads varies across regions, as well as economic periods. During crisis times, good macroeconomic fundamentals are helpful in containing bond spreads, but less than in non-crisis times, possibly reflecting the impact of extra-economic forces on bond spreads when a financial crisis occurs. For some emerging economies, in-sample predictions of the monthly changes in bond spreads obtained with rolling regression routines are significantly more accurate than forecasts obtained with a random walk. Rolling regression-based bond spread predictions appear to convey more information than those obtained with a linear prediction method. By contrast, bond spreads forecasts obtained with a linear prediction method are less accurate than those obtained with random guessing.

Abstract

We estimate sovereign bond spreads of 28 emerging economies over the period January 1998-December 2011 and test the ability of the model in generating accurate in-sample predictions for emerging economies bond spreads. The impact and significance of country-specific and global explanatory variables on bond spreads varies across regions, as well as economic periods. During crisis times, good macroeconomic fundamentals are helpful in containing bond spreads, but less than in non-crisis times, possibly reflecting the impact of extra-economic forces on bond spreads when a financial crisis occurs. For some emerging economies, in-sample predictions of the monthly changes in bond spreads obtained with rolling regression routines are significantly more accurate than forecasts obtained with a random walk. Rolling regression-based bond spread predictions appear to convey more information than those obtained with a linear prediction method. By contrast, bond spreads forecasts obtained with a linear prediction method are less accurate than those obtained with random guessing.

I. Introduction

Sovereign debt securities have become a key method of funding for many emerging market economies as well as an increasingly important asset class for investors. A relevant question for policymakers and investors is whether the difference between the yield of a given emerging market sovereign bond and the yield of a United States Treasury debt security of a comparable maturity – the sovereign bond spread – is appropriately priced in relation to the country-specific fundamentals of that particular emerging economy. If the sovereign bond spread stays at very low levels for long without reflecting the economy’s fundamentals, sudden shifts in the investors’ perception of risk may lead to sharp changes in the cost of external borrowing for that particular economy.

Against that background, many studies propose a wealth of empirical models to estimate sovereign bond spreads using country-specific and common explanatory variables. However, to our knowledge, the empirical literature has not always emphasized that the contribution of the variables explaining sovereign bond spreads may change across time and regions. In addition, the ability of empirical models in generating accurate in-sample bond spread predictions has not been extensively tested yet. In this context, this study attempts to answer the following questions. Does the contribution of country specific variables change when the time and country dimensions of the panel change? Can an empirical model – used to estimate sovereign bond spreads – generate in-sample predictions for sovereign bond spreads which are more informative than those obtained with random guessing?

Following Hartelius (2006), we estimate emerging economies sovereign bond spreads using a panel of 28 emerging economies, over the period January 1998–December 2011 and allow for the dimensions of the panel to change. After estimation, we back-test the model by generating bond spreads in-sample predictions with linear predictions and rolling regression routines. We are interested to establish (i) which of the methods is more successful at correctly predicting the direction of the monthly change in bond spreads, (ii) whether the forecasting accuracy of each method changes before and after the global financial turmoil of 2008, and (iii) to test whether the forecasting methods employed are more accurate than a random walk in predicting the monthly change in bond spreads.

In the first part of the paper, we find that better country-specific fundamentals are associated with lower bond spreads, although their impact on spreads varies across periods and regions. This implies that over time and across regions of emerging economies investors do not always assign the same importance to country-specific variables when investing in emerging economies’ sovereign bonds. We also find that the impact of global explanatory variables, as well as their statistical significance, in explaining bond yield spreads changes with the economic period considered.2 Specifically, US short and long-term interest rates are no longer significant if the time dimension of the panel includes only the period beginning with the latest global financial crisis. In addition, the model fails to explain well the rising bond spreads in observed in some of the emerging economies between 2010 and 2011. This could reflect concerns that international investors might have about the potential impact of the euro area economic downturn on emerging economies and on their borrowing costs. Finally, we find that during crisis times, good macroeconomic fundamentals are helpful in containing bond yield spreads, but less than in non-crisis times. This might reflect the likely impact of extra-economic forces on bond yield spreads when a financial crisis occurs.

In the second part of the paper, we assess the ability of the model to generate accurate predictions for bond spreads. For some emerging economies – Colombia, Mexico, and Poland – forecasts of the monthly changes in actual bond spreads obtained with rolling regression routines are significantly more accurate than forecasts obtained with a random walk model. The results enrich the literature because they suggest that rolling regression method can in some cases be more accurate than a random walk model in generating predictions for bond spreads, perhaps reflecting the fact that rolling regression routines allow to gradually enrich the information set available to investors.

This paper is structured as follows. Section II contains a review of the relevant literature for this study. Section III describes the data while section IV describes the empirical methodology employed. Section V presents the estimation results while the back-testing exercise of the model is presented in section VI. Concluding remarks are in Section VII.

II. Literature

There are at least two branches of literature that are relevant for this study. On the one hand, there is the empirical work analyzing the determinants of emerging market bond spreads. On the other hand, some studies are concerned with the use of sovereign bond spreads in early warning systems. To our knowledge, the literature has not been testing sufficiently the ability of empirical models to generate accurate out-of-sample forecasts for sovereign bond spreads, which is the main goal of this study. This study proposes a forecasting method to predict sovereign bond spreads which was found to be superior to random guessing for some emerging market economies. Such a method could be useful for conducting scenario analysis that use sovereign bond spreads as one of the inputs.

The production of empirical studies analyzing the determinants of emerging market bond spreads was stimulated by the use of Brady bonds in the early 1990s, and the development of indices of secondary market bond spreads (see IMF 2004). While in theory it was expected that lower world interest rates would lead to higher demand of risky financial assets and lower bond spreads in emerging economies, Cline and Barnes (1997), Min (1998) and Kamin and von Kleist (1999) did not find significant relationships between U.S. Treasury yields and emerging market bond spreads. Then, the literature found evidence of significant relationships between emerging market sovereign bond spreads and country-specific macroeconomic indicators (pull factors) and indicators of external financing conditions (push factors). Eichengreen and Mody (1998), Kamin and von Kleist (1999), and Sy (2002) all found that improved credit ratings were associated with lower bond spreads. Other studies found a greater role for advanced economies interest rates in explaining emerging market bond spreads. Ferrucci (2003) finds that a steeper U.S. yield curve is associated with lower EM bond spreads, a result he suggests may be attributable to the presence of leveraged investors, who borrow at short-term rates to lend at longer-term rates.

Other studies identified also the degree of investors risk aversion as an important factor to explain bond spreads. McGuire and Schrijvers (2003) found a significant role for a single common external factor underlying the variation of spreads across the constituents of the EMBI Global index. The authors find that the best fit for the common factor is investors’ attitude toward risk as proxied by the VIX Index.

Models including country-specific fundamentals and indicators of external financing conditions became increasingly popular to estimate bond spreads. For example, Hartelius (2006) estimates emerging markets sovereign bond spreads using a set of country-specific and common external explanatory variables. The study found that the contraction of EMBIG spreads observed until 2006 could not be explained entirely by the improvements in emerging markets country-specific fundamentals. Rather, the low volatility environment of global financial markets has also played a role in explaining the tightening of EMBIG spreads since January 2003. Luengnaruemitchai and Schadler (2007) use a similar model and ask whether market participants underestimated or not the riskiness of holding sovereign bonds issued by new European Union Member States (Central and Eastern European Countries, CECs) relatively to other emerging markets sovereign bonds. They find that for CECs the residuals were systematically negative during the period included between mid-2002 and the end of 2006. This suggests that before the global financial crisis, market participants were systematically requiring lower yields to hold CECs sovereign bonds in their portfolio than those determined by the econometric analysis. Hartelius et al. (2008) model emerging market sovereign bond spreads as a function of domestic fundamentals and global liquidity conditions. They find that both domestic fundamentals and global liquidity conditions contribute significantly to explain the change in emerging market sovereign bond spreads over the period included between December 2002 and February 2007. González-Rosada and Levy Yeyati (2008) regress bond spreads over a set of country-specific and global factors for 33 emerging economies. They find that global factors are largely responsible for most of the variance of emerging market bond spreads. By contrast, they find that the contribution of the evolution of country-specific fundamentals to the variability of emerging market bond spreads is lower. Finally, Caceres et al (2010) analyze how much of the movements in euro area sovereign bond spreads reflected shifts in global risk aversion and country-specific risks. They find that earlier in the crisis, the increase in global risk aversion was a significant factor influencing euro area sovereign spreads, while more recently country-specific factors have started playing a more important role.

There is also a branch of the economic literature which is concerned with the use of sovereign bond spreads in early warning systems. Baldacci et at. (2011) propose an index of fiscal stress to provide early warning signals of fiscal sustainability problems in advanced and emerging economies. They use among other indicators also sovereign bond spreads to identify periods of fiscal crises. Schaecther et al 2012, propose a set of short-term and long-term indicators to assess fiscal vulnerabilities in advanced economies. Among the indicators to assess short-term financing pressures, they include measures of financial market perception of sovereign risks. Finally, Candelon et al. (2012) provide evidence that sovereign bond yield spreads in a number of emerging market economies turn out to be an important leading indicator for currency crises.

III. The Data

A. Emerging Market Sovereign Bond Spreads Data

We take monthly data for sovereign bond spreads for 28 emerging market economies, for the period January 1998 – December 2011, using the JP Morgan’s Emerging Market Bond Index – Global (EMBIG) database. Bond spreads are defined as weighted averages of bond yield spreads over US government debt securities of external debt instruments issued by sovereign and quasi sovereign entities in emerging market economies, denominated in US$ (see Luengnaruemitchai and Schadler, 2007 and Kim, 2010). For those countries where US$ EMBIG spreads data are not available, we use Euro EMBIG spreads data, which are bond yield spreads over German government debt securities of external debt instruments issued by sovereign and quasi-sovereign entities, denominated in euros.3

The 28 economies considered are a subset of all the emerging market economies included in the JP Morgan EMBIG index, plus Romania: Argentina, Brazil, Bulgaria, Chile, China, Colombia, Croatia, Dominican Republic, Ecuador, Egypt, El Salvador, Hungary, Indonesia, Lebanon, Malaysia, Mexico, Pakistan, Panama, Peru, Philippines, Poland, Romania, Russia, South Africa, Turkey, Ukraine, Uruguay and Venezuela.4 Countries have been chosen according to the following rules: for each emerging market economy, sovereign bond spreads monthly data must be available at least from January 1, 2005. Sovereign bond spreads are regressed on a set of push and pull factors.

B. Pull Factors Data

Pull factors monthly data for each economy in the sample are taken from the International Country Risk Guide (ICRG) database.5 The ICRG database contains monthly data for a political risk rating (PRR), an economic risk rating (ERR) and a financial risk rating (FRR)6. Each risk rating is calculated as a weighted average of the scores assigned to a number of individual risk subcomponents. For example, the PRR includes twelve individual subcomponents that capture one given aspect of political risk, while the ERR and the FRR indices include five individual subcomponents each.

Political Risk Rating (PRR)

The PRR measures the degree of political stability in a given country. The sub-components included in the PRR are government stability, socioeconomic conditions, investment profile, internal conflict, external conflict, corruption, military in power, religious tensions, law and order, ethnic tensions, democratic accountability and bureaucracy quality. The PRR can assume any value included between 0 and 100. In each country, low scores signal high political risk, whereas high scores are associated to low risk.

Economic Risk Rating (ERR)

The ERR measures the soundness of the macroeconomic fundamentals of each emerging market economy. The ERR includes five components: per capita GDP, the real GDP growth rate, inflation, as well as fiscal and current account balances expressed as percentages of GDP. The ERR can assume any value between 0 and 50. Low scores signal weak macroeconomic fundamentals, while high scores are associated to sound fundamentals.

Financial Risk Rating (FRR)

The FRR assesses the ability of a country to pay its external debt obligations. Like the ERR, the FRR includes five sub-components: external debt as a percentage of GDP, external debt as a percentage of exports of goods and services, current account balance as a percent of exports of goods, the ratio between official reserve holdings and months of imports, and a measure of nominal exchange rate stability. The FRR can be interpreted as an index that measures the degree of external vulnerability of a given country. The FRR can assume any value between 0 and 50. Low scores signal a high degree of external vulnerability, while high scores are associated to low degrees of external vulnerability (or resilience to external shocks).

C. Push Factors Data

Following Hartelius et al. (2008) and Luengnaruemitchai and Schadler (2007), one of the push factors included in the regression is the CBOE volatility index (VIX), which measures the expected stock market volatility over the next 30 days from the prices of the S&P500 stick index options.7 The CBOE Volatility Index (VIX) is frequently used as an indicator to quantify the degree of investors’ risk appetite. 8 In addition, we include in the push factors the three-month and ten-year U.S. interest rates.

IV. The Model

Like Luengnaruemitchai and Schadler (2007), we follow Edwards (1986) to motivate the theoretical rationale behind the model used for obtaining estimates. Specifically, Edwards (1986) considers a one-period bond i where in case of default the lender will not recover anything:

p(Xit)*0+[1p(Xit)](1+rtf+sit)=(1+rtf)(1)

where rtf is the world risk-free interest rate at time t, p(Xit) is the probability of default, Xit denote the country’s fundamentals and sit is the country’s risk premium.

After rearranging (1), the country’s risk premium

sit=[p(Xit)1p(Xit)](1+rtf)(2)

Assuming that the probability of default has a logistic form,

p(Xit)=expΣβiXit1+expΣβiXit(3)

then the country risk premium (or spread) can be expressed as

sit=[expΣβiXit](1+rtf).(4)

Equation (4) shows that the bond spread at time t is influenced by the country’s fundamentals Xit and by the risk-free interest rate. Expressing (4) in logs yields

lnsit=ΣβiXit+ln(1+rtf)+εit(5)

where a disturbance term εit has been added.

To perform regressions, we use a working specification of (5) whereby we expect that U.S. three-month and the ten-year nominal interest rates, and the VIX expected stock market volatility index all play a role in explaining the country spread. Specifically, bond spreads are regressed on country specific variables (ERR, FRR and PRR) and global variables (VIX, US long-term and short-term nominal interest rates):

ln(embigit)=α0i+α1ln(errit1)+α2ln(frrit1)+α3ln(prrit1)+α4ln(vixt)++α5ln(10yt)+α6ln(3mt)+εit(6)

In (6) embigit denotes the bond spreads of country i at time t, errit–1, frrit–1 and prrit–1 denote, respectively, the lagged economic, financial and political risk ratings of country i, vixt is the VIX stock market volatility at time t, 10yt and 3mt denote respectively the U.S. ten year and three month nominal interest rate at time t, respectively. The explanatory variables are lagged in order to control for endogeneity.

Before choosing the technique for estimating (6), we check for panel unit roots and cointegration. Panel unit root tests show that the panel is potentially mixed as for a given variable stationarity is detected only in some of the countries of the panel.9 We also performed the error-correction-based co-integration Westerlund (2007) test for panel data. The test failed to reject the null hypothesis of no co-integration among the variables used. We therefore estimate (6) with fixed effects.

V. Regression Results

We begin by estimating a baseline regression and check how the results change if the time dimension of the panel is modified. First, we run a baseline regression over the period January 1998-December 2011. Then, we run a regression for the period January 2003 –July 2007, labeled as Global Abundant Liquidity and one for the period August 2007–July 2011, labeled as Global Financial Crisis. We also divide the panel into three broad emerging market regions (Asia and Pacific, Eastern Europe, Middle East and Africa, henceforth EMEA, and Western Hemisphere). For each region, we run three separate regressions: one for the period January 1998–December 2011, one for the period of Global Abundant Liquidity and one for the Global Financial Crisis. Finally, we show how much each individual emerging economy included in the sample can benefit from an improvement in its country-specific fundamentals.

Throughout this study, we run fixed effects regression with Driscoll and Kraay (1998) standard errors to control for heteroskdasticity, autocorrelation and possible correlation within groups in the panel. Following Driscoll-Kraay (1998), Driscoll and Kraay standard errors are robust to very general forms of cross-sectional (“spatial”) and temporal dependence when the time dimension becomes large.

A. Baseline regression

The baseline regression shows that both the country-specific and global explanatory variables are statistically significant to explain emerging market bond spreads (table 1). Specifically, better country-specific fundamentals are associated with lower emerging market bond spreads while a higher degree of investors’ risk aversion (as measured by the VIX index) and higher long term U.S. interest rates are associated with higher emerging market bond spreads.

Table 1.

Sovereign Bond Spreads: Coefficient Estimates, All Emerging Market Economies

article image
*Significant at 5%; **significant at 1 %. Driscoll-Kraay robust standard errors in parentheses.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

A 10% increase in the log of long-term U.S. interest rates is associated with a 4.8% increase in the log of emerging markets bond spreads. An increase in the ten-year U.S. interest rate increases debt-servicing costs of external debt and may deteriorate the creditworthiness of emerging market borrowers. It also increases the rate at which the existing debt must be rolled over. In addition, an increase in U.S. interest rates may also be associated with lower risk tolerance of international investors, driving bond yield spreads wider. Finally, stock market volatility matters for bond spreads, as a ten percent increase in the log of the VIX raises emerging market bond spreads by 8.5%. An increase in risk aversion raises the yields requested by investors to hold emerging market sovereign debt securities.

B. Global Abundant Liquidity and Global Financial Crisis

The impact of push and pull factors on emerging market bond spreads changes depending on the economic period considered. During the Global Financial Crisis, while the indices for political risk (PRR) and external vulnerability (FRR) remain significant in explaining bond spreads, the index for macroeconomic variables (ERR) is no longer significant. By contrast, since the beginning of the Global Financial Crisis, the VIX index gained significance in explaining bond spreads.

Three-month U.S. interest rates were significantly negatively related with bond spreads only during the period of Global Abundant Liquidity. These findings are in line with Eichengreen and Mody (1998), as they found a negative relationship between U.S. Treasury yields and emerging market bond spreads, possibly motivated by supply and demand conditions of emerging market sovereign debt securities. The results in table 1 show that during the period of Global Abundant Liquidity, low short-term US interest rates constituted favorable financing conditions for the issuance of emerging markets debt securities, which ultimately might have led to excess supply of emerging market sovereign bonds and higher spreads. Conversely, a rise in US short-term interest rates tightened financing conditions, thereby reducing the supply of emerging market sovereign bonds. With the beginning of the crisis, however, this effect disappears: US three-month interest rates rapidly approached the zero bound without rebounding, while emerging market bond spreads became more volatile compared to the pre-crisis period.

Ten-year US interest rates are significant in explaining bond spreads neither in the Global Abundant Liquidity period nor in the Global Financial Crisis period. This suggests that from 2003 the demand of international investors for emerging market sovereign bonds tends to be more sensitive to country-specific explanatory variables rather than to US long-term interest rates. Put differently, long-term world interest rates appear to lose significance in explaining the creditworthiness of emerging market sovereign borrowers.

Summing up, the significance of country-specific and global factors in explaining bond yield spreads changes with the economic period considered, which is in line with the findings in Mauro et al. (2002, 2006). In addition, and differently from González-Rosada and Levy Yeyati (2008), country-specific explanatory variables play systematically an important role in explaining emerging market sovereign bond spreads.10

C. Regional Subgroups

Table 2 reports the coefficients estimates across the different emerging market regions. The importance of country-specific factors in explaining bond spreads varies across emerging market regions and periods.

Table 2.

Sovereign Bond Spreads: Coefficient Estimates Across EM Regions.

article image
*Significant at 5%; **significant at 1%. Driscoll-Kraay robust standard errors in parentheses.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

During the Global Abundant Liquidity period none of the country-specific explanatory variables is significant to explain bond spreads in emerging Asia. In addition, the economic risk rating index – a proxy for the macroeconomic fundamentals – is significant neither in Asia, nor in the Western hemisphere during the Global Abundant Liquidity and the Global Financial Crisis periods. By contrast, the economic risk rating index is always significant in the EMEA region. The financial risk rating index – a proxy for the degree of external vulnerability – always played a significant role in containing bond spreads in the Western Hemisphere region, while during the Global Abundant Liquidity period the financial risk rating was not found to be significantly related with bonds spreads in Asia and EMEA.

Finally, the political risk rating index was not significant for the EMEA region during the Global Abundant Liquidity and Global Financial Crisis periods.

As regards the global factors, the degree of risk appetite – as proxied by the VIX index – is almost always significant to explain bond spreads across the three different regions of emerging economies. By contrast, the ten-year U.S. interest rates were not significant for bond spreads during the Global Abundant Liquidity and the Global Financial Crisis periods. U.S. short-term interest rates were significant in explaining bond spreads only during the Global Abundant Liquidity period.

D. How Do Fitted Bond Spreads Compare With Actual Bond Spreads?

After having obtained estimates, the fitted bond spreads are compared with the actual ones. If the actual bond yield spread is higher than the fitted bond yield spread, then that particular bond trades at a lower price compared to what the model suggests. By contrast, if the actual bond yield spread is lower than the fitted spread, than that bond trades at a higher price compared to what implied by the model.11

Charts 1-4 plot the actual and fitted bond spreads, as well as the residuals, for selected Latin American economies. The charts show that since January 2006, a number of Latin American economies – Brazil, Colombia, Mexico and Peru – had most of times negative residuals, meaning that in those economies the actual spread was systematically lower than the fitted bond yield spread. Luengnaruemitchai and Schadler (2007) found a similar result for bonds issued by the New European Union (EU) Member States. They regressed emerging market sovereign bond spreads on a set of country-specific and global variables to determine whether the compression in bond spreads observed in the mid-2000s was justified or not by the fundamentals. They concluded that international investors tended to underestimate the risk of holding sovereign bonds issued by the New EU Member States, by requiring systematically lower yields compared to what suggested by their model. They interpreted this result by observing that as international investors expected a smooth entry of those new EU Member States into European Monetary Union (EMU), they were anticipating a steady decline in bond yields and spreads. The Authors labeled this phenomenon as the Halo Effect. With the Halo Effect, governments of the new EU Member States were able to borrow externally at a lower interest rate compared to other emerging markets governments.

Panel 1.
Panel 1.

Actual and Fitted Sovereign Bond Spreads

(basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

The results obtained by Luengnaruemitchai and Schadler (2007) appear to be broadly in line with the charts in Panel 1 and the tables in Panels 2–5 (see appendix), as they show that for most of the period between January 2003 and July 2007, in the New EU Member States (Bulgaria, Hungary, Lithuania, Poland and Romania) actual bond spreads were lower than the fitted bond spreads. However, with the beginning of the global financial crisis, those economies experienced bond flow reversals, their bond yields rose and the residuals became positive. Put differently, the results show that the global financial crisis removed the Halo Effect from the valuations of the New EU Member States sovereign bonds. By contrast, for most of the period after January 2006, in a number of Latin American countries – Brazil, Colombia, Mexico, Panama, Peru and Uruguay – sovereign bond yields compressed substantially and the difference between actual and model spreads became negative. Hence, the results suggest that following the latest financial crisis international investors reduced their holdings of sovereign bonds issued in New EU Member States possibly in favor of sovereign bonds issued in Latin America.

Panel 2.
Panel 2.

Actual and Fitted Sovereign Bond Spreads:

(basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

Finally, charts 7-8 plot actual and fitted bond spreads for China and Hungary. The charts show that in 2010 and 2011, as the economic downturn and debt sustainability concerns in some advanced economies became more acute, actual sovereign bond spreads in China and Hungary increased considerably. This increase in risk perceptions could be related to concerns that market participants might have about the potential impact of economic downturn of some advanced economies on the Chinese and Hungarian economies. Put differently, the rising residuals in 2010 and 2011 suggest the possible presence of contagion from the euro area toward emerging market economies.

Panel 3.
Panel 3.

Actual and Fitted Sovereign Bond Spreads

(Basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

E. Robustness Checks

In this session we perform some robustness checks of the coefficient estimates obtained so far. Specifically, we are interested to assess the extent to which the coefficient estimates change if the dimensions of the panel change as follows. First, we remove Argentina from the list of the countries in the panel, de facto omitting a major financial crisis after which the sovereign spreads remained stubbornly high before the debt-rescheduling with private creditors in 2005. Second, we change the time dimension of the panel by restricting it to the period included between 2003 and 2011. In this way, we exclude from the panel those observations relative to the financial crises originating in emerging economies between 1998 and 2002.

Table 3.

Sovereign Bond Spreads: Coefficient Estimates, Robustness Checks.

article image
**Significant at 1 %, *significant at 5%. Driscoll-Kraay robust standard errors in parentheses.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

Table 3 shows that most of the coefficient estimates of the country-specific explanatory variables maintain the sign and the degree of statistical significance even if the dimensions of the panel change. The coefficient of the country-specific explanatory variables that varies the most of is the one associated to the economic risk rating, which becomes more important in containing sovereign bond yield spreads if the crisis observations are omitted from the panel. Overall, the results suggest that the impact of having good economic indicators on bond yield spreads is stronger when the panel does not include observations relative to the 1998-2002 emerging market financial crises. The implication is that during tranquil times, having good economic fundamentals may be quite effective in containing external borrowing cost. In crisis times, good macroeconomic fundamentals are still helpful in containing bond spreads, but less than during crisis times. Perhaps this is because extra-economic forces are also responsible for the movement in bond spreads during crisis times.

F. Simulating an Improvement in Country-specific Variables on Bond Spreads

After having established that the impact of country-specific factors on emerging market bond spreads varies across regions and periods, we now turn to simulate the impact of potential changes in country-specific explanatory variables on bond spreads of all the emerging economy included in the panel.

Emerging economies sovereign bond spreads have been regressed over a set of country-specific factors, all expressed as indices. For each emerging economy in the panel we calculate the percent change in the estimated bond spread provoked by a one-standard deviation change in each country-specific explanatory variable, holding everything else constant.

The results are reported in table 4 and panel 1. An improvement in country-specific explanatory variables lowers bond spreads, while a deterioration in country-specific factors increases it. The impact is asymmetric, as the increase in the model spread provoked by deteriorating fundamentals tends to be larger than the decline in the bond spread provoked by improving fundamentals. For example, a one-standard deviation improvement in the economic risk rating leads to a decline of the average model spread of 6.1%.12

Table 4.

Impact of one-standard deviation change on the model spread

(Percent)

article image
Sources: J.P. Morgan, Bloomberg, ICRG Database and author’s calculations.

Conversely, a one-standard deviation deterioration in the economic risk rating is estimated to increase the external cost of borrowing by 7.5%. The financial risk rating, a proxy for the degree of external vulnerability, is the country fundamental with the strongest estimated impacts on the cost of external borrowing. A one-standard deviation improvement in the financial risk rating lowers the average model spread by 18.1%, while a one-standard deviation deterioration in the financial risk rating increases the average model spread by 26.6%. The impact of a change in the political risk rating is asymmetric as well. A one-standard deviation improvement in the political risk rating index lowers the average model bond spread by 10%, while a deterioration increases it by 12.3%.

Summing up, changes in the economic risk rating have the smallest impact on the estimated spreads, while the financial risk rating is the country-specific fundamental that affects the estimated bond spread the most.

The countries that benefit most from an improvement in the economic risk rating are Russia and Venezuela. A one-standard deviation improvement in the economic risk rating in Russia and Venezuela would have lowered the model spread by 12.9% and 11% respectively.

Improvements in financial risk rating – a proxy for the risk of experiencing sudden capital outflows – would have lowered considerably (e.g. by more than 20%) the model spread in Argentina, Brazil, Bulgaria, Ecuador, Indonesia, Pakistan, Romania, Russia, Turkey, Ukraine and Uruguay. Considerable reductions (e.g. by more than 10%) in the model spread provoked by improvements in political risk rating would have been observed in Argentina, Colombia, Ecuador, Egypt, Indonesia, Pakistan, Philippines, Russia, Turkey, Ukraine and Venezuela.

In Brazil, Russia and South Africa, the country-specific factor affecting the most the model spread is the financial risk rating. In Brazil and Russia, a deterioration of a one-standard deviation in the financial risk rating index can be very costly, as the model spreads would increase by 50% and 43% respectively. By contrast, a similar deterioration in the financial risk rating leads to a more contained (but still considerable) increase in the model spread of South Africa (14.4%). On the other hand, gains would also be considerable for the three countries. A one-standard deviation improvement in the financial risk rating lowers the model spread by 29% in Brazil, 27% in Russia and 12% in South Africa.

Panel 4.
Panel 4.

Impact on the Model Spread Provoked by a One-standard Deviation Change in Country-specific Factors

(Percent)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Sources: J.P. Morgan, ICRG and Author’s calculations.

China is the country where the model spread declines the least following a one-standard deviation improvement in the economic rating, as the model spread declines by only 2.3%. By contrast improvements in China’s financial risk rating and in the political risk rating are more powerful in reducing the model spread. A one-standard deviation improvement in China’s financial risk rating index lowers the model spread by 7.2%, while a one-standard deviation improvement in China’s political risk rating lowers the model spread by 8.7% (almost three times the decline in the model spread following a similar improvement in the economic risk rating). On the other hand, a one-standard deviation deterioration in China’s economic risk rating increases the model spread by 2.4%. A similar deterioration in the political risk rating increases the model spread by 10.1%, more than four times the increase following a deterioration in the economic risk rating.

Summing up, changes in the degree of external vulnerability are estimated to provoke the largest changes in the cost of external financing. Improvements in the degree of external vulnerability are estimated to be three times more effective than improvements in the economic risk rating and almost twice more effective than improvements in the political risk rating in lowering the cost of external debt finance for emerging market economies. In addition, improvements in the degree of political risk are estimated to be twice as more powerful than improvements in the economic risk rating in lowering the cost of external borrowing.

VI. Back-Testing the Model

Thus far, we have estimated emerging markets bond spreads and asked whether the estimates changed across different periods and regions. We now turn to back-test the model by generating in-sample predictions for bond spreads, which will be compared with the actual bond spreads. We follow the idea developed in Berg and Pattillo (1998) and Kumar et al. (2003) among others. We proceed as follows. The time dimension of our panel consists of T observations. We re-estimate the model using the data in a subsample made of t<T observations (the estimation sample) to generate bond spreads forecasts in the remaining part (T-t) of the whole sample (the forecasting sample).

In terms of our study, we re-estimate emerging market bond spreads for the periods January 1998–December 2006, January 1998–December 2007 and January 1998–December 2008 (the estimation samples) in order to forecast bond spreads in the periods January 2007–December 2011, January 2008–December 2011 and January 2009–December 2011, respectively (the forecasting samples). The purpose of this exercise is to ask whether the model can predict accurately bond spreads in periods that are not included in the estimation sample. We use different estimation samples because we are interested to assess whether the in-sample forecasting ability of the model changes with the beginning of the global financial crisis.

We use three methods to generate in-sample predictions for bond spreads. With the first method we re-estimate the model in the estimation sample and obtain the coefficients estimates. 13 Then, in the forecasting sample we multiply the explanatory variables by the estimated coefficients to generate bond spread forecasts for all the emerging economies included in the panel. With the second method – the rolling regression method – we predict bond spread forecasts using a rolling regression routine. We run a regression over the first t<T observations of the sample. Then, the regression is run again adding the following periods t+1, t+2, …, one at a time, until the full original sample T has been employed (see Baum 2006). This routine adds gradually the latest observations in the sample. The third method is another rolling regression method where we begin running a regression over the full sample T. Then the regression is run again removing the first t<T observations of the sample, one at a time, until all the first t observations have been removed from the full sample. This routine eliminates the oldest observations in the sample. With both rolling regression methods, bond spread forecasts are generated only for some of the emerging economies included in the database.14

How do we assess the model ability to generate informative in-sample bond spread predictions? We proceed in three steps. First, in each month of the forecasting sample, we assign a value of one if actual and predicted bond spreads change in the same direction (e.g. they both increase or decrease). Otherwise, if actual and predicted spreads change in opposite directions, we assign a value of zero. We then calculate the probability that each forecasting method correctly predicts the direction of monthly changes in actual bond spreads. Second, within the set of correct calls on the direction of monthly changes in bond spreads, we calculate the probability that each forecasting method correctly predicts upward or downward movements in bond spreads. Finally, we assess the accuracy of the two forecasting methods by running the Diebold and Mariano (1995) test.

A. Linear Prediction Method

Table 5 shows for each emerging economy the probability that the linear prediction (LP) method correctly predicts the direction of the monthly change in actual bond spreads. We consider LP to perform well in predicting the direction of the monthly change in bond spreads if for a given country the probability is above 0.7 in every forecasting period. The countries having a probability above 0.7 in all the forecasting periods are Colombia, Dominican Republic, Indonesia, Peru, Philippines, and Uruguay. By contrast, the model is considered to perform poorly if for a given country the probability is below 0.6 in any of the forecasting periods. By this criterion, the model performs poorly for Argentina, Chile, China, Ecuador, Egypt, Hungary, Lebanon, Malaysia, and Pakistan.

Table 5.

Probabilities that the linear prediction method correctly predicts (i) the direction of monthly changes in bond spreads (M), (ii) upward movements in bond spreads (U), and (iii) downward movements in bond spreads (D)

Probabilities

article image
Legend: M: monthly change in bond spreads; U: upward change in bond spreads; D; downward change in bond spreads.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

The table also shows that in two of the three forecasting samples (January 2007–December 2011 and January 2008 – December 2011), on average the model predicts equally well downward and upward movements in bond spreads. However, if the forecasting sample is restricted to the period January 2009–December 2011, the number of emerging market economies for which the model predicts downward movements in bond spreads better than upward movements rises to thirteen (from ten in the forecasting sample January 2007–December 2011 and twelve in the sample January 2008–December 2011). These results suggest that if the estimation sample includes the year 2008 the model’s ability to forecast declining bond spreads improves. This result is in line with the notion that following the global financial turmoil in 2008, investors preferred to gain exposure to emerging market sovereign debt securities, as they were anticipating a deterioration in credit quality of (sovereign and corporate) debt securities issued in advanced economies.

B. Rolling Regression Method

Table 6 shows for each country the probability that the rolling regression (RR1) method correctly predicts the direction of the monthly change in actual bond spreads.As for the bond spread forecasts obtained with LP, we consider RR1 to perform well in predicting the direction of the monthly change in bond spreads if, for a given country, the probability is above 0.7 in every forecasting period. The countries with a probability above 0.7 in all the forecasting samples are Brazil, Peru, Philippines, Russia, Turkey and Venezuela. By contrast, the model performs less well for Ecuador and Malaysia, where the probability is lower than 0.6. Finally, similarly to the linear prediction method, in each forecasting period the model appears on average to be more successful in predicting downward than in predicting upward movements in bond spreads.

Table 6.

Probabilities that the rolling regression (RR1) method correctly predicts (i) the direction of monthly changes in bond spreads (M), (ii) upward movements in bond spreads (U), and (iii) downward movements in bond spreads (D)

Probabilities

article image
Legend: M: monthly change in bond spreads; U: upward change in bond spreads; D; downward change in bond spreads.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

To check the robustness of the results obtained with RR1, we also run another regression routine (RR2) to forecast bond spreads and calculate the probabilities of correctly predicting the direction of the monthly change in bond spreads. This time we assess whether removing observations – instead of adding them – affects the ability of the model to correctly predict the direction of the monthly change in bond spreads. We proceed as follows. We begin running a regression over the full sample T. Then the regression is run again removing the first t<T observations of the sample, one at a time, until all the first t observations have been removed from the full sample. This routine eliminates the oldest observations in the sample. We intend to check if for each country and in each month of the forecasting period, actual and predicted bond spreads change in the same direction. In addition to that, we are interested to check whether the model forecasts better upward or downward monthly changes in bond spreads. The results are summarized in table A1 (see Appendix). The RR2 method obtains the best results for Brazil, Bulgaria, Colombia, Mexico, Panama, Philippines, South Africa and Turkey, while it performs less well for China, Ecuador and Malaysia. Finally the results confirm that the model on average predicts downward movements better than upward movements in bond spreads.

Summing up, judging by the probability to correctly predict the direction of the monthly changes in bond spreads, all the forecasting methods used – LP, RR1 and RR2 – appear to be successful. The results also show that all methods are better in predicting downward than upward movements in bond spreads. However, this does not constitute sufficient information to assess which of the forecasting methods is the most accurate in predicting the direction of monthly change in bond spreads. In the next section, we run the Diebold and Mariano (1995) test for forecasting accuracy.

C. Comparing Competing Forecasts

We perform the Diebold–Mariano (1995) test for each emerging economy for which we have generated bond spread predictions with both forecasting methods.15 Given actual bond spreads, the Diebold Mariano test is a measure to establish which of the two competing methods has the highest predictive accuracy in forecasting bond spreads. The Diebold-Mariano test outcomes are reported in table 7.

Table 7.

Measuring the accuracy of bond spread forecasts with the Diebold-Mariano test

article image
Significant test outcomes in bold.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

The test outcomes show that in most cases bond spread forecasts obtained with the rolling regression method (RR1) are significantly more accurate than those obtained with the linear prediction method (LP). This result can be motivated by observing that the rolling regression method involves adding one observation at a time to the original estimation sample, hence it is possible to enrich by one observation at a time the information set available to market participants. By contrast, with the linear prediction method, the information set is fixed at time t<T. Intuitively, if market participants have a richer information set available, then they will formulate more accurate predictions for bond spreads.

For robustness, we also ran the Diebold-Mariano test to compare the forecast accuracy of the other method involving a rolling regression routine (RR2) with the linear prediction method. Table A2 (in the Appendix) shows also that RR2 produces more accurate forecasts compared to LP. It also shows that RR2 generates more accurate bond spread forecasts compared to RR1. These results imply that gradually removing the initial (oldest) t<T observations from the estimating sample produces better bond spread forecasts then gradually adding the last (newest) T-t observations to the estimation sample. In addition, for both rolling regression methods (RR1 and RR2) we calculated other measures for forecasting accuracy, such as the mean squared error (MSE), the mean absolute error (MAE) and Theil’s U-Statistics (see tables A3 and A4 in the Appendix).16 The tables show that the bond spread predictions generated with the RR2 method tend to have lower MSE and MAE. The tables also show that, as opposed to the RR1 method, the U-Statistics associated to the bond spread predictions generated with the RR2 method are frequently lower then unity, particularly when the forecasting period is set between January 2008 and December 2011.

We now turn to test whether the forecasting methods used so far – linear prediction and rolling regressions – are significantly more accurate in predicting the monthly changes in bond spreads than a naïve forecasting method (e.g. a random walk model). Following Diebold and Mariano (1995), the series to be forecast is the monthly change in emerging market bond spreads from January 2007 until December 2011. We assess four forecasts: the change in bond spread prediction associated with a random walk model (RW), the predicted monthly changes in bond spreads obtained with the rolling regression methods – RR1 and RR2 – and with the linear prediction method (LP). The Diebold-Mariano (1995) test outcomes are reported in table 8.

Table 8.

Measuring the accuracy of predicted monthly changes in bond spreads with the Diebold-Mariano test

article image
Significant test outcomes in bold (95% confidence level).Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

Table 8 shows that in most cases, when the rolling regression methods are compared with the random walk, it turns out that most of the times the test outcomes are not significant. In the cases of Colombia, Mexico and Poland, the shows that rolling regression methods are significantly more accurate than random walk models in generating in-sample bond spread predictions. In other cases (Ecuador, Malaysia and Peru), rolling regression methods dominate the random walk model, but the test outcomes lack of statistical significance. By contrast, in the cases of Bulgaria and Venezuela, the random walk forecasts of the monthly changes in bond spreads are significantly more accurate than the corresponding rolling regression forecasts. Finally, the random walk forecasts appear significantly more accurate in most of the cases when compared with the linear prediction forecasts. Overall, the results suggest that while the linear prediction method does not deliver more information compared to a random walk model, rolling regression methods can in some cases be more accurate than a random walk models to generate predictions for bond spreads.

VII. Concluding Remarks

This study was divided into two parts. In the first part, in a baseline regression we estimated sovereign bond yield spreads for 28 emerging market economies using a set of country-specific and global factors, over the period January 1998 – December 2011. We also ran the same regression while allowing for the dimensions of the panel to change, and calculated the improvement in the fitted bond spreads following a hypothetical improvement in the country-specific explanatory variables.

The second feature of this study was to back-test the model to assess the ability of the model to generate accurate in-sample forecasts for bond spreads. We generated bond spread forecasts with three competing forecasting methods: linear prediction and two rolling regression routines. For each method used, we checked whether actual and predicted bond spreads changed in the same direction during each month of the forecasting period. Then, we compared the forecasting accuracy of both methods by running the Diebold-Mariano (1995) test. Finally, we compared the accuracy of each forecasting method against that of random walk model in predicting bond spreads.

A number of conclusions can be drawn from this study.

First, the results show that the coefficient estimates and statistical significance of country-specific and global explanatory variables on bond spreads may vary across time and regions. One possible reason for this finding is that over time and across different emerging economies, investors do not always assign the same weight to country-specific and global factors when selecting which sovereign bonds to hold in their portfolios. From an econometric perspective, the results imply that the coefficient estimates of the explanatory variables and their statistical significance may be sensitive to the dimensions of the panel. Changing the dimensions of the panel may lead to different coefficient estimates and may change the degree of statistical significance for the explanatory variables. However, from a policymaking perspective, despite country-specific explanatory variables may not always be significant to explain bond spreads the results show that good country-specific fundamentals tend to reduce the external cost of borrowing.

Second, the model fails to fully explain the increase in sovereign bond spreads observed in 2010 and 2011 in some emerging economies. The increase in sovereign bond spreads, hence yields, could be related to concerns that international investors might have about the potential impact of the euro area economic downturn on emerging economies and on their borrowing costs. Related to this result, we also find that during crisis times, good macroeconomic fundamentals are helpful in containing bond yield spreads, but less than in non-crisis times. Perhaps this is because extra-economic forces are also responsible for the movement in bond yield spreads when a financial crisis occurs.

Third, changes in the degree of external vulnerability are estimated to cause the largest changes in the cost of external borrowing for emerging economies. Improvements in the degree of external vulnerability are three times more effective than improvements in the economic risk rating and twice more effective than improvements in the political risk rating in lowering the cost of external borrowing. Improvements in the degree of political risk are estimated to be twice as more powerful than improvements in the economic risk rating to lower the cost of external borrowing. The results of these simulations imply that a low degree of external vulnerability and a high degree of political stability can substantially reduce the cost of external borrowing. From a policy perspective, the simulations results underscore the importance for emerging economies to adopt measures aiming to reduce their degree of external vulnerability such as, for example, developing local currency bond markets in order to reduce the reliance on external debt financing. In addition, the simulations results highlight the importance of having in place (or building) strong institutions to achieve and maintain political stability. Failure to do so may have negative implications for the cost of external borrowing.

Finally, we generated in-sample bond spread predictions with two competing forecasting methods. We ran the Diebold-Mariano (1995) test for forecasting accuracy to rank the three competing forecasting methods. Bond spread predictions obtained with rolling regression routines tend to be more accurate than those obtained with linear prediction, possibly reflecting that rolling regression routines allow to gradually enriching in every period the information set available to market participants, unlike in the case of the linear prediction forecasting method. We also tested whether the three forecasting methods used were significantly more accurate in predicting the monthly changes in bond spreads than a naïve forecasting method (e.g. a random walk model). For some countries – Colombia, Mexico and Poland – forecasts of the monthly changes in bond spreads obtained with rolling regression routines were significantly more accurate than forecasts obtained with a random walk model. The findings suggest that the rolling regression method can in some cases be more accurate than a random walk model to generate predictions for bond spreads. By contrast, the linear prediction method does not deliver more information compared to a random walk model. An implication of this finding is that rolling regression routines can be useful when forecasts for bond spreads are needed for scenario analyses to simulate the path of sovereign bond spreads and to measure the degree of fiscal distress.

This study can be extended in a number of directions.

As regards the estimation part of this study, we use indices for political, economic and financial risk from the International Country Risk Guide (ICRG) as country-specific controls in the regression for spreads. While these indices allow for a range of variables to be taken into account and introduced in the model in a parsimonious way, it would be interesting to check how the results look like when these indices are “unbundled” (e.g. use external debt/GDP, external debt/exports, current account/GDP and reserve adequacy indicators as controls rather than the ICRG Financial Risk Rating index). Similarly, it would be interesting to include to the country-specific explanatory variables data for real GDP growth, inflation, current account balance, and industrial production in emerging economies instead of the ICRG Economic Risk Rating index. It would also be interesting to consider other global explanatory variables such as the slope of the U.S. yield curve, as well as other panel estimation techniques that allow estimating the short-term dynamics of bond yield spreads. Another interesting extension would be running separate regressions for each country and compare the forecast performance of the panel regression (where variables such as the VIX have a common coefficient for all countries), with one where it is ran separately for each country (where all variables have a country-specific coefficient).

As regards the forecasting part of the study, another line of work could be to conduct more experiments to see whether sovereign bond spread forecasts have desirable properties for being used as a leading indicator of financial crises. Finally, if would be interesting to back-test a model where the panel includes also advanced economies in addition to emerging ones.

Appendix

A. Tables

Table A1.

Probabilities that the rolling regression (RR2) method correctly predicts (i) the direction of monthly changes in bond spreads (M), (ii) upward movements in bond spreads (U), and (iii) downward movements in bond spreads (D).

Probabilities

article image
Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.
Table A2.

Comparing rolling regression and linear prediction forecasts with the Diebold-Mariano test

article image
Significant test outcomes are in bold.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.
Table A3.

Mean Square Error, Mean Absolute Error and Theil’s U Statistics for the rolling regression (RR1) method

article image
Legend: MSE: mean square error; MAE: mean absolute error; U-STAT: Theil’s U Statistics.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.
Table A4.

Mean Square Error, Mean Absolute Error and Theil’s U Statistics for the rolling regression (RR2) method

article image
Legend: MSE: mean square error; MAE: mean absolute error; U-STAT: Theil’s U Statistics.Sources: J.P. Morgan, Bloomberg, ICRG database, author’s calculations.

B. Charts

Panel A1.
Panel A1.
Panel A1.
Panel A1.
Panel A1.
Panel A1.

Emerging Market Sovereign Bond Spreads: Actual, Fitted and Residuals

Basis Points

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Sources: J.P. Morgan, ICRG Database, Bloomberg and Author’s calculations.
Panel A2:
Panel A2:

Emerging Markets Sovereign Bond Spread Tracker: January 1998 – December 2001

(Basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Panel A3:
Panel A3:

Emerging Markets Sovereign Bond Spread Tracker: January 2002 – December 2005

(Basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Panel A4:
Panel A4:

Emerging Markets Sovereign Bond Spread Tracker: January 2006 – December 2009

(Basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

Panel A5:
Panel A5:

Emerging Markets Sovereign Bond Spread Tracker: January 2010 – December 2011

(Basis points)

Citation: IMF Working Papers 2012, 212; 10.5089/9781475505627.001.A001

References

  • Baldacci, Emanuele, Iva Petrova, Nazim Belhocine, Gabriela Dobrescu and Samah Mazraani 2011, “Assessing Fiscal Stress”, IMF Working Paper No. WP/11/100 (Washington, International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Baum, Christopher, 2006, “An Introduction to Modern Econometrics Using STATA,” STATA Press.

  • Bellas, Dimitri, Michael G. Papaioannou, and Iva Petrova, 2010, “Determinants of Emerging Market Sovereign Bond Spreads: Fundamentals vs Financial Stress”, IMF Working Paper No. WP/10/281 (Washington, International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Berg,