Financial Soundness Indicators and Banking Crises
  • 1 0000000404811396https://isni.org/isni/0000000404811396International Monetary Fund

Contributor Notes

Author’s E-Mail Address: athegeya@imf.org

The paper tests the effectiveness of financial soundness indicators (FSIs) as harbingers of banking crises, using multivariate logit models to see whether FSIs, broad macroeconomic indicators, and institutional indicators can indeed predict crisis occurrences. The analysis draws upon a data set of homogeneous indicators comparable across countries over the period 2005 to 2012, leveraging the IMF’s FSI database. Results indicate significant correlation between some FSIs and the occurrence of systemic banking crises, and suggest that some indicators are precursors to the occurrence of banking crises.

Abstract

The paper tests the effectiveness of financial soundness indicators (FSIs) as harbingers of banking crises, using multivariate logit models to see whether FSIs, broad macroeconomic indicators, and institutional indicators can indeed predict crisis occurrences. The analysis draws upon a data set of homogeneous indicators comparable across countries over the period 2005 to 2012, leveraging the IMF’s FSI database. Results indicate significant correlation between some FSIs and the occurrence of systemic banking crises, and suggest that some indicators are precursors to the occurrence of banking crises.

I. Introduction

Capturing early warning signals of potential financial or banking sector shocks has become increasingly important since the outbreak of the global financial crisis in 2007. In this regard, a critical need has arisen to test current regulatory tools and health indicators of the financial and banking sectors, and also to see how they can be improved.

Financial Soundness Indicators (FSIs) comprise of a set of indicators that measure the health of a country’s financial system. In principle, the evolution of these indicators should indicate potential vulnerabilities of the financial sector and point out possible weaknesses, thereby functioning as tools of macroeconomic policy. However, in light of the recent crisis, it is clear that FSIs have not been used extensively for this purpose.

This paper tests the effectiveness of FSIs as indicators of potential banking crises, using multivariate logit models to see whether FSIs, broad macroeconomic indicators, and institutional indicators can indeed predict crisis occurrences. A two-stage model is estimated to test whether volatility in indicators is correlated with the occurrence of crisis events: in the first stage, linear regressions are run on FSIs against a time trend by country and residuals obtained; in the second stage logit regressions are run on banking crisis events against the FSI residuals, lagged year-on-year differences in macroeconomic indicators, and a composite governance indicator.

Following Laeven and Valencia (2012), banking crises are defined as systemic if: i) there are significant signs of distress in the banking system, evidenced through bank runs, losses or liquidations; and ii) there are significant banking policy intervention measures in response to losses in the banking system. The banking crisis variable used in the analysis is a binary variable encoded as ‘1’ if a systemic banking crisis occurs in a given year, and a ‘0’ otherwise.

The results indicate significant correlation between some FSIs and crises: specifically, regulatory capital to risk-weighted assets (CAR) and return on equity (ROE) show significant negative contemporaneous correlation with the occurrence of banking crises. Additionally, lagged ROE is a significant leading indicator of crises. While the sample period of this analysis corresponds to the global financial crisis of 2007, these results mirror the findings of Čihák and Schaeck (2007), who perform an analysis of global crises over the 1990s.

This paper is the first to make use of a data set of FSIs collected under an internationally accepted methodology. The use of a coherent consolidation basis methodology ensures that financial sector risk exposure within and beyond each country’s economic territory is accurately measured by the indicators. Importantly, this means that FSIs are sensitive to economic and financial sector shocks that extend beyond a given domestic economy. Unlike any previous literature on FSIs, consistent accounting, aggregation and consolidation principles also allow better cross-country comparability of FSIs. While consolidation bases can differ by country, the data are comparable across countries because all significant sources of financial risk are covered at the country level.

Additionally, this paper tests the usefulness of a broader set of FSI indicators than previously tested in existing literature. While currently available data allow an analysis of 6 core FSIs in this paper, the IMF collects data on 12 core and 28 encouraged FSIs, forming a rich basis for future research. As we run reduced-form models, we stress that the results indicate correlations between FSIs and crises, and we do not establish causality by estimating a derived structural model.

A number of studies exist on the determinants of banking crises. Demirgüç-Kunt and Detragiache (1998) use a multivariate logit model to explore which macroeconomic indicators are associated with the emergence of banking crises. Their results suggest that crises tend to occur in an environment of low growth, high inflation, and high real interest rates. Interestingly, they also find that countries with explicit deposit insurance schemes are particularly at risk.

The first study on the use of FSIs as indicators of potential banking sector crises is provided by Čihák and Schaeck (2007). They run the first tests on the ability of FSIs to explain the emergence of banking crises. However, they use FSIs that were not compiled under a commonly accepted international methodology. Therefore, some FSIs are not strictly comparable.2 Similar to Demirgüç-Kunt and Detragiache (1998), they run a multivariate logit model, but they include FSIs as explanatory variables in addition to macroeconomic indicators. They find that the CAR and the NPL ratio provide signals for systemic banking problems, and that the ROE of banks serves as an indicator for the timing of a crisis.

Following the pioneering work of Čihák and Schaeck (2007), Babihuga (2007) tests FSIs against a number of macroeconomic indicators and finds that FSIs fluctuate strongly with the business cycle and the inflation rate. Sun (2011) investigates FSIs at the individual bank level for a list of global financial institutions, and finds that leverage indicators are the most reliable.3

Other studies look at the relationship between firm-specific indicators and financial stability. Bunn and Redwood (2003) use a probit model to assess the determinants of failure amongst UK companies, where their explanatory variables include firm-specific factors and macroeconomic conditions. They find a negative relationship between profitability and corporate failure, and a positive relationship between the debt to assets ratio and the probability of failure. By industry, they find that firms in the services sector are less likely to fail than those in manufacturing and utilities. Bonfim (2009) studies credit risk drivers in a panel data set of Portuguese firms, and finds that both firm-specific and macroeconomic conditions are important determinants of default probabilities over time.

The remainder of the paper is organized as follows. Section II discusses the usefulness of FSIs in the context of financial stability. Section III describes the data used in the econometric analysis. Section IV provides an overview and descriptive statistics of the data. Section V focuses on the empirical model and presents estimation results. Finally, Section VI concludes and discusses directions of further research.

II. FSIs and Financial Stability

FSIs are aggregate measures of the health of a country’s financial sector that comprise a key and integral part of a regulatory authority’s macroprudential surveillance toolkit. The collection of FSIs dates back to 1999, when the IMF and the World Bank launched the Financial Sector Assessment Program (FSAP) to monitor financial system fragility. A subset of FSIs was collected as part of the FSAP, but inconsistency in the data collection methodology hindered cross-country comparisons of data. Following broad consultations in 2000, the IMF, in collaboration with the International Accounting Standards Board (IASB), the Bank for International Settlements (BIS), the Basel Committee for Banking Supervision (BCBS), and other international and regional organizations drafted a guide on concepts, definitions, data sources, and techniques for FSI compilation.4

A consistent set of guidelines has since been established in the Financial Soundness Indicators Compilation Guide published in 2006 (FSI Compilation Guide) and its amendments,5 and the IMF maintains an expanding database of countries that adhere to the methodology and standards specified in the guide. As the regional coverage of FSIs and the number of indicators increase, key regulatory concerns are whether FSIs are effective forward-looking indicators of financial sector distress, and if so, which FSIs are particularly effective.

FSIs are split into two sets of core and encouraged indicators, and currently 80 countries report FSIs on a regular basis to the IMF.6 The core FSIs are collected by all the reporting countries while encouraged indicators are collected on a country-by-country basis depending on financial sector sophistication and data availability. There are 12 core FSIs that span deposit-taking institutions, and these FSIs cover capital adequacy, asset quality, earnings and profitability, liquidity, and sensitivity to market risk.7 Additionally, there are 28 encouraged FSIs defined for deposit-taking institutions, other financial corporations, nonfinancial corporations, households, market liquidity, and real estate markets.

The introduction of Basel III in response to the rapidly changing financial environment has resulted in some key forward-looking redefinitions of core and encouraged FSIs. These revisions are led by the IMF in close collaboration with a broad-based group of experts, international standard setting bodies, FSI-reporting countries, and concerned international organizations.8 Basel III has placed a greater emphasis on common equity in regulatory capital calculations, and the method of measuring the capital base has changed in favor of a narrower definition. In addition, a new counter-cyclical buffer has been introduced. With regard to liquidity standards, Basel III has introduced two internationally harmonized global standards—the liquidity coverage ratio and the net stable funding ratio—as complements to the capital adequacy requirements. Further forward-looking revisions enhance the usefulness of FSIs by including distribution and concentration measures.

The fundamental value of FSIs lies in their properties potentially to indicate overall distress within a banking sector, and in their ability to differentiate between strong and weak banks through comparisons across indicators. FSIs for individual institutions would in principle help country authorities to address emerging issues in time. In addition to their signaling value, FSIs are useful tools for monitoring the overall health of a given banking sector. Even though defaults are likely to occur in the weaker institutions of the banking sector, a systemic crisis is likely to affect aggregate measures of the entire sector’s health. Therefore, FSIs should be correlated with crisis episodes or banking sector shocks, and this paper examines which indicators exhibit the highest levels of correlation with past crises. Further, it explores whether some FSIs can be leading indicators of crises.

III. Data

A. FSI and Macroeconomic Data

The core data set used in this study comprises of 80 countries that report FSIs to the IMF between 2005 and 2012.9 The majority of the FSI reporting countries are European, and only 6 percent are African. Six FSIs are used in the econometric analysis, including CAR, NPLs net of provisions to capital, NPL ratio, ROE, interest margin to gross income, and non-interest expenses to gross income. While the IMF collects data for a larger set of core and encouraged FSIs, data limitations preclude an analysis of the remaining indicators. Further, while the first data points are available in 2005, some countries in the sample do not report FSI data until 2008.

Annual FSI data for core and additional indicators are combined with macroeconomic indicators—GDP growth, broad money to international reserves ratio, inflation rate, credit to the private sector, current account balance to GDP ratio, real effective exchange rate, sovereign credit default swap spreads, and the monetization ratio10—taken from the IMF’s International Financial Statistics database (IFS), the World Bank’s World Development Indicators database (WDI), and Bloomberg.

Additionally, governance indicators are added to the data set to account for cross-country institutional differences. Three indicators that are likely to have an impact on the banking sector—regulatory quality, rule of law, and control of corruption—are taken from the World Bank’s Worldwide Governance Indicators. Each indicator is normalized with a mean zero and a standard deviation of one. As the indicators are highly correlated, a composite index is created as the unweighted average of the three indicators for econometric analysis. The overall choice of macroeconomic and governance variables is driven by the existing empirical literature on the determinants of financial and banking crises, as well as data availability considerations.

The dependent variable in this analysis is a binary outcome indicating the occurrence of a banking crisis as described in Laeven and Valencia (2012). They describe a banking crisis as systemic if two conditions are met: 1) there are significant signs of distress in the banking system, evidenced through bank runs, losses or liquidations; and 2) there are significant banking policy intervention measures in response to losses in the banking system.

Following Boyd et al. (2009), this paper also defines a banking shock as a significant annual decrease in gross loans outstanding, taking thresholds of 10 percent and 20 percent over the period 2005–12. The authors pick this threshold on the basis that a policy response does not indicate the beginning of a crisis, but rather occurs with a significant time lag after a crisis begins. The details of crisis episodes using these two methods are identified in Appendix III. Notably, there is very little overlap in systemic crisis episodes identified between these methods, as Boyd et al. (2009) underscored.

The core data set is combined with additional FSI data collected for the IMF’s Global Financial Stability Report (GFSR) to create an extended data set covering 108 countries over the same time period.11 Two sets of data are also collected for analysis on a temporal basis, an annual data set and a quarterly data set. Details on data collection and the treatment of data gaps are given in Appendix V.

B. Consolidation of FSI Data

Financial systems are complex, and financial risks and exposure may span multiple economic territories. It is important to ensure that data are consolidated to capture financial exposure that may extend beyond a given country’s economic territory. Allowing a country to select the correct consolidation basis ensures a more holistic coverage of the financial sector on a country by country basis.

FSI are compiled using a consolidation methodology that is specified under the FSI Compilation Guide. There are five consolidation bases, namely: Domestically Consolidated (DC); Domestically Controlled, Cross-border, Cross Sector (DCCBS); Domestically Controlled, Cross-border (DCCB); Cross-border, cross-sector consolidation basis for all domestically incorporated entities (CBCSDI); and Cross-border consolidation basis for all domestically incorporated entities (CBDI). The most commonly used of all consolidation bases is DC, which refers to all deposit-taking entities (subsidiaries or branches) operating within the domestic economy. The other consolidation bases include deposit-taking foreign branches and subsidiaries; other branches and subsidiaries in financial intermediation beyond deposit-taking; and differentiate between domestically controlled and foreign controlled entities.

It is important to note that the use of different consolidation bases does not make FSI data incomparable across countries.12 A country selects the most appropriate consolidation basis according to its financial system infrastructure, and a country may opt for a given consolidation basis simply because it estimates that its risk exposure across other dimensions is not significant. For example, advanced economies are likely to have significant cross-country exposure and significant exposure beyond deposit-taking institutions. These economies use the CBCSDI consolidation basis, which covers financial sector risks across borders and across sectors for all domestically incorporated financial institutions. Conversely, developing economies are likely to have most financial exposure concentrated within the domestic economy, and consequently use the DC consolidation basis.

The recommended consolidation bases within the FSI Compilation Guide are CBCSDI and DCCBS, as these have the largest coverage across sectors and borders. Figure 1 illustrates the distribution of consolidation bases by per-capita income across FSI reporting countries, which is likely to be correlated with the degree of financial system sophistication.

Figure 1:
Figure 1:

Distribution of Consolidation Bases by Income Group

Citation: IMF Working Papers 2013, 263; 10.5089/9781484327616.001.A001

WDI definitions used to classify countries by income group. High income countries using DC are Brunei Darussalam, Croatia, Estonia, Poland and Slovak Republic.

IV. Summary Statistics

A. A Comparison of Crisis and Non-Crisis Countries

In contrast to previous periods of banking sector fragility across the world, banking crises over the decade 2000–09 were concentrated in European countries (Figure 2). European countries have seen a steady increase in banking sector fragility since the 1980s, when they enjoyed the highest levels of banking stability. Almost three-quarters of all financial crises experienced over the decade 2000–09 were experienced in Europe. Of these crises, 55 percent occurred within Euro area countries. The extraordinary turmoil during this decade was also concentrated in 2008, when three-quarters of the crisis events occurred.

Figure 2:
Figure 2:

Historical Timeline of Banking Crises

Citation: IMF Working Papers 2013, 263; 10.5089/9781484327616.001.A001

Notes & Sources: Banking crises are defined according to Laeven and Valencia 2012. IMF regions are used for categorization of countries.

Figure 3 illustrates the temporal evolution of FSIs amongst FSI reporting countries, where crisis countries are defined as those that experienced one or more banking crises between 2000 and 2009, and non-crisis countries are those that did not experience any crisis over the same period.13 Crisis countries had on average lower levels of CAR than non-crisis countries, but all countries responded to the 2007 banking crisis with a marked increase in regulatory capital.

Figure 3:
Figure 3:
Figure 3:

FSIs over Time for Crisis and Non-Crisis Countries

Citation: IMF Working Papers 2013, 263; 10.5089/9781484327616.001.A001

Notes & Sources: Graphs plot percent indicators versus years. FSI data from IMF database; banking crises are defined according to Laeven and Valencia (2012). Panels include: regulatory capital to risk-weighted assets; regulatory tier-1 capital to risk-weighted assets; non-performing loans net of provisions to capital; non-performing loans to total gross loans; return on assets; return on equity; non-interest expenses to gross income; and liquid assets to short-term liabilities. FSI data are based on 80 reporting countries. Outliers in the 1st and 99th percentile are excluded. Ukraine is excluded due to significant changes in methodology.

NPLs net of provisions to capital and the NPL ratio increased more rapidly in crisis countries after the 2007 banking crisis, and showed a sustained increase over subsequent years. Return on assets (ROA) and return on equity (ROE) were higher in non-crisis than in crisis countries, although both indicators declined prior to the beginning of the crisis. Non-interest expenses to gross income were higher in crisis countries, and the gap between the two groups increased during the crisis. Crisis countries had better coverage of liquid assets to short-term liabilities (liquidity coverage ratio), although both groups had liquidity coverage ratios below one.

With the exception of the liquidity coverage ratio, the above indicators are aligned with the theory and the existing literature. Non-crisis countries enjoy higher levels of liquid assets, but also maintain higher exposure to short-term liabilities than crisis countries. The liquidity coverage ratio is explained by the fact that crisis countries keep a higher relative level of liquid assets to cover liabilities than non-crisis countries. Within a signaling framework in a world of imperfect information, better banks are able to signal their quality through their performance and the levels of their indicators. A possible explanation for the higher liquidity coverage within crisis countries may be credit rationing. Given that weaker banks are likely to be credit rationed in the event of short-term liquidity shocks, weaker banks may be forced to maintain higher liquidity coverage ratios to overcome any shocks.

In comparison to Čihák and Schaeck (2007), NPL ratios and ROE follow similar patterns. Counter-intuitively, Čihák and Schaeck find that regulatory capital levels are higher in crisis than non-crisis countries within their sample.

Figure 4 illustrates a comparison of two countries: Ireland and Chile. Crisis shocks were concentrated within the Euro area, where Ireland was severely affected by the banking crisis. Conversely, Chile experienced a relatively moderate contraction. The figure compares CAR, NPL ratio and ROE for these countries. Of the indicators, ROE drops precipitously in Ireland, and remains negative for a prolonged period beginning in 2008. In contrast, ROE in Chile remains relatively stable over 2005–2012. The NPL ratio is below 1 percent in Ireland prior to 2008, but jumps significantly thereafter, and continues rising above 10 percent. In contrast, Chile’s NPL ratio increases in 2008 but subsequently stabilizes at a level below 5 percent. For both Ireland and Chile, the CAR does not exhibit a significant drop prior to the banking crisis, but there is an increase in each country’s CAR immediately following the crisis shock.

Figure 4:
Figure 4:

Comparison of Ireland and Chile

Citation: IMF Working Papers 2013, 263; 10.5089/9781484327616.001.A001

B. Description of Core FSIs

The core FSIs used in the analysis exhibit a number of interesting patterns by region and income group. Capital adequacy levels were lowest in high income countries over the sample period. By region, CAR was lowest in Europe and highest in the MENA and Central Asia regions. NPLs net of provisions to capital levels were highest in low and middle-income countries before the crisis, but were surpassed by levels in high-income countries after the start of the crisis. Both NPLs net of provisions and the NPL ratio declined at the beginning of the crisis but subsequently increased across all regions and income groups.

ROE declined consistently during the crisis years, most visibly in Europe. ROE was consistently higher in low and middle-income countries between 2005 and 2012, and was highest in sub-Saharan Africa. Without exhibiting any clear patterns by region, interest margin to gross income showed an increasing trend throughout the sample period. Non-interest expenses to gross income ratios suggest that banks were more efficiently run in low and middle-income countries than in high-income countries as measured by this metric. Appendix IV gives summary statistics of the core FSI indicators used in this paper by income and region. WDI definitions are used to classify countries by income, and IMF regions are used for regional classification.

V. Econometric Analysis

The econometric analysis in this paper assumes that the true likelihood of a financial or banking crisis y is a function of a set of industry-specific indicators Z, and economy-wide indicators X as given by:14

y=α+Xβ+Zγ+u

However, the observed likelihood of a banking crisis is given by economy-wide indicators X and Q as follows:

y=α˜+Xβ˜+Qγ˜+v

where ∀ ziZ

zi=ai+Qbi+ei

and where ei are error terms, and E(y|X,Z,Q)=E(y|X,Z). Conditional on observing industry-specific indicators, the economy-wide indicators carry no additional information. If the industry specific indicators Z are unobserved then economy-wide indicators Q are used as proxy variables and the proxy variable coefficients are biased (a simple proof is given in Appendix VI). FSIs are industry-specific indicators that overcome the bias problem that arises when only economy-wide indicators are used to estimate the likelihood of a banking crisis.

To test the early warning properties of selected FSIs, this paper estimates a multivariate logit model to predict banking crises, where the likelihood of observing a crisis in country i at time t is modeled as a function of macroeconomic indicators and selected FSIs.

The dependent variable is encoded as a ‘1’ if a crisis event occurs and as a ‘0’ for a non-crisis period. The explanatory variables include a set of FSIs, as well as macroeconomic indicators.15 Due to data constraints, the sets of FSIs and macroeconomic variables are limited. Six core FSIs are included in the analysis which measure capital adequacy, asset quality, and earnings and profitability. Due to the incidental parameters problem, maximum likelihood estimates are inconsistent for a fixed effects logit model with fixed time T.16 For a dependent variable yit, Chamberlain (1980) shows that Si=t=1Tyit is sufficient for the incidental parameters, which correspond to the time invariant effects. However, the distribution of data conditional on S excludes all countries that do not experience any crisis over the sample period.17 Following Demirgüç-Kunt and Detragiache (1998), this paper excludes country fixed effects to avoid selecting a biased sample of only countries that experienced crises.

Additionally, crisis episodes are concentrated around 2008 within the data set. This restricts the ability of the model to include time dummies as maximum likelihood estimates are unbounded for all years during which a crisis does not occur. For example, if there are no crisis events in 2005, then the probability of a crisis is zero, and the log-odds ratio is unbounded. Any other variables over which complete or partial separation occurs are also excluded, where separation refers to a rule that can partition the data set into two distinct crisis and non-crisis subsets for a given explanatory variable. For the above reasons, the paper selects a multivariate pooled logit model.18

Model estimation is carried out in two stages. In the first stage, regressions are run on FSIs against a time trend by country and residuals obtained. In the second stage, logit regressions are run on banking crisis events against the FSI residuals and lagged year-on-year differences in macroeconomic indicators and the governance composite indicator. This model specification tests whether volatility in indicators is correlated with the occurrence of crisis events, while correcting for time trends in the data. Year-on-year differences in FSIs are not used due to data constraints: of the countries that experience banking crises, many only start reporting FSIs on the year during which the crisis occurs.

Results

The results indicate significant correlation between some FSIs and crises; specifically, CAR and ROE show significant negative contemporaneous correlation with the occurrence of banking crises. Additionally, lagged ROE is a significant leading indicator of crises. While the sample period of this analysis corresponds to the global financial crisis of 2007, these results mirror the findings of Čihák and Schaeck (2007), who perform an analysis of global crises over the 1990s.

Logit model results are given in Table 1 for 80 countries that compile and report FSIs to the IMF following a consistent accounting and consolidation methodology. Estimates are given for six FSIs: CAR, NPLs net of provisions to capital, NPL ratio, ROE, interest margin to gross income, and non-interest expenses to gross income. Results are presented from an initial parsimonious specification in models I and II that includes common macroeconomic indicators and the composite governance indicator. Models III and IV expand the list of independent variables to include contemporaneous FSIs, and models V and VI include FSIs lagged by one period. Due to multicollinearity, regressions including both FSIs and lagged FSIs are not estimated.19 There is significant variation in the number of crises included in models I through IV, and models V and VI respectively, due to data limitations. The regressions in models V and VI are therefore less indicative as they include almost half the number of crisis observations in models I through IV.

Table 1:

Logit Model Results for FSI Data

article image
Notes & Sources: FSI data correspond to 80 reporting countries from IMF database; macroeconomic variables from WDI and IMF IFS; banking crisis data from Laeven and Valencia (2012). ***, **, and * are levels of significance at 1%, 5% and 10% respectively. Robust standard errors are given in parentheses. 1st and 99th percentiles of observations are excluded from the analysis. FSI variables are residuals from country-by-country regressions of FSIs to a time trend. Models III and IV include contemporaneous FSIs and Models V and VI include FSIs lagged by one period. All macroeconomic variables are year on year differences lagged by one period. The composite governance indicator is the unweighted average of regulatory quality, rule of law and control of corruption. Macroeconomic variable definitions are given in Appendix VII.

Model results show correlation between some FSIs and banking crises. The CAR, ROE and non-interest expenses to gross income show significant contemporaneous correlation with the occurrence of crises, and additionally, lagged ROE is a significant leading indicator of banking crises. Consistent with theory, the coefficients of CAR and ROE are negative, indicating that a decline of each of these FSIs corresponds to a potential crisis. The coefficients also suggest that small changes in CAR have large effects on the probability of default. Results also indicate that an increase in non-income expenses to gross income corresponds to a higher likelihood of banking crises. The coefficient of lagged ROE is positive, consistent with the theory that periods prior to banking crises correspond to high returns and high concomitant risk within the banking sector.

Of the macroeconomic control variables, inflation, monetization and the ratio of broad money to international reserves are positive and significant in some model specifications. However, no macroeconomic variables are consistently significant in all models. The composite governance indicator is insignificant.

Logit model results are presented in Table 2 for three indicators that are included in the IMF’s Global Financial Stability Report (GFSR). FSIs for an additional 28 countries are combined with the core FSI data set for a total of 108 countries. The additional FSIs are not guaranteed to follow a consistent methodology as followed within the core FSI data set, but the models are estimated due to the additional coverage by region and by size of economy over time. The FSIs included are CAR, NPL ratio and ROE. Similar to the core FSI data set, six model specifications are estimated.

Table 2:

Logit Model Results for Extended FSI data

article image
Notes & Sources: FSI data correspond to 80 reporting countries from IMF database and GFSR data for 28 additional countries; macroeconomic variables from WDI and IMF IFS; banking crisis data from Laeven and Valencia (2012). ***, **, and * are levels of significance at 1%, 5% and 10% respectively. Robust standard errors are given in parentheses. 1st and 99th percentiles of observations are excluded from the analysis. FSI variables are residuals from country-by-country regressions of FSIs to a time trend. Models III and IV include contemporaneous FSIs and Models V and VI include FSIs lagged by one period. All macroeconomic variables are year on year differences lagged by one period. The composite governance indicator is the unweighted average of regulatory quality, rule of law and control of corruption. Macroeconomic variable definitions are given in Appendix VII.

Results of the analysis based on the extended data set suggest that CAR, NPL ratio and ROE for depository corporations provide signals of the likelihood of occurrence of banking crises. Of the lagged variables, only ROE seems to be an early warning indicator. The NPL ratio is significant with a negative sign, and may indicate the refinancing of loans or a transfer of poor quality loans off balance sheet during restructuring measures taken during periods of heightened distress. Of the macroeconomic control variables inflation and credit to the private sector are significant in some model specifications. No macroeconomic control variables are significant across all model specifications, and the composite governance indicator is insignificant across all specifications.

The performance of the logit regressions is assessed based on model chi-squared and Akaike’s Information Criterion (AIC). The chi-squared suggests that the null hypothesis that all partial slope coefficients are equal to zero can be rejected for all model specifications of Tables 1 and 2. The AIC penalizes regression models for adding regressors, and the model with the lowest AIC is preferred. According to the AIC, specifications including FSIs tend to perform better than specifications without FSIs. All model specifications have a strong capacity to classify non-crisis events, but do not accurately classify crisis events. However, the classification accuracy of crisis events jumps significantly for model specifications that include FSIs in comparison to those specifications that do not include FSIs. The performance suggests that FSIs add predictive power beyond estimates obtained solely using macroeconomic indicators.

Robustness

In addition to annual data, the analysis has been conducted using a quarterly data set over the period 2005 Q1 through 2012 Q4 for both FSI reporting countries and the GFSR set of countries. The results are in line with those given in Tables 1 and 2.

In addition to testing differences in FSIs, models are estimated to test the ability of FSI and macroeconomic variable levels to predict banking crises. Logit estimates are consistent but inefficient if there is time dependence, and Poirier and Ruud (1998) show that standard errors are wrong. This paper corrects the standard errors by using robust standard errors clustered around observations by country. Additionally, the duration since the last crisis and the number of past crises in each country since 1970 are included as explanatory variables.20 CAR and ROE remain significant in these models.

Additional robustness tests were conducted by including regional dummy variables, the Volatility Index (VIX), the ratio of external debt to GDP, and return on assets. Regional dummy variables and the VIX were dropped from the analysis due to separation within the annual data set. For example, there are no crisis observations within the Asia and Pacific, Middle East and Central Asia, and sub-Saharan Africa regions.21 External debt to GDP is insignificant, and is dropped from the results as both the coefficient and standard error are quite large, indicating convergence problems. Return on assets is dropped from the analysis due to a strong positive correlation with return on equity.

A comparison of the same regression specifications as Čihák and Schaeck (2007) is given in Table 3. The Results show that contemporaneous CAR and NPL ratio, and lagged CAR and ROE for deposit taking institutions have significant explanatory power. Of the macroeconomic control variables, M2 to international reserves, real GDP per capita, and GDP growth are significant in some specifications. In contrast to Čihák and Schaeck (2007), the coefficient on lagged ROE is positive and the coefficient on contemporaneous NPL ratio is negative.

Table 3:

Logit Model Results – Comparison to Čihák and Schaeck

article image
Notes & Sources: FSI data correspond to 80 reporting countries from IMF database; macroeconomic variables from WDI and IMF IFS; banking crisis data from Laeven and Valencia (2012). ***, **, and * are levels of significance at 1%, 5% and 10% respectively. Robust standard errors are given in parentheses. 1st and 99th percentiles of observations are excluded from the analysis. Model numbers correspond to models in Čihák and Schaeck (2007), Table 4. Models IV, VI, VIII and X are excluded due to data constraints for corporate ROE and debt/equity FSIs.

VI. Final remarks

Our analysis adds to the burgeoning literature on the usefulness of FSIs. The analysis is the first to make use of a data set of FSIs collected under an internationally accepted methodology. Consistent accounting, aggregation and consolidation principles allow cross-country comparability of FSIs, and a coherent consolidation basis methodology ensures that indicators are sensitive to financial sector risk exposure both within and beyond each country’s economic territory.

By estimating a simple multivariate logit model on FSI indicators and macroeconomic control variables, the paper demonstrates that FSIs are contemporaneously correlated with the occurrence of banking crises. Specifically, CAR and ROE show a negative correlation with crisis episodes across a number of model specifications. The analysis also indicates that lagged ROE may be a leading indicator of banking crises. These findings resonate with Čihák and Schaeck (2007).

While the results offer support for the usefulness of FSIs, the analysis was hampered by a lack of sufficient data to include a larger set of core and encouraged FSIs. Coverage of core and encouraged FSIs is limited by gaps in historical reporting of FSIs, and in many countries consistent reporting only begins after 2008. The analysis would benefit from compilation of historical FSI data for all countries with data gaps prior to the banking crisis shock. Macroprudential regulation and future research on FSIs will also benefit from increased coverage of FSIs across countries and across various sectors within financial intermediation going forward, as well as a longer time-series of data.

Appendix I: List of Core and Encouraged FSIs for Deposit-Takers

Core Set of FSIs

  • 1 Regulatory Capital to risk weighted assets

  • 2 Nonperforming loans net of provisions to capital

  • 3 Sectoral distribution of loans to total loans

  • 4 Return on equity

  • 5 Noninterest expenses to gross income

  • 6 Liquid assets to short-term liabilities

  • 7 Regulatory Tier 1 capital to risk weighted assets

  • 8 Nonperforming loans to total gross loans

  • 9 Return on assets

  • 10 Interest margin to gross income

  • 11 Liquid assets to total assets (liquid assets ratio)

  • 12 Net open position in foreign exchange to capital

Encouraged Set of FSIs

Deposit-Takers
  • 1 Capital to assets

  • 2 Geographical distribution of loans to total loans

  • 3 Gross liability position in financial derivatives to capital

  • 4 Personnel expenses to noninterest expenses

  • 5 Spread between highest and lowest interbank rate

  • 6 Foreign-currency-denominated loans to total loans

  • 7 Net open position in equities to capital

  • 8 Large exposures to capital

  • 9 Gross asset position in financial derivatives to capital

  • 10 Trading income to total income

  • 11 Spread between reference lending and deposit rates

  • 12 Customer deposits to total (non-interbank) loans

  • 13 Foreign-currency-denominated liabilities to total liabilities

Other Financial Corporations
  • 14 Assets to total financial system assets

  • 15 Assets to GDP

Nonfinancial Corporations
  • 16 Total debt to equity

  • 17 Return on equity

  • 18 Earnings to interest and principal expenses

  • 19 Net foreign exchange exposure to equity

  • 20 Number of applications for protection from creditors

Households
  • 21 Household debt to GDP

  • 22 Household debt service and principal payments to income

Market Liquidity
  • 23 Average bid-ask spread in the securities market

  • 24 Average daily turnover ratio in the securities market

Real estate markets
  • 25 Residential real estate prices

  • 26 Commercial real estate prices

  • 27 Residential real estate loans to total loans

  • 28 Commercial real estate loans to total loans

Appendix IIA: List of Countries Included in Core FSI Database

Sub-Saharan Africa

  • 1 Kenya

  • 2 Mauritius

  • 3 Seychelles

  • 4 South Africa

  • 5 Uganda

Asia and Pacific

  • 6 Australia

  • 7 Bhutan

  • 8 Brunei Darussalam

  • 9 China, P.R.: Hong Kong

  • 10 China, P.R.: Mainland

  • 11 India

  • 12 Indonesia

  • 13 Japan

  • 14 Korea, Republic of

  • 15 Malaysia

  • 16 Philippines

  • 17 Singapore

  • 18 Sri-Lanka

Europe

  • 19 Austria

  • 20 Belarus

  • 21 Belgium

  • 22 Bosnia and Herzegovina

  • 23 Bulgaria

  • 24 Croatia

  • 25 Cyprus

  • 26 Czech Republic

  • 27 Denmark

  • 28 Estonia

  • 29 Finland

  • 30 France

  • 31 Germany

  • 32 Greece

  • 33 Hungary

  • 34 Ireland

  • 35 Israel

  • 36 Italy

  • 37 Kosovo, Republic of

  • 38 Latvia

  • 39 Lithuania

  • 40 Luxembourg

  • 41 Macedonia, FYR

  • 42 Malta

  • 43 Moldova

  • 44 Netherlands

  • 45 Norway

  • 46 Poland

  • 47 Portugal

  • 48 Romania

  • 49 Russian Federation

  • 50 Slovak Republic

  • 51 Slovenia

  • 52 Spain

  • 53 Sweden

  • 54 Switzerland

  • 55 Turkey

  • 56 Ukraine

  • 57 United Kingdom

Middle East and Central Asia

  • 58 Afghanistan, Islamic Republic of

  • 59 Algeria

  • 60 Armenia, Republic of

  • 61 Georgia

  • 62 Kazakhstan

  • 63 Lebanon

  • 64 Pakistan

  • 65 Uzbekistan

  • 66 West Bank and Gaza

Western Hemisphere

  • 67 Argentina

  • 68 Brazil

  • 69 Canada

  • 70 Chile

  • 71 Colombia

  • 72 Costa Rica

  • 73 Ecuador

  • 74 El Salvador

  • 75 Honduras

  • 76 Mexico

  • 77 Paraguay

  • 78 Peru

  • 79 United States

  • 80 Uruguay

Appendix IIB: List of Additional Countries Included in Extended FSI Database

Sub-Saharan Africa

  • 1 Gabon

  • 2 Ghana

  • 3 Lesotho

  • 4 Mozambique

  • 5 Namibia

  • 6 Nigeria

  • 7 Rwanda

  • 8 Senegal

  • 9 Sierra Leone

  • 10 Swaziland

Asia and Pacific

  • 11 Thailand

Europe

  • 12 Albania

  • 13 Iceland

  • 14 Montenegro

  • 15 Serbia

Middle East and Central Asia

  • 16 Egypt

  • 17 Jordan

  • 18 Kuwait

  • 19 Morocco

  • 20 Oman

  • 21 Saudi Arabia

  • 22 Tunisia

  • 23 United Arab Emirates

Western Hemisphere

  • 24 Bolivia

  • 25 Dominican Republic

  • 26 Guatemala

  • 27 Panama

  • 28 Venezuela

Appendix III: List of Banking Crises since 2005

article image
Notes & Sources: Banking crisis data from Laeven and Valencia (2012), and authors’ calculations.

Appendix IV: FSI Statistics by Income and Region

Regulatory capital to risk-weighted assets

article image
Source: Authors’ calculations.

Non-performing loans net of provisions to capital

article image
Source: Authors’ calculations

Non-performing loans to total loans

article image
Source: Authors’ calculations

Return on equity

article image
Source: Authors’ calculations

Interest margin to gross income

article image
Source: Authors’ calculations

Non-interest expenses to gross income

article image
Source: Authors’ calculations

Appendix V: Data Notes

Lending rates are not consistently defined across countries. Each country is required to report a lending rate to the IMF, but the IMF does not historically impose any restrictions on what the lending rate should be. More recently, more detailed lending data are collected. IMF IFS notes on countries missing lending rates data are as follows:

  • Austria – Lending rate corresponds to rate on loans to enterprises up to one year

  • Denmark – Calculated from interest accrued on krone-denominated loan accounts divided by average loan balance in the quarter

  • France – Rate on short-term bank loans

  • Germany – Rate on current-account credit in denominations of less than 500,000 euro

  • Luxembourg – Minimum rate on mortgage loans by the Banque es Caisse d’Epargne de l’Etat

  • Sweden – End-quarter average lending rate of 11 largest commercial banks

  • Greece – Short-term loans to enterprises

  • Ireland – Lower point of range of rates charged on short-term loans to large commercial customers by the associated banks

  • Portugal – Weighted monthly average rate charged by commercial banks on 91- to 180-day loans and advances to nonfinancial private enterprises

  • Spain – Rate charged by banks to discount three-month commercial bills

  • Kazakhstan – None

The following series are substituted, and deflated with the GDP deflator:

  • Austria – Corporations: stocks, up to 1 year

  • Denmark – Mortgage bond yield (no corporate rate available)

  • France – Corporations: stocks, up to 1 year

  • Germany - Corporations: stocks, up to 1 year

  • Luxembourg - Corporations: stocks, up to 1 year

  • Sweden – Government bond yield (no corporate rate available)

  • Greece - Corporations: stocks, up to 1 year

  • Ireland - Corporations: stocks, up to 1 year

  • Portugal - Corporations: stocks, up to 1 year

  • Spain - Corporations: stocks, up to 1 year

Broad money growth is incomplete for a number of countries. Broad money is calculated using IMF IFS data for countries where data are missing, using the formula:

Broad money = Net Foreign Assets + Domestic Claims − Other Items Net

Data from Standard Report Form (SRF) countries are combined with data from non-SRF countries using a butt-splice methodology, as this methodology allows for the longest data series.22 For countries where claims on private sector are unavailable, aggregate claims on other sectors are taken as an estimate, which include claims on other financial corporations, state and local government, and public non-financial corporations.

Appendix VI: Proof of Proxy Variable Coefficient Bias

This paper considers the true likelihood of a financial or banking crisis y as a function of a set of industry-specific indicators Z, and economy-wide indicators X as given by:

y=α+Xβ+Zγ+u

for K economy-wide and L industry-specific indicators. The observed likelihood of a banking crisis is given by economy-wide indicators X and Q as:

y=α˜+Xβ˜+Qγ˜+v

for M indicators Q, where ∀ ziZ

zi=ai+Qbi+ei

and where ei are error terms. Stacking the equations for all zi gives:

Z=A+QB+E

where A is L x 1, Q and B are L x M and M x L respectively, and E is L x 1. Assuming that E(y|X,Z,Q)=E(y|X,Z) and E(ei|X)=0 for all ei, and substituting Equation 4 into Equation 1:

Y=(a+Aγ)+Xβ+(QB)γ+(u+Eγ)

where the intercept is α + Aγ, the error term is u + Eγ and the economy-wide indicators are given by (Q′B)′γ. It follows that the intercept α˜ and the coefficients γ˜ are biased, although the coefficients β˜ remain unbiased.

Appendix VII: Description of Variables

article image
article image

References

  • Babihuga, R., 2007, “Macroeconomic and Financial Soundness Indicators: An Empirical Investigation”, IMF Working Paper 07/115, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Beck, N., Katz, J., and Richard Tucker, 1998, “Beyond Ordinary Logit: Taking Time Seriously in Binary Time-Series-Cross-Section Models”, American Journal of Political Science Vol. 42, 126088.

    • Search Google Scholar
    • Export Citation
  • Bonfim, D., 2009, “Credit Risk Drivers: Evaluating the Contribution of Firm Level Information and of Macroeconomic Dynamics”, Journal of Banking and Finance Vol. 33, 281299.

    • Search Google Scholar
    • Export Citation
  • Boyd, J., De Nicolo, G., and E. Loukoianova, 2009, “Banking Crises and Crisis Dating: Theory and Evidence”, IMF Working Paper 09/141, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Bunn, P., and Victoria Redwood, 2003, “Company Accounts Based Modelling of Business Failures and the Implications for Financial Stability”, Working Paper 210 (Bank of England).

    • Search Google Scholar
    • Export Citation
  • Chamberlain, G., 1980, “Analysis of Covariance with Qualitative Data”, Review of Economic Studies Vol. 47, 225238.

  • Čihák, M., and Schaeck, Klaus., 2007, “How Well Do Aggregate Bank Ratios Identify Banking Problems”, IMF Working Paper 07/275, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Demirgüç-Kunt, A., and E. Detragiache, 1998, “The Determinants of Banking Crises in Developing and Developed Countries,Staff Papers, International Monetary Fund, Vol. 45, No. 1, pp. 81109.

    • Search Google Scholar
    • Export Citation
  • Demirgüç-Kunt, A., and E. Detragiache, 1999, “Monitoring Banking Sector Fragility: A Multivariate Logit Approach”. IMF Working Paper 99/147, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Hsiao, C., 2003, Analysis of Panel Data (Cambridge University Press, Cambridge).

  • International Monetary Fund, 2001, “Financial Soundness Indicators: Policy Paperhttp://www.imf.org/external/np/mae/fsi/2001/eng/pp.pdf.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2005, “Progress on the Financial Soundness Indicators Work Program,SM/05/215, http://www.imf.org/external/np/sta/fsi/eng/2005/061405.htm.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2003, Public Information Notice (PIN) No. 03/71, June 13, 2003, http://www.imf.org/external/np/sec/pn/2003/pn0371.htm.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2003b, “Financial Soundness Indicators,Policy Paper, SM/03/175, http://www.imf.org/external/np/sta/fsi/eng/2003/051403.pdf.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2007, “Financial Soundness Indicators: Experience with the Coordinated Compilation Exercise and Next Steps”.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2007, Public Information Notice (PIN) No. 07/135, November 20, 2007, http://www.imf.org/external/np/sec/pn/2007/pn07135.htm.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2013, “Modifications to The Current List of Financial Soundness Indicators”.

  • International Monetary Fund, 2013, “Modifications to The Current List of Financial Soundness Indicators—Background Paper”.

  • Laeven, L., and Valencia, F., 2012, “Systemic Banking Crises: An Update”, IMF Working Paper 12/163, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Minoiu, C., and Reyes, A. J., 2010, “A network analysis of global banking: 1978–2009”, IMF Working Paper 11/74, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Neyman, J., and Scott, E. L., 1948, “Consistent Estimation from Partially Consistent Observations”, Econometrica Vol. 16, 132.

  • Poirier, D., and Paul Rudd, 1988, “Probit with Dependent Observations”, Review of Economic Studies Vol. 55, 593614.

  • Reinhart, C. M., and Rogoff, K. S., 2008, “Is the 2007 U.S. sub-prime Financial Crisis so different? An international historical comparison”, NBER Working Paper 13761, (Cambridge: National Bureau of Economic Research).

    • Search Google Scholar
    • Export Citation
  • Sun, T., 2011, “Identifying Vulnerabilities in Systemically Important Financial Institutions in a Macro-financial Linkages Framework”, IMF Working Paper 11/11, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Sundararajan, V., Enoch, C., San Jose, A., Hilbers, P., Krueger R., Moretti, M., and Slack, G., 2002Financial Soundness Indicators: Analytical Aspects and Country Practices.Occasional paper 212 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
1

The authors thank Luca Errico, Elena Loukoianova, Yevgeniya Korniyenko, Thomas Elkjaer, Joseph Crowley, Renato Perez, Phousnith Khay, Artak Harutyunyan, Xiuzhen Zhao, and IMF seminar participants for valuable suggestions. The authors also highly appreciate the assistance of Laurent Meister, Naman Khandelwal, Eric Dery, Sergio Gutierrez, Hanan AbuShanab, and Afshan Hina with regard to data management.

2

Differences within the data set include institutional coverage, inter-group consolidation adjustments, and accounting differences under the International Financial Reporting Standards (IFRS).

3

Leverage indicators in the study include debt to common equity, debt to assets, long-term debt to capital, short-term and current portfolio long-term debt to total debt, and cost of debt.

4

See Financial Soundness Indicators: Experience with the Coordinated Compilation Exercise and Next Steps (http://www.imf.org/External/NP/pp/2007/eng/101807a.pdf); Financial Soundness Indicators: Policy Paper (http://www.imf.org/external/np/mae/fsi/2001/eng/pp.pdf); Financial Soundness Indicators (http://www.imf.org/external/np/sta/fsi/eng/2003/051403.pdf).

5

The FSI guide is available from the IMF website: http://www.imf.org/external/pubs/ft/fsi/guide/2006/index.htm. Amendments to the FSI guide are available at: http://www.imf.org/external/pubs/ft/fsi/guide/2008/pdf/071408.pdf.

6

FSI data are publicly available from the IMF website: http://fsi.imf.org/.

7

See Appendix I for details.

8

See International Monetary Fund, 2013, Modifications to The Current List of Financial Soundness Indicators; International Monetary Fund, 2013, Modifications to The Current List of Financial Soundness Indicators – Background Paper.

9

See Appendix IIA for details.

10

The monetization ratio is defined as the ratio of broad money to GDP. Detailed variable definitions are given in Appendix VII.

11

The list of the additional countries included in the extended data set is provided in Appendix IIB.

12

Within countries, different consolidation bases may be used for different indicators depending on data availability.

13

A list of countries that experienced financial crises since 2005 is given in Appendix III. Additionally, Uruguay and the Dominican Republic experience crises in 2002 and 2003 respectively.

14

Defaults in the banking sector can arise for a number of reasons. Exogenous shocks in other sectors to which the banking sector is exposed can trigger defaults. Within the banking sector itself, poorly capitalized or mismanaged banks can experience distress.

15

Appendix VII provides details of explanatory variables.

16

Information about incidental parameters stops accumulating after a finite number have been taken. Neyman and Scott (1948) describe the general incidental parameters problem. Hsiao (2003) gives a simple illustration of inconsistency of the maximum likelihood estimates for a logit model with one regressor that is observed over two periods.

17

Any country that experiences a crisis during every period of the sample would also be dropped. A simple illustration can be given for time T = 2. Conditional on yi1+yi2=0, the probability that yi1 and yi2 are zero equals 1. Similarly, conditional on yi1+yi2=2, the probability that yi1 and yi2 are 1 equals 1. The log likelihood for both types of observations is zero conditional on the sum of the dependent variable over T (Chamberlain, 1980). Thus, the terms add nothing to the conditional loglikelihood.

18

For example, stock market volatility can be modeled by including the volatility index (VIX). However, in any year in which the sample does not have any crisis observations, the crisis variable is completely determined; that is, the probability of a crisis is zero conditional on the VIX observation for the year. The logit coefficient in this instance is minus infinity.

19

Multicollinearity is identified due to high variance inflation factors between FSIs and lagged FSIs.

20

An alternative solution as shown by Beck et al. (1998) is to include a series of dummy variables marking the number of periods that have passed since the last crisis occurrence in each country. This specification is argued to be equivalent to a duration model. This solution is not adopted as the crisis variable is completely determined for a subset of the dummy variables.

21

There are no crisis observations within the core data set for sub-Saharan Africa, but Nigeria is included in the extended data set. Observations for Kazakhstan are dropped in 2007 as FSIs are outliers in the 99.5th percentile.

22

A backwards ratio splice was also considered but not used because a large number of countries did not have overlapping data to calculate the ratio.