Ukraine: Ex Post Evaluation of Exceptional Access Under the 2014 Stand-By Arrangement

Ukraine requested a 24-month SDR 10.976 billion exceptional access Stand-By Arrangement (SBA) in April 2014 against the backdrop of large internal and external imbalances, considerable domestic political upheaval, and an emerging conflict in the East. Inconsistent macroeconomic policies in the preceding years had led to a potent combination of an overvalued pegged exchange rate, large and growing twin deficits, and a weak banking system by end-2013. Domestic political turmoil and conflict in Crimea and Eastern Ukraine added to these problems, creating an urgent need for financial assistance from the international community. The 2014 SBA (of about $17 billion) was Ukraine's third since 2008.

Abstract

Ukraine requested a 24-month SDR 10.976 billion exceptional access Stand-By Arrangement (SBA) in April 2014 against the backdrop of large internal and external imbalances, considerable domestic political upheaval, and an emerging conflict in the East. Inconsistent macroeconomic policies in the preceding years had led to a potent combination of an overvalued pegged exchange rate, large and growing twin deficits, and a weak banking system by end-2013. Domestic political turmoil and conflict in Crimea and Eastern Ukraine added to these problems, creating an urgent need for financial assistance from the international community. The 2014 SBA (of about $17 billion) was Ukraine's third since 2008.

Introduction

1. This paper presents an Ex Post Evaluation (EPE) of the 2014 Stand-By Arrangement (SBA) with Ukraine. The 24 month, SDR 10.976 billion (800 percent of quota) program was approved in April 2014. The first review was concluded in August and the program was canceled on March 11, 2015 with the approval of an Extended Fund Facility (EFF) arrangement. The approved level of access under the SBA was “exceptional” as it involved access above the Fund’s normal access limits that were prevailing at that time (200 and 600 percent of quota on an annual and cumulative basis, respectively). Fund policy requires an EPE to be completed for exceptional access programs in the year after they end, to assess “whether justifications presented at the outset of the program were consistent with Fund policies and to review performance under the program” (See Ex Post Evaluation of Exceptional Access Arrangements—Revised Guidance Note).

2. The paper is organized as follows: The next section describes the background and context for the 2014 SBA. The subsequent sections give an overview of the program strategy and design, summarize program objectives and outturns in the key policy and reform areas, assess whether the program adhered to Fund policies, and explore questions that arise from the 2014 SBA experience. Lessons from the program and authorities views on the findings conclude the report.

Background and Context for the 2014 SBA

3. Ukraine had a long history of engagement with the Fund prior to the 2014 SBA, with some similarities among past programs. The 2005 Ex Post Assessment (EPA) and the EPEs for subsequent exceptional access programs note that weak policies and political instability had prevented Ukraine from fully transitioning to a market-based system. The associated vulnerabilities had periodically given rise to financing needs, requiring external assistance, including from the Fund. Past program requests have also typically coincided with a change in political leadership. According to the EPA and the EPEs, past programs were relatively successful at stabilizing the macroeconomic situation, but had made less progress on structural reforms due to the lack of ownership and governance issues before going off track (Box 1).

4. Vulnerabilities had been building up for some time in the lead up to the 2014 SBA. As discussed in the 2013 Article IV Report (IMF Country Report No. 14/145), progress on reforms had stalled in the aftermath of the 2010 SBA, and inconsistent macroeconomic policies had deepened vulnerabilities in the lead up to 2014. In particular, a potent combination of an effectively pegged overvalued exchange rate, twin deficits reflecting unsustainable energy pricing policies and generous spending, deficit financing through bank balance sheets and monetization, a steady rise in indebtedness, growing contingent liabilities, pressure on international reserves and loss of market access characterized the economy in late 2013.

5. Ukraine was also undergoing another period of political change. Then-President Yanukovych’s unexpected decision not to sign the EU trade treaty in late November 2013 gave rise to anti-government protests (“Maidan” movement), culminating in then-Prime Minister Azarov resigning in January and, subsequently, President Yanukovych stepping down on February 22. Presidential elections were expected in May, but it was not clear whether parliamentary elections would be held at that point.

6. One important difference from earlier programs was a newly-emerging conflict in the East. Right after President Yanukovych left office, tensions emerged in Crimea and soon spread in the Eastern regions. In addition, a gas price dispute emerged between Gazprom and Naftogaz, threatening not only the fiscal balance but also the gas supply to Ukraine and the rest of Europe.

7. Discussions on the 2014 SBA took place under difficult economic and political circumstances (Box 2). By March 2014, Ukraine was in the midst of a full-fledged currency, banking, balance of payments and political crisis: reserves were declining rapidly amidst capital outflows; the effective peg had to be abandoned after which the hryvnia quickly depreciated; and bank and corporate balance sheets came under increasing pressure. The annexation of Crimea by Russia and ongoing tensions in the East weighed on confidence and domestic political uncertainty, complicating the situation. With international markets effectively closed, Ukraine requested financial assistance from the international community and the Fund to meet its financing needs, including for making repayments to the Fund.

8. A key consideration in program design was how to take account of the newly-emerging conflict in the East. The ratification of the European Union (EU) Association Agreement in March 2014 provided some indication/signal that the EU might have helped to promote stability and security in the region. In addition, IMF management secured specific assurances from the European Union, Russia, and the United States that they were committed to working with all relevant parties to help restore peace and security as soon as possible, thereby laying the basis for economic stability and recovery. Based on these assurances and the broad support of the international community, the program was predicated on the assumption that tensions in the East would not escalate or spill over to the rest of the economy. This formed the basis for the Executive Board’s decision to approve the program. It was nonetheless recognized from the outset that economic, political and, importantly, geopolitical risks, loomed large and could derail the program.

9. The political environment, despite the uncertainties, was seen as conducive to making a decisive break from the past. Following the Maidan movement, there was a strong sentiment to address deep-seated governance and institutional problems, and a desire to integrate further into the global economy. All presidential candidates expressed support for program objectives, and notwithstanding uncertainties stemming from upcoming presidential elections, a new administration was seen as providing a window of opportunity for change. These political assurances were another important consideration that featured in the IMF’s decision to approve the program.

Overview of the 2014 SBA

A. Program Strategy

10. The 24-month SBA was approved in April and rightly focused on three main objectives: 1) stabilizing the macroeconomic situation in the short run; 2) implementing deep-reaching reforms to strengthen governance and transparency; and 3) laying the foundation for robust and balanced economic growth over the longer term. Reforms were aimed at achieving and sustaining external sustainability, ensuring financial stability, fixing public finances, rationalizing the energy sector, and improving the business environment.

11. Conditionality was appropriately comprehensive and front-loaded, supporting program objectives while seeking to mitigate implementation risks. Following the recommendation of the EPE for the 2010 SBA, the program had relatively more upfront structural conditionality, including 12 prior actions upon approval, to strengthen the odds of achieving a decisive break from Ukraine’s poor track record under past arrangements. The structural conditions covered a broad range of policy areas (Figure 1) and were more comprehensive than in Ukraine’s past programs or other recent exceptional access arrangements (Figure 2; Tables 1 and 2).

Figure 1.
Figure 1.

Structural Conditionality by Topic

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF country reports 14/106, 14/146 and 14/263.
Figure 2.
Figure 2.

Ukraine Program Track Record and Conditionality at 2014 SBA Request 1/

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff Estimates.1/ Ukraine had a 12-month precautionary SBA in 2004 under which no reviews were completed or purchases made.
Table 1.

Structural Conditionality under the 2014 SBA

article image
article image
article image

Met on the basis of compensatory measures in revised 2015 budget following rejection by Parliament of a proposal agreed with Staff in December 2014.

Amendments were needed to original legislation approved by Parliament in 2014 to meet compliance with the benchmark.

Table 2.

Ukraine: Quantitative Program Targets and Projected Performance 1/

(End of period; millions of Ukrainian hryvnias, unless otherwise indicated)

article image
Sources: Ukrainian authorities; and IMF staff estimates and projections.

Definitions and adjustors are specified in the Technical Memorandum of Understanding (TMU).

Targets and projections are cumulative flows from end-December, 2013. Data for March are flows from end-December, 2013.

Targets and projections are cumulative flows from April 1, 2014. Data for March are stocks as of end-March, 2014.

Calculated using program exchange rates specified in the TMU.

Data for March is a stock as of the end of the month. The flows for May and July are cumulative from end-March 2014. Targets for September and December are cumulative flows from end-May 2014.

Naftogaz is currently disputing the arrears to Gazprom. The estimates of potential liabilities arising from such disputed arrears are provided solely for the purpose of accounting for program financing and risk assessment considerations.

Arrears stock data for end-March, end-May, end-July include arrears for gas imports in 2013 and for imports up to end-March 2014, end-April, and end-June respectively. Arrears for end-September program targets are the sum of unpaid bills from January 2014 (US$3.759 billion).

12. As an additional safeguard against implementation risks, the program was initially monitored on a bimonthly basis (Table 3). The idea was to allow for early corrective actions should policies deviate from the programmed targets. In hindsight, the high review frequency may have helped maintain close engagement with the authorities and gather updated data, but did not necessarily help put in place emergency measures sooner.

Table 3.

Access and Phasing under the 2014 SBA

($bn)

article image
Source: IMF staff estimates.

Of which SDR1,290 for budget support.

Sources: IMF Country Reports 14/106

B. Program Financing

13. Approved access of about $17 billion covered over 60 percent of Ukraine’s financing needs. Ukraine’s gross external financing needs were projected at $27 billion over 2014-16, driven by a substantial current account deficit, large private sector external debt obligations and the need to replenish the very low level of National Bank of Ukraine’s (NBU) international reserves (Table 4). Access to Fund financing was slightly above the median in exceptional access arrangements approved since 2000 at that time (Figure 3).1 Roughly $15 billion was pledged by other official creditors and the projection assumed regained access to market financing in later program years (see later discussion on the third exceptional access criterion).

Table 4.

Ukraine: Program Scenario – Gross External Financing Requirements, 2013-15

(Billions of U.S. dollars)

article image
Sources: National Bank of Ukraine; and IMF staff estimates and projections.

Includes repayment of Naftogaz Eurobond in September 2014.

Mainly reflects residents’ conversion of hryvnia cash to foreign currency held outside of the banking system.

For the projection period (2014–19), financing from official sources is recorded below the line.

The IMF composite measure is calculated as a weighted sum of short-term debt, other portfolio liabilities, broad money, and exports in percent of GDP, with different weights for “fixed” and “floating” exchange rate regime. Official reserves are recommended to be in the range of 100–150 percent of the appropriate measure. For Ukraine “fixed weights are used until 2013, and “floating” weights are used from 2014 onwards.

Figure 3.
Figure 3.

Ukraine Program – Access and Phasing

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff Estimates.

14. Phasing was designed to balance Ukraine’s urgent financing needs against the considerable risks to the program (Figure 3). Poor implementation under the previous two SBAs justified limiting Fund’s exposure until performance under the program started to establish a better track record. Therefore, access was only moderately frontloaded, with SDR 2 billion (150 percent of quota) made available upon approval, helping to alleviate immediate financing pressures and catalyze international support. Subsequent purchases were more back-loaded. The planned bimonthly reviews at the beginning of the program would have also increased Fund’s exposure incrementally.

15. The program ended up providing more budget financing than envisaged, owing to the rising fiscal needs stemming from Naftogaz losses. At the program request, about $2 billion of the first purchase (roughly a tenth of total agreed access) was allocated for budget support. The First Review reallocated another $1 billion to the budget to cover Naftogaz’s increasing deficit, raising the share of budget financing to over 40 percent of the realized purchases under the 2014 SBA.

16. Financing needs ballooned towards the end of the program, ultimately making the program objectives unachievable within its timeframe. As discussed further below, the financing envelope constrained policy space to some extent in meeting program objectives. In the event, many of the risks noted in staff papers materialized during the short-lived program; notably, the conflict intensified over the summer, confidence could not be sustained and the domestic political uncertainty ended up being more protracted (see next section). In the First Review, financing needs were contained by lowering reserve accumulation targets and assuming that the de-escalation of the conflict would allow for higher market access later in the year (Figure 4, Table 2, section on exceptional access criteria). However, by the end of the year, the financial situation became more difficult. Naftogaz payments to clear arrears to Gazprom, continued capital outflows, as well as delays in disbursements from other external parties, contributed to reserves being depleted to critical levels. The Fund recognized at that stage that Ukraine’s financing needs would be larger and more protracted than covered under the SBA, requiring deeper structural reforms and a debt restructuring operation to ensure sustainability. To that end, the SBA was replaced with the EFF, which included additional financing and has a longer repayment period. The international community also provided additional financing and the authorities started debt restructuring talks.

Figure 4.
Figure 4.

Evolution of Financing Needs and Shortfall from Initial Reserve Targets1/

(in billions USD)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff Estimates.1/ March 2015 observation for 2014 financing needs reflects the outcome as assessed at the time and partially reflects delays in external financing caused by delays in completing the SBA reviews.

Program Implementation and Outturn

A. Macroeconomic Framework

17. The strong V-shaped recovery expected under the program was predicated on program policies being implemented and the conflict in the East being short-lived (Table 5). Growth was expected to decline initially, reflecting a drop in private consumption and investment, coupled with some drag from fiscal consolidation. The exchange rate was expected to stabilize at that point, restoring competitiveness. With successful program implementation, growth was expected to recover strongly and quickly, led by investment and exports. More importantly, reflecting available information at the time of the program approval, the outlook hinged on the Eastern conflict ending soon, not having major spillover effects to confidence, and being contained in Crimea, which accounted for only 4 percent of GDP.

Table 5.

Ukraine: Program Scenario – Selected Economic and Social Indicators, 2013-15

article image
Sources: Ukrainian authorities; World Bank, World Development Indicators; and IMF staff estimates.

The general government includes the central and local governments and the social funds.

Government and government-guaranteed debt.

For 2014, average of rates for January–August.

18. Most risks highlighted in the program materialized, and most macroeconomic outcomes deviated fundamentally from projections, particularly in the second half of 2014 (see next section for details):

  • Most importantly, the conflict in the East was more intense and longer-lasting than assumed in the baseline projections. Besides the direct impact on GDP, through a severe drop in industrial production and exports in the affected regions (Figure 5), the escalating conflict deteriorated confidence and demand in the rest of the economy. On the domestic political front, after the presidential elections, parliamentary elections were set for the Fall, and forming a government took several months. The ensuing uncertainty further deteriorated consumer and business confidence.

  • Bouts of rapid capital outflows led to more depreciation than expected under the baseline. From its end-2013 level, the hryvnia depreciated by 35 percent at the time of the SBA request and by nearly 90 percent by year-end. Constrained by fiscal dominance, including the need to facilitate the financing of gas imports and the DGF, the monetary stance remained looser than should otherwise have been. The outflows and depreciation added to pressures on bank balance sheets, further reducing credit to the economy.

  • The large depreciation also added to the domestic costs of imported energy, further depressing domestic demand and adding to Naftogaz’s losses. Moreover, the effective loss of control over Crimea resulted in about 14 percent loss of Naftogaz output.

  • The depreciation, and higher energy prices added to inflation, raising it from 16 percent at the time of the program request to 25 percent by end-2014.

  • Notwithstanding the sharp import contraction, the current account recovered less than expected, since exports remained weak owing to the collapse of trade with Russia, Ukraine’s largest trading partner.

Figure 5.
Figure 5.

Share of Eastern Territories in Ukraine’s GDP, 2012

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff Estimates

19. In the end, the recession turned out to be deeper and more protracted than expected (Figure 6). Real GDP contracted by 6.8 percent in 2014, close to the projection at the time of the First Review. However, the sharp V-shaped recovery did not materialize. 2015 growth projected at the time of the EFF First Review was -9 percent, 10-11 percentage points lower than projected under the SBA.

Figure 6.
Figure 6.

Ukraine: Key Economic Indicators

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff Estimates.

B. Exchange Rate and Monetary Policy

Program Strategy

20. The SBA targeted maintaining a flexible exchange rate, gradually unwinding controls, and moving to an inflation targeting regime. These were long-standing policy objectives, including under the 2010 SBA. In February 2014, facing pressure on the hryvnia and rapidly declining reserves, the long-standing exchange rate peg was abandoned and a flexible exchange rate regime was formalized in NBU regulations. The SBA supported maintaining exchange rate flexibility, but judging the depreciated hryvnia at the start of the program to be in line with fundamentals, cautioned against overshooting, which could adversely affect balance sheets.2 Under the program, exchange controls in place prior to program approval were to be gradually unwound after July, as conditions allowed. The move to inflation targeting as the new monetary anchor was planned by 2015:Q2.

21. Monetary policy was envisaged to be tight, but was hampered by the need to provide adequate domestic financing, which came at the cost of depleting reserves. Until the envisaged move to inflation targeting, the program aimed to keep monetary policy tight through quantitative targets and a positive real interest rate. However, the ceiling on Net Domestic Assets (NDA) allowed for purchasing government bonds for recapitalizing the Deposit Guarantee Fund (DGF) and Naftogaz of UAH68 billion during the program period. This expansion of NDA came in addition to a UAH70 billion increase in Q1 alone from government financing and extending liquidity to banks. The impact on the monetary base for the year was expected to be 21.5 percent (against a 3.5 percent increase in nominal GDP), given the envisaged decline in NBU Net Foreign Assets (NFA) by about 14 percent.

22. In addition, the adjustors to the monetary performance criteria were generous, and injected further liquidity in the system. The program had adjusters not just for lower-than-projected disbursements by other creditors, but also to accommodate NBU liquidity support to the Deposit Guarantee Fund (DGF) and bond purchases to finance recapitalizing the DGF and banks.3 The program also included an indicative target on the cumulative change of the monetary base that only allowed for an upward adjustment should the NBU have to finance the Deposit Guarantee Fund (DGF) or purchase government bonds to recapitalize banks. The indicative target foresaw no adjustments for a better than expected outcome in reserves accumulation. In short, by design, these adjustors contributed to permanently injecting liquidity and lowering reserves under the program.

Outturn

23. The monetary stance was looser than envisaged and reserves were severely depleted under the program. With the budget facing significant financing constraints, the NBU was called to become the country’s lender of last resort. In the end, the NBU’s net claims on the government ended up growing by over 125 percent, 2.5 times more than initially envisaged. This contributed to NDA growing by over 65 percent and NFA declining more than expected. Further pressure on reserves came from the weakening confidence in the currency and the banks: household hryvnia deposits declined by almost 10 percent over 2014, while foreign currency deposits declined even more sharply by US$11.1 billion, accounting for most of the US$15 billion decline in NBU’s net foreign assets (NFA) over 2014 (Figure 7). The rest of the NFA decline is largely due to the $3.1 billion Naftogaz payment to Gazprom. The NBU’s efforts to tighten monetary conditions by raising interest rates in the second half of 2014 failed to affect market rates or raise bank deposits with the NBU (Figure 8). A tighter monetary stance from the outset, and further tightening when pressures on the hryvnia mounted, could have buttressed demand for domestic currency and also shifted the burden of the adjustment to the government (paying higher interest rate on its domestic debt). Such a stance would have been more consistent with program objectives of building reserves, stabilizing prices and preventing exchange rate overshooting, and could also have improved the effectiveness of exchange controls (also see section on capital controls). That said, such a policy would have also been procyclical, adding to already severe downside pressures on the real economy and would have required financing for the government from other sources.

Figure 7.
Figure 7.

Banking Sector Deposits and Evolution of NBU’s Balance Sheet

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF staff estimates.
Figure 8.
Figure 8.

Interest Rates and Deposits at NBU

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF staff estimates.

24. Exchange rate flexibility was maintained, albeit with episodes of large foreign exchange intervention. The NBU allowed the exchange rate to depreciate significantly and to some extent absorb the impact of the geopolitical turmoil and the weaker policy stances. However, the NBU intervened heavily during the third quarter as the conflict in the East intensified and the domestic political uncertainty and elections spurred capital outflows, returning to a flexible stance only later in the year (Figure 9). While an effort was made to tighten capital controls, the volume of capital flight suggests that these controls may have been too weak, not implemented fully, or put in place too late to counter the effects of the geopolitical instability and the loose monetary stance. Overall, the hryvnia depreciated against the U.S. dollar by about 90 percent by the end of 2014, far more than envisaged under the program.

Figure 9.
Figure 9.

Ukraine: Gross International Reserves, Exchange Rate and Capital Controls

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: World Economic Outlook, NBU and IMF staff calculations (2015).

25. The plan to move to an inflation targeting regime was overly ambitious. The plan would have been ambitious even in the absence of the conflict, given that a move from exchange rate anchoring to inflation targeting would require, among other things, overhauling NBU operations and internal procedures, building a track record of meeting forecasts, and improving its communication strategy, all of which take some time. Though more technical assistance was provided and the NBU made progress towards the goal, in the end, the preconditions for moving to inflation targeting were not present then. Fiscal dominance continued and the monetary transmission mechanism was still impaired due to the weak banking system.

C. Financial Sector Policies

26. The SBA included actions in five priority areas regarding the financial sector: continue providing liquidity to solvent banks in need; assess bank resilience through an independent asset quality review (AQR) for the top 50 banks; assess bank solvency and make sure that shareholders were the first line of defense to capitalize banks; upgrade the regulatory and supervisory framework to international standards; and improve banks’ capacity to resolve NPLs. Though earlier programs had attempted to unveil the ownership of banks, the 2014 SBA did not look into this area.

27. As the NBU’s technical capacity strengthened during the SBA, problems in banks’ balance sheets came to light. Nonperforming loans (NPLs) rose from 23.5 to 32.0 percent over 2014, brought about by the economic crisis and the geopolitical developments. Over this time, the NBU made progress in improving supervision and upgraded its regulatory framework in critical areas, particularly in connected lending. This allowed the NBU to conduct a second AQR, which identified larger capital needs in some banks than the independent reviews had found.4 These steps also allowed the NBU, together with the recapitalized DGF, to begin downsizing the banking system in an orderly way; of the 180 banks that Ukraine had at the beginning of 2014, 33 banks had gone into resolution by the end of the year and some 80 more were being closely monitored, a commendable feat that is difficult to undertake in most circumstances.

28. The pace of reforms in other priority areas was much slower. The mechanisms for emergency liquidity assistance to the financial system (ELA) were upgraded. While shareholders have been used as a first line of defense when resolving banks, the government has had to buttress the solvency of some public banks. Creating an official centralized credit registry is pending legislation and the banks’ capacity to deal with NPLs remains a challenge. Reforms in many of these areas are covered in the successor program.

D. Fiscal Policy

Program Strategy

29. Fiscal vulnerabilities had been accumulating in Ukraine for years, even if public debt was initially relatively low. From 2011 to 2013, the overall general government balance deteriorated by 2 percent of GDP (1½ percent in structural terms), due in large part to pension and wage increases. In addition, off balance sheet activity had been increasing as the authorities tried to buoy public investment by extending state guarantees (reaching 7 percent of GDP in 2013) and resorted to government IOUs for repayment of overdue VAT refunds and expenditure arrears (over 1 percent of GDP). Quasi-fiscal losses in the energy sector had also been accumulating as a result of low gas tariffs. Therefore, in addition to general government deficit targets, the program also included a target on the combined general government and Naftogaz deficit (next section).

30. The fiscal situation at the outset of the 2014 SBA was therefore challenging. In the absence of program measures, the 2014 general government deficit was expected to reach 8½ percent of GDP on further wage and entitlement spending increases and falling revenues as a result of poor tax compliance and the weak economy. Such a deficit would have required large-scale monetization and further contributed to unfavorable debt dynamics and deteriorating confidence.

31. Against this background, the fiscal objectives were broadly appropriate aiming to maintain priority spending and initiate medium-term fiscal adjustment (Text Table 1). Revenue shortfalls resulting from macroeconomic and political disruptions required a rapid policy response involving a mix of revenue and expenditure measures. Over the medium-term, an expenditure-led consolidation would return public finances to sounder footing. Specifically, the program targeted a structural fiscal adjustment of 2 percent of GDP from 2013 to 2016, with half of the adjustment front-loaded in 2014. The target on the overall balance, however, masked a rising interest bill. Looking instead at the programmed structural primary balance, the fiscal effort in the initial program was over four percent of GDP, including 2 percent in 2014.

Text Table 1.

Fiscal Balances at Program Request

(percent of GDP)

article image
Source: IMF Staff Estimates

32. With tax rates in Ukraine already high, program measures on the revenue side focused on eliminating VAT exemptions and improving tax administration (Figure 10). The authorities committed to suspend the application of a zero VAT rate to grain and crop exports, introduce a reduced VAT rate on medical products previously exempt, and a higher excise tax rate for diesel fuel, alcohol and tobacco. A reorganization of state tax and customs services to reduce tax fraud, specifically concerning fake exports of fuel and illegal alcohol production, was also expected to yield significant revenues. Importantly, as a prior action, parliament also reversed the planned VAT rate reduction for 2015.

Figure 10.
Figure 10.

Ukraine – Cross-country Comparison of Fiscal Policy

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Sources: Word Economic Outlook, 2015.1/ Family type: Single person at 100% of average earnings, no child.

33. With spending relatively high in Ukraine, expenditure efforts rightly constituted the bulk of planned adjustment (Figure 10). Specifically, the upfront ratio of expenditure to revenue measures was about 2:1. The government agreed to cancel already-planned discretionary wage increases, maintain a hiring freeze, and cancel the discretionary increase in pensions and pension-linked benefits. As a prior action, a new public procurement law was adopted to strengthen governance and reduce exemptions from regular competitive procedures, allowing additional savings on government purchases. Other program measures included a rationalization of subsidies to enterprises, social assistance, and, capital expenditures.

Outturn

34. The 2014 budget deficit outturn significantly overperformed program targets, on the back of one-off factors and a less-than-desirable composition (Figure 11). In light of the weak economy and falling revenues, the fiscal target was loosened at the First Review while maintaining the same structural effort, including through additional measures reflected in a supplementary budget. Eventually, however, revenue losses resulting from the deteriorated security situation in the East and weak economic growth were partially offset by higher-than-expected exchange rate depreciation and inflation. Importantly, expenditures were significantly curtailed, owing to liquidity constraints (VAT arrears, which were subsequently cleared) and stalled budgetary payments to the conflict areas in the East. Moreover, an earlier profit transfer from the NBU supported the budget outcome. As a result, the general budget balance for 2014 was higher than targets by about 0.7 percent of GDP while the structural balance exceeded targets relative to the program request by about percent, implying an adjustment of 1½ percent over 2014.

Figure 11.
Figure 11.

General Government Fiscal Targets and Outcomes

(in percent of GDP)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: Staff Estimates.

35. The significantly smaller deficit outturn was procyclical and suboptimal, but perhaps unavoidable given the severe financing constraints. With shortfalls in external financing and revenue considerably below targets, including due to the unexpected disruptions of fiscal flows to and from the East, expenditure cuts contributed to the overperformance. At the same time, it was also important to take advantage of political and reform momentum at the outset of the program to improve long-term sustainability. To that end, on the revenue side, it would have been better to discontinue the preferential VAT regime for agriculture as envisaged under the program.

E. Energy Sector Policies

Program Strategy

36. The loss-making and opaque gas sector in Ukraine weighs heavily on public finances, the external sector, and the overall economy. The very low tariffs for residential gas and district heating encourage excessive energy consumption and lead to large fiscal losses, drive gas imports up, discourage investment in domestic production, and breed governance problems (Figure 12).

Figure 12.
Figure 12.

Key Energy Sector Links to Economy

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff.

37. Previous programs attempted, unsuccessfully, to address the issue through a series of tariff increases. The 2010 SBA, for example, included a 50 percent increase in tariffs as a prior action. However, in an environment of rising import prices, the 2010 tariff increases achieved little and the authorities balked at additional increases before the program went off track. By end-2013, tariffs were just 10-20 percent of import parity and significantly lower than in peer countries.

38. Consequently, the financial position of Naftogaz entering the 2014 SBA was precarious. With a deficit of 1.9 percent of GDP in 2013, the energy sector was creating large quasi-fiscal losses and adding to public debt. In addition, the low tariffs left the Naftogaz balance vulnerable to exchange rate depreciation that could further increase import costs, as well as a growth slowdown that could impact gas sales and the collection of receivables.

39. The 2014 SBA aimed to gradually eliminate Naftogaz losses by implementing staged tariff increases and improving payment discipline (Figure 13). Specifically, retail gas and heating tariffs were increased by 56 and 40 percent, respectively, in 2014 as a prior action. In addition, a schedule of annual increases of around 20 percent was agreed with the aim to eliminate Naftogaz losses by 2018. To support the tariff increases, the program also addressed the low compliance rates of district heating companies, including by creating special distribution accounts into which all utility payments are made, and from which payments to Naftogaz are automatically drafted.

Figure 13.
Figure 13.

Ukraine: Import Prices and Gas Tariffs

(US$/tcm)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Sources: Naftogaz, Eurostat, Ukrainian Authorities and IMF Estimates.1/ Tariffs net of transit fees, transportation costs and VAT.

Outturn

40. A dispute between Naftogaz and Gazprom in early 2014 further weakened program buffers. Specifically, the two companies disagreed on the gas price from the second quarter of 2014 and the amount of unpaid gas deliveries in 2013-14. In order to reduce the risks stemming from the dispute, the First Review provided for the clearance of undisputed arrears from 2013 (US$1.45 billion) and the unpaid gas bills in April–May 2014 (US$1.64 billion) valued at Naftogaz’s advocated price as a prior action. Because the sum was larger than envisaged under the original program, the international reserves target was reduced accordingly. It was hoped that this arrangement would contribute to de-escalating tension and reaching a durable price agreement. Ultimately, Gazprom halted gas supply to Ukraine in June, but Ukraine was able to purchase additional gas through reverse flows from EU countries to ensure sufficient gas supply through the heating season.

41. To mitigate the impact on households, the tariff increases were appropriately accompanied by measures to protect the most vulnerable. In particular, the existing housing utilities subsidy program that covers the utility bills above a fixed percent of the enrolled households’ income and the category-based privileges program remained in place and a new program to protect vulnerable households not covered by the existing schemes was introduced. Ultimately, the new scheme proved largely redundant, as it overlapped with existing social assistance programs, and these programs were consolidated. Faster tariff increases could have been accompanied by additional social assistance to help maintain popular support for the program; however, this would have required additional fiscal adjustment.

42. In hindsight, the programmed operational balance for Naftogaz in 2014 proved highly optimistic, leading to significant additional financing needs. Specifically, by the time of the First Review, additional exchange rate depreciation was expected to increase the 2014 gas import bill by 0.7 percent of GDP and external debt repayment by 0.9 percent of GDP. Similarly, revenue projections (gas sales and receivables) were reduced by 2.3 percent of GDP as a result of weak growth and poor payment discipline. With increased transit revenues and other savings expected to provide some offsets, total Naftogaz financing needs in 2014 increased from 4 to 7½ percent of GDP by the time of the First Review. These developments pushed the Naftogaz operational deficit – and consequently the combined general government-Naftogaz deficit – above program targets (missed performance criterion, Table 2, Figure 14).

Figure 14.
Figure 14.

Naftogaz Balance and Public Debt

(In percent of GDP)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Sources: Naftogaz, Ukrainian Authorities and IMF Estimates.

43. With no prospects for additional external financing and little appetite for additional tariff increases in 2014, additional financing needs were accommodated at the time of the first review. Support was delivered in the form of government recapitalization through t-bills, which is recorded below the line in the budget and therefore contributed to an increase in government debt, further reducing buffers to absorb future shocks.

44. Although Naftogaz finances did not improve as programmed, progress was made on the structural agenda in the energy sector. In particular, the distribution accounts were established, helping to strengthen payment discipline and secure Naftogaz revenues. Audits of Naftogaz finances were also initiated, verifying the accuracy of Naftogaz’s reporting of its financial results under the program.

F. Governance and Business Climate Reforms

45. Weak governance, lack of transparency, and a difficult business climate have long impeded Ukraine’s ability to maintain higher growth. These constraints have suppressed the productivity potential of the economy, discouraged much-needed investments, and contributed to the significant macroeconomic imbalances in the lead up to the 2014 SBA (as well as earlier programs). Furthermore, the lack of transparency and unfavorable perception of governance problems in the energy sector undermine the legitimacy of higher energy tariffs and impede efforts to reduce the quasi-fiscal deficits.

46. The authorities produced a candid and comprehensive diagnostic study, with contributions from IMF staff, which helped lay a strong foundation for governance and the business climate reforms, including for the successor arrangement. Specifically, the study examined the anti-corruption framework, the design and implementation of key laws and regulations affecting the business climate, and the effectiveness of the judiciary. These areas were supported by new structural conditionality introduced at the first review. Notably, the study—unprecedented in the context of Fund programs—was published by the government, which was interpreted at the time as a signal of strong political buy-in and ownership of its recommendations.

47. Separately, the program also aimed to tackle other long-standing issues. Reforming procurement practices, a long-standing source of corruption, and improving transparency in the state-owned part of the gas sector, including to boost popular support for tariff increases, were part of the authorities’ reform agenda for the SBA. The first review also identified a need to amend the NBU Law to address safeguards concerns as well as the anti-money laundering law and the criminal code to support the anti-corruption effort.

48. Reform implementation was uneven after the diagnostic study was completed, raising questions about the influence vested interests still have. Parliament passed legislation to establish an anti-corruption agency to investigate corruption offences and acts of laundering of proceeds among high-level officials. However, changes were made to the legislation that diluted its effectiveness. Progress was also made on an action plan to simplify regulatory frameworks affecting economic activity, although the proposals lacked prioritization and an adequate institutional framework governing its implementation. A new procurement law was passed as a prior action to the program, but later faced repeated, albeit ultimately unsuccessful, efforts by factions of the parliament to re-introduce exemptions from competitive procedures. Amendments to the anti-money laundering law and the criminal code were successfully passed, notwithstanding some initial delays. The program did not address the area of judicial reforms in its limited timeframe, with specific steps planned only in 2015.

Consistency with Fund Policies

A. Were the exceptional access (EA) criteria well justified?

  • EA Criterion 1 (EA1) – Exceptional balance of payments pressures: At the time of the program request Ukraine was experiencing balance of payment pressures from both the current and capital account. By March 2014 official reserves had fallen to critically low levels, covering only two months of imports. While the current account deficit adjusted to some degree over the course of the program, it was to remain elevated and pressures from the capital account continued throughout. The estimated financing needs exceeded normal limits, even after taking into account financial support from the broader international community.5

  • EA Criterion 2 (EA2) – Debt sustainability with high probability: The assessment that debt was sustainable with a high probability rested on the baseline outlook, which assumed no intensification of the conflict and program policies being implemented successfully, which was critical for debt trajectories remaining non-explosive in the DSA shock scenarios. Initially, debt being well below the 70 percent risk threshold was used as an argument, and subsequently, when debt exceeded 70 percent in the projections, the argument hinged on the breach being short-lived. The First Review report recognized explicitly that the debt ratio would remain above the 70 percent risk threshold over the medium term should the conflict intensify. In hindsight, while downside risks to the outlook and those flagged in the DSA tools were well recognized and presented in the program and first review staff reports, the fact that debt proved unsustainable only a few months after the First Review because well-recognized risks materialized calls into question whether these risks were sufficiently taken into account in assessing the probability of debt sustainability (see next section on risks to debt sustainability).

  • EA Criterion 3 (EA3) – Prospect of gaining or regaining market access. Ukraine was expected to regain access to markets in 2015 owing to successful program implementation and support from the international community, and spreads did come down after the SBA approval (Text Table 2, Figure 15). At the time of the First Review, though, despite a worse macro and geopolitical outlook, the market access assumptions were revised up and also brought forward. This proved highly optimistic; spreads increased sharply following the First Review as the conflict escalated and domestic political uncertainty continued, and by year-end, markets were already pricing in a debt operation (Box 3).

  • EA Criterion 4 (EA4) – Strong prospects for success. Despite Ukraine’s poor track record of program implementation, the case for EA4 gave the benefit of the doubt to the new authorities, who were seen as committed to reforms, promising a decisive break from the past. In fact, the ongoing geopolitical conflict was considered to play a positive role in galvanizing parliamentary support to undertake reforms that faced resistance from vested interests, including a comprehensive set of prior actions. The case for EA4 was further supported by assurances from the leading presidential candidates, representatives of key political parties and civil society groups. In addition, management had secured assurances from the EU, Russia and the United States on their efforts to help restore peace and security, thereby laying the basis for stability and growth. However, implementation risks were still considerable, and not only because of the protracted and escalating conflict in the East. The reinstatement of the 2004 Constitution gave the parliament, formed under the previous regime, more powers than before. In the event, persistence of vested interests and the fractured political situation contributed to heightened uncertainty, complicated areas of reform implementation and gave rise to legislative initiatives running counter to the program’s objectives. Some structural conditions were not met or were significantly delayed (VAT reform in agriculture, law to facilitate NPL resolution, amendments to NBU law), while implementation of regulatory streamlining and anti-corruption measures faced resistance. Notwithstanding smoother program policy implementation in other areas, in hindsight, this experience and the uncertain political preconditions cast some doubt on whether the “strong prospects for success” underpinning EA4 were met, especially at the time of the First Review when structural conditionality was set over the election cycle. Ukraine’s case also raises the question of how to assess the prospects for program success when a country is in an active and uncertain conflict situation.

Text Table 2.

Market Access Assumptions under the 2014 SBA

($bn)

article image

2014 included a US$1 billion Eurobond guarantee from the U.S., which is not considered market access for program purposes.

Sources: IMF Country Reports 14/106 and 14/263
Figure 15.
Figure 15.

EMBIG Spreads (2013 – Present)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Sources: Bloomberg

B. Were financing assurances and capacity to repay given due regard?

49. Financing assurances weakened as program risks materialized. The program was fully financed ex-ante under the baseline scenario, albeit with limited margins for deviations. However, at the First Review, a $3 billion shortfall in external financing was identified, including about $1.1 billion in the following 12 months, owing to delays in project implementation related to the conflict (Figure 16). The program was nonetheless assessed as adequately financed at that time on grounds of the revised market access assumption for late 2014 (see above section). It is debatable whether, at the First Review, such grounds represented firm financing commitments for the following 12 months, as required under the Fund’s financing assurances policy.6 Financing assurances for the remainder of the program also hinged on securing an additional $0.9 billion of bilateral support from donors and the estimated financing gap under the baseline scenario, while the prospects for covering significantly higher external financing needs in event of a prolonged conflict were not addressed.

Figure 16.
Figure 16.

Revisions to Financing Envelope, First Review

(USD bill.)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Country Report No. 14/106 (Request) and 14/263 (First Review).1/ Official financing excludes $1 billion Eurobond guarantee from the U.S. in 2014.

50. The potential adverse impact of the exceptional risks on Ukraine’s capacity to repay could have been recognized more explicitly. Ukraine’s capacity to repay was deemed adequate, with the assessment hinging on the baseline macroeconomic assumptions, as per usual practice, while recognizing “exceptional risks” to the Fund and Fund liquidity.7 Given these exceptional risks, the analysis could have been usefully expanded to include the impact of the illustrative adverse scenario presented in the First Review on key repayment capacity indicators and Ukraine’s ability to meet its obligations, including to the Fund.

Program Design and Strategy Issues

A. Program Design

Was the length and scope of the program appropriate?

51. Program length needs to be guided by members’ financing needs and should be sufficient to implement needed policies. According to Fund policies, there should be no residual financing gap beyond the program horizon. The program also needs to allow sufficient time to implement the needed policies. In assessing the extent to which a program should focus on reforms, it is useful to consider whether the macroeconomic imbalances are symptoms of deep-rooted issues. As such, it would be important for programs to include reform elements where relevant, and allow for sufficient time for their implementation, recognizing that reforms can in some cases require advance work, TA, or be politically challenging. In addition, countries like Ukraine that have a poor track record of program performance need time to show commitment and policy action to mobilize external financing.

52. The approved length and scope appear appropriate in this context. The time-frame allowed planned policy adjustment to be reasonably paced in closing the financing gap and rebuilding reserve buffers. The SBA was comprehensive on policies, and while some reforms under the program could have been tackled later, such as adopting inflation targeting, the program was able to support the authorities in getting started on needed structural reforms, e.g. related to anticorruption, the energy and banking sectors, laying the foundations for the broader structural agenda to be supported by the EFF, and helping to address deep-rooted weaknesses that give rise to macroeconomic vulnerabilities.

Was the macroeconomic framework too optimistic?

53. The likelihood and severity of the various well-recognized risks would have warranted adopting a more balanced baseline scenario, especially by the First Review. As discussed above, the program was predicated on the conflict being short-lived, with considerable downside risks surrounding the baseline macroeconomic outlook, supported by assurances from the international community that all key parties were committed to help restore peace and security as soon as possible. Against that background, it may not have been possible to predict the full extent of evolution of the conflict at that time, or reflect it in the baseline. At the same time, the staff reports recognized a number of other “very high” risks, including from the weak financial sector and domestic political uncertainty, which could have warranted more conservative assumptions. Moreover, with the conflict starting to escalate by the completion of the First Review, the baseline at that stage could have reflected these latest developments having a deeper impact on the economy, even if the conflict ended soon. In other words, in the EPE team’s view, the pressing risks that were mostly on the downside meant that the baseline was more of a best case scenario that had an increasingly lower likelihood of materializing.

54. A more conservative baseline would have in turn provided more buffers and improved the program’s prospects of success. Putting aside the conflict, the baseline facing mostly downside and large risks meant that most deviations from the baseline could exhaust buffers and jeopardize program success, raising additional concerns over prospects for program success (EA4). A more conservative outlook could have allowed for adjusting program objectives without jeopardizing overall program success as risks materialized, though it would have required a larger financing envelope, which was not considered feasible at the time.

55. Instead, the baseline outlook was usefully complemented with an illustrative adverse scenario that helped set expectations in case the conflict intensified (Text Table 3). The adverse scenario presented in the First Review staff report showed that, should the conflict continue at its level of intensity at that time and hurts confidence, maintaining the SBA reserve targets would require an additional $19 billion in external financing through end-2015. The scenario helped communicate that such an event could not be accommodated under the SBA and would trigger fundamental changes to the program strategy.

Text Table 3.

SBA First Review Baseline vs. Adverse Scenario vs. Outturn 1/

article image
Source: IMF Country Report No. 14/263 (SBA First Review) and 15/218 (EFF First Review).

Based on Box 2 of First Review Under Standby Arrangement.

Outturn is based on IMF Country Report No. 15/218 (EFF First Review). The 2014 financing needs outturn is notably lower than projected in large part due to lowered reserve accumulation targets. 2015 reserves include additional financing provided under the EFF.

56. The economic outturn was closer to country experiences with a combination of currency, banking and twin deficit crises (Box 4). Growth and exchange rate projections under the baseline were gauged based on the experience of currency crises in emerging markets (SBA Request, Figure 6). However, the crisis in Ukraine ended up being not just a currency crisis but also a sudden stop, banking and a twin deficit crisis during the 2014 SBA. Studies have found that sudden stops that require a fixed exchange rate regime to be abandoned can result in depreciations of 50-100 percent, depending on the circumstances. When currency crises are combined with banking crises, the economic downturn becomes more severe. Country experiences show that the output contraction in such cases can be 6-9 percent on average per year. Both sets of findings are close to Ukraine’s experience.

Were downside risks sufficiently factored into the probability assessment of debt sustainability?

57. While various high risk scenarios and susceptibility to shocks were well-acknowledged, the probability analysis of debt sustainability did not sufficiently weigh these in. Notwithstanding the extensive discussion of risks, the reports did not adequately explain how they were accounted for in the probability analysis of debt sustainability. In fact, in the First Review, the DSA heat map, which summarizes risks to debt sustainability under various dimensions under the baseline scenario, looked very similar to those in the Ireland and Portugal programs where exceptional access was justified by invoking systemic exemptions because debt was assessed to be sustainable, but not with high probability (Figure 17). The adverse scenario in the First Review showed that the debt ratio would remain above the 70 percent risk threshold over the medium term if the conflict were to intensify. The reports should have integrated better the risk scenarios and DSA tools to provide a more comprehensive discussion of the impact of risks on the probability analysis of debt sustainability.

Figure 17.
Figure 17.

Evolution of Heat Map from 2014 SBA Request to First Review

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Country Report No. 14/106 (SBA Request) and 14/263 (SBA First Review).

58. In the end, public debt and financing needs overshot program projections by a significant margin. By end-2014, Ukraine’s public debt was 15 percentage points higher than projected under the program and the latest estimates for the 2015 debt ratio are 30 percentage points higher than envisaged at that time (Figure 18). This puts the program at the highest debt surprise for crisis programs (among non-restructuring cases) following one year of the program approval. The change is explained mostly by the larger-than-expected hryvnia depreciation, i.e., 90 percent instead of the assumed 25 percent over the year. The depreciation added directly to public debt, as two-thirds was denominated in foreign currency. It also added to contingent liabilities by raising bank recapitalization needs and financing requirements for Naftogaz.

Figure 18.
Figure 18.

Changes to 2014 Public Debt

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Staff Estimates.

B. Program Strategy

59. As Ukraine’s public debt was deemed sustainable with high probability and there were no residual financing gaps, a debt operation was not undertaken at the outset of the program. NBU holding of about 30 percent of public debt was seen as a mitigating factor to rollover risks. And at the time of the First Review, with only US$2 billion maturing in external public and guaranteed debt for the remainder of 2014, the benefits of a debt operation were considered to be rather low against the perceived risks to market confidence.

60. An early debt reprofiling operation would nonetheless have provided useful liquidity relief during the program, at a time of exceptional uncertainties and large financing needs. A reprofiling operation that extended maturities of the privately-held external debt that was maturing over the program period, i.e. about US$3 billion and US$4.4 billion for 2014 and 2015 respectively, would have reduced near-term financing needs (Figure 19). This would have provided additional liquidity buffers and improved debt sustainability, as well as allowed for lower fiscal adjustment and/or lower financing from the Fund, when the country was facing severe economic, financial, political and geopolitical risks, and financing needs were large (Box 3).8 An early reprofiling would have provided immediate liquidity relief, while also preserving the option of future operations, if needed. In fact, by the time the debt operation was completed in September 2015, public debt had risen by an additional 20 percentage points and had become a solvency issue. The operation therefore ended up being a restructuring that was larger and also covered more debt instruments (state enterprises’ non-guaranteed debt).

Figure 19.
Figure 19.

Amortization of Public Debt Held by External Private Creditors

(in US$ million)

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Sources: IMF Staff Estimates.1/ Includes Naftogaz Eurobond.

Could energy prices have been hiked faster?

61. Given the distance from import parity, faster tariff increases, including scheduled future increases linked to the exchange rate, would have been fiscally prudent, but may have been socially difficult. Tariff levels are a politically and socially sensitive issue in Ukraine, and a more aggressive approach could have undermined support for the program. For this reason, the program rightly targeted annual increases toward the end of each heating season, allowing households time to internalize the higher tariffs before the next heating season. A larger upfront increase would have reduced energy-sector vulnerabilities more quickly, but may also have led to higher inflation and lower growth by depressing household disposable income.

62. Going forward, it would be useful to invest more in cultivating public ownership for energy sector reforms in Ukraine. Energy sector reforms have been attempted and failed in earlier programs, being one of the most unpopular policies. However, as the 2013 Article IV Staff Report clearly demonstrates, the tariff structure is regressive, distortionary, and creates arbitrage opportunities. Most benefits accrue to high income households, with lower income households spending a larger share of their income on gas and heating. The resulting fiscal burden from low tariffs is a key source of vulnerability to the Ukrainian economy. Furthermore, social assistance programs provide targeted relief from higher tariffs to make the burden more equitable, bolstering public support for the tariff increases. This all points to the importance of garnering support from the general public for energy sector reforms.

Could banking sector diagnostics have been done sooner and with a greater emphasis on bank ownership?

63. Improving transparency in the banking sector had typically been an area of slow progress, and the program prioritized more urgent issues. The 2010 SBA had focused on the need to have a clear picture about the true ownership of banks but had failed to make the needed progress. The concern on banking sector ownership was not a priority area for the 2014 SBA from the outset; the program instead focused on the more urgent need to improve resilience of bank balance sheets to depreciation. Had the issue been highlighted earlier, perhaps the initial AQR could have allowed an earlier start in arresting connected lending that has subsequently been identified as the greatest weakness of Ukraine’s financial sector. In any event, and as the meager progress of the previous program suggests, the administrative difficulties faced by NBU may have been a great constraint. In these circumstances, the program could have been more sanguine on what could be expected on banking regulation and supervision and on other areas supervised by NBU.

Could capital controls have been brought in sooner and made more stringent?

64. Capital controls need to be considered in the context of the overall policy stance and structure of the economy. The program’s initial stance included gradually unwinding exchange restrictions and capital controls, including those that breached Article VIII. It was envisaged that with successful program implementation (and in the absence of shocks), easing controls would be a confidence-building signal, intended to reduce deposit outflows and stem capital flight. The easing was premature as subsequent shocks and further tightening of controls demonstrated. The tightening did not fully bring about the desired effect either. As noted in the Fund’s institutional view on capital flow management, controls “appear to be more effective if they accompany sound macroeconomic policies, are well designed and enforced, and are part of a comprehensive policy package.”9 Several of these conditions were missing in 2014, as also discussed in the earlier sections. Specifically, effective controls would have warranted a much tighter monetary stance, implying overcoming fiscal dominance or much higher market interest rates, as well as overcoming administrative challenges to implementing controls so as to tax powerful interest groups that own most banks.

Conclusion and Lessons from the 2014 SBA

A. Conclusion

65. The 2014 SBA placed a lot of faith in the conflict not escalating and the new government’s capacity to deliver policies. Program success hinged on the assurances from the international community to help restore peace and security, and continue supporting Ukraine. The authorities also stated a strong commitment to tackle difficult reforms, though it was not clear whether they had the majority support to sufficiently overcome vested interests.

66. Despite the fragile political equilibrium, meaningful and difficult reform steps were taken under the program. The first stage of energy tariff increases was implemented successfully together with commendable progress in improving Naftogaz governance and finances. A flexible exchange rate was maintained, albeit with occasional sizeable interventions. In the financial sector, tangible steps were taken to identify weaknesses in banks and several were decisively resolved. The authorities’ comprehensive diagnostic study on corruption and governance helped lay a strong foundation for reforms.

67. Policy and reform implementation was nonetheless uneven, raising questions about the influence of vested interests at a time when political uncertainty ensued. Fiscal consolidation began, and the outturn was even better than targeted, but in part due to low quality and one-off measures. The 2014 SBA also aimed at a broader set of governance and business environment reforms, which were going to be difficult regardless of the external environment. And indeed, by December 2014, only half of the end-October structural benchmarks had been met, some were delayed, and some faced resistance in implementation. With the macroeconomic situation deteriorating, delays in program implementation on the structural reforms front became less visible, but were evidence of waning ownership and continuing influence of vested interests.

68. In the end, while the SBA was short-lived and did not achieve many of its goals, it served as an anchor for economic policies in a difficult and uncertain economic and political situation. Assurances to restore peace and security ultimately proved insufficient and the conflict lasted longer and had a deeper impact on the economy. The domestic political scene also changed more than expected at the outset, with a new parliament coming into office only by the end of the year. During this time, important policy steps and structural reforms were taken. Moreover, the program helped garner international support for Ukraine at a critical time and possibly prevented worse outcomes. A number of unfinished agenda items, e.g., on energy, banking and governance reforms, are being followed through in the current extended arrangement.

B. Lessons

69. With the benefit of hindsight, Ukraine’s experience offers the following lessons for future Fund engagements, including with Ukraine:

  • In active conflict situations, having a well-developed and realistic adverse scenario and contingency plans is critical. In such active conflict cases, risks to the baseline outlook might be tilted to, or as in Ukraine’s case, almost exclusively on the downside. This implies that, in the EPE team’s view, the baseline is more of a best case scenario, where any deviation is likely for the worse, by definition, rendering any analysis calibrated on the baseline subject to high risks. Elaborating on downside scenarios before risks materialize can usefully allow for contingency plans to be developed in less politicized environments. A probabilistic baseline, with analyses of key macroeconomic indicators’ sensitivity to the main risks (e.g., fan charts for each variable), could be useful to that end.

  • Programs in countries with recurring economic crises should not hold back from pursuing structural reforms, though these need to be carefully prioritized. As the 2013 Article IV Staff Report (IMF Country Report No. 14/145) noted, Ukraine entered 2014 with a potent mix of vulnerabilities and low buffers that had resulted, in large part, from unsustainable energy, macroeconomic and exchange rate policies, motivated by preserving vested interests. When faced with urgent financing needs, short-term macroeconomic stabilization is certainly critical. But such limited scope programs, as recommended by the 2008 and 2010 EPEs, are not necessarily desirable; any macroeconomic stabilization is not likely to be sustainable if authorities’ program objectives do not include tackling the economic structures that give rise to these vulnerabilities. Even in the face of conflicts, the structural agenda should not be sacrificed; rather, it should be prioritized more stringently. Ukraine’s 2014 SBA started useful progress on key structural reforms, which set the stage for the EFF to continue with them; this would not have been possible with a short-term program aimed only at stabilizing the economy.

  • It would be useful to develop guidance on integrating risks to the outlook into a bottom line assessment regarding the probability of debt sustainability. The current DSA framework includes a number of useful stress tests and realism checks, but they remain as standalone pieces and as a result there is considerable room for interpretation in coming up with a bottom line assessment on probability. It would be useful to develop guidance on translating the risk analyses and other relevant factors into the probability of sustainability to inform the exceptional access criteria assessment, while still leaving some room for judgment. Tools that the Fund staff has been developing to help assess the probability that debt is sustainable would be a key contribution to this end.

  • It would be worthwhile to consider developing guidance on assessing a program’s prospect for success for EA4. Track record with earlier programs can be an important indicator, since it reflects deep rooted problems that cannot be addressed easily. At the same time, basing the assessment solely on track record may not give due consideration to new governments with new policy agendas and mandates from the general public. Staff should consider how the forward-looking evaluation of EA4 could more systematically draw on a deeper understanding of the political and social context, including factors such as proximity of elections, the existence and stability of a reformist majority in parliament, fragility of the state (e.g. in conflict or not), the evolution of the political influence of vested interests as well as technical assistance provided to-date.

Authorities’ Views10

70. The authorities generally appreciated the Fund’s prompt response to the crisis in early 2014. The authorities noted that the approval of the SBA had a positive impact on sentiment and garnered international support at a critical time while providing impetus to important reforms through conditionality.

71. They broadly considered that the program objectives were rightly calibrated, while noting some aspects that could have improved the outturn. Some argued that financing needs were underestimated, reflecting the underestimated effects of the conflict on the economy and the severity of the inherited imbalances. Others indicated that the reform agenda should have been more ambitious and front-loaded, taking advantage of the post-revolution environment of change, to tackle critical reforms on the energy and pension fronts. Overall, the authorities’ views varied on whether the program sufficiently addressed Ukraine’s deep-rooted structural problems or effectively restored macroeconomic stability at a critical time.

72. While views differed on whether intensification of conflict could have been foreseen, the authorities agreed that the Fund should have reacted more swiftly to the deteriorating situation. The authorities generally concurred that the program strategy should have been changed by the time of the First Review (July-August) when it had become clear that the conflict would last longer and have deeper effects on the economy, including on trade, military spending needs, confidence, and ultimately, financing needs. They noted that the delay in moving to the EFF contributed to reserves dropping to critical levels and the exchange rate depreciating significantly in the interim, weakening the economy further.

73. The authorities noted that not pursuing an earlier debt operation, upon the Fund’s recommendation, and the Gazprom payment, placed considerable strain on the economy. The authorities explained that, at the time of the SBA program negotiations, they initiated discussions with private creditors to undertake a debt reprofiling deal, which included $2 billion in additional financing. The operation was not pursued, following the IMF recommendation, but this is now seen as a missed opportunity to regain market access and prevent a liquidity problem from becoming a solvency problem. Furthermore, they noted that the Gazprom payment, a prior action for the First Review, was untimely as reserves were already under sizeable pressure due to capital outflows and domestic political uncertainty. Meanwhile, the promised financing from IFIs for winter gas purchases did not materialize within the initially envisaged timeframe due to unforeseen technical details, resulting in a 9-months delay.

74. On specific program policies, the authorities had the following observations:

  • Monetary and Exchange Rate Policy: The authorities pointed out that while the program targeted a tight monetary stance, the monetary targets ended up being too loose, allowing the fiscal deficit to be monetized and reserves to fall to uncomfortably low levels. While views differed on whether the move to inflation-targeting in mid-2015 was too ambitious, the authorities agreed that the objective was useful as a basis for abandoning the fixed exchange rate regime. The NBU noted that the transmission mechanism of the interest rate policy was not effective due to the vulnerabilities in the banking sector. On capital controls, the authorities and private sector members criticized the Fund’s market approach to the escalating conflict and argued that the comprehensive and tight capital controls introduced in February of 2015 should have been introduced earlier in 2014.

  • Financial Sector Policies: The authorities were critical of the program’s target of providing emergency liquidity assistance to banks which they believed placed considerable strain on an-already depreciating currency and contributed to capital flight and deposit outflows. They were also highly critical of the quality of the AQR conducted by the independent auditors but noted that it provided the groundwork to build the institutional infrastructure within NBU to properly conduct banking sector diagnostics leading to more effective subsequent AQRs and some progress on the related-party lending problem.

  • Fiscal and Energy Sector Policies: While the authorities agreed with the fiscal tightening objectives of the program, they cautioned against adopting unpopular measures with low yield, such as freezing pensions and minimum wages. On tariffs, the NBU and Naftogaz would have preferred faster tariff increases under the program, but the Ministry preferred the gradual approach of the program to avoid straining the accompanying subsidy scheme.

75. The authorities emphasized the need for contingency planning in a conflict situation and suggested a number of takeaways for future engagements. They recommended that the Fund be “flexible and creative” in reacting to unconventional circumstances such as an escalating conflict. They gave as examples collaborating more with other partners, market analysts and experts in areas where the Fund lacks expertise, and rethinking following a market approach in a conflict situation, and having contingency plans in place. The authorities and private sector members saw a need for the Fund to closely study the political environment, engage different factions, and communicate the benefits of reforms more widely to the general public to strengthen ownership. They also found strict conditionality useful and suggested even or back-loaded programs to maintain reform momentum.

Key Findings of Ukraine’s Prior Ex Post Evaluations/Assessments

A common thread running through evaluations of prior Fund arrangements with Ukraine is their broad success in achieving short-term stabilization objectives but failure to gain traction in reforms to address key medium-term vulnerabilities. The evaluations reveal a history of incremental but ultimately incomplete progress in key reforms, particularly in areas of exchange rate flexibility, energy and banking sectors and governance, while highlighting long-standing difficulties in addressing weak program ownership and strong vested interests. Stepwise achievements under the programs are often associated with strong upfront conditionality, although this has not always assured success. Given the poor track record, the 2010 and 2008 ex-post evaluations suggested shorter future arrangements with less ambitious medium-term reform agendas. In turn, following a period of successive shorter arrangements, the 2005 ex-post assessment recommended longer Fund engagements to guide more medium-term institutional reforms.

The 2010 SBA Ex-Post Evaluation found the program helped restore market access and made some headway in eliminating preferential energy tariffs, strengthening central bank independence and pension reform, but failed to make progress in the areas of exchange rate flexibility, energy price adjustment as well as bank and NPL resolution. The evaluation largely attributed the program’s successes to prior actions, while also suggesting that smaller and shorter arrangements focusing on most critical issues may have better odds of success in cases with poor track record of reform implementation. The evaluation also suggested a mechanism for automatic termination of GRA programs if no review was completed within a short grace period.

The 2008 SBA Ex-Post Evaluation found the program helped prevent a financial meltdown amidst the global crisis by supporting an exchange rate adjustment, cushioning an even sharper demand shock and influencing some policy proposals that may have worsened economic distortions. However, no major shift in policy making occurred under the program and absence of sustained reform drive left large vulnerabilities and distortions in place. On strengthening ownership, the evaluation found that prior actions had facilitated progress in some but not all areas, while less front-loaded access could have helped policy incentives. The evaluation also noted that a shorter program horizon may have better reflected political realities, been more explicit of the program’s crisis management-focus and have helped front-load the program design in line with financing. It further highlighted the merit of consolidated monitoring of fiscal and quasi-fiscal accounts and underscored criticality broad donor support and engagement.

The 2005 Ex-Post Assessment of Longer Term Program Engagement found Fund-supported programs successful in redirecting focus of monetary and fiscal policies to macroeconomic stability objectives, but lack of reform-oriented political consensus hindering more sustained reforms toward a market-oriented macroeconomic framework. For future Fund engagements, the assessment underscored the need of strong program ownership and political support and streamlined structural measures focused on critical institutional bottlenecks. The assessment also suggested that addressing Ukraine’s medium-term challenges warrants consideration of program horizons longer than one year, with prior actions serving a key role in building a track-record.

Ukraine’s 2015 Debt Operation

By the end of 2014 it became clear that debt was unsustainable. As downside risks materialized and public debt to GDP surprised by about 30 percentage points as compared to the March 2014 SBA request together with ballooning financing needs, it became clear that the debt path was unsustainable.

The EFF that succeeded the 2014 SBA required undertaking a debt operation that would restore debt sustainability. Restoring sustainability was needed to justify the second exceptional access criterion under the Fund’s lending framework. The sovereign debt exchange offer was launched on September 22. Elements of the operation are still under discussion.

Objectives of the debt operation included: (i) generate about US$15 billion in public sector financing during the program period; (ii) bring the public and publicly guaranteed debt/GDP ratio from a projected pre-operation 79.2 percent of GDP to under 71 percent of GDP by 2020; and (iii) keep the budget’s gross financing needs at an average of 10 percent of GDP (maximum of 12 percent of GDP annually) in 2019–25. The debt operation also needed to reduce gross financing needs during the EFF program period (2015–18), from an average of 18 percent of GDP to 12 percent.

The debt perimeter, about $18 billion, included foreign-currency denominated debt held by private external creditors (Figure B3.1). This included Eurobonds and commercial loans. Domestically held foreign-currency denominated debt was not included on the basis of potential costs to the banking system, which may have increased recapitalization needs and therefore further incur a fiscal cost.

Figure B3.1.
Figure B3.1.

Composition of External Debt under Debt Operation

Citation: IMF Staff Country Reports 2016, 320; 10.5089/9781475543506.002.A001

Source: IMF Country Report No. 14/106 (Request) and 14/263 (First Review)

Ukraine’s agreement with private external creditors included the following terms:

  • (i) 20 percent nominal haircut;

  • (ii) maturities extended to 2019–27 (versus 2015–23 under existing instruments);

  • (iii) coupons of 7.75 percent (versus a pre-exchange average of 7.2 percent);

  • (iv) a value recovery instrument (a GDP growth warrant), providing potential payments to participating bondholders from 2021–40 if nominal GDP is above US$125.4 billion and real GDP growth is above 3 percent (with payments capped at 1 percent of GDP only during 2021–25).

Ukraine: Comparable Crisis Episodes

Ukraine was facing a sudden stop, accompanied by a currency, banking and a twin deficit crisis during the course of the 2014 SBA. Inconsistent macroeconomic policies had produced a potent combination of an overvalued pegged exchange rate, large and growing twin deficits, a weak banking system and very low buffers. Domestic political turmoil followed by conflict in Crimea and Eastern Ukraine unanchored expectations and led to rapid capital outflows. With reserves being depleted to dangerous levels, NBU abandoned the de facto currency peg in February 2014. This contributed to further weakness at banks and added to fiscal pressures, while the current account deficit remained large as trade with Russia plummeted after the conflict began. The resulting exchange rate depreciation over 2014 was about 90percent and real GDP contracted by 6.8 percent. Over 2015, the hryvnia broadly stabilized but the economy is estimated to have contracted by another 9 percent.

Literature suggests that a sudden stop that induces a floating regime, as in Ukraine, can result in depreciation of 50-100 percent. Cavallo et. al. (2005) find that collapses of fixed exchange rate regimes typically follow a sudden stop of capital inflows and a sharp short-run overshooting of nominal (and real) exchange rate well above fundamental values.1 In addition, they find that countries entering a crisis with high levels of foreign debt tend to experience large real exchange rate overshooting, estimating REER total depreciation across 24 crisis episodes in 1990s as 54.5 percent. Rebelo and Vegh (2001) identify 51 crisis episodes in which the fixed exchange rate regime was abandoned and estimate the average change in exchange rate as 98.6 percent.2 Hagiwara (2005) estimates that the nominal exchange rate depreciation of countries that abandoned a fixed exchange rate system following a sudden stop experienced on average a of 50.4 during a sudden stop, and greater than 50 percent in the first year.3

Studies have shown that currency and banking crises combined can result in economic contractions of 6-9 percent on average per year, similar to Ukraine’s experience. Kaminsky and Reinhart (1998) find that the economic fundamentals are more severely hit when a currency crisis occurs together with a banking crisis (the currency crisis deepens the banking crisis leading a vicious circle) and resulting in an output loss of 8 percent on average.4 Hutchinson and Noy (2005) find in a sample of emerging economies from 1975-97 that currency and banking crises contribute over a 2-4 year period to an output contraction of 5-8 percent and 8-10 percent, respectively which suggests a combined output loss for Ukraine of 6.5-9 percent in the first year.5 Aziz et. al. (2000) find in a sample of 39 banking and currency crises in emerging market economies that cumulative output loss averages 11.7 percent for contractionary crises (71 percent of sample) and 8.3 percent for all crises over an estimated 1.9 years recovery time, which suggests an output loss of 4.4-6.2 percent per year.6 Bordo (2006) finds that average output loss for sudden stops accompanied by a financial crisis is 6.25 percent based on a sample of emerging markets from 1980-97.7 Hutchinson et al. (2010) estimate that average cumulative output loss as 9.2 percent in a sample of 83 sudden stop episodes across 66 emerging and developing countries from 1980-2003.8 In light of the escalating geopolitical crisis, it could be argued that a more conservative GDP estimate would have entailed a sharper than average contraction.

1/ Cavallo, M., Kisselev, K., Perri, F., and Roubini, N. (2005). “Exchange Rate Overshooting and the Costs of Floating.” New York University.2/ Rebelo, S., and Vegh, C. (2001). “When Is It Optimal to Abandon a Fixed Exchange Rate?” National Bureau of Economic Research.3/ Terada-Hagiwara, A. (2005), “Explaining the Real Exchange Rate during Sudden Stops and Tranquil Periods”, Discussion Paper No. E-15, Institute for Monetary and Economic Studies, Bank of Japan, Tokyo.4/ Kaminsky, G., and Carmen M. R. (1996). “The Twin Crises: The Causes of Banking and Balance-of-Payments Problems,” International Finance Discussion Paper No. 544 (Washington: Board of Governors of the Federal Reserve System).5/ Hutchinson, M., and Han N. (2005). “How Bad are the Twins? Output Costs of Currency and Banking Crises.” Journal of Money, Credit and Banking.6/ Aziz, J., Caramazza, F., Salgado, R., 2000. “Currency Crises: In Search of Common Elements.” IMF Working Paper No. 00-67.7/ Bordo, M. D. (2006). “Sudden Stops, Financial Crises, and Original Sin in Emerging Countries: Déjà vu?” National Bureau of Economic Research.8/ Hutchinson, M., Noy, I., Wang, L. (2010). “Fiscal and Monetary Policies and the Cost of Sudden Stops.” Journal of International Money and Finance 29 (6), 973–987.
1

The $27 billion estimated financing needs does not include the $5.2 billion of scheduled repurchases to the Fund over the program horizon. In net terms, the Fund’s share of overall support over the program was 44 percent given these scheduled repurchases.

2

Staff cautioned that a further depreciation (to UAH/USD 12.5) would increase capitalization needs in large domestic banks from 1½ to 3½ percent of GDP and, perhaps, as high as 5 percent of GDP if the exchange rate depreciated by 50 percent relative to end-2013.

3

The existing Board guidance on adjusters for NIR and NDA performance criteria speaks only of allowing for small deviations from program financing assumptions that could be accommodated within the program without affecting the program’s main objectives. Since adjusters can defer policy adjustment, it is recommended that programs rely on reviews and waivers from the Board if adjustments are needed.

4

Among the steps taken by NBU under the 2015 EFF were the creation of a special unit in charge of monitoring connected lending, and the granting of legal powers to that office to presume connected lending whenever the documentation and guarantees of a loan are substandard. Banks do have the recourse to complete the documentation or upgrade the guarantees.

5

Ukraine’s credit outstanding at the time of approval was SDR 2.58 billion (187.9 percent of quota), leaving up to SDR 2.91 billion that could have been requested without triggering exceptional access procedures over the 24-month period.

6

At program approval and completion of each review, the Fund’s financing assurances policy calls for (i) firm financing commitments to be in place for the next 12 months and (ii) good prospects for adequate financing for the remainder of the program.

8

Under the modified EA policy, an assessment at the time of the SBA’s approval that Ukraine’s debt was sustainable, but with uncertainty as to whether it was sustainable with high probability, could have categorized Ukraine as a “gray case”. This could have enabled a re-profiling (i.e., an extension of maturities during the program period), assuming that all other elements of the modified EA policy were also met.

10

Based on views expressed during the EPE team’s staff visit to Kiev in March, by the authorities in office then and earlier, including in the Prime Ministry, the NBU, Ministry of Finance and Ministry of Economy, as well as by counterparts in Naftogaz and the private sector.