2008 Triennial Surveillance Review - Background Information and Statistical Appendix
Author:
International Monetary Fund
Search for other papers by International Monetary Fund in
Current site
Google Scholar
Close

Country surveillance constitutes an essential part of the IMF's mandate to oversee the international monetary system and to monitor the economic and financial policies of its 185 member countries. The IMF's Executive Board conducts regularly scheduled reviews of country surveillance (the Triennial Surveillance Review) to consider ways to improve its effectiveness. The 2008 review is the first such review since the Executive Board approved, in June 2007, a new Decision on Bilateral Surveillance. This Decision affirms that the focus of bilateral surveillance is on those policies of members that can significantly influence present or prospective external stability. The review focused on the implementation of country surveillance in the recent past, as presented in the following set of papers: • The overview paper presents the main findings and priority areas for further work. The review finds that stakeholders hold the quality of IMF surveillance in high regard, but that improvements should focus on risk assessment, integration of macroeconomic and financial sector surveillance, multilateral perspectives (cross-border spillovers and cross-country analysis), and exchange rate assessments. The priority areas identified in the review served as key background for the preparation of the IMF’s Statement of Surveillance Priorities (SSP). • The Thematic Findings (Supplement 1) provides supporting analysis on the implementation of bilateral surveillance in the recent past and, particularly, on the appropriateness of its focus and its analytical value added in particular areas, including the overall “health check”, exchange rates, financial sector issues, cross-country analysis and cross-border spillover analysis (including a case study of surveillance in the run up to the subprime crisis), the degree of candor and evenhandedness in surveillance, and the effectiveness of its communication. • The Background Information paper (Supplement 2) provides further information, including a description of review methodologies, and results including interview findings, surveys of various audiences, and supporting data on the quality of consultation documents. • The External Consultant’s Report provides an independent view of IMF surveillance in Europe.

Abstract

Country surveillance constitutes an essential part of the IMF's mandate to oversee the international monetary system and to monitor the economic and financial policies of its 185 member countries. The IMF's Executive Board conducts regularly scheduled reviews of country surveillance (the Triennial Surveillance Review) to consider ways to improve its effectiveness. The 2008 review is the first such review since the Executive Board approved, in June 2007, a new Decision on Bilateral Surveillance. This Decision affirms that the focus of bilateral surveillance is on those policies of members that can significantly influence present or prospective external stability. The review focused on the implementation of country surveillance in the recent past, as presented in the following set of papers: • The overview paper presents the main findings and priority areas for further work. The review finds that stakeholders hold the quality of IMF surveillance in high regard, but that improvements should focus on risk assessment, integration of macroeconomic and financial sector surveillance, multilateral perspectives (cross-border spillovers and cross-country analysis), and exchange rate assessments. The priority areas identified in the review served as key background for the preparation of the IMF’s Statement of Surveillance Priorities (SSP). • The Thematic Findings (Supplement 1) provides supporting analysis on the implementation of bilateral surveillance in the recent past and, particularly, on the appropriateness of its focus and its analytical value added in particular areas, including the overall “health check”, exchange rates, financial sector issues, cross-country analysis and cross-border spillover analysis (including a case study of surveillance in the run up to the subprime crisis), the degree of candor and evenhandedness in surveillance, and the effectiveness of its communication. • The Background Information paper (Supplement 2) provides further information, including a description of review methodologies, and results including interview findings, surveys of various audiences, and supporting data on the quality of consultation documents. • The External Consultant’s Report provides an independent view of IMF surveillance in Europe.

I. Methodological Framework for Assessing the Effectiveness of Surveillance1

1. An important contribution of the 2008 TSR is the establishment of a strengthened methodological framework for assessing the effectiveness of Fund surveillance (EFS). The 2008 TSR is the first opportunity to establish, implement, and fine-tune the methodological framework for EFS assessment discussed by the Board in February 2007. This background paper presents the framework and reports on its implementation in the 2008 TSR.

The EFS assessment framework

2. The framework is based on a working definition of EFS and a set of seven key diagnostic questions that reflect prior work on the priority quality attributes of surveillance (Appendix). The EFS working definition is that surveillance is effective when it provides, to each member country and to the international community, the information and policy advice best-suited to help preserve global financial stability and the external stability of each member country. Whether the information is used and advice followed is critical for ultimate effectiveness, but largely beyond the Fund’s control. The diagnostic questions, which derive from staffs earlier work, endorsed by the Board in February 2007, emphasize substance, quality, and outcomes over process, quantities, and outputs. They reflect the understanding that priority quality dimensions of effective surveillance are relevance, appropriateness, practicality, candor, and evenhandedness. The questions (which are supported and clarified by more detailed sub-questions) are:

(a) Is surveillance focused on the issues that are most critical to its mandate?

(b) Is the analytical content of surveillance of sufficiently high quality to add value reflecting the Fund’s unique expertise?

(c) Is surveillance candid?

(d) Is surveillance consistent and evenhanded?

(e) Is surveillance effectively communicated to its key audiences?

(f) Is surveillance having an impact?

(g) Is surveillance cost-effective?

3. The framework also entails an agreed set of sources of information and techniques to answer the diagnostic questions, allowing for triangulation. The three categories of information deemed most relevant for EFS assessment are output quality, outcomes, and impact. In principle, TSRs would collect information on all three, but this one focuses on the quality of outputs and on value-added, which is a form of impact. In the future, information on outcomes and impact will also be collected, drawing, inter alia, on surveillance agendas. The agreed techniques and their use in the 2008 TSR are covered in detail in the next section. A key feature of the approach to information and techniques is that it supports triangulation. That is, when possible, findings about particular aspects of EFS are drawn from different sources of information or different audiences, using a variety of methods, and compared for consistency. For example, different internal and external audiences were asked similar questions about the comprehensibility of staff reports.

4. The framework provides the basis for assessing the quality of surveillance over time and across countries and for assessing progress against time-bound surveillance priorities. Findings under the main diagnostic questions establish performance benchmarks for future TSRs. Alongside such permanent components, the framework also contains specific provisions for assessing performance against the more time-bound priorities outlined in the three-year Statements of Surveillance Priorities (SSP). Collected information is analyzed not only in aggregate, for the membership as a whole, but also separately for key country groupings (e.g., advanced/emerging/developing; area departments’ coverage; floaters and peggers etc.). This permits the identification of systematic differences in treatment, which can then be examined against the background of underlying economic realities to look for suggestions of bias or lack of evenhandedness.

Assessment techniques and their application in the 2008 TSR

5. The EFS assessment framework mainly features the following techniques. For all of the techniques covered, the reader is referred to the Statistical Appendix for additional and more detailed information on how they were implemented in the 2008 TSR, as well as the results of their application.

Standardized qualitative assessment of a representative sample of staff reports

6. A representative sample of Article IV reports were internally reviewed in order to collect standardized qualitative information across the main diagnostic questions.

The review was conducted by PDR economists in a division not involved in the review process of individual country surveillance reports. The universe from which the sample was selected was defined as the 88 Article IV staff reports discussed by the Board in the period July 1, 2007 to February 28, 2008. A sample of 50 reports/countries was reviewed, rather than the universe, to allow for more qualitative and in-depth review of staff reports, compared to earlier surveillance reviews. Detailed questionnaires corresponding to the main diagnostic questions were developed by the team to collect standardized qualitative information on the reports.

7. Several precautions were taken to maximize consistency across reviewers. Pairs of economists from the review team “test-drove” the questionnaire for two countries per pair. That is, pairs of economists reviewed a given set of two countries against the full questionnaire and then met to compare their responses and exchange information about problems encountered and the solutions adopted. This measure helped develop common understandings across the reviewers on how to interpret the questions and implement the questionnaire uniformly for staff reports reflecting a range of country and operational circumstances; this in turn helped ensure consistency of assessment across reviewers. Furthermore, when the internal review was completed, the team member responsible for a given part of the questionnaire checked the results across the 50-country sample for accuracy and consistency. Countries were divided up among reviewers in a way that ensured that each reviewer reviewed a group of countries that was diverse in terms of area departments, income level, and Fund program status.

8. PDR research assistants (RAs) reviewed the reports to provide the perspective of “an average college-educated reader.” RAs who were relatively new to the Fund reviewed the executive summaries and staff appraisal of staff reports and answered several overarching questions on the readability of reports and the clarity of key conclusions provided by the report in specific areas. These questions and the RAs’ responses provided checks for questions in thematic parts of the questionnaire on candor and evenhandedness, focus, and exchange rates.

Case studies

9. Case studies are useful for drilling down, i.e., for undertaking thorough and comprehensive analysis of developments where country, temporal, or other specific circumstances need to be taken into account, as well as for topics that require gathering information beyond that available in staff reports; additional sources considered in case studies could include additional internal documents (e.g., briefing papers) and external ones (e.g., media coverage of Article IV consultations, relevant/concurrent analyses produced by other international institutions, credit rating agencies, consultancies, or research institutes), and interviews. Five case studies were conducted in the 2008 TSR (see Box 1).

Topics for Case Studies in the 2008 TSR

(i) The quality, consistency and candor in exchange rate analysis under the 2007 Decision;

(ii) Fund surveillance of countries concerned in the run up to the subprime crisis and its aftermath;

(iii) Consultations with intensive involvement of the Monetary and Capital Markets Department (MCM) following the Rajan-Lipschitz-Caruana Task Force;

(iv) Focus of staff reports’ analytical background work, including the use of crosscountry analysis, based on a review of Selected Issues Papers produced for the entire membership;

(v) The treatment of real-financial linkages and regional cross-country spillovers in a region chosen as globally systemic and highly integrated, comprising a diverse mix of countries, and ideally subject to analysis by many “competitors” (to allow a better analysis of value-added).

Stakeholder surveys

10. Surveys are particularly helpful to refine diagnostics, understand the drivers of certain phenomena, and cast light on desirable remedies to problems identified separately. Key groups are: country authorities (to gauge their views of surveillance of their country); Executive Board members (with emphasis on their views as proxy for “the international community” on surveillance of countries other than the one(s) they represent); Article IV mission chiefs (as “producers”); and the public, including financial market participants, opinion-makers (media, think tanks), and civil society organizations (CSO). Both anonymous surveys and structured interviews by staff or, where more appropriate, an independent consultant, are expected to be used in the EFS assessment framework over time. For the 2008 TSR, stakeholder consultations were carried out through surveys and, in some cases, interviews with all of the above groups as detailed in the Section III.

11. Problems encountered. Response rates for the surveys of think tanks and CSOs were so low (320 think tanks contacted yielded a 3 percent response rate; and 1000 CSOs contacted a 0.3 percent response rate) that feedback from these sectors was not incorporated, and in the future other means of obtaining feedback from these audiences will need to be explored. Ex post, scope for improving the parallelism of questions on similar topics in surveys of different audiences was recognized (for example, in the question on the overall quality of analysis, the breakdown of different areas of analysis was not identical across surveys). A more general problem is that, ex post, the sample of respondents to a survey or participants in interviews may not be fully representative of the original population targeted.

Given that participation is voluntary, little can be done about this, beyond making the results available by relevant subsets within a given targeted stakeholder group, when possible. In the case of the survey of Executive Directors, the breakdown of respondents across country categories in not known, as to preserve their anonymity, it was felt necessary to refrain from asking respondents questions related to the country(ies) they represent. Thus while the overall response rate (58 percent) was satisfactory, it is an open question whether the responses really capture the diversity of views of the full Board.

Studies by independent consultants

12. Using independent consultants to investigate particular questions, themes, and/or audiences provides a different governance structure to assessments conducted by staff. Such consultants may conduct a survey, review documents, or use other sources of information, sometimes in combination with their own background or expertise. They provide views and analysis that have the potential advantages of (i) eliciting more candid feedback from both internal and external persons who are interviewed or surveyed and (ii) providing independent, external views on surveillance. For the 2008 TSR, an independent consultant was hired to conduct one of the case studies ((v) in Box 1), and another to conduct structured interviews with country authorities. Both of their reports are provided as part of the TSR documentation.

Indicators

13. Output indicators—numerical indices summarizing information on outputs and output quality—can be useful, but should be drawn on sparingly and with caution, given their weaknesses. For the 2008 TSR, a proximity indicator that measures the sharpness of the focus of SIPs, working papers, and surveillance agendas on issues most likely to be relevant to external stability was developed as part of the analytical underpinnings of surveillance case study. Also, an indicator on the extent, quality, and impact of cross country analysis in SIPs was developed as part of the thematic study of cross country analysis and spillovers.

Reporting in Article IV staff reports of past surveillance advice uptake

14. The requirement for staff reports to report on follow up to past surveillance advice earns mixed reviews as part of the EFS assessment framework. Since the 2002 review of surveillance, staff reports have been required to include a brief assessment of the authorities’ response to the key policy challenges identified in previous consultations—a requirement instituted specifically with an eye on providing information on the effectiveness of past surveillance. The staff paper for the February 2007 Board seminar noted pitfalls of this measure, notably that the results are not detailed enough to allow conclusions to be drawn on the effectiveness of surveillance on a country-specific basis, let alone to be aggregated to form a membership-wide assessment. Also, it may be inappropriate and distortionary to assess the quality and impact of staffs past advice in the same forum where the staff’s current assessment and policy advice is presented. The measure also suffers from the pitfalls of self-assessment, since the assessment of uptake of advice is done by the same department and staff that developed the advice. The 2004 surveillance review found that the reporting in many cases was “cursory, partial, and pro-forma.” The present analysis finds that only 60 percent of staff reports include this “required” information, and in only about one-half of these cases is the information reasonably substantial, i.e., one-half page in length or more.

15. Further experience has clarified that this reporting serves two distinct functions. For some consultations, it can provide useful background information to Executive Directors; but it was instituted as a universal requirement in Article IV reports not for this purpose but as a means of EFS assessment. The first function is clearly valuable, while as the preceding paragraph indicates, the second is not well served. Staff therefore proposes that it be understood that the sole purpose of the reporting is the first function. Therefore staff could use judgment in deciding whether the information is useful background but would not be required to present the information as a form of EFS assessment. These sections of staff reports do not say anything about whether the authorities’ actions were influenced by surveillance, and there is some risk of selective reporting when key areas of advice are not identified ex ante. In future TSRs, staff will be able to draw on the three-year surveillance agendas to assess actual outcomes against those intended ex ante.

Assessing performance against the SSP

16. As part of the TSR, the performance against priorities established in the SSP will be assessed. It is expected that this assessment will draw on the assessment tools outlined in the previous section. The SSP provides that at the time of each TSR, the Managing Director will report on progress in attaining the SSP priorities, management’s and staffs contributions, and the factors that impeded progress. The specific questions set out in the box accompanying the SSP (see Annex in the overview paper) will provide useful guidance to develop specific performance benchmarks, and it is expected that assessment of the SSP priorities will draw on the various tools outlined in the section on assessment techniques above.

Basic Framework for Assessing the Effectiveness of Surveillance

Object of the assessment. Surveillance is effective when it provides, to each member country and to the international community, the information and policy advice best-suited to help preserve global financial stability and the external stability of each member country. Whether the information is used and the advice followed is critical for ultimate effectiveness, but largely beyond the Fund’s control. What the Fund is responsible for in making surveillance effective is the focus of its efforts, the richness of its analysis and advice, and the quality of its communication. It is these that enable the Fund to maximize, within its mandate, its relevance to its members. The actual impact of surveillance will also depend on the Fund’s legitimacy—a dimension largely related to governance, but for which evenhandedness in surveillance is also important.

Key questions. This broad conceptual framework can be translated into a list of overarching questions that should constitute the backbone of future TSRs. Relative emphasis on the different aspects could vary over time as circumstances require. The key questions—which conceptually apply to all forms of surveillance: bilateral, regional or global—are listed below (focus areas for the 2008 TSR are italicized).

(a) Is surveillance focused on the issues that are most critical to its mandate?

  • ❖ Is surveillance (and underlying analytical work) focused on global and single country domestic and external stability, and their interdependence?

  • ❖ Is analysis focused on areas where risks are greatest?

  • ❖ Is surveillance timely in its analysis of issues?

(b) Is the analytical content of surveillance of sufficiently high quality to add value reflecting the Fund’s unique expertise?

Analysis of risks and real-financial linkages

  • ❖ Does surveillance provide adequate health checks, including sharp analysis of exchange rate issues ?

  • ❖ Does surveillance adequately integrate the analysis of economic and financial risks?

  • ❖ Is surveillance good at diagnosing risks and anticipating adverse developments?

Multilateral perspective

  • ❖ Does surveillance help members understand the international context and implications of each member’s policies (both inward and, where relevant, outward spillovers)?

  • ❖ Does it make enough use of the Fund’s cross-country knowledge?

Quality of Policy Advice

  • ❖ Are surveillance recommendations appropriate and well-tailored to the economic situation?

  • ❖ Do surveillance recommendations have enough operational acumen? Or are they sometimes impractical given country circumstances, or too generic to be useful?

(c) Is surveillance candid? 2

  • In assessing domestic and external stability, does surveillance too often wear rose-colored spectacles (e.g., assume problems away)? Does it tend to focus too much on central scenarios at the expense of risks?

  • Does surveillance tend to couch the description of problems (e.g., vulnerabilities, exchange rate misalignment) or recommendations in unclear or overly hedged language?

(d) Is surveillance consistent and evenhanded?

  • Is the quality of surveillance (as defined in a, b and c above) consistent across countries and country groups?

  • ❖ Are surveillance policy recommendations consistent across countries (i.e., similar for countries in similar conditions)?

  • Is the degree of candor in assessing risks and recommending policy adjustments consistent across countries?

(e) Is surveillance effectively communicated to its key audiences?

  • ❖ Are the key vehicles available (mission concluding statements, staff reports, summings up, published bundles) effective and efficient in conveying the messages of surveillance to their key audiences—country authorities, the Board, the broader international community, and the public? In particular, are staff reports and bundles (in their current format) well-suited to communication with the Board, the international community, and the public?

  • ❖ Are other forms of communications and outreach used sufficiently and effectively?

  • ❖ Is surveillance communicated in a sufficiently timely fashion to its various audiences?

  • Separately from the vehicle, are surveillance messages presented in a convincing, user-friendly manner (e.g., well argued, prioritized)?

(f) Is surveillance having an impact?

  • ❖ Is surveillance significantly informing policy decision making? the public debate? markets?

  • ❖ Are the policy recommendations of surveillance followed?

(g) Is surveillance cost-effective?

  • ❖ Do the modalities of surveillance allow it to deliver the best value at the lowest cost?

II. Report on InterviewsWith Country Authorities3

1. Interviews were conducted with senior officials from 19 countries.4 According to the WEO classification, 7 countries belong to the group of advanced economies and 12 to the group of emerging market and developing countries.5 The interviews were based on a brief questionnaire distributed to interviewees before the meetings and concentrated primarily on the key questions related to implementation of surveillance to be examined in the 2008 TSR, namely: appropriateness of focus, given the mandate of surveillance and the circumstances of the member; analytical value-added; and the effectiveness of current modalities of bilateral surveillance, especially the way in which its messages are communicated to the authorities and other audiences in the country.

2. Almost all of those interviewed said IMF surveillance added significant value, through several channels: (i) as an integrated macroeconomic assessment from a global perspective; (ii) as a test against the authorities’ own judgments; (iii) as a transparent source of standardized information and, for some countries, (iv) as a source of specific policy advice. On the latter, most interviewees from advanced economies said surveillance generally did not say anything they had not already heard about policies, but it provided a useful comprehensive synthesis. This was especially appreciated by interviewees from smaller advanced economies. Many interviewees from emerging markets noted that the uniqueness of IMF surveillance as an external assessment was less than before, which highlighted the importance of adopting surveillance outputs so as to maintain IMF relevance. The messages from interviewees across different groups of countries were broadly similar, except where noted below.

Appropriateness of focus

3. Many regarded the 2007 Decision as a welcome legal framing of what IMF surveillance had already been doing in recent years. Therefore, in judging its implementation, they did not expect to see radical changes in approach. In any event, it was still too early to judge the full extent of any changes on those countries that had not yet completed a full cycle under the new framework.

4. Almost all those interviewed supported the new focus, but stressed that it had to be tailored to specific country circumstances. In particular, the new framework should not become another “check list.” For example, several of those interviewed had the impression that some surveillance reports were overemphasizing the discussion of regional spillovers or deviations of exchange rates from “equilibrium” even when the evidentiary basis was limited and other issues were more important.

5. Many of those interviewed thought that the coverage of exchange rate issues still lacked uniformity. For example, there was wide disparity in the coverage of CGER analysis across surveillance reports with different advanced and emerging market economies. Many emphasized the need for new operational guidelines on surveillance to ensure greater uniformity. Some thought the treatment of exchange rate issues in the bilateral surveillance reports for member countries of currency unions as integrated as those of the EU was especially problematic, since they did not think the current account balance of individual member countries of the union contained useful information about the exchange rate.

6. Interviewees thought the FSAP approach had added major value and had helped to deepen surveillance of financial sector issues, but the follow-up could be improved further. The integration with surveillance can be patchy and needs to move further from a follow-up of static assessments against standards to a more dynamic analysis of key risks and risk management. A number of interviewees said the insufficient technical expertise on financial sector issues of regular Article IV missions had reduced the value of some follow-up discussions on the financial sector.

7. There was broad support for deeper surveillance coverage of real-financial sector linkages. Many interviewees recognized that this involved significant analytical challenges, but that the Fund should take the lead in analyzing such linkages from a global perspective. For example, more attention should be given to approaches that treated endogenously the consequences of various shocks for credit expansion and growth. One interviewee noted that the FSAP Handbook already set out possible analytical approaches and another suggested that greater efforts could be made to incorporate World Bank analysis of the real sector into surveillance exercises.

8. Many interviewees stressed the need for realism about the Fund’s role in predicting crises. Financial markets are highly dynamic and the IMF neither could nor should be expected to detect all potential crises, especially if domestic supervisors failed to do so. The Fund role should be to highlight the most significant vulnerabilities as it sees them, with the focus on global inter-linkages. In this respect, some interviewees thought that the Fund had been slow to analyze the potential ramifications of the U.S. mortgage-financing crisis.

9. While recent surveillance reports were moving in the right direction, many interviewees would like to see even more emphasis on distilling relevant experience from other member countries. Several interviewees mentioned specific examples where greater emphasis on analyzing how other countries had addressed certain policy issues would have been useful (e.g., dealing with the macro challenges of terms of trade appreciation in advanced economy natural resource exporters; detailed policy responses to capital inflows in emerging markets). They noted, for example, that more could be done in bilateral surveillance to draw out country-specific policy lessons both from multilateral surveillance analysis and from bilateral surveillance of other countries facing similar policy issues. (See the next section for specific examples.)

10. A number of those interviewed thought that bilateral surveillance still gave too much attention to general structural reform issues, where the IMF often had little new to add. Several mentioned pro forma and rather superficial discussions of trade policy as an example. Fund surveillance should be even more selective and go deeper with topics chosen according to country circumstances and linked more dynamically to future macro challenges. Some interviewees noted that the Executive Board had to contribute to this selectivity, by refraining from new mandates outside the core competencies and not criticizing staff when greater selectivity means some issues are not covered.

11. While there was broad support for a greater emphasis on regional linkages where these were substantial, the relevance of a more “regional” approach to country surveillance depended on each country’s circumstances. Interviewees from countries where regional trade and financial linkages were not large said greater regional surveillance risked distracting from more important activities. Some from relatively smaller countries, including among the advanced economies, said a shift to regional surveillance reports could risk crowding out some issues of importance to them. In the words of one interviewee, earlier attempts to “streamline” surveillance, with distinctions between systemic and non-systemic countries, had not been well thought through, since the integrated assessment of IMF surveillance was often of greater value added to the latter countries. In countries where regional linkages were substantial, interviewees saw greater regional surveillance as a useful supplement to, rather than a replacement of, bilateral surveillance. In such cases, the main value added would come from an exploration of economic and financial spillovers within the region rather than from comprehensive regional surveys.

12. In countries with IMF-supported programs, a broader surveillance dialogue is still crowded out by the continued focus on detailed program implementation during Article IV missions. Interviewees from developing countries who commented on this issue said a great surveillance focus on the forward-looking macro challenges of enhancing growth was needed, rather than detailed reporting on program implementation. This would require greater selectivity, with some interviewees welcoming what they saw as a recent reduction in surveillance attention given to detailed social expenditure and poverty issues.

Analytical value-added

13. Many of those interviewed thought the exchange rate analysis (specifically, the CGER exercise) was not yet sufficiently robust to justify the weight put upon it in many recent surveillance reports. In particular, a good conceptual definition of ‘external stability’ was still lacking to make the framework operational. While most supported the Fund’s continued efforts to develop its analytical tools in this area, the language used in reporting results needed to be very cautious. Greater uniformity of treatment across countries was also needed. Several interviewees also said the Fund was often too quick to translate an analysis of price competitiveness into exchange rate policy advice, whereas many other policies also influenced cost structures. In contrast, some others stressed that, while the underlying analysis was inevitably imperfect, the Fund as an institution was still not sufficiently forceful in expressing its conclusions when there was evidence of major misalignments.

14. Many interviewees identified the Fund’s fiscal analysis as a particular source of value-added. Longer-term fiscal sustainability exercises that took account of ‘hidden’ fiscal costs in the broader public sector had often been helpful in adding to the transparency of the public policy debate, even in a number of cases where the underlying facts were already well-know to the authorities.

15. Treatment of financial sector issues in surveillance has greatly improved in recent years, in large part because of the FSAP, but further improvements in the analytical toolkits used in country work were needed if the Fund were not to fall behind the curve. Some interviewees said that the follow-up of the FSAP process in subsequent missions had not had the same ‘level’ of dialogue as on more general macro policies; in some cases, there as too much of a ‘checklist’ approach to following up on minor details rather than considering risks and risk management in a holistic manner. One interviewee suggested that, while it was unrealistic to expect the Fund to predict specific crises, it could do more to explore in advance possible spillover routes of financial shocks and the influence of different institutional settings. Another noted that, while the FSAP Handbook already had a useful chapter on approaches to treating endogenously credit expansion and economic growth, most FSAPs relied on simpler stress tests; consequently, the ‘next generation’ of FSAPs and surveillance needed to upgrade the analytical tools applied.

16. Many said they would like to see more evidence-based policy advice, adapting global analysis and cross-country experience to country-specific circumstances. One positive example cited of such analysis was the recent study of the impact of high oil prices, which had used the Fund’s comparative advantage to combine a global assessment with regional and country specifics. One issue mentioned where a number of interviewees from emerging market and developing countries would like to see more concrete, operational advice was on the interlinked issues of capital market reform, financial sector liberalization, and foreign exchange markets.

17. The timing of IMF analytical inputs influenced their effectiveness. For example, a number of those interviewed said the Fund’s analysis of the fallout from the sub-prime crisis, while comprehensive, had been less timely, and therefore less helpful to them in providing a quick assessment of the potential consequences for their own country than reports by others, including investment banks. A number of those interviewed said they relied more on reports produced by a few major central banks for information on developments in key advanced and emerging market economies, because of their greater frequency. Moreover, the timing of IMF analysis needed to determined as part of a broader strategy to maximize the input to the domestic policy debate, not supply-driven by the interests and capabilities of the Article IV team. Several interviewees quoted examples where IMF analysis of an issue had been of high quality, but had come too late to influence the domestic policy debate. However, many said that pre-mission consultations on what were likely to be the most critical policy issues for surveillance had improved the relevance of the dialogue and of thematic background reports in Selected Issues papers.

18. While acknowledging recent improvements, many of those interviewed said bilateral surveillance needed to take greater account of country-specific institutional elements. In addition to political economy considerations (e.g., advice to implement across the-board reductions in subsidies was often not realistic), a number quoted examples from the financial sector where they thought that greater familiarity with the institutional setting would have improved the quality of the policy advice.

19. A number of interviewees from emerging market and developing countries said the Fund approach to analyzing macroeconomic issues in their countries—built around the financial programming framework—was behind the times and needed updating.

More sophisticated and ambitious approaches, especially to analyzing real-financial sector linkages, were potentially available (see earlier discussion).

Modalities of bilateral surveillance

20. Interviewees commented on two aspects of surveillance modalities: (i) the way in which IMF surveillance messages were communicated (i.e., the frequency, speed, and product design of bilateral surveillance outputs and the quality of communications), and (ii) factors affecting the efficiency of surveillance.

21. No strong demand for a radical change in the types of surveillance output emerged from the interviews, but many thought the time lags needed to be shortened.

Many said that the key value added—in terms of influence on policymakers—came at the time of the concluding statement of the Article IV missions and any associated briefings of high officials. Production of staff reports and the subsequent Board discussion several months later generally had limited additional impact. Many thought the time between the end of the staff visit to the country and the subsequent Board discussion and release of the staff report was too long. Some also suggested that less time and resources could be devoted to preparing the formal staff reports, since the mission’s concluding statement already contained the key messages. One interviewee suggested that resources could be shifted to producing shorter, but more frequent and hence more timely, policy-oriented notes on key groups of countries.

22. In contrast, many interviewees argued strongly that the way in which surveillance messages were communicated in the various surveillance outputs needed substantial further improvement. Many said that, while the drafting of Article IV reports had improved in recent years, more work was needed to produce shorter, sharper, and more focused reports. Several gave specific examples where they had revamped the language of staff reports in order to extract salient messages to brief senior policy officials or parliamentarians in a form that would have more influence on the domestic policy debate. One interviewee said the informal approach of many of his colleagues was to “only read the Boxes,” since they tended to contain most that was original in a staff report.

23. The language of the Board Summing Up was behind the times, in terms of modern approaches to policy communications, according to a number of those interviewed. Several said that the language used was too coded and cryptic and therefore less accessible outside a narrow circle --”as if the Fund is talking to itself,” in the words of one interviewee. One Finance Minister said the Summing Up was an important document for his country, since he used it to convey the IMF messages to his Cabinet colleagues; however, he had to ask his staff to “translate” it into plain English before it could serve this purpose. Several of those interviewed suggested the Fund could learn more from recent advances in the way some central banks conveyed their policy messages (e.g., in the context of inflation-targeting frameworks). The conventions used to convey the number of Directors expressing a particular view (‘some,’ ‘a number of,’ ‘a few,’ etc.) were judged especially opaque by many interviewees, who said such language detracted from the clarity of the surveillance message.

24. A variety of views were expressed on the Fund’s transparency initiatives. Most of those interviewed favored publication of country surveillance reports, but a number argued that the emphasis on making public the Fund’s advice, except on those issues that were highly market sensitive, had gone too far and risked undermining the Fund’s role as a confidential advisor in their countries. This group thought the appropriate degree of transparency should be decided according to country-specific circumstances. In any event, many said that more scope should be given for the authorities to present their views when they disagreed with the Article IV mission’s concluding statement, since the opportunity to express such views at the time of the Board discussion could, in their view, come too late.

25. While many stressed that surveillance was a core activity of the Fund and needed adequate resources, several suggestions for improving the efficiency of surveillance operations were made during the interviews, including (i) greater use of modern communications prior to the Article IV mission to reduce the large amount of time devoted to technical questions; (ii) more use of videoconferencing with relevant HQ experts so that scarce IMF expertise (e.g., on the financial sector) is used efficiently during surveillance; (iii) devoting more in-house research resources to developing analytical toolkit modules for country teams (e.g., for analyzing real-financial sector linkages); (iv) developing more systematically a “knowledge data bank” on different country experiences with a select group of policy issues that were likely to arise frequently in coming years (possibilities mentioned included responses to capital inflows, operational intricacies of exchange markets, and comprehensive fiscal balance sheets); and (v) further efforts to reduce staff turnover on Article IV missions, although many recognized recent progress in this area.

Country Interviews Drawn Upon for this Report

article image

III. Supporting Information for the Subprime Case Study

1. This section provides more detailed, but not exhaustive, factual supporting information on staff analysis produced in the period leading up to August 2007, organized by country case. References to paragraph numbers in the main text are to Supplement 1, Chapter VII.

A. United States6

2. Many of the macroeconomic and institutional developments that led to the buildup of vulnerabilities in the run-up to the “subprime crisis,” as well as specific vulnerabilities, risks and risk transmission channels were identified ex ante (¶95-97). Analysis of the financial sector trends has been presented in different issues of the GFSR and picked up/developed in Staff Reports(SRs)/Selected Issues Papers (SIPs):

  • Credit rating agencies and pricing of structured products. GFSR, Apr 2006: “In particular, structured credit products are likely to suffer more severe, multiple notch downgrades paths...” (p. 61); “... a more differentiated rating scale may be useful for structured products” (p. 61); SR07*¡6: “In hindsight, the losses incurred on bundled subprime mortgage securities indicate that rating agencies and investors underestimated the weakening of lending standards and its impact in 2005-06”; SR07*¡25: “...credit rating agencies are playing an increasingly important role in how complex financial products are structured, which could involve potential conflicts of interest in that rating agencies have an interest in facilitating continuing investor appetite for such products to generate fees. “.

  • Securitization model. SIP06, Ch1,\3:”With securitization, banks and other mortgage originators have been able to shift significant amounts of credit and market risks to MBS holders...”; SR07\6, “The originate-to-distribute model, however, could be exacerbating incentive problems in financial markets. The intermediaries at various stages of the process— originators, securitizers, and pool managers—are remunerated primarily through fees and often bear only limited long-term balance sheet exposure to the underlying assets. This can reduce their incentives to maintain loan quality.”

  • Pro-cyclicality of risk management models. GFSR, Sept 2003: Developments such as value-at-risk models and the ratings-based approach in Basel II greatly improve risk management. They also, however, carry the risk of pro-cyclicality and amplifying volatility by requiring asset sales as volatility increases’” SIP04, ChVI,\16: “Supervisory assessments would need to include efforts to understand the systemic implications of risk management systems and instruments, and to identify critical factors for the liquidity of markets in which hedging instruments are traded.”

3. Staff flagged several weaknesses in the US financial system and regulation:

  • Systemic risks and moral hazard concerns related to the activities of the government sponsored enterprises (GSEs) Fannie Mae and Freddie Mac. SR04, Box 6: “Besides their size, the GSEs are important to financial stability for several reasons: About 30 to 50 percent of their liabilities are short-term; their role as one of the largest counterparties in the interest-rate and swaption market...” “The potential for future problems is exacerbated by the continued perception of an implicit government guarantee,” SR05,\44:”The mission supported the Administration’s plans for establishing an independent regulator, involving limits on the size of GSE portfolios and allowing the regulator to set capital requirements, design stress tests, and place a financially-weak GSE into receivership,” SR06, *¡55: “Action is still needed to carry forward the Administration’s proposals to strengthen the supervision of the housing GSEs and limit the size of their balance sheets so as to contain systemic risk in financial markets.”

  • Lax lending standards in the subprime market. SR06,*¡43: “Supervisory agencies indicated that they were close to finalizing a guidance note (subsequently issued in May) requiring banks to strengthen risk management with regard to riskier mortgage products, a move welcomed by staff.”

  • Fragmentation of the regulatory framework. SR07,\51”With several federal and many state regulators overseeing this evolving system, the new emphasis on improving regulatory effectiveness is welcome.”

  • Consumer protection. SR07*¡25 “Fed officials explained that, in light of the subprime shakeout, they are examining whether regulations implementing the Truth in Lending Act could be modified to address concerns of predatory lending, including by nonbanks that are not covered by guidance from federal regulators. Staff supported these efforts, but suggested that, given the importance of state-registered nonbanks in originating mortgages, federal legislation might also be needed to improve the consistency of enforcement. “

4. Staff also warned about possible event risks, including:

  • a sharp rise in delinquencies on mortgage loans in subprime and near prime (“Alt-A”) segments. SIP06,*¡9 As the housing market is beginning to cool, however, concerns are growing that payment resets on ARMs and nontraditional mortgages could shock many marginal households.

  • a drying up of liquidity in securitized asset markets. GFSR, Apr06: “ ...the diversity of participants within the different tranches of a CDO (or its capital structure) is often limited and secondary market liquidity is therefore often also limited” (p.56) “In the structured credit markets, we believe the risk of liquidity disturbances is material” (p.81).

  • a volatility spike. GFSR, Sept 03: “Excessive leverage often turns volatility into instability” (p. 5); GFSR, Apr07: “A volatility shock... could precipitate sharp portfolio adjustment and a disorderly unwinding of positions. The consequences of such a shock would be amplified by the rise in leveraged investment positions, the increased use of complex derivative instruments that remain untested in more volatile market conditions, rising portfolio exposure to illiquid instruments, and the prevalence of crowded trades” (p.29) “; SR07,*¡25: “...As discussed in the April 2007 editions of the Global Financial Stability Report and the Bank of England’s Financial Stability Report, a sudden rise in risk aversion could uncover unanticipated vulnerabilities, illiquidity in newer markets, and major losses in asset value.”

5. As the subprime crisis began to unfold, staff warned about similar vulnerabilities in other markets, e.g., leveraged loans: SR07,\7:”Staff see parallels to subprime mortgage developments in other market segments, including leveraged loans. In particular, the boom in leveraged buyouts is being funded through CLOs which have been in high demand from investors, and there is evidence that covenants in the underlying loans have eased. A turn in the credit cycle, especially if volatility and risk aversion rise, could expose financial vulnerabilities and unanticipated risk concentrations, with adverse effects on activity.”

6. Staffs analysis of the size and sources of cross-border risk transmission showed the importance of outward spillovers from the US through financial channels. See SIPs 07, Ch I: “Summary of Foreign Entanglements: Measuring the Size and Source of Spillovers Across Industrial Countries,” and Ch II “Summary of the Ties that Bind: Measuring International Bond Spillovers Using Inflation-indexed Bond Yields’”

What could have been done better?

7. Many issues were analyzed in depth, but the bottom line reached was overly optimistic (1199-102):

  • The likelihood and magnitude of a housing market correction. The US housing market started to falter in 2005-06. The risk of a correction was discussed in the SR04, SR05 and SR06. Staff subscribed to the official view of “no nationwide bubble”, on the basis of staffs own empirical analysis. SR04, \17:”They (officials) agreed with staff that some regional markets appeared overheated but observed that house prices in general were recovering from relatively sluggish increases during the 1990s and were broadly in line with disposable income,” SR05, \15: “Officials also noted signs of “froth” in the housing sector...However, the situation at the national level was less of a concern, and the most likely scenario was a flattening ofprices rather than outright declines... Staff agreed that house price stagnation was the most likely scenario.” The house price overvaluation was explicitly acknowledged after the correction had already started7 (SR06,^7:”Staff observed that, while conditions varied across regions, U.S. house prices seemed overvalued and a correction appeared to have started.” (Chapter 1 of the Selected Issues paper suggests “house _ prices are 1520percent above equilibrium. “)

  • The overall fragility of the US financial system, including the potential impact of a house price correction. During 05-06, the lack of concern about a nationwide housing bubble combined with the fact that banks’ loan portfolios seem to have been well diversified across regions supported staffs view that financial system was resilient to the potential real estate shock. SR05,*¡43:”Risks to banks from a correction in housing markets were judged relatively low. Despite froth in some regional markets and increasing use of riskier mortgage products, such as interest-only and adjustable rate loans, trends on a national level were less of a concern and loan portfolios were well diversified geographically,” SR06,\26:”Financial sector risks related to household borrowing appeared relatively manageable....,” SIP06,ChV,\18: “Financial soundness of Large Complex Banking Groups (LCBGs), as well as investment banks and insurers is found to have improved in 2003-05. Distance-to-Default (DD) measures are at multi-year highs, while weakening comovements of LCBG risk profiles point to diversification gains at a system level.” Even in 07, spillovers from subprime to the broader financial system were still viewed as being contained and systemic risk was still judged to be low. SR07,*¡4:”... Rising subprime delinquencies led to a jump in spreads on higher-risk mortgage-backed securities, but there has yet been little contagion outside of the near prime (“Alt-A”) segment of the mortgage market, reflecting the wide dispersion of risk and concentration of difficulties in specialist subprime originators... “

Known Unknowns, and Unthinkables

8. The full impact of the crisis would have been difficult to gauge, as it would have required data that was non-existent, or known unknowns: fl|103)

  • Incomplete information about potentially relevant risk exposures.8 e.g., staffs sensitivity analysis to the real estate shock on the LCBGs in Box 2, SIP06, ChV, focused only on retained loan book, not including MBS exposures; also, measures of leverage for LCBGs would have been more informative if they were computed on a consolidated basis (including both on and off-balance sheet positions), especially given that SIVs turned out to be not as remote as they were generally believed to be, as illustrated by the Bear Stearns’ case.

  • Difficulties in assessing certain risk exposures were acknowledged by staff. SR07,*¡50: “.. new instruments have made it more difficult to assess risks at a time when benign market conditions have encouraged risk taking and lower lending standards. Tightening financial conditions could expose unanticipated risk concentrations and links across markets. “ GFSR, Sept 03: “ Supervisors must continually improve the sophistication of their leverage measurement—both on and off-balance sheet—to keep up with market innovations” (p. 5).

  • Some of the information gaps were explicitly acknowledged as well: SIP06, ChV, “Informational lacunae are especially evident in the reporting of hedging and credit risk transfer activity;” Footnote 33: “The regulatory data do not, for instance, separate derivatives dealing positions from proprietary hedges, or clarify whether interest and exchange rate contracts represent net long or short positions, or identify holdings of collateralized debt and mortgage obligations by tranche;” \15:”...accounting data shed little light on growing risk transfer activity, while market prices cannot be assumed to perfectly reflect underlying risks,” GFSR, April 2006: “While structured credit products provide a wealth of market information, there remains a paucity of data available for public authorities to more quantitatively assess the degree of risk reduction among banks and to monitor where credit risk has gone”.. “such calculations require more detailed transaction data not currently collected by public authorities (including tranche-specific distribution data).”

9. The freezing up of the interbank money market and a sharp increase in liquidity funding risk for otherwise-solvent, systemically important core institutions were “unthinkable” and unforeseen by anybody fl|104). Any discussion of the counterparty risks tended to focus on exposures of regulated financial institutions to hedge funds. SR07,*¡23: “...staff were concerned about whether adequate due diligence—including of exposures of the core to hedge funds—was possible with limited hedge fund disclosure, whether risk management systems were sufficiently robust to a shock with consequences across a range of markets and if, given likely shifts in the investor base for hedge funds, consumer protection issues would become more pertinent.

Was the right policy advice given?

10. Staff mostly expressed support for policy measures already taken, or under consideration (¶107).

  • Staffs broad support of the Fed’s monetary policy stance was consistent with the benign view on the US housing market. SR04, \68:”The Federal Open Market Committee (FOMC) has appropriately begun preparing market for the gradual withdrawal of stimulus,” SR05 \52: The Federal Reserve’s gradual and flexible approach to monetary tightening has been effective.... Looking forward, however, monetary conditions still appear accommodative and—especially against the background of low unemployment, the recent rise in unit labor costs, and house price inflation—a more aggressive pace of interest rate hikes cannot be ruled out.”)

  • The financial sector policy recommendations appear to have been mostly in line with the authorities’ plans. SR07,\28:”Staff reiterated their support for proposals to improve regulatory effectiveness;”“SR07, *¡51: “...We strongly support plans to study the scope for rationalizing the regulatory structure, which can build on options earlier discussed by the GAO.” In some areas, staffs recommendations were more specific and/or went a bit further than the authorities’ plans at the time (SIP07, Ch IV, 1J48 did contain a specific recommendation for the US authorities to consider moving investment banks under the Fed’s supervision); staff repeatedly recommended publishing a Financial Stability Report.

were views communicated with enough emphasis?

11. The degree of concern related to flagged risks was not always clear, and headline messages tended to be reassuring (1J108).

  • Headline messages presented in SR05, SR06, SR07 continued to be reassuring. Even when financial market disruptions in the spring 2007 brought downside risks into a sharper focus, staff continued to put more weight on the “soft landing” scenario SR07,\4:”Underlying the baseline forecast of a soft landing is the continuation of supportive financial conditions, even after the emergence of problems with subprime mortgages.” SR07,\23:”Core commercial and investment banks are in a sound financial position, and systemic risks appear low. “

  • Against the benign baseline outlook, warnings were presented either as more medium-term “regulatory challenges” (SR07,*¡25) or in the form of general cautionary statements. SR07,*¡25: “Staff suggested that, while recent financial developments have helpfully spread risk, the impact of an extremely adverse market outcome may have risen... “

B. United Kingdom 9

what was called

12. All of the underlying conditions and trends (the state of the world) were discussed, and many aspects of the institutional frameworks, though some were—wrongly—not assessed as critical at the time (¶95-98). Most vulnerabilities had been recognized and risks individually investigated (¶97).

  • Rising house prices were emphasized from as early as 2002. A Selected Issues paper on House Prices (CR/03/47, p. 10, ¶15) warned “in 2002 that increases in real house prices appear significantly out of line with ... determinants’” The 2004 Report (CR/05/80, p.3) noted “houseprices are widely seen as overvalued,” referencing the September 2004 WEO research. By 2005, as house price increases decelerated, the Staff Report (CR/06/86, ¶12) noted “staff suggested that house prices are likely still overvalued” but “the degree ... is tempered by ... the stabilization of house prices over the past year.” The 2006 Report later noted (CR/07/91, ¶9), “House price growth increased [again] ... and house prices are likely overvalued;” (¶14) “risks are not insignificant” and “increases... risk of an abrupt downward adjustment.”

  • Increased risk taking and search for yield was flagged in the 2005 Selected Issues FSAP Follow-Up (CR/06/87, p.103)—while “The outlook for the U.K. banking system is favorable..’” (¶1), it offered the caveats, “medium-term risks exist, shaped by apparent expectations that benign credit conditions will continue indefinitely... risk may currently be underpriced, as investors leverage-up in their search for returns...” (¶2). The Staff Report echoed this message, including “increasingleverage and... search for yield represent downside risks” (CR/06/86, ¶6). In 2006, the house price pick up was linked to the “decline in 2-year bond yields” (CR/07/91, ¶9).

13. Institutional arrangements in the financial sector were picked up in the 2003 FSSA.

  • The eventual shortcomings of the “Tripartite Arrangement” were not foreseen, however these shortcomings at least partly reflected a failure in implementation— beyond what surveillance can be expected to see. The FSSA had noted (emphasis added): “The UK’s financial stability policy framework is well designed... While the framework has yet be tested in a genuine crisis, the MoU provides a strong framework for coordination and information sharing..., both in crisis periods and more normal times” (CR/03/46, ¶80). Later, missions asked about simulation exercises designed to identify implementation weaknesses (see below).

  • The FSSA also noted that the success of authorities’ deposit insurance scheme was “highly dependent on ... safety nets [being]... well understood by potential claimants... “ (¶104). In addition, in implicit recognition of possible problems with insurance payments under this scheme, this paragraph went on to note that at a planned review of the deposit insurance arrangements, “one of the aspects that should be considered is whether a more explicit contingency credit line from the Government would be desirable.”

  • The fact that “The UK has no special statutory regime to address the insolvency of financial institutions” was also recognized in the FSSA (¶42), however, it was not flagged as a major weakness since it was noted that “The authorities... can take a number of enforcement actions before an institution reaches the stage of statutory insolvency proceedings” (¶43). But the FSSA went on to encourage the authorities “ to keep the issue under review ... with a view to considering the scope and desirability of possible reforms to the system to broaden the ability of the FSA and/or other governmental agencies to restructure and liquidate financial institutions outside of the corporate insolvency system” (¶103).

14. Most emerging vulnerabilities and risks were picked up:

  • Exposure from the credit risk transfer instruments were (Selected Issues, CR/06/87, p.94) “a key concern ... may actually pose problems for financial sector stability in the event of a major negative shock in credit markets” and recommended “greater disclosure by financial institutions, of their holdings in CRT instruments’” But the overall message, consistent with the GFSR, was that CRT “has facilitated the dispersion of risk and enhanced the stability and efficiency of the financial system” (p. 79).

  • Risks from UK-based subprime lending in the context of search for yield was noted in (Selected Issues, CR/06/87, p.94, ¶13) “Sub-prime mortgage lending in the United Kingdom is reportedly increasing... more mainstream lenders are reportedly entering the market, albeit at the less-risky end of the sub-prime range initially.” In addition, concerns were raised about “signs of a loosening in corporate lending standards, as banks compete ... to provide funding in a low-yield environment.” (Staff Report, CR/06/86, ¶25).

  • The liquidity/wholesale funding risk, though without explicit reference to Northern Rock, was (p. 108, ¶27) also noted in the 2005 Selected Issues (CR/06/87): “...greater use of wholesale funding by banks has been observed. This strategy has somewhat increased the liquidity risk for some banks, as wholesale funding may be difficult and costly to roll over during times of company-specific or market-wide stress:’ This message was repeated in the 2006 Staff Report (CR/07/91, ¶30).

  • Crisis management arrangements were discussed during missions, where three components of crisis management (domestic, EU, international) were noted, with annual simulations: “taking the problem up to the highest echelons of decision making.” The 2005 Staff Report (CR/06/86, ¶24) likewise noted authorities “are continuously improving their ability to respond to shocks, including... crisis simulation exercises based on ... macroeconomic events.”

  • International contagion risks from systemic banks were considered (Selected Issues, CR/07/90), while the Staff Report noted links—especially through the inter-bank markets—were growing and “These growing linkages are both a strength and a vulnerability. They allow ... bad shocks to be more broadly dispersed... absorbed by individual institutions and the system as a whole. However, they also potentially allow the impact to be spread around the global financial system more widely and rapidly” (CR/07/91, ¶29). The report went on to note: “Given these growing crosscountry linkages, global risks are particularly important to the UK financial system, more for their potential severity than for their likelihood of being realized:” fl¶30). Finally, Box 5 of the Staff Report notes that due to increasing linkages between international banks “while the national focus of financial supervisory authorities has been appropriate until now, improving international cooperation in financial crisis prevention and management is becoming more important” (p. 23).

Was the right policy advice given?

15. Policy advice to mitigate the emerging risks was given, though sometimes little more could be done than to urge vigilance (¶105):

  • The FSSA noted with respect to the authorities’ deposit insurance scheme, that they “are taking steps to address [limited public awareness and should] consider whether a more explicit contingency credit line from the Government would be desirable” (CR/03/46, 1104). This was not picked up in later surveillance.

  • The Selected Issues (CR/06/87, p.128, ¶75) noted: “The FSA should continually enhance its surveillance of the CRT marketin cooperation with their overseas counterparts—given the rapid evolution of the market.” These also highlight known unknowns:

  • ➢ Absent solid research pointing to precisely what data should be disclosed, the recommendation to collect credit risk transfer data was not made in the Staff Report (CR/06/86, 1 27): “Officials... reluctant to increase the formal reporting burden... are not sure which data series would adequately capture key risks. For the time being, they preferred to focus on gathering market intelligence.”

  • ➢ The Staff Appraisal emphasized, “The rapid growth of credit risk transfer instruments, which are providing important diversification benefits, is also creating some risks. The authorities’ efforts, again, to publicize risks, but also to address the transactions backlog are right. And with due attention to the costs and benefits of new regulatory burdens, the authorities should continue to strengthen surveillance of the market and encourage initiatives to improve disclosure CRT exposures” (CR/06/86, ¶45).

  • “Supervisors’ judgment that specific risks—including... commercial property, a possible loosening of corporate lending standards, and the growth of sub-prime lending—are manageable seems reasonable... the authorities’ warnings that investors may be underpricingrisk ... are welcome” (CR/06/86, ¶45)

Were views communicated with enough emphasis?

16. The degree of concern related to flagged risks was not always clear, and headline messages tended to be reassuring (1108):

  • 2005 Article IV risk summary. “Supervisors are keenly aware of risks in the present global environment” (CR/06/86, 18). “Staff asked about risks posed by global imbalances. Officials responded that sudden shifts in international capital flows could disrupt a wide range of asset markets, potentially leading to costly and disorderly adjustments in banks’ balance sheets. Staff and officials agreed that the banking system is well-positioned to absorb substantial shocks”“ (125). “A risk to the outlook is the housing market, where valuations remain high by some metrics despite the stabilization of prices during the past year”“ (CR/06/86, ¶39)

  • 2005 Article IV bottom line. “Staff and officials agreed that the banking system is well-positioned to absorb substantial shocks” (CR/06/86, ¶25). “Macroeconomic performance in the United Kingdom remains remarkable.” (¶37) “Financial supervisors are skillfully meeting the challenge of overseeing a global financial center. Well-capitalized and cost-efficient, banks appear to be well-positioned to absorb losses that might arise from the most likely types of financial market disturbances.” fl¶45).

  • 2006 Article IV risk summary. “risks are not insignificant:... In light of estimates that house prices are already overvalued, this would increase the subsequent risk of an abrupt downward adjustment... External risks are low-probability but potentially high-impact, particularly as the global financial center could transmit shocks to the domestic economy. Higher global interest rates could trigger a reassessment of asset valuations, including UK house prices...” (CR/07/91, ¶14)

  • 2006 Article IV bottom line. “Macroeconomic performance in the United Kingdom remains impressive... Given this favorable ... outlook, financial sector prospects are strong.” (CR/07/91, ¶38) “Lastly, on the financial sector, which is in a position of strength, the authorities are appropriately promoting the system’s resilience.” (¶43)

C. Switzerland10

What was called

17. All of the underlying conditions and trends (the state of the world), and many aspects of the institutional frameworks were discussed (¶95-98).

  • Exposures to external developments, particularly in the US was flagged in the 2005 and 2006 Staff Reports, and substantiated more in the 2007 FSAP Update (f7) “the main downside risks for the financial sector appear to be external. Given their large trading portfolios, the two large banks are potentially exposed to market downturns and significant increases in volatility, associated for example with a disorderly unwinding of global imbalances that could put further pressure on U.S. exchange and interest rates, and induce a potentially severe drop in global equity markets and turbulence in financial markets. Risks would be compounded by a hard landing of housing markets in the U.S. and other key industrial countries via direct exposures and also indirectly through feedback to real economic activity.”

  • Capital adequacy problems (2007 FSAP Update, ¶10) “While capital adequacy ratios (CARs) of the two large Swiss banks are ample by current regulatory standards, other indicators suggest somewhat weaker positions. The banks have internationally comparable high risk-weighted CARs under Basel I, but their leverage ratios (equity to assets) are relatively low by international comparisons.”

  • Exposure of banks’ large trading portfolios liquidity risks (2007 FSAP, Box 1) “a systemic or institution-specific event that would disrupt market liquidity, particularly in markets with crowded trading, creates contagion risk and also could make it difficult for the banks to trade out their positions”.

  • Weaknesses in supervision (2007 FSAP Update, 127) “The Swiss Federal Banking Commission (SFBC) has made impressive progress (...). Nevertheless, two areas that remain a concern are (i) the SFBC’s budgetary independence; and (ii) the need to address liquidity monitoring.”

What could have been done better?

18. Stress tests underestimated the impact of various shocks on the banks (¶102). “Stress tests and scenario analysis indicate that the Swiss banking sector is resilient to most relevant macroeconomic shocks (...) Top-down stress tests indicated that the effect of the international scenario wiped out the sector’s profits but its effect on the sector’s capitalization level was negligible since the banking sector suffered only minor losses.” (2007 FSAP Update, ¶11). Two factors seem the most relevant to explaining why:

  • The stress tests turned out to be milder than the actual shock that ensued, even though the mission was trying to mimic a turbulent time “For the global scenario, its was agreed that the global credit conditions (...) should mirror the changes in credit conditions in 2001” (2007 FSAP, ¶52).

  • The FSAP Update was not able to quantify (although a qualitative assessment was provided) the additional problems that banks’ large trading portfolios would face in the context of a liquidity crisis (2007 FSAP, Box 1).

Was the right policy advice given?

19. Policy advice to mitigate the emerging risks was given (¶105-106):

  • “The new consolidated regulator (FINMA) needs to have operational independence and financial resources to be a constructive and appropriately forceful supervisor and regulator of the very large systemic financial institutions. Continuing efforts are needed to evaluate the large banks’ operating models and to ensure that liquidity and capital regimes are sufficient.”(2007 SR, ¶38).

  • More detailed advice was given in the 2007 FSAP Update regarding how to strengthen the monitoring of liquidity risks “the approach to liquidity regulation and supervision outlined in an SFBC Banking Ordinance should be updated to be aligned with the Basel Committee’s paper on managing liquidity in banking organizations. Indeed, the analysis needs to go beyond this given the systemic relevance of the large banks as global market players (*¡28), and the review of capital adequacy “the SFBC should review in depth the capital adequacy of the two large banks and pillar II capital requirements in the context of BASEL II implementation” (Executive Summary)

Were views communicated with enough emphasis?

20. The risks were clearly flagged, but the degree of concern attached to these risks was less clear (¶108): “ while stress testing indicates that the financial sector is generally resilient

to shocks, bank operations are increasingly complex, involving exotic instruments and high-leveraged counterparties (...) The main downside risk is that healthy balance sheets and profits may be building a degree of complacency, creating a vulnerability to increased volatility or shocks.” (2007SR, ¶37, second sentence)

D. Germany11

What was called

21. Many weaknesses of the institutional frameworks were highlighted (95-98).

  • The need for reform of the Landesbanken (LBs), and what to do, were first raised in the FSSA: “Restructuring the LBs is urgent, given their systemic importance ... “ (FSSA, ¶55) “The public LBs have started the process of adapting to the removal of government guarantees starting in 2005. However, it is unclear whether these steps are sufficient to address the trend decline in profitability. . a reduction in legal and other barriers (within or across pillars), would foster consolidation and innovation ... (FSSA, p.1 box) An 2004 Occasional paper (no. 233) further reinforced the message (p. 1). Since then, successive staff reports continued to pursue these issues. “Market-driven reform of LBs is essential, as ... they have imposed a large opportunity cost on the economy.” (SR 2006, ¶24, see also Box 3) The full analysis of opportunity costs to the taxpayer was presented in the 2006 SIP, including capital injections or ownership through other public bodies, lower financial returns, and also underscored LBs’ higher probability of insolvency. See also SR05, ¶34-38, and SR06, ¶24, which discuss the banking sector’s low profitability.

  • The increased risk taking by some Landesbanken was flagged in passing in the FSSA, and was not directly mentioned in staff reports-staff reports framed the issue as “a lack of a viable business model”. The FSSA flagged the risk in the context of developments in the derivatives markets (emphasis added): “Derivatives exposures of internationally active banks have increased . but appear manageable. This reflects in part a wider awareness of credit and market risks . but partly also regulatory arbitrage and a search for new high yielding products, especially _ for LBs’” (¶10). In 2005, the staff report noted “LBs have shored up their liquidity by raising long term funding prior to the withdrawal of state guarantees in July 2005, but they still need to develop viable business models. Although there may be isolated instances of strain, the likelihood of systemic difficulties is small.” (¶54) In 2006, this assessment seems not to have changed, with the focus squarely on the medium-term: “strains could reemerge during the next downturn and developments in neighboring countries risk leaving the German banking system behind.” (SR06, ¶53)

22. The Fund recommended legal changes to support market based-restructuring of the banking system (¶105) and facilitate consolidation. Private capital needed to be injected into public sector banks to “foster synergies and returns to scale, and help direct funds more readily to areas of highest investment needs” (SR05, ¶55), and “... to harness market signals and facilitate restructuring.” (SR06, ¶53). On supervision, staff supported the move to risk-based supervision, and urged greater disclosure and transparency on the methodology underlying risk-oriented supervision (SR06, ¶54), and of publishing “more timely financial soundness data, in particular on impaired loans.” (SR05, ¶56).

Were views communicated with enough emphasis?

23. The headline messages in the staff appraisal reinforced the need for banking reform (¶108). The staff appraisal gave tough overall messages: “Germany needs a decisive, forward-looking policy strategy to confront the serious challenges it faces.” (SR05, ¶45) In 2006, conditions had improved somewhat, but “without deeper structural change, however, the improved cyclical prospects do not alter Germany’s low growth potential.” (SR06, ¶48)

IV. Statistical Appendix12

A. Sample Selection for Review of Staff Reports

The following selection process resulted in the 50-country sample of staff reports:

1. The sample universe includes 88 Article IV consultation staff reports discussed by the Board between July 1, 2007 (after the 2007 Decision began to be implemented) and

February 28, 2008.

2. The membership was stratified by income group (advanced, emerging, and developing) and by region (5 regions according to area department), and percentages of the membership within each strata calculated. The sample universe was similarly stratified, and a target number of countries was specified (based on a total of 50 staff reports) to match the percentage of the membership within each strata. The actual country sample was then randomly drawn from within each strata to match the target number as closely as possible, within the constraints of the available universe (Tables 1 and 2).

  • Advanced: advanced economies according to the WEO classification.

  • Emerging markets: Includes countries listed in Emerging Market Bond Index (EMBI) Global, or the Morgan Stanley Capital International (MSCI) EM Free or countries that have accessed syndicated loans every year between 2002-2006.13 Excludes countries classified as Advanced in the WEO (Cyprus, Slovenia).

  • Developing: countries that fall into none of the above categories.14

3. The sample includes five program countries and three streamlined Article IV consultations.

Table 1.

List of 50 Countries for the Review of Staff Reports

article image
Notes 1. Bolded countries are part of the MCM case study countries (see Appendix in FSS paper for details). 2. (*) Denotes program countries. 3. Italics denote members of currency unions or exchange arrangement with no separate legal tender. 4. (S) denotes streamlined consultations.
Table 2.

Sample and Membership Strata by Region and Income Level

article image

B. Summary of Staff Report Reviews by Thematic Background

Table 3. Summary of Staff Report Review - FocusCircle

Table 4.

Summary of Staff Report Review - Health Check

article image
Table 5.

Summary of Staff Report Review - Financial Sector Surveillance

article image
1/four countries — Angola, Afghanistan, CAR and Congo — for which questions Q3 and Q4 were considered NOT applicable by reviewers are excluded.
Table 6.

Summary of Staff Report Review - Exchange Rate

article image

“Fixed” defined as arrangements with no separate legal tender, currency boards, other conventional pegs and pegs within horizontal bands (Annual Report on Exchange Arrangements and Exchange Restrictions (AREAER), 2007).

“Flexible” defined as crawling pegs (Botswana), managed floats and independent floats (Annual Report on Exchange Arrangements and Exchange Restrictions (AREAER), 2007).

The sample contains 17 cases with CA deficit over 5 percent of GDP and 9 cases with a CA surplus over 5 percent of GDP.

Table 7.

Summary of Staff Report Review - Spillovers and Cross Country Analysis

article image

The results are in percentages of all answers given to the question which may be less or more than the 50 sample size.

Table 8.

Summary of Staff Report Review - Candor

article image
Table 9.

Summary of Staff Report Review - Communication

article image
Table 9.

Summary of Staff Report Review - Communication

article image
Table 9-1.

Summary of Staff Report Review - Communication from Health Check

article image
Table 10.

Summary of Staff Report Review - Evenhandedness

article image
1/ Q3 in Candor is derived from Q2c in the Communication section, answered by non-economist readers.

C. Stakeholder Surveys

4. Several surveys were conducted for the TSR, to gather views across different groups of stakeholders on various aspects of surveillance. Survey audiences included member country authorities, Executive Directors, IMF mission chiefs, financial market participants, and think tanks and civil society. The surveys and responses follow.

5. The surveys posed questions relevant for each TSR theme, varying in emphasis depending on the audience, with the aim of capturing each audience’s unique perspective of surveillance. To maximize response rates, the number of questions in each survey were limited and the questions were phrased at a relatively general level.

  • The thematic areas included (i) focus; (ii) multilateral perspective (cross-border spillovers and cross-country analysis); (iii) financial sector and macroeconomic linkages; (iv) exchange rate analysis; (v) candor; and (vi) communications.

  • The surveys of authorities, EDs, and mission chiefs were most similar in content and structure, focusing more on the quality of coverage in thematic areas. Authorities and mission chiefs responded to questions about surveillance in their specific cases, while EDs shared their broader perspective of surveillance in countries outside of their constituency, as a proxy for the views of the international community.

  • The surveys of market participants, think tanks, and civil society also focused on the quality of coverage in thematic areas, with questions also aiming to assess the effectiveness of communication. In thematic areas, respondents were asked to compare the quality of the Fund’s analysis to other institutions doing similar analysis. The surveys also sought to assess the degree of use of various surveillance outputs, and strengths and weaknesses of these outputs.

  • A more limited survey of the media focused on the effectiveness of communications.

6. For all audiences, efforts were made to include as many respondents as possible.

The table below summarizes the universe of possible respondents and response rates. All responses were anonymous. Questions were included to help stratify the results by region and income level, and the type of institution as relevant (e.g., finance ministry or central bank for authorities; investment bank, hedge fund, rating agency, etc. for market participants).

Table 11.

Stakeholder Survey Sample Universes and Response Rates

article image
*Due to an insufficient number of responses, the surveys for think tanks, civil society and media are not included.

D. Stakeholder Survey Questionnaires with Survey Results

1. 2008 Triennial Surveillance Review Survey of Country Authorities (Total 63 responses)

The response rates for each question are in percentage. A number of responses for each question is provided when it is different from the total number of responses. The percentage figures are calculated based on this number. Due to no responses, the total percentage for each question may not add up to 100 percent.

The Fund has begun work on the 2008 Triennial Surveillance Review (TSR). The key objectives of this Review are to take stock of experience with the new surveillance framework, and of the distance to the new frontier outlined by the refocusing exercise launched by the Managing Director. The Fund also wants to shed light on how and why there are shortcomings in the practice of surveillance, to help guide future work, and to identify key operational priorities in surveillance over the medium-term. The review is expected to focus on recent experience— broadly the past year. The views of country authorities are being sought to inform the review, and will be handled anonymously.

article image

On the basis of recent surveillance of your country, please respond to the following statements:

Contribution of IMF surveillance

Please rate using: 1 - not at all; 2 - a little; 3 - to some extent; 4 - to a large extent; 5 - to a very large extent. Surveillance has contributed to my understanding of, or provided new insights for me into, my country’s:

article image
A01ufig02

1.1. Contribution of IMF Surveillance

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

*Rating scale: 1 — not at all; 2 — a little; 3 — to some extent; 4 — to a large extent; 5 — to a very large extent
article image
article image

Communication

Please rate all the following using: 1 - strongly agree; 2 - agree; 3 - neutral; 4 - disagree; 5 - strongly disagree

CO1. Besides discussions with the mission, the following are effective vehicles to communicate the messages from surveillance to my institution:

article image
A01ufig03

1.2. Effective Vehicles of Communication Besides Discussions with the

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig04

1.3. Areas Where Surveillance Contributed to Country Authorities’ Understanding

(in percent)

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Source: TSR Authorities' survey responses.
A01ufig05

1.4. Areas of Improvements Compared with Previous Article IV Cycles

(in percent)

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig06

1.5. Candor

(in percent)

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Source: TSR Authorities’ survey responses.
A01ufig07

1.6. Effective Vehicles for Country Authorities to Communicate the Messages from Surveillance to Their Institution

(in percent)

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Source: TSR Authorities’ survey responses.

2. 2008 Triennial Surveillance Review - Questionnaire for Executive Directors (Total 14 responses)

The response rates for each question are in percentage. A number of responses for each question is provided when it is different from the total number of responses. The percentage figures are calculated based on this number. Due to no responses, the total percentage for each question may not add up to 100 percent.

Welcome to the survey of Executive Directors, conducted in preparation for the 2008 Triennial Surveillance Review. Please respond to these questions taking into consideration only Article IV reports for countries outside your constituency. Your answers are very important to inform the review. To ensure a candid assessment, all responses will be anonymous and treated in strict confidence. We appreciate your participation.

Quality of Analysis

Focus of consultations

1. With the hindsight of economic and financial developments (global and country-specific), please indicate what proportion of recent Article IV consultation staff reports discussed in the past 12 months focused on an appropriate set of issues.

article image
A01ufig08

2.1. Have Article IV Staff Reports Focused on an Appropriate Set of Issues?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig09

2.2. Has the Focus of Article IV Consultations Improved?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

2. Please indicate whether the focus of Article IV consultations (grouped by type of economy) has improved in recent years.

article image

Multilateral perspective: Spillovers across countries, and cross-country analysis

3. Please indicate what proportion of Article IV reports discussed in the past 12 months have met your expectations in their analysis of relevant inward economic spillovers (e.g., global/regional economic and financial developments, as discussed in other surveillance vehicles such as the WEO, GFSR or REOs, and their impact on individual economies through real and financial linkages).

article image
A01ufig10

2.3. Proportion of Article IV Reports that have met Your Expectations in the Analysis of Inward Economic Spillovers?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig11

2.4. ...and in the Analysis of Outward Economic Spillovers

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

4. Please indicate what proportion of Article IV reports discussed in the past 12 months have met your expectations in their analysis of relevant outward economic spillovers (the impact of policies and developments in systemic economies, global and regional, on other countries).

article image

5. Please indicate the usefulness to you of the following types of cross country analysis in Article IV staff reports:

article image
A01ufig12

2.5. Usefulness of Different Types of Cross-Country Analysis

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Financial Sector Surveillance

6. In the analysis of financial sector and macro-financial issues, please indicate what proportion of Article IV reports discussed in the past 12 months has met your expectations, in allowing you to form a clear view on how financial sector developments could potentially impact domestic or external stability (the reverse linkages—from macro economic developments to the financial sector—are dealt with in the next question).

article image
A01ufig13

2.6. What Proportion of Article IV Reports has met Your Expectations in Allowing You to Form a View on the Impact of Financial Sector Developments on Domestic or External Stability?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig14

2.7. What Proportion of Article IV Reports has met Your Expectations in Allowing You to Form a View on the Effect of Macroeconomic Developments on the Financial Sector?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

7. In the analysis of financial sector and macro-financial issues, please indicate what proportion of Article IV reports discussed in the past 12 months has met your expectations, in allowing you to form a clear view on how macroeconomic developments could potentially affect the financial sector.

article image

8. Please indicate whether the quality of coverage of financial sector and macro-financial issues in Article IV reports discussed in the past 12 months has improved in recent years.

article image
A01ufig15

2.8. Has the Quality of Coverage of Financial Sector and Macro-Financial Issues Improved?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Analysis of exchange rate issues

9. Please indicate in what proportion of staff reports discussed in the past 12 months the quality of analysis of exchange rate issues has met your expectations in the areas specified below.

article image
A01ufig16

2.9-A Appraisal of Exchange Rate Policies and Quality of Relevant Staff Recommendations

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig17

2.9-B. Assessment of Consistency of the Exchange Rate Level with Macroeconomic Fundamentals

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig18

2.9-C. Overall Quality of Analysis of Exchange Rate Issues

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

10. Please indicate whether the quality of discussion of exchange rate issues in staff reports has improved in recent years in the areas specified below.

article image
A01ufig19

2.10-A. Appraisal of Exchange Rate Policies and Related Staff Recommendations

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig20

2.10-B. Assessment of Consistency of the Exchange Rate Level with Macroeconomic Fundamentals

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig21

2.10-C. Overall Quality of Analysis of Exchange Rate Issues

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Overall quality of analysis

11. As it relates to Advanced Economies, please indicate the extent to which you, and the government agencies with which you liaise, rely on the Fund’s Article IV consultation staff reports (for countries outside your constituency) for analysis of the issues specified below.

article image
A01ufig22
A01ufig23
A01ufig24

12. As it relates to Emerging Market Economies, please indicate the extent to which you, and the government agencies with which you liaise, rely on the Fund’s Article IV consultation staff reports (for countries outside your constituency) for analysis of the issues specified below.

article image
A01ufig25
A01ufig26
A01ufig27

13. As it relates to Low Income Economies, please indicate the extent to which you, and the government agencies with which you liaise, rely on the Fund’s Article IV consultation staff reports (for countries outside your constituency) for analysis of the issues specified below.

article image
A01ufig28
A01ufig29
A01ufig30

14. Please use this space to insert additional comments, if any, on the quality of analysis of consultations, including focus, economic spillovers, cross country analysis, financial sector surveillance, analysis of exchange rate issues, and overall quality of analysis. These may include examples of staff reports that stand out as best practice in particular areas, or as illustrations of missed opportunities.

- We still need to embed multilateral to bilateral and vice versa.

- Macro to financial analysis is sound but financial to macro remains weak.

- 2007 Decision has taken us backwards as there is now too much concentration on e/r levels and not enough on the overall consistency between the inter-related policy frameworks and their consistency with internal stability and their effects on external stability.

- While our countries use information on advanced and emerging economies regularly, they do not source this from Article IV reports for the most part. Up-to-date information is usually sourced from country websites or publications with respect to policy making. These reports serve more as an occasional reference document. Authorities may occasionally refer to specific reports to review the experiences of those countries in tackling a given issue. For us, specifically, these reports are reviewed primarily for Board discussions, they are not something we rely on to inform our decisions per se -- however, some of the information in them is internalized by us and may subsequently inform other work we do.

- We would encourage greater use of the organizing framework of domestic and external stability in writing Article IV reports.

- United States Article IV has been a missed opportunity to guide macro and supervisory policies, it sketched a too rosy picture and was not consistent with WEO.

- Switzerland Article IV was a fine example of addressing financial sector issues.

- India and Turkey Article IVs were excellent and well-focused.

- Among advanced economies, Euro-area countries’ report tend to be less focused, possibly due to the lack of monetary policy.

- Although the focus of Article IV consultations has not deteriorated over the recent years, the analytical content of staff reports has.

Candor of Discussions

15. Please indicate the proportion of staff reports which seem to candidly discuss any differences of view between the authorities and staff.

article image
A01ufig31

2.15. Candid Discussion?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

<For those who answer “many reports,” “some,” or “very few or no reports,” please also answer question 15.1>

15.1. Please indicate whether you see a systematic tendency for reports on certain types of countries, or countries with certain types of issues, to be less candid than others.

- I don’t think this is about types of countries, or particular issues. Rather, if you are a Fund member that has a powerful voice (whether advanced or EME) and/or you protest a lot, then the area departments can be worn down in their candor. Also, many member countries are very concerned about the political economy when it comes to publications, and therefore candor in reports to the Board can suffer. In my view, we still have to look carefully in our publications policy on the trade off between the Fund being a confidential adviser, and it being candid and independent whistle blower.

- Reports on systemic countries’ inaction or limited action in implementing stated or agreed policies to deal with global imbalances have tended to be ‘papered’ over. The same goes for international financial architecture / sector issues related to money laundering, where the emphasis tends to be on likely misdeeds in emerging market and low- income countries, with no searchlight focused on advanced-country financial institutions, where the laundered or stolen proceeds tend to reside.

- Yes, there is clearly a systematic tendency, mainly as result of political influence. But there are also systematic differences across area departments.

- There is a systematic tendency for staff reports to be less candid on major countries, both advanced and emerging.

- Yes, there is a systematic tendency of this type. For African countries, there is very little reflection of the authorities’ viewpoints in Article IV reporting. The impression created that there was consensus in the discussions is often not true.

- The staff should be candid in discussing their views with their authorities throughout the membership.

- Gulf and Mid-east, larger surplus EMEs and to some extent pegged exchange rate countries more generally are systematically less candid.

- Exchange rate issues.

- Yes, I see such systematic tendency.

- GCC countries.

- No

16. Please indicate the proportion of staff reports that take as baseline a medium-term and long-term outlook that is neither too optimistic, nor too pessimistic.

article image
A01ufig32

2.16. A Medium and Long Term Outlook Taken as a Baseline, not too Optimistic nor too Pessimistic?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

<For those who answer “many reports,” “some,” or “very few or no reports,” please also answer question 16.1>

16.1. For the reports in which you do not consider the baseline appropriate, do you see a general tendency toward bias in a particular direction? (7 responses)

article image

17. Please indicate the proportion of staff reports in which different kinds of risks to the medium and long-term outlook seem appropriately weighted and incorporated in the staff’s bottom-line assessment.

article image

<For those who answer “many reports,” “some,” or “very few or no reports,” please also answer question 17.1>

17.1. For the reports in which you do not consider the risks to be appropriately incorporated, do you see a general tendency toward bias in a particular direction? (9 responses)

article image
A01ufig33

2.17. Different Kinds of Risks Seem Weighted and Incorporated?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig34

2.18. Communication Aspects of Surveillance

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Communication Aspects

18. Please indicate the proportion of Article IV consultation staff reports which conform to the following statements about the communication aspects of surveillance.

article image

19. Please use this space to insert additional comments, if any, on the communications aspects of Article IV consultations.

- There is at times a disconnect between individual country projections in the WEO and the analysis in Article IV reports, where generally speaking Article IVs seem to be the more reliable ones.

- Communication on recent US policies has been inconsistent with Article IV analysis. -Staff strength is in making well argued and convincing analysis.

- The weakness is in the fact that the report is dated by the time it is published. Also, often the reports aren’t clear because they are too long and not focussed on IMF core issues, and the staff appraisal is often a repetition of the discussion of policy issues and it would be better if there were a clear and concise set of recommendations of what the Fund really wants the authorities to do.

- Finally, the Fund staff have difficulty connecting their top class economic analysis to the political economy. This is about having Mission Chiefs that are experienced in policy design and advising, and who can communicate to different stakeholders in engaged and influential ways. This comes from working closely with member countries about what is achievable both in the short and medium term and devising strategies to finally get there. It isn’t a process that can be learnt from PhD studies.

- Staff’s view, rather than Summing-up, is usually perceived as the official view of the Fund.

- Staff sometimes avoid changing views in the staff report despite important developments between an Article IV mission and a Board meeting.

- The analytical content of staff reports has deteriorated over the recent 2 years.

3. 2008 Triennial Surveillance Review - Questionnaire for Mission Chiefs (Total 55 responses)

The response rates for each question are in percentage. A number of responses for each question is provided when it is different from the total number of responses. The percentage figures are calculated based on this number. Due to no responses, the total percentage for each question may not add up to 100 percent.

Focus of consultation

Q1.What were the main considerations that guided the choice of the issues that the latest Article IV consultation focused on (i.e,. on which the greatest analytical efforts were expended) ? (Check all that apply)

article image

Q2.Were there issues with a potentially significant impact on domestic or external stability that the latest consultation did not focus on (albeit they might have been discussed in passing)?

article image

If yes, what were the reasons for not focusing on these issues? (Check all that apply) (3 responses)

article image

Q3.With the hindsight of recent developments in the economy, do you think past Article IV consultations (prior to the latest one) focused on the most important topics from the point of view of preserving domestic or external stability?

article image

Multilateral Perspective: Spillovers Across Countries and Cross Country Analysis

Q4. To what extent have you paid more attention to analyzing the following types of factors in the latest consultation than in previous years? (54 responses)

article image

Q5.What impediments, if any, do you see to routinely analyzing cross-country spillover issues? (Please rank them from 1 to 6, 1 being the biggest impediment and 6 being the smallest impediment. A ranking may be used more than once. Factors not considered impediments should not be ranked) (53 responses)

article image
A01ufig35

3.5. Impediments to Analyzing Cross-Country Spillover Issues?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig36

3.6. Impediments to Making Greater Use of CrossCountry Perspective

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Q6.What impediments, if any, do you see to making greater use of cross-country perspectives? (Please rank them from 1 up, 1 being the biggest impediment and 6 being the smallest impediment. A ranking may be used more than once. Factors not considered impediments should not be ranked) (53 responses)

article image

Q7. To what extent have you paid more attention to analyzing financial sector and macro-financial issues in the latest consultation than in previous years? (53 responses)

article image

Q8.What types of financial sector and macro-financial issues did you find the most challenging to cover in the context of the latest Article IV consultation? (Please rank them from 1 to 4, with 1 being the most challenging and 4 the least challenging.) (52 responses)

article image
A01ufig37

3.8.1. Most Challenging Financial Sector and Macro-Financial Issues..

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Ranking scale: 1 being the most challenging and 4 the least challenging.

3.8.2. Average Rating on Challenging Issues by “Type” of Economy Based on Mission Chiefs’ Characterization

article image

Q9.What do you see as the biggest impediments to analyzing financial sector and macro-financial issues in the context of Article IV consultations? (Please rank them from 1 to 7, 1 being the biggest impediment and 7 being the smallest impediment. A ranking may be used more than once. Factors not considered impediments should not be ranked) (52 responses)

article image
* Specifics provided by the respondents as “other” include lack of resources and word count limits, lack of desk economists in the department who can effectively combine macroeconomic and financial sector perspectives, country’s shallow financial sector and limited scope of analysis, and that the fact that the profession itself does not always have a clear picture of the effect of financial sector developments on the macroeconomy, and the profession itself cannot provide a very solid understanding of the linkages unless very wide error bands are admitted.
A01ufig38

3.9.1. The Biggest Impediments to Analyzing Financial Sector and Macro-Financial Issues in the Context of Article IV Consultations?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Ranking scale: 1 being the biggest impediment and 5 being the smallest impediment.
A01ufig39

3.9.2. Average Rating on Impediments by “Type” of Economy Based on Mission Chiefs’ Characterization

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

article image

Exchange rate issues

Q10. To what extent have you paid more attention to exchange rate issues in the latest consultation than in previous years? (52 responses)

article image
A01ufig40

3.10. To What Extent have You Paid More Attention to Exchange Rate s sues?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Q11. If applicable, Please indicate what issues were discussed more extensively than before: (Check all that apply.) (52 responses)

article image

Q12. Please indicate the extent to which each of the following factors posed a challenge for the full treatment of the discussions of exchange rate issues in your staff report: (52 responses)

article image

Q13. Based on your experience with the latest Article IV consultation in your country, to what extent would you say that the discussion of exchange rate issues with the authorities were candid? (52 responses)

article image

Candor

Q14. How would you evaluate the degree of candor, on the part of the team, in the dialogue with the authorities? (52 responses)

article image

Q15. How would you evaluate the degree of candor, on the part of the authorities, in the dialogue with the team? (52 responses)

article image

Q16. To what extent did the following possible factors constrain your presentation of a candid staff report? (Check what applies for each factor.) (52 responses)

article image

Q17. If you answered “To a Large Extent” or “To a Very Large Extent” to any of the possible factors in Question 16 above, did you deliver more candid messages to the authorities through other channels? (15 responses)

article image
A01ufig41

3.17. Through What Other Channels did You Deliver More Candid Messages to the Authorities?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Independence

Q18. To what extent did pressures from members (your assigned country, or others) constrain the surveillance work of the mission (e.g., issues discussed, analysis, policy recommendations, candor of the staff report)? (52 responses)

article image
A01ufig42

3.18. To What Extent did Pressures from Members Constrain the Surveillance Work of the Mission?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Communication

Q19. How much impact on the public debate would you say Fund surveillance achieves in your country thanks to each of the following communication tools? (52 responses)

article image

Q20. Are there procedural changes that, in your view, would likely improve the communication value of Fund surveillance if pursued? (52 responses)

article image

Country characteristics

Q21. As mission chief for what type of country are your answering this survey? (Check what applies) (52 responses)

article image

Q22. What Fund department covers this country? (Check what applies.) (52 responses)

article image

Q23. What description best characterized your country at the time of the latest Article IV consultation? (52 responses)

article image

4. 2008 Triennial Surveillance Review-Questionnaire for Financial Market Participants

(Total 96 responses)

The response rates for each question are in percentage. A number of responses for each question is provided when it is different from the total number of responses. The percentage figures are calculated based on this number. Due to no responses, the total percentage for each question may not add up to 100 percent.

Welcome to the survey conducted in preparation for the 2008 Surveillance Review. Your answers are very important to inform the review. To ensure a candid assessment, all responses will be treated anonymously and in strict confidence. We appreciate your participation.

1. What is your company’s profile?

article image
A01ufig43

4.1. Company’s Profile

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

2. What are your areas of focus?

article image

3. Which of IMF’s analytical products do you use and to what extent? (70 responses) - 1=to a large extent, 2=to some extent, 3=somewhat, 4=hardly; 5=not at all;

article image
A01ufig44

4.3. To What Extent do You Use IMF’s Analytical Products?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

All Countries

article image

Industrial Countries - North America

article image

Industrial Countries - Europe

article image

Industrial Countries - Asia

article image

Emerging Europe, Middle East & Africa

article image

Emerging Asia

article image

Latin America

article image

Developing/Low-Income Countries

article image

4. How do you see the role of the IMF’s country reports? (69 responses) - please rank from 1 to 5, with 1 being the most important and 5 being the least important

article image

5. What features of IMF’s country reports do you consider as their main strengths/weaknesses?

- please mark each feature as a strength, a weakness, or neither

article image
A01ufig45

4.5. Strengths/Weaknesses of Features of the IMF’s Country Reports

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

6. In your view, what are the areas in which the IMF’s country reports add value compared to the analytical products provided by other private and public institutions?

(68 responses)

- 1=significant contribution, 2=some contribution, 3=no contribution

article image
article image
article image
A01ufig46

4.6. In What Area do the IMF’s Country Reports Add Value?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Ranking scale: 1=significant contribution, 2=some contribution, 3=no contribution
A01ufig47

4.6-A. Distribution by All

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig48

4.6-B. Distribution by Industrial Countries

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig49

4.6-C. Distribution by Emerging Market Countries

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig50

4.6-D. Distribution by Developing/Low-Income Countries

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

7. How would you assess the overall quality of the cross-country analysis and of the analysis of cross-border risk transmission in the IMF’s country reports? (compared to an average quality of similar type of analysis available from other public and private institutions): (68 responses)

article image
A01ufig51

4.7. The Overall Comparable Quality of the IMF’s Cross-Country and Cross-Border Risk Transmission Analysis?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

A01ufig52

4.8. The Overall Comparable Quality of the IMF’s Analysis of Macro-Financial Issues?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

8. How would you assess the overall quality of the analysis of macro-financial issues in the IMF’s country reports (compared to an average quality of similar type of analysis available from other public and private institutions): (67 responses)

article image

9. How would you assess the overall quality of the analysis of exchange rate issues and external stability/vulnerability issues in the IMF’s country reports? (compared to an average quality of similar type of analysis available from other public and private institutions): (66 responses)

article image
A01ufig53

4.9. The Overall Comparable Quality of the IMF’s Analysis of Exchange Rate Issues and External Stability/Vulnerability Issues?

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

10. Please provide examples of the IMF analysis that you found particularly useful (please explain why):

General comments

   - IMF publications including article IV staff reports, Global Financial Stability Report, World Economic Outlook, Regional Economic Outlook, selected issues papers, working papers, article IV mission concluding statements.

   - Global statistics.

   - Punctual facts.

   - Global insights.

   - I am a significant consumer of IMF reports. I find the GFSR and WEO the best resource for global cross-cutting “current” issues; I rely on the data tables in IMF article IV reports as an important cross check for our own data analysis; and as I’m responsible for an entire region also find the regional outlook reports particularly useful. My team frequently reverts to Article IV reports, particularly for low income countries where they tend to be the only source but also in emerging markets as a useful reality check for our own work.

   - I found the working paper on ‘Public debt markets in Central America, Panama and the Dominican Republic’ particularly useful in gaining insight into the structure and composition of these markets and the key problems and challenges. This was useful background information in preparation for meetings with authorities and the report provided data that is not always easy to gather, particularly for domestic issuance.

   - Last year’s analysis on credit growth trends in the new EU countries and the risks that that poses, analysis of the recent Czech fiscal package, analysis of fair value on Iceland FX, EU funds and Poland in Poland’s latest selected issues.

   - Small industrial countries which is covered by IMF but not by other organizations, San Marino for example.

   - Country reports / selected issues for low-income and EMs.

   exchange rate policy comes under national sovereignty, this can hamper the IMF in saying what it thinks.

Comments on Article IV staff reports

   - IMF’s analysis of monetary conditions in Armenia, including policy strategy of authorities, was very useful.

   - IMF’s analysis of energy sector issues in Belarus and Ukraine was the clearest and most comprehensive available of an important area for both countries.

   - You will see my referencing in my speeches and commentaries the excellent written work of the IMF, citing specific examples -- Article IV reports, FSAPs, ROCSs, GFSR.

   - Your accounting, on the other hand, is opaque. I’ve written about that too.

   - GDP forecast of if has been very useful.

   - UAE Article IV report. Attempt to compile UAE wide fiscal numbers was not available elsewhere.

   Comments on WEO

   - WEO reports are insightful and extremely useful .

   - World Economic Outlook presented comprehensive overview of current issues affecting both advanced and emerging economies.

   - Chapter 3 on housing cycles, in the April WEO - depth, breadth and relevance.

   - It provides a very thorough overview of the world economic conditions.

   Comments on GFSR

   - Some Financial Stability Reports (April 2007, on subprime) was ahead of the game.

   - GFSR analysis of the sub-prime crisis. Breadth, relevance, insights and depth of knowledge of a complex issue.

   - Global Financial Stability reports are very insightful and timely.

   Comments on Selected Issues

   - Selected issues papers on issues related to structural reform, giving a cross-country perspective has been useful.

   - Analysis with respect to financial sector issues (for example related to legal issues in a crosscountry comparison) have been useful.

   - Selected issues papers on issues related to structural reform, giving a cross-country perspective has been useful.

   - Many studies on the special issues on Article IV are insightful. Comments on REO

   - The latest Regional economic Outlook on sub-Sahara Africa was very topical and relevant.

   - Africa REO - analysis of local debt markets.

   - Compilation of REER series and publication in REOs (why not in IFS!!??)

   Comments on working papers

   - I have read with great interest the IMF staff papers on the fair value of exchange rates (e.g. Alberola, Garcia, Lopez, Ubide “Global Equilibrium Exchange Rates - Euro, Dollar, “Ins,” “Outs,” and Other Major Currencies in a Panel Cointegration Framework”.)

   - IMF Working Paper WP/08/13, because of the insight it provides. Usefulness would be greatly enhanced however by providing access to databases.

   Comments on statistics

   - Now old, but the joint work on EM debt data was particularly useful due to consistency and breadth.

   - Country reports on smaller Latin America economies where data is not always readily available is especially useful.

   11. Please comment on types of analyses that you would like to see more of:

Comments on staff report

   - More brief, short updates of the recent topic events in the economy.

   - More timely/regular updates/assessments.

   - More frequent country analyses - easy to wish!

   - More timely and more frequent macro analysis. When I want to look for country analysis, the latest reports are often 1 to 2 years old. Furthermore, after returning from Article IV missions it can take months to release the papers. Previously the press releases for Article IV missions contained a forecast table. Please reinstitute the forecast tables. Otherwise we know nothing about what is happening with respect to macro developments until the board papers are published.

   - Timeliness of publication is key. Critical that data tables are maintained - no one in the private sector devotes the time to projections that IMF teams do.

   - Country reports with authors on the ground.

   - More updates on development of authorities’ policy strategy.

   - Country by country - Stock Market reports.

   - Overall information.

Comments on analyses

   - Risk analyses.

   - Macro issues, sensitivities.

   - More detailed scenario analyses and sensitivities of growth and exchange rates in sub-Sahara Africa to commodity prices, global growth, the global growth breakdown and impact assessment/scenario of institutional reform in sub-Sahara Africa.

   - In-depth analysis on the money flows between the major economies and emerging countries including bricks etc.

   - Analysis of local money market issues is often missing and BoP analysis often stops short of a discussion of the factors driving demand for equities and bonds. More generally, BoP projections could be more detailed and more explicit about assumptions underlying specific line items.

   - Global financial vulnerabilities.

   - Financial sector spillover risks to cross-border vulnerabilities.

   - Exchange rate valuation analysis.

   - Sector analysis: Provide analysis on economic potentials. for instance, assume case scenarios in Colombia of its potential by developing agro business, creating strong infrastructure. What would be an impact on GDP, and What would be a growth like? We need independent assessments publicly known to show the possibilities of development and its real impact on the community.

   - More cross country comparisons of corporate accounts including consistent treatment of pension liabilities.

   - Broad cross-country comparisons of development paths (e.g. work done on housing markets recently has been a good example of that) and policy choices.

Comments on analyses (continued)

   - Stock markets regulation cross country comparison. Answer a simple question, why has the Brazilian market exploded in market cap terms, while Mexico’s is lagging behind?

   - In addition to country specific analyses, it would be helpful to have more regional analyses that compares and contrasts policy responses to macroeconomic challenges (eg inflation shock, terms of trade shock) and the effectiveness of the results of these policy choices.

   - Thematic cross country research is always very useful, such as last year’s article on credit growth in the new EU countries. The regional reports are great.

Comments on linkages

   - In terms of types of analyses, it would be useful to enhance further the analysis of the interlinkages between exchange rates, financial systems and the real economy.

   - More on linkages between the financial sector and the real sector. Regional, cross-border financial sector surveillance is important. Why not move over to “regional FSAPs” in regions with important cross-border flows.

   - Links / risk transmission between developed and emerging markets.

   - Factor affecting credit markets in both advanced and emerging economies.

   - Systemic risks and financial stability report is always interesting. Maybe could include More on impact on financial market linkages due to rise in certain entities, e.g rise of quant funds and rule based trading impact on volatility and tail risk.

Comments on data

   - I think the IMF has done a great job with standardizing international statistics and I hope the SDDS databases will be further enhanced and made available with historical time series.

   - I will consumer anything you publish on smaller Latin American economies, especially data which can be hard to come by.

   - More data on hedge fund exposures and activities.

   - Possibly include external accounts info on a cross currency accounting basis (if I understand correctly, BOP is done on a country of ownership basis.)

   - Ready access to your data bases in areas where private sources are lacking. eg cross country comparisons of house price indexes, public debt (and composition), productivity. Also, IMFs long time series history in many areas is very useful.

   - Little attempt has been made to provide comprehensive GG debt numbers on a regular basis.

   - Data in Article IV reports is often inconsistent across countries.

Comments on debt

   - Public debt issues - local fixed income markets.

   - External debt analysis still often ignores private sector debt and makes no attempt to qualify official data if suspect.

   - External Debt Sustainability.

   - There should be more data on debt, both domestic and external, and debt of the private sector.

General comments

   - Unfortunately, I think that your objective should be to maintain the current level of output. I don’t see how you can increase it with the staff reductions that are underway.

   - Competitiveness.

   - Fiscal policy.

   - Structural.

   - Growth, balance of payments, debt management, exchange rate management.

   - Sources of long term growth; interaction of demographics and economics; optimal capital market liberalization. Clarification of the ECB lender of last resort role; costs of undervalued exchange rates; actual job losses ascribable to trade; costs and benefits of originate to distribute. And so on.

   - More on asset allocation; home bias, market trends and impacts.

   - Methods of forecasting inflation.

   - Forecasting Frequency.

   - Macro models.

   - Selected Economic Issues.

   - FSAPs.

A01ufig54

D.1. Areas of Staff Report Significantly Valuable to Stakeholders by Income Group

(in percent)

Citation: Policy Papers 2008, 003; 10.5089/9781498334211.007.A001

Note: Percentage response rates are taken for answer choices, “To a large (great) extent” and “To a very large (great) extent” from the Authorities’ (Executive Directors’) survey, and “ Significant contribution” from the Financial Market Participants survey.Source: TSR Stakeholders’ survey of Authorities, Executive Directors, and Financial Market Participants.

E. Key Data on the Analytical Underpinnings of Surveillance

1. This chapter presents the key data collected through the case study of the focus of surveillance’s analytical underpinning. This study reviewed the areas of focus of the individual chapters of all Selected Issues Papers (SIPs) issued from July 2006 to June 2008, and of two samples of 50 working papers (WPs) each, one from the second half of 2006, and one from the first half of 2008. It also assessed in which areas resources for bilateral were intended to be put in the next three years, by reviewing the work program sections of all surveillance agendas (SAs) produced between July 2007 and April 2008.

2. The methodology for this data builds on the guidance provided by the new Surveillance Decision for the focus of bilateral surveillance. The study sought to classify the topics of relevant documents (SIP chapters, WPs, SAs) according to how likely the area in which they fall is to significantly impact external stability. Specifically, topics were classified into 4 circles, as defined in the illustration below, with circle 1 including issues the most likely relevant to external stability and circle 4 the least. Assigning a grade 1 to circle 1, 2 to circle 2 and so on allowed to calculate a weighted average measure of the proximity to external stability (the “proximity indicator”) for a given group of countries over a given period of time and allowed comparisons across groups and over time. The “proximity indicator” ranges from 1 to 4, with a smaller value denoting a sharper focus. This tool is rudimentary, but it allows to form a view of the main trends at play.

Table 12.

Focus of Selected Issue Paper Chapters, 2006-08

article image

Weighted average of the position across circles, assigning a grade 1 to C1, 2 to C2 etc. The indicator can range from 1 to 4. The smaller the value of the indicator, the closer the focus of surveillance to issues significantly impacting external stability.

Table 13.

Focus of Selected Issue Paper Chapters, Detailed Breakdown, 2006-08

article image
Table 14.

Focus of Working Papers, 2006-08

article image

Weighted average of the position across circles, assigning a grade 1 to C1, 2 to C2 etc. The indicator can range from 1 to 4. The smaller the value of the indicator, the closer the focus of surveillance to issues significantly impacting external stability.

Table 15.

Focus of Working Papers, Detailed Breakdown, 2006-08

article image
Table 16.

Focus of the Work Program Sections of Surveillance Agendas, July 2007-April 2008

article image

Weighted average of the position accross circles, assigning a grade 1 to C1, 2 to C2 etc. The indicator can range from 1 to 4. The smaller the value of the indicator, the closer the focus of surveillance to issues significantly impacting external stability.

Table 17.

Country Groupings used in the Triennial Surveillance Review

article image

References

  • Bayoumi, Tamim, and Andrew Swiston, 2007, “Summary of Foreign Entanglements: Measuring the Size and Source of Spillovers Across Industrial Countries,” United States—Selected Issues, IMF Country Report No. 07/265 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Bhatia, Ashok V., 2006, “U.S. Banking: Financial Innovation and Systemic Risk,” United States—Selected Issues, IMF Country Report No. 06/278 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Bhatia, Ashok V., 2007, “New Landscape, New Challenges: Structural Change and Regulation in the U.S. Financial Sector,” United States—Selected Issues, IMF Country Report No. 07/265 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Brunner, Allan, Jõrg Decressin, Daniel Hardy, and Beata Kudela, 2004, Germany’s Three-Pillar Banking System: Cross-Country Perspectives in Europe, IMF Occasional Paper No. 233 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Case, K., and R. Shiller, 2004, “Is There a Bubble in the Housing Market?,” Cowles Foundation Paper No. 1089, Yale.

  • Chan-Lau, Jorge A., and Li L. Ong, 2006, “The Credit Risk Transfer Market and Implications for Financial Sector Stability,” United Kingdom—Selected Issues, IMF Country Report No. 06/87 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Chan-Lau, Jorge A., Srobona Mitra, and Li L. Ong, 2007, “Transmission of Shocks in the International Banking System and Implications for London as a Global Financial Center,” United Kingdom—Selected Issues, IMF Country Report No. 07/90 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Cihák, Martin, 2006, “The German Banking Sector: Credit Decline, Soundness, and Efficiency,” Germany—Selected Issues, IMF Country Report No. 06/17 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Cihák, Martin, and Bob Traa, 2006, “Landesbanken: A Measure of the Costs for Taxpayers,” Germany—Selected Issues, IMF Country Report No. 06/436, (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Committee on the Global Financial System, 2005, The Role of Ratings in Structured Finance: Issues and Implications, report by a Working Group of the Bank for International Settlements (BIS), January.

    • Search Google Scholar
    • Export Citation
  • De Nicoló, Gianni, Peter Hayward, and Ashok V. Bhatia, 2004, “U.S. Large Complex Banking Groups: Business Strategies, Risks, and Surveillance Issues,” United States— Selected Issues, IMF Country Report No. 04/228 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Goodhart, C., 2008, “The Background to the 2007 Financial Crisis,” February 19 (London: Financial Markets Group (FMG) research centre, London School of Economics and Political Science (LSE)).

    • Search Google Scholar
    • Export Citation
  • Hollar, Ivanna R. V., 2003, “An Analysis of House Prices in the United Kingdom,” United Kingdom—Selected Issues, IMF Country Report No. 03/47 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2002-2007, World Economic Outlook, various issues (Washington). Available via the Internet: http://www.imf.org/external/ns/cs.aspx?id=29

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, 2003-2007, Global Financial Stability Report, various issues (Washington). Available via the Internet: http://www.imf.org/external/pubs/ft/GFSR/index.htm

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, Financial Sector Stability Assessments and associated documents for: United Kingdom: IMF Country Report No. 03/46, 03/208; Switzerland:IMF Country Report No. 07/187, 07/198-07/203; and Germany: IMF Country Report No. 03/343.

    • Search Google Scholar
    • Export Citation
  • International Monetary Fund, Staff Reports for 2004-2007 Article IV Consultations with United States, United Kingdom, Switzerland, and Germany. United States: IMF Country Report No. 04/230, 05/257, 06/279, 07/264. United Kingdom: IMF Country Report No. 05/80, 06/86, 07/91. Switzerland: IMF Country Report No. 05/190, 06/202, 07/186, 08/170. Germany: IMF Country Report No. 06/16, 06/438, 08/80.

    • Search Google Scholar
    • Export Citation
  • Kindleberger, Charles Poor, 1978, Manias, Panics and Crashes: A History of Financial Crises (New York: Basic Books).

  • Kodres, Laura, 1999, “Financial Sector Issues in Germany,” Germany—Selected Issues, IMF Country Report No. 99/130 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Krugman, Paul, 2005, “That Hissing Sound,” New York Times, August 8.

  • Mühleisen, Martin, 2006, “The Attractiveness of U.S. Financial Markets: The Example of Mortgage Securitization,” United States—Selected Issues, IMF Country Report No. 06/278 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Ong, Li L., and Martin Anderssõn, 2006, “FSAP Follow-Up Report,” United Kingdom— Selected Issues, IMF Country Report No. 06/87 (Washington: International Monetary Fund).

    • Search Google Scholar
    • Export Citation
  • Rogoff, Kenneth, 2006, “In the Best of Times, It’s Wise to Ponder the Worst,” Financial Times, January 2.

  • Shiller, Robert J., 2005, “People Are Talking...,” Wall Street Journal, June 2, Sec. A12.

1

The main author of this paper is Lynn Aylward.

2

Biennial Review of the Implementation of the Fund's Surveillance and of the 1977 Surveillance Decision - Modalities of Surveillance.1/The questions under this heading have been assessed in the 2008 TSR with a sharp focus on external and exchange rate issues, against the background of the adoption of the 2007 Surveillance Decision.

3

Prepared by David Goldsbrough.

4

Interviews were conducted during April 2008 by two external consultants, Messrs. David Goldsbrough and Max Watson. No staff were present during the interviews.

5

See Annex I for a full list of countries.

6

Prepared by Anna Ilyina.

7

A similar view (at least until 2005) was shared by some prominent academics: “... However, judging from the historical record, a nationwide drop in real housing prices is unlikely, and the drops in different cities are not likely to be synchronous: some will probably not occur for a number of years. Such a lack of synchrony would probably blunt the impact on the aggregate economy of the bursting of housing bubbles.” (“Is There a Bubble in the Housing Market?,” K. Case and R. Shiller, Cowles Foundation Paper N.1089, Yale, 2004).

8

It should be acknowledged that staff’s access to financial data/information in the context of an Article IV consultation is typically more limited than in the context of an FSAP mission.

9

Prepared by Chris Marsh.

10

Prepared by Pedro Rodriguez.

11

Prepared by Piyabha Kongsamut.

12

This appendix was prepared by Piyabha Kongsamut (sections A and C), Jinsook Lee (sections B and D) and Jean-François Dauphin and Chris Bouzaher (section E).

13

Bond, Equity, and Loan database sourced from Dealogic, as published in the October 2007 GFSR.

14

The TSR papers use the terms “developing economies” and “low-income countries” indiscriminately. In practice, the former concept, which is slightly broader, was used to analyze staff reports, while the latter was used in the surveys. Low-income countries are those developing countries who are eligible to the PRGF and indicated with * in Table

  • Collapse
  • Expand
2008 Triennial Surveillance Review - Background Information and Statistical Appendix
Author:
International Monetary Fund