Can Government Demand Stimulate Private Investment? Evidence from U.S. Federal Procurement1
  • 1 0000000404811396https://isni.org/isni/0000000404811396International Monetary Fund

Contributor Notes

Authors’ E-Mail Addresses: Shebous@imf.org; tom.zimmermann@frb.gov

We study the effects of federal purchases on firms’ investment using a novel panel dataset that combines federal procurement contracts in the United States with key financial firm-level information. We find that 1 dollar of federal spending increases firms’ capital investment by 7 to 11 cents. The average effect masks heterogeneity: Effects are stronger for firms that face financing constraints and they are close to 0 for unconstrained firms. In line with the financial accelerator model, our findings indicate that the effect of government purchases works through easing firms’ access to external borrowing. Furthermore, industry-level analysis suggests that that the increase in investment at the firm level translates into an industry-wide effect without crowding-out capital investment of other firms in the same industry.

Abstract

We study the effects of federal purchases on firms’ investment using a novel panel dataset that combines federal procurement contracts in the United States with key financial firm-level information. We find that 1 dollar of federal spending increases firms’ capital investment by 7 to 11 cents. The average effect masks heterogeneity: Effects are stronger for firms that face financing constraints and they are close to 0 for unconstrained firms. In line with the financial accelerator model, our findings indicate that the effect of government purchases works through easing firms’ access to external borrowing. Furthermore, industry-level analysis suggests that that the increase in investment at the firm level translates into an industry-wide effect without crowding-out capital investment of other firms in the same industry.

I. Introduction

A key question in macroeconomics and finance is whether government demand stimulates private investment. In this paper, we address this question by examining the effects of government spending on firms’ capital investment using novel micro-level data on federal procurements in the United States.

We argue that the response of capital investment of financially constrained firms to government demand shocks is more pronounced than that of non-constrained firms. Our argument can be motivated by the financial accelerator framework of Bernanke et al. (1996). Without financial frictions, optimal capital investment is determined by equating the marginal product of capital and the real price of capital. However, consider a firm that cannot reach this optimum due to financing constraints, thus requiring external funding to invest in inputs of its production function. Because the collateral-in-advance constraint is binding, a financing premium hinders firms’ external borrowing. Within this minimal setup, the creation of new government demand increases the net wealth of the firm through the additionally generated cash flow. The new government demand reduces the external financing premium, thereby relaxing the constraint and hence increasing firms’ demand for inputs. The hypothesis that follows from this simple model is that government demand shocks increase capital investment particularly for financially constrained firms.

To test this hypothesis, we link data from two different sources. The Federal Funding Accountability and Transparency Act (FFATA), signed in September of 2006, requires the Office of Management and Budget (OMB) to organize a database including each contract transaction awarded by federal agencies in the United States from 2000 onwards. Key information includes the name of the contractor, the value, and the date of the award. According to the OMB, the aggregate annual value of awarded federal contracts in the United States has been close to 500 billion dollars in the last years. We merge the data on federal contracts with information on the contractors, such as capital expenditure, total assets, and other financial variables obtained from Compustat. The resulting dataset is novel and includes about 94,000 quarterly observations from 2000Q1 to 2012Q4.

We construct a measure of government spending shocks at the firm level linking federal procurement contracts with firms’ financial information. We use several restrictions to make sure that the demand shock is unanticipated by firms. In particular, we only include a contract if it was awarded in a full and open competition with at least two bidders. These restrictions enable us to filter out potential anticipation effects and focus on unexpected changes to a firm’s future cash flows. We scale the sum of all of a firm’s contracts in a given quarter by its lagged capital.

Our empirical analysis is based on a panel data approach to estimate an investment equation, as in Chaney et al. (2009). We account for time-invariant dimensions of heterogeneity among firms by using firm-fixed effects, which nests all unobserved industry-specific effects, such as monopolistic structure. In addition, the analysis of government spending has to consider the issue of time- or regime-dependency. Recent studies suggest that government spending can have differential effects depending on the stance of the business cycle.3

Our detailed micro-analysis enables us to address this concern by using period-fixed effects. In our set up, the inclusion of a fixed effect for each quarter in the sample captures all time-variant macroeconomic variables such as—changes in the interest rate, changes in legislations, or shocks to the U.S. economy—that are common among all firms. In contrast with studies that use aggregate time series within one country, and hence cannot employ a period-fixed effect as it eliminates all variations in the sample, we can disentangle heterogeneous responses by exploiting cross-sectional variation in the data.

We provide evidence for three main results. First, the estimates suggest that 1 dollar of federal spending increases capital investment by about 7 cents. When we zoom in on relatively large contracts (that is, focusing on a firm’s largest contracts), the effect on investment increases to about 12 cents. Second, the evidence indicates that firms that face financing constraints display the highest increase in investment following a new government award. This pattern occurs for different measures of financing constraints that are commonly used in the literature, based on firm size, payout ratio, and corporate bond rating. We complement this analysis by showing that capital investment is mainly financed via short-term debt. Our results suggest that a contract of 1 percent of a firm’s capital increases short-term liabilities by .05 percent. Third, industry-level analysis suggests that firms’ investment is leading to an increase in investment at the industry-level ruling out a crowding-out hypothesis. Additionally, the evidence indicates that industries with higher dependence on external financing tend to respond more to industry-level government spending, in line with Aghion et al. (2014).

We confirm the robustness of our results by considering a range of specifications, including dynamic models and various subsets of contracts. One general concern with this type of analysis is that awards can be anticipated. We test whether competitive federal contracts are anticipated by examining stock markets’ returns. The idea is that if contracts are anticipated, then they should be priced in the financial markets. We find no evidence for anticipation effects, a finding that reinforces the interpretation of our results.

While a number of studies examine the response of private consumption to fiscal stimuli (for example, Sahm et al. (2010) or Parker et al. (2013)), less attention has been paid to the reaction of private investment to government demand. Understanding the link between government spending and investment at the firm level is a central issue in several contexts in economics. From a macroeconomic standpoint, the Keynesian doctrine views government spending as a stimulator for the economy; however, it is well known that not all economists subscribe to this macroeconomic notion.4 One source of the disagreement comes from the ambiguous predictions regarding the response of private investment to changes in government purchases. Our micro-based evidence sheds light on one transmission mechanism whereby government purchases can affect aggregate private investment. An effective fiscal intervention is, generally, one that helps reduce the external financing costs of firms. This finding is consistent with recent insights into the role of credit market conditions in the propagation of economic shocks (Gertler and Kiyotaki (2010)). An effective public intervention should address the disparity in firms’ access to external funding.

Our paper is related to three strands of the literature. The first strand is empirical and focuses on the effects of financing constraints on firms’ investments. Fazzari et al. (1988) argue that financing constraints lower firms’ investments. Recently, the findings in Almeida and Campello (2007), Chaney et al. (2012), and Rauh (2006) lend empirical support for this hypothesis. These papers, however, do not consider the potential role of fiscal policy in easing financing constraints. Zwick and Mahon (2014) and Dobridge (2015) consider the effects of tax incentives on investment. They find that financially constrained firms tend to increase investments more than unconstrained firms as a reaction to tax refunds’ stimulus policy in the United States. Against this background, we contribute to the literature by studying the spending side of fiscal policy at the firm level and showing that government purchases can also influence financing constraints through cash flow. Related to our paper, Ferraz et al. (2015) study the new hiring patterns of Brazilian firms that win a procurement contract. Our paper uses firms in the United States, looks at capital investment, and focuses on a specific channel via financing constraints.

The second strand of the literature is concerned with estimating the effects of fiscal policy on macroeconomic activities. Available evidence in this area is largely based on vector autoregression models using aggregate data, and the discussion is centered on the size of government spending multipliers—that is, the final effect on key macroeconomic variables such as output and investment.5 Increasingly, to strengthen identification, studies are relying on a disaggregated level such as regions or industries. Brueckner and Tuladhar (2014) estimate local government spending multipliers in Japan using data at the prefecture level and find that multipliers tend to be lower in prefectures characterized by a high degree of financial distress. Wilson (2012) estimates the job multiplier of ARRA grants. Cohen et al. (2011) find that government spending shocks, identified at the state-level in the United States, lead to corporate retrenchment. Aghion et al. (2014) examine a panel of OECD countries and find that the effect of a countercyclical fiscal policy is higher in industries that are more dependent on external finance. While our study is not about estimating the spending multiplier, it provides the first micro-level evidence on one transmission mechanism through which government spending can affect the economy, namely, via private investment of constrained firms.

The third related strand of the literature is within the ambit of theoretical macroeconomics and financial economics modeling the links between financial frictions and fiscal policy in a Dynamic Stochastic General Equilibrium (DSGE) framework. Studying the interaction between credit market conditions and macroeconomic fluctuations is currently a very active and extensive area of research, such that a survey is beyond our scope (see, e.g., Hall (2011)). However, while earlier studies do not include a fiscal block, an increasing number of papers address interlinks between government spending and credit market conditions. Examples include Fernández-Villaverde (2010), Canzoneri et al. (2015), Carrillo and Poilly (2013), and Challe and Ragot (2011). Generally, the message arsing from this literature is that the spending multiplier is larger when government spending improves financial intermediation. Our contribution provides firm-level evidence in line with this theoretical prediction.

The paper proceeds as follows. In section 2, we motivate the role of government spending in a framework with a collateral-in-advanced constraint. In section 3, we describe the data, and in section 4 we present our empirical specification and main results. Section 5 presents robustness checks. Finally, we conclude in section 6.

II. Hypothesis Development

Lenders provide firms with funds as governed by the discounted value of their collateral. In the absence of a binding collateral-in-advance constraint, the optimal demand for input follows from equating the marginal product with the real price of that input, a familiar result maintained in any model without frictions. However, the financial accelerator model of Bernanke et al. (1996) posits that when the collateral-in-advance constraint is binding, a firm faces a financing premium and the demand for input and capital investment is given by this constraint.

The simplest way to illustrate a link between government spending and firms’ investment in their inputs is to consider a prototypical two-period collateral-in-advance constraint:

xt+1=atf(xt)+(Pt+1rt+1)KrtBt(1)

where xt+1 is the demand for input x in the second period, at atf(xt) is available cash flow from last period (the price of output is normalized, and f(xt) is the production function with the usual properties), (Pt+1rt+1)K is the discounted value of the collateral K, and rtBt is the cost of servicing existing debt Bt for an interest rate rt. at can be viewed as market capacity and is generally considered to be a function of a number of characteristics, such as consumers’ taste and industrial structure. Because the constraint is binding, the demand for xt+1 is given by equation 1. In our context, the main point is that government spending can also act as a factor that influences market capacity.

As the financing premium is firm specific, the effect of a newly awarded government contract is heterogeneous across firms depending on whether or not the constraint was initially binding. If the constraint was initially binding, the additionally generated cash flow from new government demand reduces the external financing premium through at, hence easing the constraint and increasing the firm’s demand for inputs and production.

In the absence of new government demand, ceteris paribus, a firm would be still facing a binding constraint. Note that if the government contract is awarded to a financially nonconstrained firm, there is no effect on the financing. The reason is that such a firm is already at the optimum and follows the optimal path to address demand changes. Thus, we expect that government purchases have a positive effect on firms’ investment, particularly for financially constrained firms.

Recent full pledged models predict similar outcomes in spite of different details. For example, Carrillo and Poilly (2013) show in DSGE setup that increases in government spending stimulate capital accumulation leading to an increase in the price of capital and thus an increase in the value of collateral. The increase in the value of collateral reduces credit spreads and raises firms’ investments. In a similar spirit, Challe and Ragot (2011) show that the government spending multiplier is relatively large when government expenditures increase liquidity and loosen firms borrowing constraints. Canzoneri et al. (2015) present a DSGE model predicting that the government spending multiplier is larger when spending affects financial frictions.

Against this background, in the following we empirically assess the link between government spending and firms’ capital investment. It is important to stress that this link is independent from the nature of the final good or service that is purchased by the government (i.e., whether it is government consumption or government investment, or whether it is wasteful or not wasteful from a macroeconomic standpoint). For instance, a bridge may or may not present productive spending affecting long-term productivity and output in the economy. However, this paper is not about the effect of the “bridge” on the economy, but it is about the effect of spending on the “firm that builds the bridge”, or more generally the effect of spending on the firm upon which government demand falls. This effect is one element that feeds into an aggregate “multiplier”.6

III. Data

The mechanism that we outlined above operates via a shift in government demand for firm specific products. Thus, testing it requires detailed data on government purchases at the firm level. This section describes the data collection of contract-level federal awards, the aggregation to the firm-quarter level, and the matching with firms’ accounting information. The matching procedure can be useful for other researchers that want to combine federal awards data with other firm-level information.

A. Federal Procurement Data

The Federal Funding Accountability and Transparency Act of 2006 required the creation of a public database that includes comprehensive information on federal expenditure. The database contains contract-level transactions for each federal award of more than $3,000. Available information includes: the entity that receives the award, the amount that was awarded, the awarding agency, and specifics of the award (for example, whether the winner of the award was determined in a competitive bidding process).7 The database is publicly available and it covers the time period from 2000 onwards.

We proceed in steps imposing several restrictions on the data. First, we restrict the contracts database to firms that can be matched with financial information in Compustat. This step removes many small companies for which accounting information is not available. Second, we include only those contracts that were awarded in a full and open competition with at least two bidders. Our hypothesis implies that only unexpected changes to a firm’s future cash flows should affect investment, and the purpose of the restriction is to capture the unanticipated component of a firm’s future government demand8. Moreover, we directly test for anticipation effects in section 5. Third, we drop observations that seem to be reporting errors; e.g., when the signing date of a contract is after its effective date.

The total value of contracts (after our restrictions) is 750 billion dollars of which we match roughly 620 billion dollars (83 percent). In order to match the awards with firm-level financial information, we collapse the awards data to the quarterly level by summing over the amounts of all awards that a firm has received in each quarter. The mean of awarded firm-quarter contracts is about 26 million dollars and the distribution of awards is right-skewed as is evident from the median that is much lower than the mean (Table 1). Table 2 shows the number of awards by firm-year. Typically, a firm in our sample receives between 1 and 5 contracts per year, but some firms receive more contracts per year.

Table 1:

Summary statistics for main variables

article image
Note: Contract amount is the quarterly sum of the values of awarded contracts to a firm and it is expressed in millions of U.S. dollar. Capital investment and cash are scaled by PPE. Sort Term (ST) liabilities and total liabilities are quarterly growth rates. All ratio variables are expressed in percent except for capital investment and cash. RoA is return on assets divided by total assets. Size is the natural logarithm of total assets. Rating is a numerical variable reflecting the S&P corporate bond rating; high values reflect better rating. Section 8 provides the definitions and sources of all variables.
Table 2:

Number of contracts per firm-year

article image

Table 2 shows the number of awards by firm-year. Typically, a firm receives between 1 and 5 contracts per year, but some firms receive more than 25 contracts per year.

B. Firm-Level Data

We obtain firm-level accounting information at the quarterly level from Compustat. Our main variable of interest is the received amount scaled by lagged property, plants, and equipment (PPE) for each firm and quarter (AwarditKi,t1). Figure 1 is a histogram of AwarditKi,t1. In the benchmark case, we do not restrict the sample of contracts (beyond the procedure described above) to compute AwarditKi,t1. We call this the sample of all contracts. In addition, we consider another definition of a firm-specific shock by considering “large contracts”, defined as the sum of all amounts in a quarter that lie above the 90th percentile of all awarded contracts for a firm in a specific year.

Figure 1:
Figure 1:

Awarded Contracts

(Scaled by Property, Plants and Equipment)

Citation: IMF Working Papers 2016, 060; 10.5089/9781513578729.001.A001

We define capital investment as capital expenditures normalized by the lagged value of PPE, as is standard in the literature on firms’ investments (see, for example, Kaplan and Zingales (1997)). In addition, we construct control variables such as cash, return on assets, and the market-to-book ratio.

Appendix 8.2 describes all variables in detail. Table 1 displays descriptive statistics of the main accounting variables that are used in our study.

Contract recipients operate in various sectors of the economy. Figure 2 displays major economic sectors (SIC, 2 digit) according to their share of the number of received contracts. Major recipients of awards are manufacturing, including sectors such as industrial machinery and computer equipment, as well as business services.

Figure 2:
Figure 2:

Industry Distribution

Citation: IMF Working Papers 2016, 060; 10.5089/9781513578729.001.A001

We define financially constrained firms in three different ways and compare results across those definitions. The three definitions are taken from the literature, e.g. Almeida et al. (2004) and Almeida and Campello (2007). First, using firm size as a proxy for constraints, we rank firms based on their total assets and consider those in the lower (upper) 30th percentile as constrained (unconstrained). Second, in a similar fashion, we rank firms based on their payout ratios and consider those in the lower (upper) 30th percentile as financially constrained (unconstrained). Last, we consider firms to be constrained if the S&P domestic long-term issuer credit rating is in the high yield range or lower.

IV. Empirical Analysis

A. Specification

We start with the following reduced-form specification to test our hypotheses:

IitKi,t1=α0+βAwarditKi,t1+αi+λt+γXit+uit(2)

where Awardit is the sum of the values of all awarded government contracts to firm i in quarter t.9 We include firm-fixed effects (αi) and time-fixed effects (λt) and a set of control variables (Xit).

We estimate equation (2) using the sample of all firms or subsamples including constrained or non-constrained firms. We are interested in β, and we expect that the marginal effect is larger for financially constrained firms than for unconstrained firms. The coefficient β is identified from two different sources of variation: First, we exploit differences across-firms that won contracts and those firms that did not win a contract in a certain quarter t. The second source of variations is within a firm i—that is, periods when a firm i has not been awarded contracts versus periods when a firm i has been awarded a contract. We run this model for the sample including all contracts and also for a sample including only relatively large contracts as described in the previous section.

The effects of government demand on firms’ output can be regime-dependent. Bernanke et al. (1999) provide a comprehensive overview clarifying the relation between the finance premium and the business cycle suggesting that the external finance premium can be countercyclical. Therefore, during periods of financial turmoil, the premium is higher than in normal times and the constraint becomes binding for a larger number of firms. Liebman and Mahoney (2013) find that quality of federal spending in the IT sector declines at the end of the fiscal year. We deal with potentially time-dependent impacts of spending by using period-fixed effects, λt, capturing all factors that are common across firms in a quarter. As guided by theory, the vector of controls, Xit, is based on Chaney et al. (2012) and includes cash and lagged market-to-book value of assets (Mkt to Book), lagged returns on assets (RoA), and the lagged size of the firm. Note that all industry-specific time-invariant unobserved heterogeneous effects, such as the market structure, are nested within the set of firm-fixed effects, αi.

Our analysis is conditional on the observation of winning a contract. One potential endogeneity concern is that signing a contract can be predicted leading to a correlation with the error terms uit. However, because all contracts in our sample were awarded through a competitive procedure, we expect that predictability is unlikely to be a serious concern in our application. Nonetheless, in section 5, we consider this issue by testing whether stock returns can predict subsequent contracts and find no evidence that awards are anticipated.

B. Baseline Results

Table 3 presents our benchmark results. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a firm over time. In panel A, the first column refrains from including controls or sets of fixed effects. The estimated coefficient suggests that a 1 dollar increase of federal spending increases investment by 7.5 cents. In columns (2) to (4), we interchangeably include firm-fixed effects and/or period-fixed effects. In column (5), we include the full sets of fixed effects as well as the control variables. The estimated coefficients remain statistically significant at the 1 percent level and become only slightly smaller, with an estimated impact of 6.5 cents in the last column.

Table 3:

Effect of Winning Government Contracts on Capital Investment

article image
Note: *p ≤ 0.1, ** p ≤ 0.05, ***p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalised by the lagged book value of PPE. Amount Won is the obliged amount of a federal contract normallized by the Lacked boot value of PPE. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-leve correcting for a correlation between error terms within a cell.

In panel B, we use only contracts that are relatively large for each firm - that is, we include only contracts that are above the 90th percentile of all awards won by a firm in a specific year. The rationale behind this exercise is that the sample of all contracts includes very small contracts compared to the firm size, and those might be less crucial in deriving investment decisions.10 The evidence lends support to this argument. The estimates in panel B of table 3 are generally larger than those in panel A. When we include firm- and period-fixed effects and controls in column (10), our estimate suggests that 1 dollar of federal spending increases investment by 11 cents. The coefficient on the lagged market-to-book value of assets is positive in line with the literature.

Financing Constraints

The above results motivate the question: Which firms invest more in reaction to new government demand? We estimate equation (2) for the subsamples of constrained and unconstrained firms separately to test the hypothesis that financially constrained firms invest more into capital after receiving an unanticipated government award. Recall that we define financially constrained firms as those that are either small, pay low dividends, or have a low corporate credit rating. Table 4 displays the results. Panel A shows that small firms increase investment by 7.5 cents for every dollar of government awards. The effect jumps to 15 cents when we consider only large contracts in panel B. In both panels A and B, we do not find any effect for large companies. Interpreting small firms as more likely to be constrained, these findings indicate that firms with financing constraints do raise investment more in reaction to federal spending.

Table 4:

Effect of winning government contracts on capital investment: Constrained vs Unconstrained Firms

article image
Note: *p ≤ 0.1, ** p ≤ 0.05, ***p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalized by the lagged book value of PPE. Amount Won is the obliged amount of a federal contract normalized by the lagged book value of PPE. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell.

The result is robust to using other indicators of financing constraints. Using the payout ratio as an indicator, we find that firms that pay low dividends increase investment by 7.4 cents (for all contracts) or 12.7 cents (for large contracts), whereas we find lower and non-significant effects for firms that pay higher dividends. Using the credit rating as an indicator, we find that firms that have a high-yield or no credit rating increase investment by 6.7 cents (for all contracts) or 11.3 cents (for large contracts), whereas we find no effect for firms with an investment grade rating.

External Borrowing

Our results so far suggest that financing constraints can play an important role in the transmission of government demand to firm investment. Next, we examine whether an awarded contract facilitates firms’ access to external financing. We estimate the impact of federal procurements on debt changes using the following model

Δyityi,t1=α0+βAwarditKi,t1+αi+λt+γXit+uit,(3)

where yit is total debt or short-term debt. Note that, unlike in the baseline regression (2), we are using growth rates as the dependent variable (3) because debt is a state variable from the firms’ balance sheets (unlike investment, which is a flow variable).

We start with the results for all firms in Table 5. Winning an amount of 1 percent of capital is associated with short-term debt growth of .06 percentage points, using all contracts or large contracts only. The effect on total liabilities is slightly smaller.

Table 5:

Effect of Winning Government Contracts on Firms’ Liabilities

article image
Nate: *p ≤ 0.1, ** p ≤ 0.05, ***p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalised by the lagged book value of PPE. Amount Wem is the obliged amount of a federal contract normalized by the lagged book value of PPE. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell.

Our initial results show that constrained firms increase their investment more. How do they finance their investment? Table 6 estimates equation (3) for constrained and unconstrained firms separately. Panels A through D show results for short-term and total debt and for all and large contracts separately. Regardless of the measure of financial constraints we find that constrained firms increase debt in response to winning government contracts. Point estimates for unconstrained firms are smaller throughout all specifications and are less precise and nonsignificant. Overall, these results are consistent with the hypothesis that federal contracts increase firms’ capacity to obtain external funding.

Table 6:

Effect of Winning Government Contracts on Firms’ Liabilities: Constrained vs Unconstrained Firms

article image
Note: *p ≤ 0.1,* * p ≤ 0.05, * * *p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalized by the lagged book value of PPE. Amount Won is the obliged amount of a federal contract normalized by the lagged book value of PPE. All specifications include the following control variables: Cash, Mkt to Book, RoA, and Size. Section 8 provides the definitions of all variables, All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell.

Industry-Level Results

A key question is whether the increase in investment by some firms crowds out investment by others. Consider, for example, a firm that increases investment in inputs following a demand shock. If the additional demand drives up inputs’ prices in the industry, investment projects of other firms might become less profitable. This might result in lower capital investments of other firms in the same industry. On the other hand, the increase in investment of some firms can generate new demand for other firms’ outputs such that the initial shock creates positive investment spillovers.

We offer suggestive evidence on industry-wide effect based on aggregating the firm-level data to the industry level. In this exercise, we include all firms in the same industry, regardless of whether or not they won a contract during our sample period. The sample of firms is the universe of firms in Compustat and industries are defined at the 4-digit standard industry classification (SIC) level, and we compute industry investment and government demand shocks on a quarterly basis.

Our first simple test relies on comparing the investment response at the industry level to that at the firm level, reported in section 4.2. If the industry-level investment effect is smaller than the firm-level effect, this would suggest that government demand shocks crowd out other firms’ investments in the same industry. If the industry-level investment response was larger, this would suggest positive spillovers to firms in the same industry.

Table 7 presents the results. The estimates using all industries in columns (1) and (4) indicate that the effects of federal procurements transmit to the industry level and do not lend support to the crowding-out hypothesis. The estimated coefficients are similar in magnitude to those in table 4. For instance, our benchmark estimate using all contracts in table 4 estimated a capital investment response of around 6 cents for every dollar of government contract. Column (1) in table 8 suggests that the industry effect is a capital investment response of 7 cents, statistically indistinguishable from the firm-level response.

Table 7:

Effect of winning government contracts on capital investment (industry-level)

article image
Note: *p ≤ 0.1, ** p ≤ 0.05, ***p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalized by the lagged book value of PPE. Amount Won is the obliged amount of federal contracts aggregated at the SIC 4-digit level normalized by the lagged book value of PPE at the SIC 4-digit level. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-level correcting for a correlation be tween error terms within a cell.

Furthermore, we present results from re-estimating the model for two subsamples distinguishing between industries based on financial dependence to check whether or not the transmitted effect depends on the external financial dependence of the industry. As an indicator of external financial dependence at the industry level, we use the industry median of capital expenditures minus cash flows over capital expenditures. This index was advocated by Rajan and Zingales (1998) and it has been heavily used in subsequent studies (for example, Aghion et al. (2014) and Duygan-Bump et al. (2015)). Higher values indicate higher debt ratios and hence higher dependence on external financing. Next, we split the sample into industries with low financial dependency, if the index is below the median, or high financial dependency, if the index is above the median. Columns (3) and (6) of Table 8 show that the rise in investment is slightly higher for industries with higher needs for external financing; the difference is small, however. Admittedly, it is challenging to pin down the exact mechanism whereby the effect transmits from the firm level to the industry level as it potentially involves within- and cross-industry spillover effects. The main point of our exercise, however, is that firms’ investment is leading to an increase in investment at an aggregate level. This compelling finding implies that government spending can lead to an increase in aggregate private investment, which challenges the traditional crowding-out hypothesis.

Table 8:

Awarded contracts and stock returns

article image
Note: This table shows results from estimating: Awardit = α + ΣθkRetit−k + ∊it, where k = 1,2, .., 20. Retit−k are daily stock returns over the past month and Awardit is the contract amount signed on a particular day. Retit−k is either a firm’s raw daily stock returns or adjusted returns defined as the residual ν^it from the regression: RetitRtf=αi+βiRtm+vit, where Rtf and Rtm are the risk-free and the market return. The F-statistics for the hypothesis of the joint significance of θk indicates that signing a contract is not anticipated by financial markets. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell. *p ≤ 0.1, * * p ≤ 0.05, * * *p ≤ 0.01.

V. Anticipation and Robustness

A. Are Competitive Contracts Anticipated?

One concern about our benchmark results in section 4.2 is that winning contracts might be anticipated. As such, winning these contracts would not represent actual demand shocks to firms. Our contract selection procedure should safeguard against that concern: Throughout the analysis, we have focused on contracts that were awarded competitively with the bidding process involving at least two firms. To formally test for anticipation effects in our main measure of government demand shocks, we use daily firm-level stock market information. If awarded contacts are anticipated, stock returns should predict subsequent contracts. We construct a daily series of signed contracts for each company and estimate the following model:

Awardit=α+ΣθkReti,tk+it(4)

where k = 1, 2, .., 20. Retit-k are daily stock returns over the past month and Awardit is the contract amount signed on a particular day. Positive statistically significant θk would imply that contracts are anticipated by financial markets.

We use two different measures of returns Retit−k. Our first measure of Retit−k is a firm’s raw daily stock returns. Our second measure uses the Capital Asset Pricing Model (CAPM) to correct for regular swings in the market. In particular, for each firm, we estimate the equation

RetitRtf=αi+βiRtm+vit,(5)

where Rtf and Rtm are the risk-free and the market return. Our second measure of returns is the residual v^it from that regression.11

We estimate equation (4) for two different samples, using all days between the year 2000 and the year 2012, and using only the days for each firm when the firm won a contract. This can be effectively interpreted as regressions with two different control groups: Using all days measures whether winning or not winning a contract is associated with past returns. Using only days when contracts are won measures whether winning large and small contracts are differentially associated with past returns.

Panel A of table 8 shows the estimation results for equation (4). For both samples and both measures of returns, we do not find evidence for anticipation effects. Naturally, some coefficients are significant when 80 different ones are estimated, but the timing patterns do not give rise to a consistent pattern. The F-statistics for the hypothesis of the joint significance of θk indicates that signing a contract is not anticipated by financial markets (except for column (1)). Panel B uses quarterly stock returns and supports these conclusions as well.

Moreover, we find evidence that winning a contract is predictive of future stock returns. This finding complements the results in Table 8. Table 9 displays stock returns of the following strategy: At the beginning of month t + 1, buy all firms that won a contract in month t and short-sell firms in the sample that did not win a contract in month t. The portfolio is updated each month with new information on contract winners in the previous month. Table 9 shows returns of that strategy against standard equilibrium models of returns, that is, the Capital Asset Pricing Model, the Fama-French three factor model and the four-factor model that adds a momentum factor. Column (1) shows that the average monthly strategy return is .5 percent or approximately 6 percent per year. Columns (2) to (4) show that this strategy return is virtually unaffected by standard factors.12 This result indicates that, while the stock market does not anticipate the winner of a contract, it reflects the winning of a contract after the contract has been awarded.

Table 9:

Strategy returns against factor models

article image
Note: This table shows strategy returns against the CAPM, the Fama-French three factor model and the four-factor model that adds momentum. The strategy works as follows: At the beginning of month t + 1, buy all firms that won a contract in month t and short-sell firms in the sample that did not win a contract in month t. The portfolio is updated each month with new information on contract winners in the previous month. Regressions are of the form: ritrft=α+βMKT(rMKT,trft)+βSMBrSMB,t+βHMLrHML,t+βUMBDrUMD,t+it,where MKT indicates returns to the market factor, SMB to the size factor, HML to the value factor and UMD to the momentum factor. rft, is the riskfree rate. Newey-West standard errors are used throughout. Note: *p ≤ 0.1, * * p ≤ 0.05, * * *p ≤ 0.01.

B. Robustness to Model Specification

While our benchmark regression model in equation (2) is a standard specification in the investment literature, our results are robust to several alternative specifications. Columns (2) and (5) of table 10 show estimates of a dynamic panel-data model that includes two lags of our dependent variable as additional regressors. To compare the estimates with the static model, we need to compute the long-run multiplier—that is, we need to adjust the point estimates β for the autoregressive structure of investment as β1b1b2 (where b1 and b2 are the coefficients on the lagged values of investment). In columns (2) and (5), we find effects of government demand on capital investment of 7.3 and 12.2 cents per dollar of demand, which are slightly higher but very similar to the benchmark estimates of the static model (reproduced in columns (1) and (4)). As is well known, using lagged values of the dependent variable as regressors in a fixed-effects panel model introduces estimation bias. Columns (3) and (6) of table 10 address the bias by using an Arellano-Bond estimation instead. Coefficient estimates are again very similar: The long-run impact of spending on investment is 4 cents per dollar for all contracts and 11 cents per dollar for large contracts.

Table 10:

Effect of winning a government contract on capital expenditure: Robustness to model specifications

article image
Note: *p ≤ 0.1, * * p ≤ 0.05, * * * p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalized by the lagged book value of PPE. Award is the obliged amount of a federal contract normalized by the lagged book value of PPE. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell.

C. Robustness to Contract Selection

Next, we show that our results are robust to other contract selection criteria. Recall that our analysis only includes contracts that were awarded competitively with at least two bidders. Our two baseline samples include all contracts regardless of size and contracts that are large relative to a firm’s typical contract. One concern is that this selection does not put hard thresholds on contract size and therefore includes many very small contracts with potentially different effects on capital investment.

Table 11 reproduces the estimation results using only contracts with amounts larger than 50,000 dollars or larger than 500,000 dollars. The coefficient estimates are very similar to the benchmark results. Again, we find an increase in capital investment of around 6 cent for every dollar of government spending. Panels A and B of table 12 show that this increase is concentrated in financially constrained firms.

Table 11:

Effect of winning a government contract on capital expenditure: Robustness to contract selection

article image
Note: *p ≤ 0.1, * * p ≤ 0.05, * * * p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalized by the lagged book value of PPE. Award is the obliged amount of a federal contract normalized by the lagged book value of PPE. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell.
Table 12:

Effect of winning a government contract on capital expenditure: Constrained vs unconstrained firms. Robustness to contract selection

article image
Note: *p ≤ 0.1, * * p ≤ 0.05, * * *p ≤ 0.01. The dependent variable is capital investment defined as capital expenditure normalized by the lagged book value of PPE. Award is the obliged amount of a federal contract normalized by the lagged book value of PPE. All specifications include the following control variables: Cash, Mkt to Book, RoA, and Size. Section 8 provides the definitions of all variables. All standard errors are clustered at the firm-level correcting for a correlation between error terms within a cell.

The literature on fiscal multiplier often focuses on defense spending as a component of government spending that might be less correlated with the business cycle (for example, Ramey (2011b), Nakamura and Steinsson (2014)). As such, it is illustrative to restrict our sample to contracts that were awarded by the Department of Defense (DoD). Columns (5) and (6) of table 11 show that the effect on capital investment is slightly higher when we use these contracts only: Firms increase capital investment by 8 cents per dollar of a Department of Defense contract. This increase is again concentrated in financially constrained firms, as shown in panel C of table 2.

D. Conclusion

Fiscal policy can affect the economy through several channels, most prominently via its effects on private consumption or investment. While a number of studies use micro-data to examine the response of private consumption to fiscal stimuli, firm-level evidence on the link between government spending and private investment is rarely available. In another strand of literature, several studies suggest that external financing constraints can hinder firms’ investment response to shocks.

Hence, against this background, we analyze the effects of government demand shocks on capital investment at the firm level using rich data on government contracts matched to firms’ financial information. To isolate a specific mechanism, we focus on the investment patterns of firms that are financially constrained, and we argue that their investment response is expected to be more pronounced.

A key finding of our analysis is that financially constrained firms react to new government demand by raising capital investment. We show that the average response of capital investment is between 6 and 11 cents per dollar of government demand. The average, however, masks substantial heterogeneity: We find larger effects for firms that are plausibly constrained and non-significant effects for unconstrained firms. The evidence indicates that government contracts enable firms to increase their capacity to obtain external financing.

When we aggregate our data to the industry-level, we find an almost one-to-one pass-through of private capital investment to industry-level capital investment. This suggests that government contracts do not crowd out private investment, an important concern for policy considerations. However, we cannot rule out crowd-out effects in other industries. An important avenue for future research is to address potential cross-industry spillover effects of government spending.

References

  • Aghion, P., D. Hémous, and E. Kharroubi (2014). Cyclical fiscal policy, credit constraints, and industry growth. Journal of Monetary Economics 62, 4158.

    • Search Google Scholar
    • Export Citation
  • Almeida, H. and M. Campello (2007). Financial constraints, asset tangibility, and corporate investment. Review of Financial Studies 20(5), 14291460.

    • Search Google Scholar
    • Export Citation
  • Almeida, H., M. Campello, and M. Weisbach (2004). The cash flow sensitivity of cash. Journal of Finance 59(4), 17771804.

  • Auerbach, A. and Y. Gorodnichenko (2015). Effects of fiscal shocks in a globalized world. IMF Economic Review, forthcoming.

  • Auerbach, A. and Y. Gorodnichenko (2012). Measuring the output responses to fiscal policy. American Economic Journal: Economic Policy 4(2), 127.

    • Search Google Scholar
    • Export Citation
  • Barro, R. (2009). Government spending is no free lunch. The Wall Street Journal.

  • Bernanke, B., M. Gertler, and S. Gilchrist (1999). The financial accelator in a quantitative business cycle framework. In J. T. . M. Woodford (Ed.), Handbook of Macroeconomics, Volume 1, Chapter 21, pp. 13411393. North Holland.

    • Search Google Scholar
    • Export Citation
  • Bernanke, B., M. Gertler, and S. Gilchrist (1996). The financial accelerator and the flight to quality. Review of Economics and Statistics 78(1), 115.

    • Search Google Scholar
    • Export Citation
  • Boehm, C. (2015). Fiscal policy and durable goods.

  • Brueckner, M. and A. Tuladhar (2014). Local government spending multipliers and financial distress: Evidence from japanese prefectures. Economic Journal 124, 12791316.

    • Search Google Scholar
    • Export Citation
  • Canzoneri, M., F. Collard, H. Dellas, and B. Diba (2015). Fiscal multipliers in recessions. Economic Journal 1(1), 12.

  • Carrillo, J. and C. Poilly (2013). How do financial frictions affect the spending multiplier during a liquidity trap? Review of Economic Dynamics 16, 296311.

    • Search Google Scholar
    • Export Citation
  • Challe, E. and X. Ragot (2011). Fiscal policy in a tractable liquidity-constrained economy. Economic Journal 121(551), 273317.

  • Chaney, T., D. Sraer, and D. Thesmar (2009). The collateral channel: How real estate shocks affect corporate investment. HEC Working Paper October, NBER.

    • Search Google Scholar
    • Export Citation
  • Chaney, T., D. Sraer, and D. Thesmar (2012). The collateral channel: How real estate shocks affect corporate investment. American Economic Review 102(6), 23812409.

    • Search Google Scholar
    • Export Citation
  • Christiano, L., M. Eichenbaum, and S. Rebelo (2011). When is the government spending multiplier large? Journal of Political Economy 119(1), 78121.

    • Search Google Scholar
    • Export Citation
  • Cohen, L., J. Coval., and C. Malloy (2011). Do powerful politicians cause corporate downsizing? Journal of Political Economy 119(6), 10151060.

    • Search Google Scholar
    • Export Citation
  • DeLong, J. and L. Summers (2012). Fiscal policy in a depressed economy. Brookings Papers on Economic Activity 44(1), 233297.

  • Dobridge, C. (2015). Fiscal stimulus and firms: A tale of two recessions.

  • Duygan-Bump, B., A. Levkovb., and J. Montoriol-Garrigac (2015). Financing constraints and unemployment: Evidence from the great recession. Journal of Monetary Economics 75(October), 89105.

    • Search Google Scholar
    • Export Citation
  • Fazzari, E., G. Hubbard, and B. Petersen (1988). Financing constraints and corporate investment. Brookings Papers on Economic Activity 1988(1), 141195.

    • Search Google Scholar
    • Export Citation
  • Fernández-Villaverde, J. (2010). Fiscal policy in a model with financial frictions. American Economic Review: Papers and Proceedings 100(2), 3540.

    • Search Google Scholar
    • Export Citation
  • Ferraz, C., F. Finan, and D. Szerman (2015). Procuring firm growth: The effects of government purchases on firm dynamics. WP 21219, NBER.

    • Search Google Scholar
    • Export Citation
  • Gertler, M. and N. Kiyotaki (2010). Financial intermediation and credit policy in business cycle analysis. In B. Friedman and M. Woodford (Eds.), Handbook of Monetary Economics, Volume 3, Chapter 11, pp. 547599. Elsevier.

    • Search Google Scholar
    • Export Citation
  • Hall, R. (2011). The high sensitivity of economic activity to financial frictions. Economic Journal 121(552), 351378.

  • Hebous, S. (2011). The effects of discretionary fiscal policy on macroeconomic aggregates: A reappraisal. Journal of Economic Surveys 25(4), 674707.

    • Search Google Scholar
    • Export Citation
  • Kaplan, S. and L. Zingales (1997). Do investment-cash flow sensitivities provide useful measures of financing constraints? The Quarterly Journal of Economics 112(1), 169215.

    • Search Google Scholar
    • Export Citation
  • Krugman, P. (2008). The conscience of a liberal. The New York Times.

  • Leduc, S., and D. Wilson (2013). Roads to prosperity or bridges to nowhere? theory and evidence on the impact of public infrastructure investment. In J. Parker and M. Woodford (Eds.), NBER Macroeconomic Annual 2012, Volume 27, pp. 89142. University of Chicago Press.

    • Search Google Scholar
    • Export Citation
  • Leeper, E., T. Walker., and S. Yang (2013). Fiscal foresight and information flows. Econometrica 18(3), 11151145.

  • Liebman, J. and N. Mahoney (2013). Do expiring budgets lead to wasteful year-end spending? evidence from federal procurement. WP 19481, NBER.

    • Search Google Scholar
    • Export Citation
  • Michaillat, P. (2014). A theory of countercyclical government multiplier. American Economic Journal: Macroeconomics 6(1), 190217.

  • Nakamura, E. and J. Steinsson (2014). Fiscal stimulus in a monetary union: Evidence from us regions. American Economic Review 104(3), 753792.

    • Search Google Scholar
    • Export Citation
  • Parker, J. (2011). On measuring the effects of fiscal policy in recessions. Journal of Economic Literature 49(3), 703718.

  • Parker, J., N. Souleles., D. Johnson, and R. McClelland (2013). Consumer spending and the economic stimulus payments of 2008. American Economic Review 103(6), 25302553.

    • Search Google Scholar
    • Export Citation
  • Rajan, R. and L. Zingales (1998). Financial dependence and growth. American Economic Review 88(3), 559586.

  • Ramey, V. (2011a). Can government purchases stimulate the economy? Journal of Economic Literature 49(3), 673685.

  • Ramey, V. (2011b). Identifying government spending shocks: It’s all in the timing. The Quarterly Journal of Economics 126(1), 150.

  • Rauh, J. (2006). Investment and financing constraints: Evidence from the funding of corporate pension plans. Journal of Finance 61(1), 3372.

    • Search Google Scholar
    • Export Citation
  • Sahm, C., M. Shapiro., and J. Slemrod (2010). Household response to the 2008 tax rebate: Survey evidence and aggregate implications. Tax Policy and the Economy 24, 69110.

    • Search Google Scholar
    • Export Citation
  • Wilson, D. (2012). Fiscal spending jobs multipliers: Evidence from the 2009 American recovery and reinvestment act. American Economic Journal: Economic Policy 4(3), 251282.

    • Search Google Scholar
    • Export Citation
  • Zwick, E. and J. Mahon (2014). Do financial frictions amplify fiscal policy? Evidence from business investment stimulus. WP 14/15, Oxford Centre for Business Taxation.

    • Search Google Scholar
    • Export Citation

Appendix A: Supplementary Online Appendix

Variable Definitions

  • Award: AwarditKi,t1 is the obliged amount of a federal contract obtained from the database of the Office of Management and Budget normalized by the lagged book value of properties, plant and equipment, PPE, obtained form Compustat (ppentq).

  • Capital investment: IitKi,t1 is capital expenditure (capxy) normalized by the lagged book value of properties, plant and equipment, PPE, (ppentq).

  • Cash: is income before extraordinary items + depreciation and amortization (iby + dpq) normalized by lagged book value of value of properties, plant and equipment, PPE, (ppentq).

  • Market to book value of assets: MkttoBook is the market value of assets (atq - ceqq + (cshoq × prccq) - txdbq) normalized by their book value (atq).

  • Size: is the log of total assets (atq).

  • RoA: is return on assets ((oibdpq - dpq) divided by atq).

  • Ex ante measures of credit constraints (Firm-level):

    • - Firm Size: In every quarter, we rank firms based on their total assets and consider those in the lower (upper) 30th percentile as constrained (unconstrained).

    • - Dividend payments (payout ratio): In every quarter, we rank firms based on their payout ratios and consider those in the lower (upper) 30th percentile as constrained (unconstrained). The payout ratio is (dvpsxq + cshopq) divided by oibdpq

    • - Corporate credit rating: We consider firms to be constrained if the S&P domestic long term issuer credit rating (splticrm is BBB or lower.

  • Financial dependency (industry-level): As in Rajan and Zingales (1998), we compute the industry-median (at the 4 digits, Standard Industrial Classification system) of capital expenditures minus cash flows over capital expenditures.

  • Returns: Ret is a daily series of stock returns from CRSP.

  • Short-term debt: The growth rate of short-term debt (ltq - lltq).

  • Total debt: The growth rate of total debt (ltq).

Matching Procedure between Procurement Contracts and Compustat

The Federal Funding Accountability and Transparency Act (FFATA) requires the disclosure of information on entities that receive Federal awards. These include types of contracts, grants, loans, and other types of spending.

The data are at the plant level, company name, address and telephone numbers are given. In addition, each entry has a DUNS number which is a plant-level company identifier that is used by some government agencies. The DUNS number of the parent company is also part of the data set. It is called parentdunsnumber and is our primary identifier for companies. We collapse all data at the parent company level and we extract a list of all unique parent DUNS numbers that are part of the dataset, a total of 566,271 different DUNS numbers.

Only few data sets have the DUNS number as an identifier.1 One dataset that includes DUNS numbers is Bureau van Dijk’s Orbis database. To quote the provider, it is a “global database containing information on millions of companies that is unique in its breadth of geographies and extent of companies covered as well as the availability of private company financial information.” We uploaded our list of unique parent DUNS numbers to Orbis and were able to match 313,935 company records. For the companies that we could match, we downloaded the company name (for checking purposes), a BvD ID number, a BvD account number and the ticker symbol alongside with the DUNS number. Ticker information was not available for 310,523 companies, which is about the size that we expected.

We could use the ticker directly in a standard financial database such as CRSP but we are careful to note that tickers might change over time. We therefore included one more step.

Another BvD product, Osiris provides financial accounting data for publicly listed companies around the world. Osiris also includes each company’s current ticker for each year.

The OS ID number is identical to the BvD account number and can be used to access the data. We uploaded our list of BvD accout numbers to Osiris (a total of 312,586 because 1349 observations do not have a unique DUNS - BvD account number match), and received data for a total of 2754 companies, by OS ID number and year from 2000 to 2012. We also downloaded the current ticker, the current CIK number, the current stock exchange and the listing status. We obtained 32,106 valid observations over the 13 years.

1

We received helpful comments from Bob Chirinko, Ruud de Mooij, Yuriy Gorodnichenko, and seminar and conferences participants at the European Central Bank in Frankfurt, IIPF meeting at the University College Dublin, Christmas meeting of German Economists Abroad in Munich, and the SEA meeting in New Orleans. The views expressed here are those of the authors and do not necessarily represent the views of the IMF, its Executive Board, IMF management, or the Federal Reserve Board of Governors.

2

Shafik Hebous, International Monetary Fund and Goethe University Frankfurt shebous@imf.org, Tom Zimmermann, Federal Reserve Board, tom.zimmermann@frb.gov

4

See, for example, Barro (2009) and Krugman (2008).

5

Ramey (2011a) and Hebous (2011) provide overviews. In a distinct but related application using spending data, Auerbach and Gorodnichenko (2015) construct a quarterly spending shock at the US level from daily spending series and study the reaction of the exchange rate.

6

For studies on the nature of spending and aggregate output, see for example Leduc and Wilson (2013) and Boehm (2015).

7

In this database, the OMB defines a federal contract as “An agreement between the federal government and a prime recipient to execute goods and services for a fee.” See: www.usaspending.gov.

8

The issue of anticipation has been discussed in fiscal policy research raising concerns that foresight can lead to biased estimates (for example, Leeper et al. (2013)).

9

Chaney et al. (2009) show that this reduced-form corresponds to a simple model of investment under collateral constraint.

10

At the macro-level, the issue of the size of a fiscal measure (that is, the intensity of treatment) is related to the discussion in Parker (2011).

11

We estimate equation (5) for every year of a firms’ stock returns separately to account for changes in the structural relationship.

12

Factor loadings are significant throughout but generally of small magnitude. The negative correlation with the market factor indicates that the strategy is a hedge against market risk. The negative correlation with the size factor indicates that the strategy loads on larger firms, as expected by the sample selection.

1

S&P Capital IQ claims to have it but since we did not have access to their dataset, we could not validate how helpful it is.