Wikipedia

# Cost–benefit analysis

Cost–benefit analysis (CBA), sometimes called benefit costs analysis (BCA), is a systematic approach to estimating the strengths and weaknesses of alternatives used to determine options which provide the best approach to achieving benefits while preserving savings (for example, in transactions, activities, and functional business requirements).[1] A CBA may be used to compare completed or potential courses of actions, or to estimate (or evaluate) the value against the cost of a decision, project, or policy. It is commonly used in commercial transactions, business or policy decisions (particularly public policy), and project investments.

CBA has two main applications:[2]

1. To determine if an investment (or decision) is sound, ascertaining if – and by how much – its benefits outweigh its costs.
2. To provide a basis for comparing investments (or decisions), comparing the total expected cost of each option with its total expected benefits.

CBA is related to cost-effectiveness analysis. Benefits and costs in CBA are expressed in monetary terms and are adjusted for the time value of money; all flows of benefits and costs over time are expressed on a common basis in terms of their net present value, regardless of whether they are incurred at different times. Other related techniques include cost–utility analysis, risk–benefit analysis, economic impact analysis, fiscal impact analysis, and social return on investment (SROI) analysis.

Cost–benefit analysis is often used by organizations to appraise the desirability of a given policy. It is an analysis of the expected balance of benefits and costs, including an account of any alternatives and the status quo. CBA helps predict whether the benefits of a policy outweigh its costs (and by how much), relative to other alternatives. This allows the ranking of alternative policies in terms of a cost–benefit ratio.[3] Generally, accurate cost–benefit analysis identifies choices which increase welfare from a utilitarian perspective. Assuming an accurate CBA, changing the status quo by implementing the alternative with the lowest cost–benefit ratio can improve Pareto efficiency.[4] Although CBA can offer an informed estimate of the best alternative, a perfect appraisal of all present and future costs and benefits is difficult; perfection, in economic efficiency and social welfare, is not guaranteed.[5]

The value of a cost–benefit analysis depends on the accuracy of the individual cost and benefit estimates. Comparative studies indicate that such estimates are often flawed, preventing improvements in Pareto and Kaldor–Hicks efficiency.[6] Interest groups may attempt to include (or exclude) significant costs in an analysis to influence its outcome.[7]

## History

French engineer and economist Jules Dupuit, credited with the creation of cost–benefit analysis

The concept of CBA dates back to an 1848 article by Jules Dupuit, and was formalized in subsequent works by Alfred Marshall.[8] Jules Dupuit pioneered this approach by first calculating “the social profitability of a project like the construction of a road or bridge”[9] In an attempt to answer this, Dupuit began to look at the utility users would gain from the project. He determined that the best method of measuring utility is by learning one's willingness to pay for something. By taking the sum of each user's willingness to pay, Dupuit illustrated that the social benefit of the thing (bridge or road or canal) could be measured. Some users may be willing to pay nearly nothing, others much more, but the sum of these would shed light on the benefit of it. It should be reiterated that Dupuit was not suggesting that the government perfectly price discriminate and charge each user exactly what they would pay. Rather, their willingness to pay provided a theoretical foundation on the societal worth or benefit of a project. The cost of the project proved much simpler to calculate. Simply taking the sum of the materials and labor, in addition to the maintenance afterward, would give one the cost. Now, the costs and benefits of the project could be accurately analyzed, and an informed decision could be made.

The Corps of Engineers initiated the use of CBA in the US, after the Federal Navigation Act of 1936 mandated cost–benefit analysis for proposed federal-waterway infrastructure.[10] The Flood Control Act of 1939 was instrumental in establishing CBA as federal policy, requiring that "the benefits to whomever they accrue [be] in excess of the estimated costs."[11]

### Public policy

CBA's application to broader public policy began with the work of Otto Eckstein,[12] who laid out a welfare economics foundation for CBA and its application to water-resource development in 1958. It was applied in the US to water quality,[13] recreational travel,[14] and land conservation during the 1960s,[15] and the concept of option value was developed to represent the non-tangible value of resources such as national parks.[16]

CBA was expanded to address the intangible and tangible benefits of public policies relating to mental illness,[17] substance abuse,[18] college education,[19] and chemical waste.[20] In the US, the National Environmental Policy Act of 1969 required CBA for regulatory programs; since then, other governments have enacted similar rules. Government guidebooks for the application of CBA to public policies include the Canadian guide for regulatory analysis,[21] the Australian guide for regulation and finance,[22] and the US guides for health-care[23] and emergency-management programs.[24]

### Transportation investment

CBA for transport investment began in the UK with the M1 motorway project and was later used for many projects, including the London Underground's Victoria line.[25] The New Approach to Appraisal (NATA) was later introduced by the Department for Transport, Environment and the Regions. This presented balanced cost–benefit results and detailed environmental impact assessments. NATA was first applied to national road schemes in the 1998 Roads Review, and was subsequently rolled out to all transport modes. Maintained and developed by the Department for Transport, it was a cornerstone of UK transport appraisal in 2011.

The European Union's Developing Harmonised European Approaches for Transport Costing and Project Assessment (HEATCO) project, part of the EU's Sixth Framework Programme, reviewed transport appraisal guidance of EU member states and found significant national differences.[26] HEATCO aimed to develop guidelines to harmonise transport appraisal practice across the EU.[27]

Transport Canada promoted CBA for major transport investments with the 1994 publication of its guidebook.[28] US federal and state transport departments commonly apply CBA with a variety of software tools, including HERS, BCA.Net, StatBenCost, Cal-BC, and TREDIS. Guides are available from the Federal Highway Administration,[29][30] Federal Aviation Administration,[31] Minnesota Department of Transportation,[32] California Department of Transportation (Caltrans),[33] and the Transportation Research Board's Transportation Economics Committee.[34]

## Accuracy

In the case of the Ford Pinto (where, because of design flaws, the Pinto was liable to burst into flames in a rear-impact collision), the company decided not to issue a recall. Ford's cost–benefit analysis had estimated that based on the number of cars in use and the probable accident rate, deaths due to the design flaw would cost it about $49.5 million in wrongful death lawsuits; a recall would cost$137.5 million. The company failed to consider the costs of negative publicity, which forced a recall and reduced Ford sales.[35]

In health economics, CBA may be an inadequate measure because willingness-to-pay methods of determining the value of human life can be influenced by income level. Variants, such as cost–utility analysis, QALY and DALY to analyze the effects of health policies, may be more suitable.[36][37]

For some environmental effects, cost–benefit analysis can be replaced by cost-effectiveness analysis. This is especially true when one type of physical outcome is sought, such as a reduction in energy use by an increase in energy efficiency. Using cost-effectiveness analysis is less laborious and time-consuming, since it does not involve the monetization of outcomes (which can be difficult in some cases).[38]

It has been argued that if modern cost–benefit analyses had been applied to decisions such as whether to mandate the removal of lead from gasoline, block the construction of two proposed dams just above and below the Grand Canyon on the Colorado River, and regulate workers' exposure to vinyl chloride, the measures would not have been implemented (although all are considered highly successful).[39] The US Clean Air Act has been cited in retrospective studies as a case in which benefits exceeded costs, but knowledge of the benefits (attributable largely to the benefits of reducing particulate pollution) was not available until many years later.[39]

## Process

A generic cost–benefit analysis has the following steps:[40]

1. Define the goals and objectives of the action.
2. List alternative actions.
3. List stakeholders.[dubious ]
4. Select measurement(s) and measure all cost and benefit elements.
5. Predict outcome of costs and benefits over the relevant time period.
6. Convert all costs and benefits into a common currency.
7. Apply discount rate.
8. Calculate the net present value of actions under consideration.
9. Perform sensitivity analysis.
10. Adopt the recommended course of action.

## Evaluation

CBA attempts to measure the positive or negative consequences of a project. A similar approach is used in the environmental analysis of total economic value. Both costs and benefits can be diverse. Costs tend to be most thoroughly represented in cost–benefit analyses due to relatively-abundant market data. The net benefits of a project may incorporate cost savings, public willingness to pay (implying that the public has no legal right to the benefits of the policy), or willingness to accept compensation (implying that the public has a right to the benefits of the policy) for the policy's welfare change. The guiding principle of evaluating benefits is to list all parties affected by an intervention and add the positive or negative value (usually monetary) that they ascribe to its effect on their welfare.

The actual compensation an individual would require to have their welfare unchanged by a policy is inexact at best. Surveys (stated preferences) or market behavior (revealed preferences) are often used to estimate compensation associated with a policy. Stated preferences are a direct way of assessing willingness to pay for an environmental feature, for example.[41] Survey respondents often misreport their true preferences, however, and market behavior does not provide information about important non-market welfare impacts. Revealed preference is an indirect approach to individual willingness to pay. People make market choices of items with different environmental characteristics, for example, revealing the value placed on environmental factors.[42]

The value of human life is controversial when assessing road-safety measures or life-saving medicines. Controversy can sometimes be avoided by using the related technique of cost-utility analysis, in which benefits are expressed in non-monetary units such as quality-adjusted life years. Road safety can be measured in cost per life saved, without assigning a financial value to the life. However, non-monetary metrics have limited usefulness for evaluating policies with substantially different outcomes. Other benefits may also accrue from a policy, and metrics such as cost per life saved may lead to a substantially-different ranking of alternatives than CBA.

Another metric is valuing the environment, which in the 21st century is typically assessed by valuing ecosystem services to humans (such as air and water quality and pollution).[43] Monetary values may also be assigned to other intangible effects such as business reputation, market penetration, or long-term enterprise strategy alignment.

## Time and discounting

CBA generally attempts to put all relevant costs and benefits on a common temporal footing, using time value of money calculations. This is often done by converting the future expected streams of costs ${\displaystyle C}$ and benefits ${\displaystyle B}$ into a present value amount with a discount rate ${\displaystyle r}$ and the net present value defined as:

${\displaystyle {\text{NPV}}=\sum _{t=0}^{\infty }{B_{t}-C_{t} \over {(1+r)^{t}}}}$
The selection of a discount rate for this calculation is subjective. A smaller rate values the current generation and future generations equally. Larger rates (a market rate of return, for example) reflects human present bias or hyperbolic discounting: valuing money which they will receive in the near future more than money they will receive in the distant future. Empirical studies suggest that people discount future benefits in a way similar to these calculations.[44] The choice makes a large difference in assessing interventions with long-term effects. An example is the equity premium puzzle, which suggests that long-term returns on equities may be higher than they should be after controlling for risk and uncertainty. If so, market rates of return should not be used to determine the discount rate because they would undervalue the distant future.[45]

### Methods for choosing a discount rate

For publicly traded companies, it is possible to find a project's discount rate by using an equilibrium asset pricing model to find the required return on equity for the company and then assuming that the risk profile of a given project is similar to that the company faces. Commonly used models include the capital asset pricing model (CAPM):

${\displaystyle r=r_{f}+\beta \left[\mathbb {E} (r_{M})-r_{f}\right]}$
and the Fama-French model:
${\displaystyle r=\underbrace {r_{f}} _{\text{Risk-Free Rate}}+\beta _{M}\underbrace {\left[\mathbb {E} (r_{M})-r_{f}\right]} _{\text{Market Risk}}+\beta _{SMB}\underbrace {\left[\mathbb {E} (r_{S})-\mathbb {E} (r_{B})\right]} _{\text{Size Factor}}+\beta _{HML}\underbrace {\left[\mathbb {E} (r_{H})-\mathbb {E} (r_{L})\right]} _{\text{Value Factor}}}$
where the ${\displaystyle \beta _{i}}$ terms correspond to the factor loadings. A generalization of these methods can be found in arbitrage pricing theory, which allows for an arbitrary number of risk premiums in the calculation of the required return.

## Risk and uncertainty

Risk associated with project outcomes is usually handled with probability theory. Although it can be factored into the discount rate (to have uncertainty increasing over time), it is usually considered separately. Particular consideration is often given to agent risk aversion: preferring a situation with less uncertainty to one with greater uncertainty, even if the latter has a higher expected return.

Uncertainty in CBA parameters can be evaluated with a sensitivity analysis, which indicates how results respond to parameter changes. A more formal risk analysis may also be undertaken with the Monte Carlo method.[46] However, even a low parameter of uncertainty does not guarantee the success of a project.

### Principle of maximum entropy

Suppose that we have sources of uncertainty in a CBA that are best treated with the Monte Carlo method, and the distributions describing uncertainty are all continuous. How do we go about choosing the appropriate distribution to represent the sources of uncertainty? One popular method is to make use of the principle of maximum entropy, which states that the distribution with the best representation of current knowledge is the one with the largest entropy - defined for continuous distributions as:

${\displaystyle H(X)=\mathbb {E} \left[-\log f(X)\right]=-\int _{\mathcal {S}}f(x)\log f(x)dx}$
where ${\displaystyle {\mathcal {S}}}$ is the support set of a probability density function ${\displaystyle f(x)}$. Suppose that we impose a series of constraints that must be satisfied:

1. ${\displaystyle f(x)\geq 0}$, with equality outside of ${\displaystyle {\mathcal {S}}}$
2. ${\displaystyle \int _{\mathcal {S}}f(x)dx=1}$
3. ${\displaystyle \int _{\mathcal {S}}r_{i}(x)f(x)dx=\alpha _{i},\quad i=1,...,m}$

where the last equality is a series of moment conditions. Maximizing the entropy with these constraints leads to the functional:[47]

${\displaystyle J=\max _{f}\;\int _{\mathcal {S}}\left(-f\log f+\lambda _{0}f+\sum _{i=1}^{m}\lambda _{i}r_{i}f\right)dx}$
where the ${\displaystyle \lambda _{i}}$ are Lagrange multipliers. Maximizing this functional leads to the form of a maximum entropy distribution:
${\displaystyle f(x)=\exp \left[\lambda _{0}-1+\sum _{i=1}^{m}\lambda _{i}r_{i}(x)\right]}$
There is a direct correspondence between the form of a maximum entropy distribution and the exponential family. Examples of commonly used continuous maximum entropy distributions in simulations include:

• Uniform distribution
• No constraints are imposed over the support set ${\displaystyle {\mathcal {S}}\in [a,b]}$
• It is assumed that we have maximum ignorance about the uncertainty
• Exponential distribution
• Specified mean ${\displaystyle \mathbb {E} (X)}$ over the support set ${\displaystyle {\mathcal {S}}\in [0,\infty )}$
• Gamma distribution
• Specified mean ${\displaystyle \mathbb {E} (X)}$ and log mean ${\displaystyle \mathbb {E} (\log X)}$ over the support set ${\displaystyle {\mathcal {S}}\in [0,\infty )}$
• The exponential distribution is a special case
• Normal distribution
• Specified mean ${\displaystyle \mathbb {E} (X)}$ and variance ${\displaystyle {\text{Var}}(X)}$ over the support set ${\displaystyle {\mathcal {S}}\in (-\infty ,\infty )}$
• If we have a specified mean and variance on the log scale, then the lognormal distribution is the maximum entropy distribution

The increased use of CBA in the US regulatory process is often associated with President Ronald Reagan's administration. Although CBA in US policy-making dates back several decades, Reagan's Executive Order 12291 mandated its use in the regulatory process. After campaigning on a deregulation platform, he issued the 1981 EO authorizing the Office of Information and Regulatory Affairs (OIRA) to review agency regulations and requiring federal agencies to produce regulatory impact analyses when the estimated annual impact exceeded $100 million. During the 1980s, academic and institutional critiques of CBA emerged. The three main criticisms were:[48] 1. That CBA could be used for political goals. Debates on the merits of cost and benefit comparisons can be used to sidestep political or philosophical goals, rules and regulations. 2. That CBA is inherently anti-regulatory, and therefore a biased tool. The monetization of policy impacts is an inappropriate tool for assessing mortality risks and distributional impacts. 3. That the length of time necessary to complete CBA can create significant delays, which can impede policy regulation. These criticisms continued under the Clinton administration during the 1990s. Clinton furthered the anti-regulatory environment with his Executive Order 12866.[49] The order changed some of Reagan's language, requiring benefits to justify (rather than exceeding) costs and adding "reduction of discrimination or bias" as a benefit to be analyzed. Criticisms of CBA (including uncertainty valuations, discounting future values, and the calculation of risk) were used to argue that it should play no part in the regulatory process.[50] The use of CBA in the regulatory process continued under the Obama administration, along with the debate about its practical and objective value. Some analysts oppose the use of CBA in policy-making, and those in favor of it support improvements in analysis and calculations. ### Example: rail transit in the United States As of 2016, only 5.1% of Americans used any form of public transit to commute to work;[51] this number has remained flat since 1980.[52] Moreover, the vast majority of U.S. metro rail systems lose money on each trip[53] and projects tend to have significant cost overruns.[54] The combination of low ridership and cost overruns suggests that, on average, the benefits of rail transit are exaggerated and the costs are understated.[55] Below are several examples of projects where either the costs are significantly higher than projected or the promised benefits have not materialized: #### High-speed rail #### Light rail #### Subways ## Distributional Issues CBA has been criticized in some disciplines as it relies on the Kaldor-Hicks criterion which does not take into account distributional issues. This means, that positive net-benefits are decisive, independent of who benefits and who loses when a certain policy or project is put into place. Phaneuf and Requate (2016: p. 649) phrased it as follows "CBA today relies on the Kaldor-Hicks criteria to make statements about efficiency without addressing issues of income distribution. This has allowed economists to stay silent on issues of equity, while focussing on the more familiar task of measuring costs and benefits".[70] The main criticism stems from the diminishing marginal utility of income.[71][72] Without using weights in the CBA, it is not the case that everyone “matters” the same but rather that people who value money less (who are by assumption people with more money) receive a higher weight. One reason for this is that for high income people, one monetary unit is worth less relative to low income people, so they are more willing to give up one unit in order to make a change that is favourable for them.[73] This means that there is no symmetry in agents. A second reason is that any welfare change, no matter positive or negative, affects people with a lower income stronger than people with a higher income. Taken together, this means that not using weights is a decision in itself – richer people receive de facto a bigger weight. As to compensate for this difference in valuation and in order to take into account distributional issues, it is possible to use different methods. The two most common ones are taxation, e.g. through a progressive tax, and the addition of weights into the CBA itself. There are a number of different approaches for calculating these weights. Often, a Bergson-Samuelson social welfare function is used and weights are calculated according to the willingness-to-pay of people.[74][75] ## See also ## References 1. David, Rodreck; Ngulube, Patrick; Dube, Adock (16 July 2013). "A cost–benefit analysis of document management strategies used at a financial institution in Zimbabwe: A case study". SA Journal of Information Management. 15 (2). doi:10.4102/sajim.v15i2.540. 2. [1]Archived October 16, 2008, at the Wayback Machine 3. Cellini, Stephanie Riegg; Kee, James Edwin. "Cost-Effectiveness and Cost–Benefit Analysis" (PDF). Archived from the original (PDF) on 2013-05-26. Retrieved 2012-09-24. Cite journal requires |journal= (help) 4. "Archived copy"(PDF). Archived from the original(PDF) on 2012-11-02. Retrieved 2012-09-20. CS1 maint: archived copy as title (link) 5. Weimer, D.; Vining, A. (2005). Policy Analysis: Concepts and Practice (Fourth ed.). Upper Saddle River, NJ: Pearson Prentice Hall. ISBN 978-0-13-183001-1. 6. Pamela, Misuraca (2014). "The Effectiveness of a Costs and Benefits Analysis in Making Federal Government Decisions: A Literature Review" (PDF). The MITRE Corporation. 7. Huesemann, Michael H., and Joyce A. Huesemann (2011). Technofix: Why Technology Won’t Save Us or the Environment, Chapter 8, “The Positive Biases of Technology Assessments and Cost Benefit Analyses”, New Society Publishers, Gabriola Island, British Columbia, Canada, ISBN 0865717044, 464 pp. 8. Wiener, Jonathan B. (2013). "The Diffusion of Regulatory Oversight". In Livermore, Michael A.; Revesz, Richard L. (eds.). The Globalization of Cost–Benefit Analysis in Environmental Policy. New York: Oxford University Press. ISBN 978-0-199-93438-6. 9. Sandmo, Agnar (2011). Economics evolving : a history of economic thought. Princeton University Press. ISBN 9780691148427. OCLC 799499179. 10. "History of Benefit-Cost Analysis"(PDF). Proceedings of the 2006 Cost Benefit Conference. Archived from the original(PDF) on 2006-06-16. 11. Guess, George M.; Farnham, Paul G. (2000). Cases in Public Policy Analysis. Washington, DC: Georgetown University Press. pp. 304–308. ISBN 978-0-87840-768-2. 12. Eckstein, Otto (1958). Water Resource Development: The Economics of Project Evaluation. Cambridge: Harvard University Press. 13. Kneese, A. V. (1964). The Economics of Regional Water Quality Management. Baltimore: Johns Hopkins Press. 14. Clawson, M.; Knetsch, J. L. (1966). Economics of Outdoor Recreation. Baltimore: Johns Hopkins Press. 15. Krutilla, J. V. (1967). "Conservation Reconsidered". American Economic Review. 57 (4): 777–786. JSTOR 1815368. 16. Weisbrod, Burton A. (1964). "Collective-Consumption Services of Individual-Consumption Goods". Quarterly Journal of Economics. 78 (3): 471–477. doi:10.2307/1879478. JSTOR 1879478. 17. Weisbrod, Burton A. (1981). "Benefit-Cost Analysis of a Controlled Experiment: Treating the Mentally Ill". Journal of Human Resources. 16 (4): 523–548. doi:10.2307/145235. JSTOR 145235. 18. Plotnick, Robert D. (1994). "Applying Benefit-Cost Analysis to Substance Abuse Prevention Programs". International Journal of the Addictions. 29 (3): 339–359. doi:10.3109/10826089409047385. PMID 8188432. 19. Weisbrod, Burton A.; Hansen, W. Lee (1969). Benefits, Costs, and Finance of Public Higher Education. Markham. 20. Moll, K. S.; et al. (1975). Hazardous wastes: A Risk-Benefit Framework Applied to Cadmium and Asbestos. Menlo Park, CA: Stanford Research Institute. 21. Canadian Cost–Benefit Guide: Regulatory Proposals, Treasury Canada, 2007. [2] 22. Australian Government, 2006. Introduction to Cost–Benefit Analysis and Alternative Evaluation Methodologies and Handbook of Cost–Benefit Analysis, Finance Circular 2006/01. http://www.finance.gov.au/publications/finance-circulars/2006/01.html Archived 2014-02-01 at the Wayback Machine 23. US Department of Health and Human Services, 1993. Feasibility, Alternatives, And Cost/Benefit Analysis Guide, Administration for Children and Families, and Health Care Finance Administration. http://www.acf.hhs.gov/programs/cb/systems/sacwis/cbaguide/index.htm 24. Federal Emergency Management Administration, 1022. Guide to Benefit Cost Analysis. http://www.fema.gov/government/grant/bca.shtm 25. Hugh Coombs; Ellis Jenkins; David Hobbs (18 April 2005). Management Accounting: Principles and Applications. SAGE Publications. pp. 278–. ISBN 978-1-84787-711-6. 26. "HEATCO project site". Heatco.ier.uni-stuttgart.de. Archived from the original on 2015-05-24. Retrieved 2013-04-21. 27. [3] Guide to Cost–Benefit Analysis of Major Projects. Evaluation Unit, DG Regional Policy, European Commission, 2008. 28. Guide to Benefit-Cost Analysis in Transport Canada. Transport Canada. Economic Evaluation Branch, Transport Canada, Ottawa, 1994 [4] Archived 2013-12-21 at the Wayback Machine 29. US Federal Highway Administration: Economic Analysis Primer: Benefit-Cost Analysis 2003 [5] 30. US Federal Highway Administration: Cost–Benefit Forecasting Toolbox for Highways, Circa 2001 [6] 31. US Federal Aviation Administration: Airport Benefit-Cost Analysis Guidance, 1999 [7] [8] 32. Minnesota Department of Transportation: Benefit Cost Analysis. MN DOT Office of Investment Management [9] Archived 2009-08-13 at the Wayback Machine 33. California Department of Transportation: Benefit-Cost Analysis Guide for Transportation Planning [10] 34. Transportation Research Board, Transportation Economics Committee: Transportation Benefit-Cost Analysis [11] 35. "Ford Fuel Fires". Archived from the original on July 15, 2011. Retrieved 29 December 2011. 36. Phelps, Charles (2009). Health Economics (4th ed.). New York: Pearson/Addison-Wesley. ISBN 978-0-321-59457-0. 37. Buekers, J (2015). "Health impact model for modal shift from car use to cycling or walking in Flanders: application to two bicycle highways". Journal of Transport and Health. 2 (4): 549–562. doi:10.1016/j.jth.2015.08.003. 38. Tuominen, Pekka; Reda, Francesco; Dawoud, Waled; Elboshy, Bahaa; Elshafei, Ghada; Negm, Abdelazim (2015). "Economic Appraisal of Energy Efficiency in Buildings Using Cost-effectiveness Assessment". Procedia Economics and Finance. 21: 422–430. doi:10.1016/S2212-5671(15)00195-1. 39. ^ a b Ackerman; et al. (2005). "Applying Cost–Benefit to Past Decisions: Was Environmental Protection Ever a Good Idea?". Administrative Law Review. 57: 155. 40. Boardman, N. E. (2006). Cost–benefit Analysis: Concepts and Practice (3rd ed.). Upper Saddle River, NJ: Prentice Hall. ISBN 978-0-13-143583-4. 41. Field, Barry C; Field, Martha K (2016). ENVIRONMENTAL ECONOMICS: AN INTRODUCTION, SEVENTH EDITION. America: McGraw-Hill. p. 144. ISBN 978-0-07-802189-3. 42. Field, Barry C; Field, Martha K (2016). ENVIRONMENTAL ECONOMICS: AN INTRODUCTION, SEVENTH EDITION. America: McGraw-Hill. p. 138. ISBN 978-0-07-802189-3. 43. Campbell, Harry F.; Brown, Richard (2003). "Valuing Traded and Non-Traded Commodities in Benefit-Cost Analysis". Benefit-Cost Analysis: Financial and Economic Appraisal using Spreadsheets. Cambridge: Cambridge University Press. ISBN 978-0-521-52898-6. Ch. 8 provides a useful discussion of non-market valuation methods for CBA. 44. Dunn, William N. (2009). Public Policy Analysis: An Introduction. New York: Longman. ISBN 978-0-13-615554-6. 45. Newell, R. G. (2003). "Discounting the Distant Future: How Much Do Uncertain Rates Increase Valuations?". Journal of Environmental Economics and Management. 46 (1): 52–71. doi:10.1016/S0095-0696(02)00031-1. hdl:10161/9133. 46. Campbell, Harry F.; Brown, Richard (2003). "Incorporating Risk in Benefit-Cost Analysis". Benefit-Cost Analysis: Financial and Economic Appraisal using Spreadsheets. Cambridge: Cambridge University Press. ISBN 978-0-521-52898-6. Ch. 9 provides a useful discussion of sensitivity analysis and risk modelling in cost benefits analysis. CBA. 47. Cover, Thomas M.; Thomas, Joy A. (2006). Elements of Information Theory. Wiley-Interscience (2nd ed.). Hoboken, NJ: John Wiley & Sons. pp. 409–412. ISBN 0471241954. 48. "Executive Order 12866: Regulatory Planning and Review". govinfo.library.unt.edu. 49. Heinzerling, L. (2000), "The Rights of Statistical People", Harvard Environmental Law Review 24, 189–208. 50. Tomer, Adie (2017-10-03). "America's commuting choices: 5 major takeaways from 2016 census data". Brookings Institution. Retrieved 2019-08-18. 51. Stromberg, Joseph (2015-04-29). "The utter dominance of the car in American commuting". Vox. Retrieved 2019-08-18. 52. Jaffe, Eric (2015-06-08). "How Much Money U.S. Transit Systems Lose Per Trip, in 1 Chart". CityLab. Retrieved 2019-08-18. 53. "Rail Transit Cost Overruns – The Antiplanner". ti.org. Retrieved 2019-08-18. 54. O'Toole, Randal (2014-06-03). "The Worst of Both: The Rise of High-Cost, Low-Capacity Rail Transit" (PDF). Policy Analysis. Cato Institute. 750. 55. Feigenbaum, Baruch (2013). "High-Speed Rail in Europe and Asia: Lessons for the United States" (PDF). Reason Foundation. 56. "Detroit People Mover | Detroit Historical Society". detroithistorical.org. Retrieved 2019-08-18. 57. Neavling, Steve (2019-05-01). "Two years in, Detroit's QLine falls far short of expectations". Detroit Metro Times. Retrieved 2019-08-18. 58. Matar, Sharif (2013-08-01). "Rail to Nowhere: Honolulu, Hawaii's Train Boondoggle". Reason.com. Retrieved 2019-08-18. 59. Journal, Dan Frosch and Paul Overberg | Photographs by Marco Garcia for The Wall Street (2019-03-22). "How a Train Through Paradise Turned Into a$9 Billion Debacle". Wall Street Journal. ISSN 0099-9660. Retrieved 2019-08-18.
60. Lyte, Brittany (2017-07-19). "Honolulu's Rapid Transit Crisis". CityLab. Retrieved 2019-08-18.
61. McFadden, Daniel (1974-11-01). "The measurement of urban travel demand". Journal of Public Economics. 3 (4): 303–328. doi:10.1016/0047-2727(74)90003-6. ISSN 0047-2727.
62. McFadden, Daniel L. (2002). "The Path to Discrete-Choice Models" (PDF). Access Magazine.
63. Rosenthal, Brian M. (2017-12-28). "The Most Expensive Mile of Subway Track on Earth". The New York Times. ISSN 0362-4331. Retrieved 2019-08-18.
64. Harris, Connor (2018-08-25). "Why building trains in New York costs more than any other city". New York Post. Retrieved 2019-08-18.
65. Rivoli, Dan (2018-05-25). "MTA Budget: Where does the money come from?". NY Daily News. Retrieved 2019-08-18.
66. Green, Ariana (2005-11-19). "A Hesitant Puerto Rico Tries Commuting by Train". The New York Times. ISSN 0362-4331. Retrieved 2019-08-18.
67. "Before and After Studies of New Starts Projects"(PDF). Federal Transit Administration. 2008.
68. Honore, Marcel (2018-07-09). "What Honolulu Rail Planners Can Learn From Puerto Rico". Honolulu Civil Beat. Retrieved 2019-08-18.
69. Phaneuf, Daniel J.; Requate, Till (2016-12-24). A Course in Environmental Economics: Theory, Policy, and Practice. Cambridge University Press. ISBN 9781316867358.
70. Nurmi, Väinö; Ahtiainen, Heini (2018-08-01). "Distributional Weights in Environmental Valuation and Cost-benefit Analysis: Theory and Practice". Ecological Economics. 150: 217–228. doi:10.1016/j.ecolecon.2018.04.021. ISSN 0921-8009.
71. Persky, Joseph (November 2001). "Retrospectives: Cost-Benefit Analysis and the Classical Creed". Journal of Economic Perspectives. 15 (4): 199–208. doi:10.1257/jep.15.4.199. ISSN 0895-3309.
72. Brekke, Kjell Arne (1997-04-01). "The numéraire matters in cost-benefit analysis". Journal of Public Economics. 64 (1): 117–123. doi:10.1016/S0047-2727(96)01610-6. ISSN 0047-2727.
73. Boadway, Robin (2006). "Principles of Cost-Benefit Analysis". Public Policy Review. 2 (1): 1–44.
74. Samuelson, P. A. (1977). "Reaffirming the Existence of "Reasonable" Bergson-Samuelson Social Welfare Functions". Economica. 44 (173): 81–88. doi:10.2307/2553553. ISSN 0013-0427. JSTOR 2553553.