The “Planning Fallacy” and Virginia Transportation

by James A. Bacon

Daniel Kahneman, an eminent psychologist, won the 2002 Nobel Prize in economics for his work showing how a key underlying assumption of classical economics — that people behave in an economically rational manner — is demonstrably false. The human brain has evolved cognitive short cuts that served homo sapiens well when survival required rapid decision making but now bias thinking in unproductive ways in the vastly more complex environment of contemporary society. Among these traits, which he explores in his book, “Thinking, Fast and Slow,” are an irrational aversion to risk in some circumstances and a proclivity for excessive optimism in others.

Little did I suspect when I embarked upon reading the book during vacation that passages would bear upon my work at Bacon’s Rebellion. But one section entitled, “The Planning Fallacy,” which describes the tendency to base plans and forecasts upon unrealistic, best-case scenarios, applied directly to a wave of transportation mega-projects, from Rail-to-Dulles to the U.S. 460 upgrade, at various stages in the approval process in Virginia. This optimism bias is a fundamental human affliction, affecting consumers, businesses and government alike. No one is immune. But the most egregious examples come from government.

Kahneman cites a fiasco in which the cost of the new Scottish Parliament building escalated from a £40 million estimate in 1997 to £431 million upon completion in 2004. He also notes a tendency for the cost of rail projects around the world to… well, to run off the rails. In a worldwide survey of projects undertaken over 30 years, the average cost overrun was 45% and passenger forecasts exceeded actual performance by 106%.

Writes Kahneman:

Errors in the initial budget are not always innocent. The authors of unrealistic plans are often driven by the desire to get the plan approved — whether by their superiors or by a client — supported by the knowledge that projects are rarely abandoned unfinished merely because of overruns in costs or completion times. In such cases, the greatest responsibility for avoiding the planning fallacy lies with the decision makers who approve the plan. If they do not recognize the need for an outside view, they commit a planning fallacy.

What decision makers should do, Kahneman writes, is to engage in what he calls “reference class forecasting,” a practice that has been implemented for transportation projects in several countries. “The outside view is implemented by using a large database, which provides information on both plans and outcomes for hundreds of projects all over the world, and can be used to provide statistical information about the likely overruns of cost and time, and about the likely underperformance of projects of different types.”

Reference class forecasting protects decision makers from excessive optimism before approving a project and may help them structure projects in ways that will help prevent cost overruns. The problem with most forecasts is that they are based upon known factors and known “unknowns” but, in the immortal words of former Defense Secretary Donald Rumsfeld, do not incorporate “unknown unknowns.” While any particular unknown may be unlikely to occur, there are so many unknowns that the odds are very high that one of them will occur, often with cascading effects. A well-run organization, says Kahneman, will reward planners for precise execution and punish them for ailing to anticipate difficulties.

That’s all very fine but how does it apply to Virginia? Hopefully, decision makers will learn something from recent experiences in administering rail projects like The Tide in Norfolk and Rail-to-Dulles in Northern Virginia. In both projects, costs outran early cost estimates but public authorities continued pursuing them because once a public project picks up momentum and costs have been sunk into it, politically there is no going back.

Now the McDonnell administration is pushing a slew of expensive bridge and highway mega-projects. Aside from the critical question of whether all of these projects are economically justified — the case for the Charlottesville Bypass is particularly weak — we now get to worry whether the projects will run over budget. The Virginia Department of Transportation is shifting from a project-management methodology in which VDOT designed the projects, bid them out to private contractors and ate the cost overruns, to a new methodology that shifts far more of the responsibility and risk  to the private contractors. The theory is impeccable. How the theory will be executed is another matter entirely. It will depend largely upon how tightly the contracts are written.

Unfortunately, Gov. Bob McDonnell will be long gone when the projects he sets into motion are completed and the costs are tallied. By the time we know how well his team did in managing the mega-projects, it will be impossible to hold him accountable — just as his predecessor Tim Kaine has eluded the fallout from the Rail-to-Dulles project that he set into motion. Accountability is the key. Private corporations have evolved mechanisms, however imperfect, for holding their decision makers accountable for successsful management of massive projects. Virginia has yet to do so.


Share this article



ADVERTISEMENT

(comments below)



ADVERTISEMENT

(comments below)


Comments

  1. DJRippert Avatar
    DJRippert

    Welcome back Jim. Hope you had a great time. Now that the pleasantries are over … you are, once again, showing your naivete.

    Where should the planning and accountability for ROI on transportation projects reside? The one term, 4 year governor? Hardly. How about the Senate Finance Committee and the House Appropriations Committee?

    Here’s the Senate Finance Committee along with the percentage of votes that senator got in the last election (2011).

    Stosch (95.6%)
    Colgan (55.0%)
    Howell, Janet (60.3%)
    Saslaw (61.7%)
    Norment (96.4%)
    Hanger (98.5%)
    Watkins (56.5%)
    Miller, Yvonne (95.6%)
    Marsh, Henry (69.0%)
    Lucas, Louise (95.9%)
    Newman (77.8%)
    Ruff (99.2%)
    Wagner, Frank (96.8%)
    McDougle (97.5%)
    Vogel (74.6%)

    Virginia’s legislative elections are the least competitive state elections in the United States. Through a variety of scams our GA members stay in power for as long as they want. Our governor is a weak position. The judges are appointed by the all-powerful, static General Assembly. Localities have no effective power.

    Jim, all of your good ideas go for naught in this environment.

    Virginia is run by a club of political elites. Incumbents almost always win. The elites have infinite power. There are no effective checks and balances.

    Nobody will take accountability for anything, Jim.

    The state is broken, badly broken.

  2. It’s not clear from your comment how you think I was being naive. I made a bland statement to the effect that Virginia has not yet devised a mechanism for holding the governor accountable for the management of mega-projects. Surely, you would not dispute that. Are you referring to my suggestion that Virginia use “reference class forecasting”?

    If so, I think that forecasting tool would be helpful, but I’m under no illusions that it would solve the underlying political dysfunctions.

  3. DJRippert Avatar
    DJRippert

    The naivete is the belief that the General Assembly will adopt good ideas because they are good ideas (i.e. good for Virginia). The Delegates and Senators in the GA will only increase their own accountability if you threaten the incumbency of those Delegates and Senators.

    Theory becomes useful when there is a method to implement the theory.

    You have good theory. However, you have no plan to get your theory implemented. Hence, my charge of naivete.

    For what it’s worth, I feel the same way about the ideas I espouse. Lots of interest but hard to get an organization to adopt new ideas when they can live their incumbent lives fat, dumb and happy.

    What is the carrot and what is the stick that gets the GA to act on any of these good ideas?

  4. The Gov in some ways, plays the game the way the game is played.

    Isn’t it odd that we treat transportation “planning” as an economic development activity but not education – the two perennial budget combatants no matter who the Gov is….

    what a shock it would be if the promoters of transportation projects for economic development too that same approach for education spending!

    🙂

  5. DJRippert Avatar
    DJRippert

    LarryG:

    Roads don’t grow up and move to Manhattan to chase Wall St money. Smart kids do.

    The real key is to build places where people want to live, work and play. Virginia sucks at this. In 1970, the city of Richmond had more people than the city of Charlotte. Today, fewer people live in the city of Richmond than lived there in 1970. Meanwhile, the population of Charlotte has almost tripled over that same period. The Charlotte MSA grew over 32% in the last 10 years. The Richmond MSA grew under 15%. The Charlottesville MSA grew 16%. The Virginia Beach MSA grew 6% over the same period.

    The fastest growing MSA in Virginia was Winchester, VA. I presume this is more to do with suburban sprawl from DC than anything else but who knows?

    Dover, DE grew faster than any Virginia MSA.

    People are voting with their feet and they are not voting for Virginia.

    How will the votes look when federal spending declines?

    42 of America’s 366 MSA’s shrank from 2000 to 2010. They are all tough places to live. In that mix is Danville, VA.

    North Carolina has weather comparable to Virginia. But people are flocking to cities in North Carolina but not Virginia.

    Why, LarryG? Why?

  6. “The Planning Fallacy,” which describes the tendency to base plans and forecasts upon unrealistic, best-case scenarios….

    =================================================

    That is not a planning fallacy nor does it have anything to do with behaving irrationally with respect to economics.

    That is planning fraud, and I have seen it hundreds of times. “this is a success oriented schedule”, they will say. This describes a schedule that assumes 20% of free overtime, zero slack time, no rework, and no contingency planning.

    In other words, a schedule guaranteed to fail.

    This happens because the professional planners are over ruled by the managers and politicoswho fear the truth won’t sell.

  7. whether it’s North Carolina or New York – the “we don’t have enough roads for economic development” mantra …is the same.

    New York and North Carolina have higher gas taxes than Virginia but both of them are as broke or more broke in terms of funding transportation.

    building roads in the name of economic development is a bad joke.

    developers … whether they be from Virginia, New York or North Carolina play the very same game. Convince someone to take millions away from taxpayers to spend on some transportation boondoggle then feast financially off the largess.

Leave a Reply