Production Forecasting: Optimistic and Overconfident—Over and Over Again
- Reidar B. Bratvold (University of Stavanger) | Erlend Mohus (University of Stavanger) | David Petutschnig (University of Texas at Austin) | Eric Bickel (University of Texas at Austin)
- Document ID
- Society of Petroleum Engineers
- SPE Reservoir Evaluation & Engineering
- Publication Date
- August 2020
- Document Type
- Journal Paper
- 799 - 810
- 2020.Society of Petroleum Engineers
- overconfidence, optimism, probabilistic production forecasting, no improvements over time
- 10 in the last 30 days
- 141 since 2007
- Show more detail
- View rights & permissions
|SPE Member Price:||USD 5.00|
|SPE Non-Member Price:||USD 35.00|
The oil and gas industry uses production forecasts to make decisions, which can be as mundane as whether to change the choke setting on a well, or as significant as whether to develop a field. These forecasts yield cash flow predictions and value-and-decision metrics such as net present value and internal rate of return.
In this paper, probabilistic production forecasts made at the time of the development final investment decisions (FIDs) are compared with actual production after FIDs, to assess whether the forecasts are optimistic, overconfident, neither, or both.
Although biases in time-and-cost estimates in the exploration and production (E&P) industry are well documented, probabilistic production forecasts have yet to be the focus of a comprehensive, public study. The main obstacle is that production forecasts for E&P development projects are not publicly available, even though they have long been collected by the Norwegian Petroleum Directorate (NPD), a Norwegian government agency. The NPD’s guidelines specify that at the time of FID, the operators should report the forecasted annual mean and P10/90 percentiles for the projected life of the field.
We arranged to access the NPD database in order to statistically compare annual production forecasts given at the time of FID for 56 fields in the 1995 to 2017 period, with actual annual production from the same fields. This work constitutes the first public study of the quality of probabilistic production forecasts. The main conclusions are that production forecasts that are being used at the FID for E&P development projects are both optimistic and overconfident, leading to poor decisions.1
1The conclusions based on the analysis presented in this paper are limited to the set of fields from the NCS. However, other authors have demonstrated the optimism bias in production forecasts from fields around the world (Nandurdikar and Wallace 2011; Nandurdikar and Kirkham 2012).
|File Size||4 MB||Number of Pages||12|
Allen, D. P. B. 2017. Handling Risk and Uncertainty in Portfolio Production Forecasting. SPE Econ & Mgmt 9 (2): 37–42. SPE-185178-PA. https://doi.org/10.2118/185178-PA.
Barker, J. W., Cuypers, M., and Holden, L. 2001. Quantifying Uncertainty in Production Forecasts: Another Look at the PUNQ-S3 Problem. SPE J. 6 (4): 433–441. SPE-74707-PA. https://doi.org/10.2118/74707-PA.
Bickel, J. E. and Bratvold, R. B. 2007. Decision-Making in the Oil and Gas Industry—From Blissful Ignorance to Uncertainty-Induced Confusion. Paper presented at the SPE Annual Technical Conference and Exhibition, Anaheim, California, USA, 1 January. SPE-109610-MS. https://doi.org/10.2118/109610-MS.
Bulmer, G. M. 1979. Principles of Statistics. New York, New York, USA: Dover.
Ernst and Young. 2014. Megaprojects—The New Norm in the Oil and Gas Industry. London, England, UK: EYGM Limited White Paper.
Flyvbjerg, B. 2011. Over Budget, Over Time, Over and Over Again: Managing Major Projects. In The Oxford Handbook of Project Management, 321–344. Oxford, England, UK: Oxford University Press.
Flyvbjerg, B. 2017. The Oxford Handbook of Megaproject Management. Oxford, England, UK: Oxford University Press.
Flyvbjerg, B., Garbuio, M., and Lovallo, D. 2014. Delusion and Deception in Large Infrastructure Projects: Two Models for Explaining and Preventing Executive Disaster. Calif Mgmt Rev 51 (2) : 170–193. https://doi.org/10.2307/41166485.
Fox, J. 2008. Applied Regression Analysis and Generalized Linear Models. Thousand Oaks, California, USA: SAGE Publications.
Haiden, T., Janousek, M., Bidlot, J. et al. 2016. Evaluation of ECMWF Forecasts, Including the 2016 Resolution Upgrade. ECMWF Technical Memorandum 792, Berkshire, England (December 2016). https://doi.org/10.21957/vltarm3ql.
Haukaas, A. and Mohus, E. 2016. The Petroleum Industry’s Inability and Lack of Will to Fulfil Its Promises—An Analysis of Overruns on the Norwegian Continental Shelf. Stavanger, Norway: University of Stavanger.
Hegstad, B. K. and Henning, O. 2001. Uncertainty in Production Forecasts Based on Well Observations, Seismic Data, and Production History. SPE J. 6 (4): 409–424. SPE-74699-PA. https://doi.org/10.2118/74699-PA.
Kahneman, D. and Tversky, A. 1979. Intuitive Prediction: Biases and Corrective Procedures. TIMS Stud Mgmt Sci 12: 313–327.
Keelin, T. W. 2016. The Metalog Distributions. Decis Anal 13: 243–277. https://doi.org/10.1287/deca.2016.0338.
Lovallo, D. and Kahneman, D. 2003. Delusions of Success: How Optimism Undermines Executives’ Decisions. Harvard Business Review 81 (7). https://hbr.org/2003/07/delusions-of-success-how-optimism-undermines-executives-decisions (accessed May 2020).
Merrow, E. W. 2012. Oil and Gas Industry Megaprojects: Our Recent Track Record. Oil and Gas Fac 1 (2): 38–42. SPE-153695-PA. https://doi.org/10.2118/153695-PA.
Ministry of Petroleum and Energy (MPE). 2010. Guidelines for PDO and PIO. Oslo, Norway: Ministry of Petroleum and Energy.
Mohus, E. 2018. Over Budget, Over Time, and Reduced Revenue, Over and Over Again—An Analysis of the Norwegian Petroleum Industry’s Inability To Forecast Production. Stavanger, Norway: University of Stavanger.
Nandurdikar, N. S. and Kirkham, P. M. 2012. The Economic Folly of Chasing Schedules in Oil Developments and the Unintended Consequences of Such Strategies. Paper presented at the SPE Hydrocarbon, Economics, and Evaluation, Calgary, Alberta, Canada, 24 September. SPE-162878-MS. https://doi.org/10.2118/162878-MS.
Nandurdikar, N. S. and Wallace, L. 2011. Failure To Produce: An Investigation of Deficiencies in Production Attainment. Paper presented at the SPE Annual Technical Conference and Exhibition, Denver, Colorado, USA, 1 January. SPE-145437-MS. https://doi.org/10.2118/145437-MS.
Neumann, K. B., Hegstad, B., Bratli, E. et al. 2012. Uncertainty Study on In-Place Volumes in Statoil. Paper presented at the Ninth International Geostatistics Conference, Oslo, Norway.
Norwegian Petroleum Directorate (NPD). 2000. PDO/PIO Guidelines. Stavanger, Norway: Norwegian Petroleum Directorate.
Norwegian Petroleum Directorate (NPD). 2013. Vurdering Av Gjennomflørte Prosjekter På Norsk Sokkel. Stavanger, Norway: Norwegian Petroleum Directorate.
Norwegian Petroleum Directorate (NPD). 2018a. Guidelines for Plan for Development and Operation of a Petroleum Deposit (PDO) and Plan for Installation and Operation of Facilities for Transport and Utilisation of Petroleum (PIO). Stavanger, Norway: Norwegian Petroleum Directorate.
Norwegian Petroleum Directorate (NPD). 2018b. RNB2019 General Guidelines. Stavanger, Norway: Norwegian Petroleum Directorate.
Norwegian Petroleum Directorate (NPD). 2019a. Reporting to the Revised National Budget 2019 (RNB2019). Stavanger, Norway: Norwegian Petroleum Directorate.
Norwegian Petroleum Directorate (NPD). 2019b. Factpage. Stavanger, Norway: Norwegian Petroleum Directorate.
Oglend, A., Osmundsen, P., and Sindre, L. 2016. Cost Overruns in Norwegian Oil and Gas Projects: A Long-Tailed Tale. Paper presented at the IAEE Energy Forum, Bergen, Norway.
Omre, H. and Lødøen, O. P. 2004. Improved Production Forecasts and History Matching Using Approximate Fluid-Flow Simulators. SPE J. 9 (3): 339–351. SPE-74691-PA. https://doi.org/10.2118/74691-PA.
Rivera, N., Meza, N. S., Kim, J. S. et al. 2007. Static and Dynamic Uncertainty Management for Probabilistic Production Forecast in Chuchupa Field, Colombia. SPE Res Eval & Eng 10 (4): 433–439. SPE-100526-PA. https://doi.org/10.2118/100526-PA.
Smyth, J. 2016. Cost Overruns Near $50bn as Australia’s LNG Boom Falters. Bracken House, London, England, UK: The Financial Times (Reprint).
Taleb, N. N. 2007. The Black Swan: The Impact of the Highly Improbable. New York, New York, USA: Random House Group.
Taraldsen, L. 2015. Norske Oljeprosjekter Har Sprukket Med over 200 Milliarder På 14 År. Oslo, Norway: Teknisk Ukeblad.
Tversky, A. and Kahneman, D. 1974. Judgment under Uncertainty: Heuristics and Biases. Science 185 (4157): 1124. http://science.sciencemag.org/content/185/4157/1124.abstract.