A Gaussian Mixture Model as a Proposal Distribution for Efficient Markov-Chain Monte Carlo Characterization of Uncertainty in Reservoir Description and Forecasting
- Xin Li (University of Tulsa) | Albert C. Reynolds (University of Tulsa)
- Document ID
- Society of Petroleum Engineers
- SPE Journal
- Publication Date
- February 2020
- Document Type
- Journal Paper
- 1 - 36
- 2020.Society of Petroleum Engineers
- MCMC, uncertainty characterization, Metropolis-Hastings, Gaussian mixture model
- 5 in the last 30 days
- 118 since 2007
- Show more detail
- View rights & permissions
|SPE Member Price:||USD 5.00|
|SPE Non-Member Price:||USD 35.00|
Generating an estimate of uncertainty in production forecasts has become nearly standard in the oil industry, but is often performed with procedures that yield at best a highly approximate uncertainty quantification. Formally, the uncertainty quantification of a production forecast can be achieved by generating a correct characterization of the posterior probability-density function (PDF) of reservoir-model parameters conditional to dynamic data and then sampling this PDF correctly. Although Markov-chain Monte Carlo (MCMC) provides a theoretically rigorous method for sampling any target PDF that is known up to a normalizing constant, in reservoir-engineering applications, researchers have found that it might require extraordinarily long chains containing millions to hundreds of millions of states to obtain a correct characterization of the target PDF. When the target PDF has a single mode or has multiple modes concentrated in a small region, it might be possible to implement a proposal distribution dependent on a random walk so that the resulting MCMC algorithm derived from the Metropolis-Hastings acceptance probability can yield a good characterization of the posterior PDF with a computationally feasible chain length. However, for a high-dimensional multimodal PDF with modes separated by large regions of low or zero probability, characterizing the PDF with MCMC using a random walk is not computationally feasible. Although methods such as population MCMC exist for characterizing a multimodal PDF, their computational cost generally makes the application of these algorithms far too costly for field application. In this paper, we design a new proposal distribution using a Gaussian mixture PDF for use in MCMC where the posterior PDF can be multimodal with the modes spread far apart. Simply put, the method generates modes using a gradient-based optimization method and constructs a Gaussian mixture model (GMM) to use as the basic proposal distribution. Tests on three simple problems are presented to establish the validity of the method. The performance of the new MCMC algorithm is compared with that of random-walk MCMC and is also compared with that of population MCMC for a target PDF that is multimodal.
|File Size||2 MB||Number of Pages||36|
Aanonsen, S. I., Nævdal, G., Oliver, D. S. et al. 2009. The Ensemble Kalman Filter in Reservoir Engineering—A Review. SPE J. 14 (3): 393–412. SPE-117274-PA. https://doi.org/10.2118/117274-PA.
Abacioglu, Y., Oliver, D. S., and Reynolds, A. C. 2001. Efficient Reservoir History Matching Using Subspace Vectors. Computat Geosci 5 (2): 151–172. https://doi.org/10.1023/A:1013155928900.
Alabert, F. 1987. The Practice of Fast Conditional Simulations Through the LU Decomposition of the Covariance Matrix. Math Geol 19 (5): 369–386. https://doi.org/10.1007/BF00897191.
Bonet-Cunha, L., Oliver, D. S., Rednar, R. A. et al. 1998. A Hybrid Markov Chain Monte Carlo Method for Generating Permeability Fields Conditioned to Multiwell Pressure Data and Prior Information. SPE J. 11 (3): 261–271. SPE-50991-PA. https://doi.org/10.2118/50991-PA.
Brooks, S. P. and Gelman, A. 1998. General Methods for Monitoring Convergence of Iterative Simulations. J Comput Graph Stat 7 (4): 434–455. https://doi.org/10.1080/10618600.1998.10474787.
Burgers, G., van Leeuwen, P., and Evensen, G. 1998. Analysis Scheme in the Ensemble Kalman Filter. Mon Weather Rev 126 (6): 1719–1724. https://doi.org/10.1175/1520-0493(1998)126%3C1719:ASITEK%3E2.0.CO;2.
Carter, J., Ballester, P., Tavassoli, Z. et al. 2006. Our Calibrated Model Has No Predictive Value: An Example From the Petroleum Industry. Reliab Eng Syst Saf 91 (10-11): 1373–1381. https://doi.org/10.1016/j.ress.2005.11.033.
Carter, J. N. and Ballester, P. J. 2004. A Real Parameter Genetic Algorithm for Cluster Identification in History Matching. Oral presentation given at the 8th European Conference on the Mathematics of Oil Recovery, Cannes, France, 30 August–2 September.
Chen, B., He, J., Wen, X. et al. 2016. Pilot Design Analysis Using Proxies and Markov Chain Monte Carlo Method. Oral presentation given at ECMOR XV–15th European Conference on the Mathematical of Oil Recovery, Amsterdam, 29 August–1 September.
Chen, C., Gao, G., Ramirez, B. et al. 2015. Assisted History Matching of Channelized Models Using Pluri-Principal Component Analysis. Presented at the SPE Reservoir Simulation Symposium, Houston, 23–25 February. SPE-173192-MS. https://doi.org/10.2118/173192-MS.
Chen, C., Li, G., and Reynolds, A. C. 2011. Robust Constrained Optimization of Short and Long-Term NPV for Closed-Loop Reservoir Management. Presented at the SPE Reservoir Simulation Symposium, The Woodlands, Texas, 21–23 February. SPE-141314-MS. https://doi.org/10.2118/141314-MS.
Chen, Y. and Oliver, D. 2013. Levenberg-Marquardt Forms of the Iterative Ensemble Smoother for Efficient History Matching and Uncertainty Quantification. Computat Geosci 17 (4): 689–703. https://doi.org/10.1007/s10596-013-9351-5.
Deutsch, C. V. and Journel, A. G. 1992. GSLIB: Geostatistical Software Library and User’s Guide. New York City: Oxford University Press.
Efendiev, Y., Datta-Gupta, A., Ginting, V. et al. 2005. An Efficient Two-Stage Markov Chain Monte Carlo Method for Dynamic Data Integration. Water Resour Res 41 (12): W12423. https://doi.org/10.1029/2004WR003764.
Efendiev, Y., Datta-Gupta, A., Ma, X. et al. 2008. Modified Markov Chain Monte Carlo Method for Dynamic Data Integration Using Streamline Approach. Math Geol 40 (2): 213–232. https://doi.org/10.1007/s11004-007-9137-1.
Emerick, A. A. and Reynolds, A. C. 2012. History Matching Time-Lapse Seismic Data Using the Ensemble Kalman Filter With Multiple Data Assimilations. Computat Geosci 16 (3): 639–659. https://doi.org/10.1007/s10596-012-9275-5.
Emerick, A. A. and Reynolds, A. C. 2013a. Ensemble Smoother With Multiple Data Assimilations. Comput Geosci 55 (June): 3–15. https://doi.org/10.1016/j.cageo.2012.03.011.
Emerick, A. A. and Reynolds, A. C. 2013b. Investigation of the Sampling Performance of Ensemble-Based Methods With a Simple Reservoir Model. Computat Geosci 17 (2): 325–350. https://doi.org/10.1007/s10596-012-9333-z.
Evensen, G. 1994. Sequential Data Assimilation With a Nonlinear Quasi-Geostrophic Model Using Monte Carlo Methods to Forecast Error Statistics. J Geophys Res 99 (C5): 10143–10162. https://doi.org/10.1029/94JC00572.
Gao, G. and Reynolds, A. C. 2006. An Improved Implementation of the LBFGS Algorithm for Automatic History Matching. SPE J. 11 (1): 5–17. SPE-90058-PA. https://doi.org/10.2118/90058-PA.
Gao, G., Vink, J. C., Chen, C. et al. 2016. Uncertainty Quantification for History Matching Problems With Multiple Best Matches Using a Distributed Gauss-Newton Method. Presented at the SPE Annual Technical Conference and Exhibition, Dubai, 26–28 September. SPE-181611-MS. https://doi.org/10.2118/181611-MS.
Gelman, A., Roberts, G. O., and Gilks, W. R. 1996. Efficient Metropolis Jumping Rules. In Bayesian Statistics, ed. J. M. Bernardo, J. O. Berger, A. P. David, et al. Chap. 5, 599–607. New York City: Oxford University Press.
Geyer, C. J. 1991. Markov Chain Monte Carlo Maximum Likelihood. In Computing Science and Statistics: Proceedings of the 13rd Symposium on the Interface, ed. W. F. Eddy, 156–163. New York City: Springer.
Green, P. 1995. Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination. Biometrika 82 (4): 711–732. https://doi.org/10.1093/biomet/82.4.711.
Grimstad, A. A., Mannseth, T., Aanonsen, S. A. et al. 2002. Identification of Unknown Permeability Trends From History Matching of Production Data. Presented at the SPE Annual Technical Conference and Exhibition, San Antonio, Texas, 29 September–2 October. SPE-77485-MS. https://doi.org/10.2118/77485-MS.
Grimstad, A. A., Mannseth, T., Nævdal, G. et al. 2001. Scale Splitting Approach to Reservoir Characterization. Presented at the SPE Annual Technical Conference and Exhibition, Houston, Texas, 11–14 February. SPE-66394-MS. https://doi.org/10.2118/66394-MS.
Haario, H., Saksmaan, E., and Tamminen, J. et al. 2001. An Adaptive Metropolis Algorithm. Bernoulli 7 (2): 223–242. https://doi.org/10.2307/3318737.
Hansen, N. 2006. The CMA Evolution Strategy: A Comparing Review. In Towards a New Evolutionary Computation Advances on Estimation of Distribution Algorithms, ed. J. A. Lozano, P. Larranaga, I. Inza, et al. Chap. 4, 75–102. New York City: Springer.
Hansen, N. 2011. The CMA Evolution Strategy: A Tutorial, arXiv:1604.00772.
Hastings, W. K. 1970. Monte Carlo Sampling Methods Using Markov Chains and Their Applications. Biometrika 57 (1): 97–109. https://doi.org/10.2307/2334940.
He, J., Xie, J., Sarma, P. et al. 2015. Model-Based A Priori Evaluation of Surveillance Programs Effectiveness Using Proxies. Presented at the SPE Reservoir Simulation Symposium, Houston, 23–25 February. SPE-173229-MS. https://doi.org/10.2118/173229-MS.
He, J., Xie, J., Sarma, P. et al. 2016. Proxy-Based Work Flow for A Priori Evaluation of Data-Acquisition Programs. SPE J. 21 (4): 1400–1412. SPE-173229-PA. https://doi.org/10.2118/173229-PA.
Houtekamer, P. L. and Mitchell, H. L. 1998. Data Assimilation Using an Ensemble Kalman Filter Technique. Mon Weather Rev 126 (3): 796–811. https://doi.org/10.1175/1520-0493(1998)126%3C0796:DAUAEK%3E2.0.CO;2.
Iglesias, M. A. 2015. Iterative Regularization for Ensemble-Based Data Assimilation in Reservoir Models. Computat Geosci 19 (1): 177–212. https://doi.org/10.1007/s10596-014-9456-5.
Jafarpour, B. and McLaughlin, D. B. 2007. Efficient Permeability Parameterization With the Discrete Cosine Transform. Presented at the SPE Reservoir Simulation Symposium, Houston, 26–28 February. SPE-106453-MS. https://doi.org/10.2118/106453-MS.
Kass, R. E., Carlin, B. P., Gelman, A. et al. 1998. Markov Chain Monte Carlo in Practice: A Roundtable Discussion. Am Stat 52 (2): 93–100. https://doi.org/10.1080/00031305.1998.10480547
Le, D. H., Emerick, A. A., Reynolds, and A. C. 2015. An Adaptive Ensemble Smoother With Multiple Data Assimilation for Assisted History Matching. Presented at the SPE Reservoir Simulation Symposium, Houston, 23–25 February. SPE-173214-MS. https://doi.org/10.2118/173214-MS.
Levin, D. A., Peres, Y., and Wilmer, E. L. 2009. Markov Chains and Mixing Times. Providence, Rhode Island: American Mathematical Society.
Liang, F. and Wong, W. H. 2000. Evolutionary Monte Carlo: Applications to Cp Model Sampling and Change Point Problem. Stat Sin 10: 317–342. https://www.jstor.org/stable/24306722.
Liang, F., Liu, C., and Carroll, R. 2011. Advanced Markov Chain Monte Carlo Methods: Learning From Past Samples. Hoboken, New Jersey: John Wiley & Sons.
Liu, N. and Oliver, D. S. 2003. Evaluation of Monte Carlo Methods for Assessing Uncertainty. SPE J. 8 (2): 188–195. SPE-84936-PA. https://doi.org/10.2118/84936-PA.
Lloyd, S. P. 1982. Least Squares Quantization in PCM. IEEE Trans Inf Theory 28 (2): 129–137. https://doi.org/10.1109/TIT.1982.1056489.
Luengo, D. and Martino, L. 2013. Fully Adaptive Gaussian Mixture Metropolis-Hastings Algorithm. Proc., 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, 26–31 May, Vancouver, British Columbia, Canada, 6148–6152. https://doi.org/10.1109/ICASSP.2013.6638846.
Ma, X., Al-Harbi, M., Datta-Gupta, A. et al. 2008. An Efficient Two-Stage Sampling Method for Uncertainty Quantification in History Matching Geological Models. SPE J. 13 (1): 77–87. SPE-102476-PA. https://doi.org/10.2118/102476-PA.
Martin, J., Wilcox, L. C., Burstedde, C. et al. 2012. A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion. SIAM J. Sci. Comput. 34 (3): A1460–A1487. https://doi.org/10.1137/110845598.
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N. et al. 1953. Equation of State Calculations by Fast Computing Machines. J. Chem. Phys. 21: 1087–1092. https://doi.org/10.1063/1.1699114.
Mohamed, L., Calderhead, B., Filippone, M. et al. 2012. Population MCMC Methods for History Matching and Uncertainty Quantification. Computat Geosci 16 (2): 423–436. https://doi.org/10.1007/s10596-011-9232-8.
Mohamed, L., Christie, M. A., and Demyanov, V. 2010. Comparison of Stochastic Sampling Algorithms for Uncertainty Quantification. SPE J. 15 (1): 31–38. SPE-119139-PA. https://doi.org/10.2118/119139-PA.
Nævdal, G., Johnsen, L. M., Aanonsen, S. I. et al. 2003. Reservoir Monitoring and Continuous Model Updating Using Ensemble Kalman Filter. Presented at the SPE Annual Technical Conference and Exhibition, Denver, 5–8 October. SPE-84372-MS. https://doi.org/10.2118/84372-MS.
Nævdal, G., Mannseth, T., and Vefring, E. H. 2002. Near-Well Reservoir Monitoring Through Ensemble Kalman Filter. Presented at the SPE/DOE Improved Oil Recovery Symposium, Tulsa, 13–17 April. SPE-75235-MS. https://doi.org/10.2118/75235-MS.
Neal, R. M. 1994. Bayesian Learning for Neural Networks. PhD dissertation, University of Toronto, Toronto, Ontario, Canada.
Neal, R. M. 2011. MCMC Using Hamiltonian Dynamics. In Handbook of Markov Chain Monte Carlo, eds. S. Brooks, A. Gelman, G. Jones, and X. Meng, Chapter 5, 113–162. Boca Raton, Florida, USA: CRC Press.
Oliver, D. S. and Chen, Y. 2011. Recent Progress on Reservoir History Matching: A Review. Computat Geosci 15 (1): 185–221. https://doi.org/10.1007/s10596-010-9194-2.
Oliver, D. S., Cunha, L. B., and Reynolds, A. C. 1997. Markov Chain Monte Carlo Methods for Conditioning a Permeability Field to Pressure Data. Math Geol 29 (1): 61–91. https://doi.org/10.1007/BF02769620.
Oliver, D. S., He, N., and Reynolds, A. C. 1996. Conditioning Permeability Fields to Pressure Data. Oral presentation given at ECMOR V–European Conference for the Mathematics of Oil Recovery, Leoben, Austria, 3–6 September.
Oliver, D. S., Reynolds, A. C., and Liu, N. 2008. Inverse Theory for Petroleum Reservoir Characterization and History Matching. Cambridge, UK: Cambridge University Press.
Petrovska, I. and Carter, J. 2006. Estimation of Distribution Algorithms for History Matching. Oral presentation given at ECMOR X–10th European Conference on the Mathematics of Oil Recovery, Amsterdam, 4–7 September.
Rafiee, J. 2017. Data Assimilation and Uncertainty Quantification With Ensemble Methods and Markov Chain Monte Carlo. PhD dissertation, University of Tulsa, Tulsa.
Rafiee, J. and Reynolds, A. C. 2017. Theoretical and Efficient Practical Procedures for the Generation of Inflation Factors for ES-MDA. Inverse Probl 33 (11): 115003. https://doi.org/10.1088/1361-6420/aa8cb2/meta.
Ravalec, M. L., Noetinger, B., and Hu, L. Y. 2000. The FFT Moving Average (FFT-MA) Generator: An Efficient Numerical Method for Generating and Conditioning Gaussian Simulations. Math Geol 32 (6): 701–723. https://doi.org/10.1023/A:1007542406333.
Reynolds, A. C., He, N., and Oliver, D. S. 1999. Reducing Uncertainty in Geostatistical Description With Well-Testing Pressure Data. In Reservoir Characterization–Recent Advances, ed. R. A. Schatzinger and J. F. Jordan, Chap. 10, 149–162. Tulsa: American Association of Petroleum Geologists.
Reynolds, A. C., He, N., Chu, L. et al. 1996. Reparameterization Techniques for Generating Reservoir Descriptions Conditioned to Variograms and Well-Test Pressure Data. SPE J. 1 (4): 413–426. SPE-30588-PA. https://doi.org/10.2118/30588-PA.
Roberts, G. O. and Rosenthal, J. S. 2001. Optimal Scaling of Various Metropolis-Hastings Algorithms. Statist. Sci. 16 (4): 351–367.
Roberts, G. O., Gelman, A., and Gilks, W. R. 1997. Weak Convergence and Optimal Scaling of Random Walk Metropolis Algorithm. Ann Appl Probab 7 (1): 110–120. https://www.jstor.org/stable/2245134.
Rosenthal, J. S. 2011. Optimal Proposal Distributions and Adaptive MCMC. In Handbook of Markov Chain Monte Carlo, ed. S. Brooks, A. Gelman, G. Jones, et al. Chap. 4. Boca Raton, Florida: Chapman & Hall/CRC.
Sarma, P., Durlofsky, L. J., and Aziz, K. 2008. Kernel Principal Component Analysis for Efficient, Differentiable Parameterization of Multipoint Geostatistics. Math Geosci 40 (1): 3–32. https://doi.org/10.1007/s11004-007-9131-7.
Seiler, A., Reivenæs, J. C., Aanonsen, S. I. et al. 2009. Structural Uncertainty Modelling and Updating by Production Data Integration. Presented at the SPE/EAGE Reservoir Characterization and Simulation Conference, Abu Dhabi, 19–21 October. SPE-125352-MS. https://doi.org/10.2118/125352-MS.
Sobel, E. and Lange, K. 1996. Descent Graphs in Pedigree Analysis: Applications to Haplotyping, Locations Scores, and Marker-Sharing Statistics. Am J. Hum Genet 58 (6): 1323–1337.
Tarantola, A. 2005. Inverse Problem Theory and Methods for Model Parameter Estimation. Philadelphia, Pennsylvania: Society for Industrial & Applied Mathematics.
Tavakoli, R. and Reynolds, A. C. 2010. History Matching With Parametrization Based on the SVD of a Dimensionless Sensitivity Matrix. SPE J. 15 (12): 495–508. SPE-118952-PA. https://doi.org/10.2118/118952-PA.
Tavakoli, R. and Reynolds, A. C. 2011. Monte Carlo Simulation of Permeability Fields and Reservoir Performance Predictions With SVD Parameterization in RML Compared With EnKF. Computat Geosci 15 (1): 99–116. https://doi.org/10.1007/s10596-010-9200-8.
Thulin, K., Li, G., Aanonsen, S. I. et al. 2007. Estimation of Initial Fluid Contacts by Assimilation of Production Data With EnKF. Presented at the SPE Annual Technical Conference and Exhibition, Anaheim, California, 11–14 November. SPE-109975-MS. https://doi.org/10.2118/109975-MS.
Tjelmeland, H., Omre, H., and Hegstad, B. K. 1994. Sampling From Bayesian Models in Reservoir Characterization. Technical Report Statistics No. 2/1994, Norwegian Institute of Technology, Trondheim, Norway.
van Leeuwen, P. J. and Evensen, G. 1996. Data Assimilation and Inverse Methods in Terms of a Probabilistic Formulation. Mon Weather Rev 124 (December): 2898–2913. https://doi.org/10.1175/1520-0493(1996)124%3C2898:DAAIMI%3E2.0.CO;2.
Vo, H. X. and Durlofsky, L. J. 2015. Data Assimilation and Uncertainty Assessment for Complex Geological Models Using a New PCA-Based Parameterization. Computat Geosci 19 (4): 747–767. https://doi.org/10.1007/s10596-015-9483-x.
Wang, Y., Li, G., and Reynolds, A. C. 2010. Estimation of Depths of Fluid Contacts by History Matching Using Iterative Ensemble-Kalman Smoothers. SPE J. 15 (2): 509–525. SPE-119056-PA. https://doi.org/10.2118/119056-PA.
Zafari, M. and Reynolds, A. C. 2007. Assessing the Uncertainty in Reservoir Description and Performance Predictions With the Ensemble Kalman Filter. SPE J. 12 (3): 382–391. SPE-95750-PA. https://doi.org/10.2118/95750-PA.
Zhang, F. and Reynolds, A. C. 2002. Optimization Algorithms for Automatic History Matching of Production Data. Oral presentation given at ECMOR VIII–8th European Conference on the Mathematics of Oil Recovery, Freiberg, Germany, 3–6 September.
Zhao, Y., Forouzanfar, F., and Reynolds, A. C. 2017. History Matching of Multi-Facies Channelized Reservoirs Using ES-MDA With Common Basis DCT. Computat Geosci 21 (5–6): 1343–1364. https://doi.org/10.1007/s10596-016-9604-1.