Research on oil saturation prediction from well logs based on a masked self-supervised Transformer

HUANG Junjie, LI Quanhou, DUAN Ye, WANG Zihan, ZHANG Ruoyu, ZHENG Zewei

Marine Origin Petroleum Geology ›› 2026, Vol. 31 ›› Issue (3) : 264-276.

PDF(8159 KB)
ISSN 1672-9854
CN 33-1328/P
PDF(8159 KB)
Marine Origin Petroleum Geology ›› 2026, Vol. 31 ›› Issue (3) : 264-276. DOI: 10.3969/j.issn.1672-9854.2026.03.005

Research on oil saturation prediction from well logs based on a masked self-supervised Transformer

Author information +
History +

Abstract

Accurate interpretation of oil saturation (So) traditionally relies on core analysis and empirical formulas, yet this process is challenged by scarce labeled samples, missing logging curves, and significant noise in logging data. To address these issues, this paper proposes a masked self-supervised Transformer-based method for oil saturation prediction from well logs, termed MWLT-So. First, multiple conventional logging curves are thoroughly aligned and standardized, and a random masking reconstruction task is designed to enable self-supervised pretraining on a large amount of unlabeled well interval, thereby learning generalizable representations with cross-well transferability. The pretrained model is then fine-tuned on a limited number of labeled samples using a regression objective, while multi-scale positional encoding and feature fusion are incorporated to enhance long-range dependency modeling. Comparative experiments across different blocks and various logging-curve combinations demonstrate that:(1) Under both random data split and rigorous well-wise split evaluation settings, MWLT-So achieves the best performance on the primary regression task. (2) MWLT-So shows clear advantages in terms of geological profile consistency and error distribution, accurately capturing boundary transition zones and high-So plateau intervals, while effectively overcoming common deficiencies of traditional methods such as over-smoothing, overshooting, and phase lag. Its residuals are more concentrated with thinner tails, and both the median error and dispersion are lower, indicating superior accuracy and robustness. (3) In the oil-bearing/non-oil-bearing identification task based on the threshold So = 0.5, MWLT-So attains the best classification performance with the lowest false-positive and false-negative rates, confirming its capability to reduce misclassification risk in threshold-based stratification scenarios. Overall, the proposed method provides effective technical support for rapid evaluation of complex reservoirs and identification of remaining oil.

Key words

masked self-supervised learning / Transformer / MWLT-So / well logging curves / oil saturation / representation learning

Cite this article

Download Citations
HUANG Junjie , LI Quanhou , DUAN Ye , et al . Research on oil saturation prediction from well logs based on a masked self-supervised Transformer[J]. Marine Origin Petroleum Geology. 2026, 31(3): 264-276 https://doi.org/10.3969/j.issn.1672-9854.2026.03.005

References

[1]
胡睿, 李勇, 刘应天, 等. 基于CL-Trans模型的测井储层参数预测方法[J]. 物探化探计算技术, 2025, 47(3): 410-419.
HU Rui, LI Yong, LIU Yingtian, et al. Prediction method for reservoir parameters based on CL-Trans network[J]. Computing techniques for geophysical and geochemical exploration, 2025, 47(3): 410-419.
[2]
HE Kaiming, CHEN Xinlei, XIE Saining, et al. Masked autoencoders are scalable vision learners[C]//2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans: IEEE, 2022: 15979-15988.
[3]
武娟, 罗仁泽, 雷璨如, 等. 基于大语言模型的致密砂岩储层测井含水饱和度预测[J]. 天然气工业, 2024, 44(9): 77-87.
WU Juan, LUO Renze, LEI Canru, et al. Prediction of water saturation in tight sandstone reservoirs from well log data based on the Large Language Models(LLMs)[J]. Natural gas industry, 2024, 44(9): 77-87.
[4]
宋兆杰, 何吉祥, 宋宜磊, 等. 基于深度学习的页岩油生产井最终可采储量预测模型: 以吉木萨尔凹陷芦草沟组为例[J]. 非常规油气, 2025, 12(1): 95-105.
SONG Zhaojie, HE Jixiang, SONG Yilei, et al. Deep learning-based estimated ultimate recovery prediction model for production wells in shale oil reservoirs: a case study of Lucaogou Formation, Jimsar Sag[J]. Unconventional oil & gas, 2025, 12(1): 95-105.
[5]
李道伦, 查文舒, 刘旭亮, 等. 深度学习网络在非常规油气开发中的应用研究[J]. 非常规油气, 2024, 11(6): 1-7.
LI Daolun, ZHA Wenshu, LIU Xuliang, et al. Research on application of deep learning network in unconventional oil and gas development[J]. Unconventional oil & gas, 2024, 11(6): 1-7.
[6]
DEVLIN J, CHANG Mingwei, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]// Proceedings of the 2019 Conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers). Minneapolis: Association for Computational Linguistics, 2019: 4171-4186.
[7]
刘军, 钟洁, 倪振, 等. 基于机器学习的低含油饱和度砂岩储层参数预测: 以准噶尔盆地夏子街油田夏77井区下克拉玛依组为例[J]. 石油实验地质, 2024, 46(5): 1123-1134.
LIU Jun, ZHONG Jie, NI Zhen, et al. Machine learning-based prediction of low oil saturation sandstone reservoir parameters: a case study of Lower Karamay Formation in Xia 77 well block of Xiazijie Oilfield, Junggar Basin[J]. Petroleum geology & experiment, 2024, 46(5): 1123-1134.
[8]
王攀, 曹宗, 陈浩, 等. 底水油藏底水分布规律及射孔参数优化: 以周长油田延安组油藏为例[J]. 非常规油气, 2024, 11(3): 139-148.
WANG Pan, CAO Zong, CHEN Hao, et al. Research on bottom water distribution law and parameter optimization of bottom water reservoir: a case of Yan'an Formation reservoir in Zhouchang Oilfield[J]. Unconventional oil & gas, 2024, 11(3): 139-148.
[9]
张雨, 许胜利, 但玲玲. 致密砂岩油气藏地震正演模拟[J]. 非常规油气, 2024, 11(1): 29-35.
ZHANG Yu, XU Shengli, DAN Lingling. Seismic forward modeling of tight sandstone reservoir[J]. Unconventional oil & gas, 2024, 11(1): 29-35.
[10]
ZHOLOBOV V A, ROMANENKOVA E D, EGOROV S A, et al. Universal representations for well-logging data via ensembling of self-supervised models[J]. Doklady mathematics, 2024, 110(S1): S126-S136.
[11]
翟晓岩, 高刚, 李勇根, 等. 融合注意力机制的二维卷积神经网络测井曲线重构方法[J]. 石油地球物理勘探, 2023, 58(5): 1031-1041.
ZHAI Xiaoyan, GAO Gang, LI Yonggen, et al. Reconstruction method of logging curves by 2D convolutional neural network integrating attention mechanism[J]. Oil geophysical prospecting, 2023, 58(5): 1031-1041.
[12]
ZERVEAS G, JAYARAMAN S, PATEL D, et al. A transformer-based framework for multivariate time series representation learning[C]//Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. New York: Association for Computing Machinery, 2021: 2114-2124.
[13]
孙正心, 金衍, 孟翰, 等. 基于深度学习数据融合的测井数据精细表征[J]. 石油科学通报, 2025, 10(1): 75-86.
SUN Zhengxin, JIN Yan, MENG Han, et al. Fine characterization of logging data based on the deep learning data fusion[J]. Petroleum science bulletin, 2025, 10(1): 75-86.
[14]
GOHARI NEZHAD A, EMAMI NIRI M. Enhancing water saturation predictions from conventional well logs in a carbonate gas reservoir with a hybrid CNN-LSTM model[J]. Journal of petroleum exploration and production technology, 2025, 15(5): 89.
[15]
邵蓉波, 肖立志, 廖广志, 等. 基于多任务学习的测井储层参数预测方法[J]. 地球物理学报, 2022, 65(5): 1883-1895.
SHAO Rongbo, XIAO Lizhi, LIAO Guangzhi, et al. Multitask learning based reservoir parameters prediction with geophysical logs[J]. Chinese journal of geophysics, 2022, 65(5): 1883-1895.
[16]
蔡振忠, 王健, 莫涛, 等. 库车坳陷克拉苏构造带博孜段巴什基奇克组超深储层特征及成岩演化[J]. 非常规油气, 2024, 11(6): 8-16.
CAI Zhenzhong, WANG Jian, MO Tao, et al. Characteristics and diagenesis evolution of ultra-deep Bashijiqike Formation reservoir in Bozi Section of Kelasu structure belt, Kuqa Depression[J]. Unconventional oil & gas, 2024, 11(6): 8-16.
[17]
钟俊杰, 许礼龙, 刘腾宇, 等. 页岩储层纳米孔受限流体相行为研究进展[J]. 非常规油气, 2025, 12(1): 72-84.
ZHONG Junjie, XU Lilong, LIU Tengyu, et al. Research advances in nanopore confined fluid phase behavior in shale reservoirs[J]. Unconventional oil & gas, 2025, 12(1): 72-84.
[18]
EGOROV S, GEVORGYAN N, ZAYTSEV A. Self-supervised similarity models based on well-logging data[EB/OL]. (2022-09-26[2026-01-08]. https://arxiv.org/abs/2209.12444.
[19]
李祯, 郭奇, 卜亚辉, 等. 基于深度学习的饱和度场样本库建立及预测[J]. 石油学报, 2024, 45(4): 698-707.
LI Zhen, GUO Qi, BU Yahui, et al. Establishment and prediction of sample pool of saturation field based on deep learning[J]. Acta petrolei sinica, 2024, 45(4): 698-707.
[20]
ZHOU H Y, ZHANG S H, PENG J Q, et al. Informer: beyond efficient transformer for long sequence time-series forecasting[J]. Proceedings of the AAAI conference on artificial intelligence, 2021, 35(12): 11106-11115.
[21]
刘建建, 周军, 余卫东, 等. 基于超参数优化LSTM的声波测井曲线生成技术[J]. 石油物探, 2024, 63(5): 1061-1074.
LIU Jianjian, ZHOU Jun, YU Weidong, et al. Acoustic log curve reconstruction based on hyperparameter optimized LSTM[J]. Geophysical prospecting for petroleum, 2024, 63(5): 1061-1074.
[22]
高攀明, 陈峰, 谢颖, 等. 吴起油田长7页岩油层钻井液优化研究[J]. 非常规油气, 2024, 11(4): 144-151.
GAO Panming, CHEN Feng, XIE Ying, et al. Optimization of drilling fluid for Chang7 shale reservoir in Wuqi Oilfield[J]. Unconventional oil & gas, 2024, 11(4): 144-151.
[23]
华科良, 王晓超, 张志军, 等. 边水水平井开发油藏调剖效果影响研究[J]. 非常规油气, 2024, 11(2): 92-98.
HUA Keliang, WANG Xiaochao, ZHANG Zhijun, et al. Study on influencing factors of profile control effect of horizontal well development reservoir with edge water[J]. Unconventional oil & gas, 2024, 11(2): 92-98.
[24]
JI M, KWON S, PARK G, et al. Prediction of water saturation from well log data using deep learning algorithms[J]. Journal of the Korean Society of Mineral and Energy Resources Engineers, 2021, 58(3): 215-226.
[25]
SOLATORIO A V, DUPRIEZ O. REaLTabFormer: generating realistic relational and tabular data using transformers[EB/OL]. (2023-02-04) [2026-01-08]. https://arxiv.org/abs/2302.02041.
[26]
李文昊, 李刚, 高冉, 等. 基于Inception-BiGRU-Transformer的测井曲线重构[J]. 计算机系统应用, 2026, 35(1): 263-275.
LI Wenhao, LI Gang, GAO Ran, et al. Well log curve reconstruction based on Inception-BiGRU-Transformer[J]. Computer systems & applications, 2026, 35(1): 263-275.
[27]
WANG Q, TAN M J, WANG S Y, et al. Intelligent method of saturation prediction using multiscale data from digital core image, core sample, and well logs[J]. SPE Journal, 2026, 31(2): 975-992.
[28]
武中原, 张欣, 张春雷, 等. 基于LSTM循环神经网络的岩性识别方法[J]. 岩性油气藏, 2021, 33(3): 120-128.
WU Zhongyuan, ZHANG Xin, ZHANG Chunlei, et al. Lithology identification based on LSTM recurrent neural network[J]. Lithologic reservoirs, 2021, 33(3): 120-128.
PDF(8159 KB)

Accesses

Citation

Detail

Sections
Recommended

/