切换至 "中华医学电子期刊资源库"

中华医学超声杂志(电子版) ›› 2024, Vol. 21 ›› Issue (06) : 563 -570. doi: 10.3877/cma.j.issn.1672-6448.2024.06.003

浅表器官超声影像学

基于深度学习的乳腺超声应变弹性图像生成模型的应用研究
李洋1, 蔡金玉2, 党晓智1, 常婉英1, 巨艳1, 高毅2, 宋宏萍1,()   
  1. 1. 710032 西安,空军军医大学第一附属医院(西京医院)超声医学科
    2. 518073 深圳大学医学部生物医学工程学院
  • 收稿日期:2024-03-18 出版日期:2024-06-01
  • 通信作者: 宋宏萍
  • 基金资助:
    国家自然科学基金面上项目(82071934); 陕西省科技计划项目国合重点项目(2020KWZ-022); 陕西省高等教育教学改革研究重点项目(21JZ009); 空军军医大学临床研究项目(2021LC2210)

Application value of a deep learning-based model for generating strain elastography images using breast grayscale ultrasound images

Yang Li1, Jinyu Cai2, Xiaozhi Dang1, Wanying Chang1, Yan Ju1, Yi Gao2, Hongping Song1,()   

  1. 1. Department of Ultrasound, Xijing Hospital, the First Affiliated Hospital of Air Force Medical University, Xi'an 710032, China
    2. Department of Biomedical Engineering, School of Medicine, Shenzhen University, Shenzhen 518073, China
  • Received:2024-03-18 Published:2024-06-01
  • Corresponding author: Hongping Song
引用本文:

李洋, 蔡金玉, 党晓智, 常婉英, 巨艳, 高毅, 宋宏萍. 基于深度学习的乳腺超声应变弹性图像生成模型的应用研究[J/OL]. 中华医学超声杂志(电子版), 2024, 21(06): 563-570.

Yang Li, Jinyu Cai, Xiaozhi Dang, Wanying Chang, Yan Ju, Yi Gao, Hongping Song. Application value of a deep learning-based model for generating strain elastography images using breast grayscale ultrasound images[J/OL]. Chinese Journal of Medical Ultrasound (Electronic Edition), 2024, 21(06): 563-570.

目的

探讨基于深度学习模型生成乳腺超声应变弹性图像的应用价值。

方法

回顾性收集2019年5月至2022年6月在西京医院行乳腺超声检查的患者的超声图像共1336组,在神经网络中生成对抗网络(GAN)的基础上构建深度学习生成模型,使用训练集882组和验证集354组图像进行模型的训练和调整,另外100组测试集图像使用模型生成弹性图像,比较真实弹性图像和生成弹性图像的相似度。选取4位不同年资医师(高低年资医师各2名)比较两种弹性图像的差异。应用归一化互相关(NCC)值评价两种弹性图像的相似程度,并进行阅片医师真实性评分;基于Tsukuba 5分弹性评分标准,应用Kappa检验比较4位医师弹性评分的一致性,绘制ROC曲线评估不同医师分别结合两种弹性图像应用BI-RADS分类诊断乳腺病灶良恶性的效能。

结果

测试集中两种弹性图像相似度的NCC平均值为0.70±0.08,中位数0.70,范围0.50~0.86。真实性评价所有医师得分为0.49,低年资医师得分0.45,高年资医师得分0.53,均接近0.50。比较4位医师弹性评分的一致性Kappa值,生成图像高于真实图像(Kappa值:0.61 vs 0.57)。每位医师分别结合两种弹性图像应用BI-RADS分类的ROC曲线下面积差异无统计学意义(P>0.05),除1名高年资医师的特异度(P=0.0196)和阳性预测值(P=0.021)外,所有医师的敏感度、特异度、阳性预测值、阴性预测值结果差异均无统计学意义(P均>0.05)。

结论

基于深度学习构建的乳腺超声应变弹性图像生成模型,能够生成与真实弹性图像相似的弹性图像,并且生成图像在辅助诊断方面达到了与真实图像相近的临床价值。

Objective

To explore the application value of a deep learning-based model for generating strain elastography images using breast grayscale ultrasound images.

Methods

A total of 1336 sets of ultrasound images of patients who underwent breast ultrasound examination at Xijing Hospital from May 2019 to June 2022 were retrospectively collected. A deep learning-based model for generating strain elastography images was constructed on the basis of generative adversarial network (GAN) in neural network. Then, 882 sets of images from the training set and 354 sets of images from the validation set were used to train and adjust the model, and 100 sets of images from the test set were additionally used to generate strain elastography images. The similarity was compared between the real elastography images and the generated elastography images. Four physicians of different seniority (2 senior and 2 junior) were selected to compare the differences between the two kinds of elastography images. Normalized cross-correlation (NCC) values were used to evaluate the similarity of the two kinds of elastography images and the authenticity score of reading physicians was obtained. Based on the Tsukuba's 5-point elastography scoring scale, Kappa test was applied to test the consistency of elastography scores of the four physicians. Receiver operating characteristic (ROC) curves were plotted to evaluate the performance of breast imaging reporting and data system (BI-RADS) classification in the diagnosis of benign and malignant breast lesions by different physicians based on the two kinds of elastography images.

Results

The average NCC value for the similarity of the two kinds of elastography images in the test set was (0.70±0.08), with a median of 0.70 (range: 0.50 to 0.86). The average authenticity score of all the physicians was 0.49, with an average score of 0.45 for junior doctors and 0.53 for senior doctors, all of which were close to 0.50. The Kappa value of elastography scores of the four physicians was higher in the generated elastography image group than in the real elastography image group (Kappa values: 0.61 vs 0.57). There was no statistically significant difference in the area under ROC curve for each physician applying BI-RADS classification based on the two kinds of elastography images (P>0.05). Except for the specificity (P=0.0196) and positive predictive value (P=0.021) of one senior physician, there were no statistically significant differences in sensitivity, specificity, positive predictive value, or negative predictive value among other physicians (P>0.05).

Conclusion

The constructed deep learning-based model for generating strain elastography images using breast grayscale ultrasound images can generate elastography images similar to real elastography images, and the generated elastography images is comparable to real elastography in terms of diagnostic assistance.

图1 B模态和E模态图像的获取
图2 特征数据和标签数据图像。图a为特征数据:B模态;图b,c为标签数据:E模态和映射后E模态
图3 弹性图像生成模型的结构示意图。图像预处理后,将B模态图像输入模型中,通过Transformer和UNet网络,输出生成的映射后E模态图像和E模态图像,判别器分别识别E模态和映射后E模态的真假。两部分在训练中不断地竞争,最终二者达到动态平衡,模型训练完成。测试阶段,由生成器生成最终结果
图4 阅片实验示意图
图5 归一化互相关(NCC)计算公式。R为NCC计算后的输出匹配值,S为真实图像,MN为真实图像尺寸,E(Si, j)为(i, j)处子图的平均灰度值,T为生成图像,st为生成图像尺寸,E(T )为生成图像的平均灰度值。公式中分子是某点灰度值减去平均灰度值的求和,分母是两幅图像灰度标准偏差的乘积
表1 图像一般特征和病灶病理结果
图6 乳腺病灶灰阶超声图像和两种弹性图像。图a、d为灰阶图像,图b、e为真实弹性图像,图c、f为生成弹性图像;图a~c为良性病灶,归一化互相关(NCC)值为0.50;图d~f为恶性病灶,NCC值为0.86
表2 每位医师分别结合两种弹性图像应用BI-RADS分类诊断病灶良恶性的AUC值比较
表3 每位医师分别结合两种弹性图像应用BI-RADS分类的诊断效能比较(%)
1
Sung H, Ferlay J, Slegel RL, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA Cancer J Clin, 2021, 71(3): 209-249.
2
沈松杰, 孙强, 黄欣, 等. 中国女性乳腺癌筛查指南(2022年版)[J]. 中国研究型医院, 2022, 9(2): 6-13.
3
Zhi H, Xiao XY, Ou B, et al. Could ultrasonic elastography help the diagnosis of small (≤2 cm) breast cancer with the usage of sonographic BI-RADS classification? [J]. Eur J Radiol, 2012, 81(11): 3216-3221.
4
Berg WA, Cosgrove DO, Dore CJ, et al. Shear-wave elastography improves the specificity of breast US: the BE1 multinational study of 939 masses[J]. Radiology, 2012, 262: 435-449.
5
Wang TH, Lei Y, Fu YB, et al. A review on medical imaging synthesis using deep learning and its clinical applications[J]. J Appl Clin Med Phys, 2021, 22(1): 11-36.
6
American College of Radiology. Breast Imaging Reporting and Data System(BI-RADS). Ultrasound [M]. 5th ed. Reston, VA: American College of Radiology, 2013: 221-362.
7
朱庆莉, 姜玉新. 乳腺影像报告与数据系统指南(第5版)超声内容更新介绍[J/CD]. 中华医学超声杂志(电子版), 2016, 13(1): 5-7.
8
Yi X, Walia E, Babyn P. Generative adversarial network in medical imaging: A review[J]. Med Image Anal, 2019, 58: 101552.
9
Chen X, Wang X, Zhang K, et al. Recent advances and clinical applications of deep learning in medical image analysis[J]. Med Image Anal, 2022, 79: 102444.
10
Barr RG, Nakashima K, Amy D, et al. WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 2: breast[J]. Ultrasound Med Biol, 2015, 41(5): 1148-1160.
11
Jin CB, Kin H, Liu M, et al. Deep CT to MR synthesis using paired and unpaired data[J/OL]. Sensors, 2019, 19(10): 2361.
12
Han X. MR-based synthetic CT generation using a deep convolutional neural network method[J]. Med Phys, 2017, 44(4): 1408-1419.
13
Wildeboer RR, van Sloun RJG, Mannaerts CK, et al. Synthetic elastography using B-Mode ultrasound through a deep fully-convolutional neural network[J]. IEEE Trans Ultrason Ferroelectr Freq Control, 2020, 67(12): 2640-2648.
14
Yao Z, Luo T, Dong YJ, et al. Virtual elastography ultrasound via generative adversarial network for breast cancer diagnosis[J]. Nat Commun, 2023, 14(1): 788.
[1] 章建全, 程杰, 陈红琼, 闫磊. 采用ACR-TIRADS评估甲状腺消融区的调查研究[J/OL]. 中华医学超声杂志(电子版), 2024, 21(10): 966-971.
[2] 罗辉, 方晔. 品管圈在提高甲状腺结节细针穿刺检出率中的应用[J/OL]. 中华医学超声杂志(电子版), 2024, 21(10): 972-977.
[3] 杨忠, 时敬业, 邓学东, 姜纬, 殷林亮, 潘琦, 梁泓, 马建芳, 王珍奇, 张俊, 董姗姗. 产前超声在胎儿22q11.2 微缺失综合征中的应用价值[J/OL]. 中华医学超声杂志(电子版), 2024, 21(09): 852-858.
[4] 孙佳丽, 金琳, 沈崔琴, 陈晴晴, 林艳萍, 李朝军, 徐栋. 机器人辅助超声引导下经皮穿刺的体外实验研究[J/OL]. 中华医学超声杂志(电子版), 2024, 21(09): 884-889.
[5] 史学兵, 谢迎东, 谢霓, 徐超丽, 杨斌, 孙帼. 声辐射力弹性成像对不可切除肝细胞癌门静脉癌栓患者放射治疗效果的评价[J/OL]. 中华医学超声杂志(电子版), 2024, 21(08): 778-784.
[6] 洪玮, 叶细容, 刘枝红, 杨银凤, 吕志红. 超声影像组学联合临床病理特征预测乳腺癌新辅助化疗完全病理缓解的价值[J/OL]. 中华医学超声杂志(电子版), 2024, 21(06): 571-579.
[7] 周荷妹, 金杰, 叶建东, 夏之一, 王进进, 丁宁. 罕见成人肋骨郎格汉斯细胞组织细胞增生症被误诊为乳腺癌术后骨转移一例[J/OL]. 中华乳腺病杂志(电子版), 2024, 18(06): 380-383.
[8] 韩萌萌, 冯雪园, 马宁. 乳腺癌改良根治术后桡神经损伤1例[J/OL]. 中华普外科手术学杂志(电子版), 2025, 19(01): 117-118.
[9] 高杰红, 黎平平, 齐婧, 代引海. ETFA和CD34在乳腺癌中的表达及与临床病理参数和预后的关系研究[J/OL]. 中华普外科手术学杂志(电子版), 2025, 19(01): 64-67.
[10] 张志兆, 王睿, 郜苹苹, 王成方, 王成, 齐晓伟. DNMT3B与乳腺癌预后的关系及其生物学机制[J/OL]. 中华普外科手术学杂志(电子版), 2024, 18(06): 624-629.
[11] 熊鹰, 林敬莱, 白奇, 郭剑明, 王烁. 肾癌自动化病理诊断:AI离临床还有多远?[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(06): 535-540.
[12] 李伟, 宋子健, 赖衍成, 周睿, 吴涵, 邓龙昕, 陈锐. 人工智能应用于前列腺癌患者预后预测的研究现状及展望[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(06): 541-546.
[13] 黄俊龙, 李文双, 李晓阳, 刘柏隆, 陈逸龙, 丘惠平, 周祥福. 基于盆底彩超的人工智能模型在女性压力性尿失禁分度诊断中的应用[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2024, 18(06): 597-605.
[14] 张琛, 秦鸣, 董娟, 陈玉龙. 超声检查对儿童肠扭转缺血性改变的诊断价值[J/OL]. 中华消化病与影像杂志(电子版), 2024, 14(06): 565-568.
[15] 孙铭远, 褚恒, 徐海滨, 张哲. 人工智能应用于多发性肺结节诊断的研究进展[J/OL]. 中华临床医师杂志(电子版), 2024, 18(08): 785-790.
阅读次数
全文


摘要


AI


AI小编
你好!我是《中华医学电子期刊资源库》AI小编,有什么可以帮您的吗?