切换至 "中华医学电子期刊资源库"

中华医学超声杂志(电子版) ›› 2022, Vol. 19 ›› Issue (03) : 206 -211. doi: 10.3877/cma.j.issn.1672-6448.2022.03.004

浅表器官超声影像学

基于深度学习的甲状腺结节超声图像分割的临床应用
广旸1, 何文1,(), 吴佳俊2, 赵明昌2, 张雨康1, 万芳1   
  1. 1. 100070 首都医科大学附属北京天坛医院超声科
    2. 214028 江苏无锡,无锡祥生医疗科技股份有限公司研发中心算法部
  • 收稿日期:2022-01-04 出版日期:2022-03-01
  • 通信作者: 何文
  • 基金资助:
    国家自然科学基金青年基金(81901744); 北京市自然科学基金(7204255)

Clinical application of deep learning based ultrasound segmentation of thyroid nodules

Yang Guang1, Wen He1,(), Jiajun Wu2, Mingchang Zhao2, Yukang Zhang1, Fang Wan1   

  1. 1. Department of Ultrasound, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
    2. Algorithm Department of the Research & Development Center, CHISON Medical Technologies Co., Ltd., Wuxi 214028, China
  • Received:2022-01-04 Published:2022-03-01
  • Corresponding author: Wen He
引用本文:

广旸, 何文, 吴佳俊, 赵明昌, 张雨康, 万芳. 基于深度学习的甲状腺结节超声图像分割的临床应用[J]. 中华医学超声杂志(电子版), 2022, 19(03): 206-211.

Yang Guang, Wen He, Jiajun Wu, Mingchang Zhao, Yukang Zhang, Fang Wan. Clinical application of deep learning based ultrasound segmentation of thyroid nodules[J]. Chinese Journal of Medical Ultrasound (Electronic Edition), 2022, 19(03): 206-211.

目的

探讨深度学习方法在超声甲状腺结节分割中的效果及其临床应用价值。

方法

收集2018年8月至2020年10月首都医科大学附属北京天坛医院的166例甲状腺结节患者的1044张超声图像。观察使用改进自注意力机制的Unet深度学习方法和Unet基础方法在测试数据集上的分割效果。以分割结果是否接近有多年临床经验的超声医师的手动标注作为参考标准,将改进自注意力机制的Unet和Unet基础方法对甲状腺结节的分割效果进行比较,以交并比(IoU)、戴斯(Dice)相似性系数及与超声医师对甲状腺结节的手动勾勒接近程度来评价深度学习模型对甲状腺结节分割效果及临床应用价值的性能。

结果

改进自注意力机制的Unet深度学习模型对甲状腺结节分割的IoU及Dice系数分别为0.815和0.839,与Unet基础方法结果(IoU为0.788,Dice系数为0.817)相比,具有更高的IoU和Dice系数值。从分割图像可以看出,基于改进自注意力机制的Unet深度学习模型对甲状腺结节整体和边缘细节上的分割效果好于Unet基础方法,更接近于超声医师的手动勾勒结果。

结论

基于自注意力机制的Unet深度学习模型在甲状腺结节分割方面有着较高的性能,可提高诊断效率,并且该方法具有一定的临床应用价值。

Objective

To explore the clinical application value of deep learning based ultrasonic thyroid nodule segmentation.

Methods

We selected 1044 ultrasound images of 166 thyroid patients collected from Beijing Tiantan Hospital Affiliated to Capital Medical University from August 2018 to October 2020. The segmentation effect of Unet with improved self-attention mechanism and control Unet-based method was assessed using test datasets. Whether the segmentation result is close to the manual annotation by a sonographer with many years of clinical experience was used as a reference standard, and the Unet and Unet-based methods with improved self-attention mechanism were compared for the segmentation effect of thyroid nodules, using IoU (intersection and union ratio), Dice (Dice similarity coefficient), and the degree of closeness to the manual outline of thyroid nodules by the sonographer to evaluate the performance and clinical value of the deep learning model for thyroid nodule segmentation.

Results

The IoU and Dice coefficients of thyroid nodule segmentation by Unet with improved self-attention mechanism were 0.815 and 0.839, respectively, which were higher than those of Unet (IoU=0.788, Dice=0.817). It can also be seen from the segmented images that the Unet based on the improved self-attention mechanism had a better segmentation effect on the overall and edge details of thyroid nodules than the Unet-based method, and was closer to the manual outline results of the sonographer.

Conclusion

Unet based on self-attention mechanism has good performance in thyroid nodule segmentation, which can improve the diagnostic efficiency, the method also has clinical application value.

图1 基于神经网络的深度学习方法的整体网络结构图以及模块
图2 甲状腺结节超声图像及各方法得到的甲状腺结节区域分割图像对比。图中第1列为甲状腺结节超声图像,第2列为医师给定的甲状腺结节区域标注结果,第3列为基础方法得到的甲状腺结节区域分割结果,第4列为本文提出的改进自注意力机制的Unet深度学习方法得到的甲状腺结节区域分割结果
1
Sung H, Ferlay J, Siegel RL, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries [J]. CA Cancer J Clin, 2021, 71(3):209-249.
2
Li Y, Teng D, Ba J, et al. Efficacy and safety of long-term universal salt iodization on thyroid disorders: epidemiological evidence from 31 provinces of mainland China [J]. Thyroid, 2020, 30(4): 568-579.
3
Kitahara CM, Sosa JA. The changing incidence of thyroid cancer [J]. Nat Rev Endocrinol, 2016, 12(11): 646-653.
4
Savelonas MA, Iakovidis DK, Legakis I, et al. Active contours guided by echogenicity and texture for delineation of thyroid nodules in ultrasound images [J]. IEEE Trans InfTechnol Biomed, 2009, 13(4): 519-527.
5
许敏, 韩峰, 罗晓, 等. 计算机辅助诊断系统鉴别甲状腺结节良恶性的诊断效能及其影响因素 [J/CD]. 中华医学超声杂志(电子版), 2019, 16(4): 252-256.
6
Narayan NS, Marziliano P, Kanagalingam J, et al. Speckle patch similarity for echogenicity-based multiorgan segmentation in ultrasound images of the thyroid gland [J]. IEEE J Biomed Health, 2017, 21(1): 172-183.
7
He K, Zhang X, Ren S, et al. Deep residual learning for image recognition [C]// Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA: IEEE, 2016: 770-778.
8
Szegedy C, Ioffe S, Vanhoucke V, et al. Inception-v4, Inception-ResNet and the impact of residual connections on learning [C]// Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, California, USA: AAAI, 2017: 4278-4284.
9
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation [C]// International Conference on Medical image computing and computer-assisted intervention. Springer: Cham, 2015: 234-241.
10
Isensee F, Petersen J, Kohl SAA, et al. nnU-net: breaking the spell on successful medical image segmentation [BD/OL]. arXiv: 1904.08128v1, 2019. [2021-12-20].

URL    
11
Chen J, You H, Li K. A review of thyroid gland segmentation and thyroid nodule segmentation methods for medical ultrasound images [J]. Comput Meth Prog Bio, 2020, 185: 105329.
12
Liu T, Guo Q, Lian C, et al. Automated detection and classification of thyroid nodules in ultrasound images using clinical-knowledge-guided convolutional neural networks [J]. Med Image Anal, 2019, 58: 101555.
13
Wildman-Tobriner B, Buda M, Hoang JK, et al. Using artificial intelligence to revise ACR TI-RADS risk stratification of thyroid nodules: diagnostic accuracy and utility [J]. Radiology, 2019, 292(1): 112-119.
14
倪炯, 王培军. 医学影像人工智能的现状与未来 [J]. 中华医学杂志, 2021, 101(7): 455-457.
15
王洪杰, 于霞, 高强. 基于深度学习的甲状腺结节自动识别方法在超声图像中的应用 [J]. 中国医疗设备, 2019, 34(10): 72-74, 78.
16
Choi YJ, Baek JH, Park HS, et al. A Computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of thyroid nodules on ultrasound: initial clinical assessment [J]. Thyroid, 2017, 27(4): 546-552.
17
方明娣, 彭梅, 毕玉. 人工智能S-Detect技术结合钙化特征对甲状腺结节的诊断价值 [J/OL]. 中华医学超声杂志(电子版), 2021, 18(2): 177-181.
18
Wang L, Zhang L, Zhu M, et al. Automatic diagnosis for thyroid nodules in ultrasound images by deep neural networks [J]. Med Image Anal, 2020, 61: 101665.
19
Huang Q, Luo Y, Zhang Q. Breast ultrasound image segmentation: a survey [J]. Int J Comput Ass Rad, 2017, 12(3): 493-507.
20
Akkus Z, Cai J, Boonrod A, et al. A survey of deep-learning applications in ultrasound: artificial intelligence-powered ultrasound for improving clinical workflow [J]. J Am CollRadiol. 2019, 16(9): 1318-1328.
21
Zhang H, Cisse M, Dauphin Y N, et al. mixup: Beyond empirical risk minimization [Z/OL]. arXiv:1710.09412, 2017. [2021-12-20].

URL    
22
Bochkovskiy A, Wang CY, Liao HYM. Yolov4: Optimal speed and accuracy of object detection [Z/OL]. arXiv:2004.10934, 2020. [2021-12-20].

URL    
23
Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need [Z/OL]. arXiv:1706.03762, 2017. [2021-12-20].

URL    
24
陈晨, 孙鹏飞, 郭君, 等. 人工智能在甲状腺结节良恶性中的诊断价值 [J]. 中国超声医学杂志, 2020, 36(7): 585-588.
25
王波, 李梦翔, 刘侠. 基于改进U-Net网络的甲状腺结节超声图像分割方法 [J/OL]. 电子与信息学报, doi: 10.11999/JEIT210015. (2021-06-01).

URL    
[1] 张婉微, 秦芸芸, 蔡绮哲, 林明明, 田润雨, 金姗, 吕秀章. 心肌收缩早期延长对非ST段抬高型急性冠脉综合征患者冠状动脉严重狭窄的预测价值[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1016-1022.
[2] 任书堂, 刘晓程, 张亚东, 孙佳英, 陈萍, 周建华, 龙进, 黄云洲. 左心室辅助装置支持下单纯收缩期主动脉瓣反流的超声心动图特征[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1023-1028.
[3] 何金梅, 尹立雪, 谭静, 张文军, 王锐, 任梅, 廖明娇. 超声心肌做功技术对2型糖尿病患者潜在左心室心肌收缩功能损伤的评价[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1029-1035.
[4] 薛艳玲, 马小静, 谢姝瑞, 何俊, 夏娟, 何亚峰. 左心声学造影在急性心肌梗死合并室间隔穿孔中的应用价值[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1036-1039.
[5] 吕琦, 惠品晶, 丁亚芳, 颜燕红. 颈动脉斑块易损性的超声造影评估及与缺血性卒中的相关性研究[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1040-1045.
[6] 魏淑婕, 惠品晶, 丁亚芳, 张白, 颜燕红, 周鹏, 黄亚波. 单侧颈内动脉闭塞患者行颞浅动脉-大脑中动脉搭桥术的脑血流动力学评估[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1046-1055.
[7] 武玺宁, 欧阳云淑, 张一休, 孟华, 徐钟慧, 张培培, 吕珂. 胎儿心脏超声检查在抗SSA/Ro-SSB/La抗体阳性妊娠管理中的应用[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1056-1060.
[8] 杨水华, 何桂丹, 覃桂灿, 梁蒙凤, 罗艳合, 李雪芹, 唐娟松. 胎儿孤立性完全型肺静脉异位引流的超声心动图特征及高分辨率血流联合时间-空间相关成像的应用[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1061-1067.
[9] 张璇, 马宇童, 苗玉倩, 张云, 吴士文, 党晓楚, 陈颖颖, 钟兆明, 王雪娟, 胡淼, 孙岩峰, 马秀珠, 吕发勤, 寇海燕. 超声对Duchenne肌营养不良儿童膈肌功能的评价[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1068-1073.
[10] 张宝富, 俞劲, 叶菁菁, 俞建根, 马晓辉, 刘喜旺. 先天性原发隔异位型肺静脉异位引流的超声心动图诊断[J]. 中华医学超声杂志(电子版), 2023, 20(10): 1074-1080.
[11] 丁雷, 罗文, 杨晓, 庞丽娜, 张佩蒂, 刘海静, 袁佳妮, 刘瑾. 高帧频超声造影在评价C-TIRADS 4-5类甲状腺结节成像特征中的应用[J]. 中华医学超声杂志(电子版), 2023, 20(09): 887-894.
[12] 张茜, 陈佳慧, 高雪萌, 赵傲雪, 黄瑛. 基于高帧频超声造影的影像组学特征鉴别诊断甲状腺结节良恶性的价值[J]. 中华医学超声杂志(电子版), 2023, 20(09): 895-903.
[13] 冯冰, 邹秋果, 梁振波, 卢艳明, 曾奕, 吴淑苗. 老年非特殊型浸润性乳腺癌超声征象与分子生物学指标的临床研究[J]. 中华普外科手术学杂志(电子版), 2024, 18(01): 48-51.
[14] 赵文毅, 邹冰子, 蔡冠晖, 刘永志, 温红. 超声应变力弹性成像联合MRI-DWI靶向引导穿刺在前列腺病变诊断中的应用[J]. 中华临床医师杂志(电子版), 2023, 17(9): 988-994.
[15] 薛念余, 张盛敏, 吴凌恒, 沙蕾, 童揽月, 沈崔琴, 李朝军, 杜联芳. 研究血清胆红素对2型糖尿病患者心脏结构发生改变前心肌功能的影响[J]. 中华临床医师杂志(电子版), 2023, 17(9): 1004-1009.
阅读次数
全文


摘要