切换至 "中华医学电子期刊资源库"

中华医学超声杂志(电子版) ›› 2026, Vol. 23 ›› Issue (01) : 30 -39. doi: 10.3877/cma.j.issn.1672-6448.2026.01.005

浅表器官超声影像学

基于多模态融合特征的甲状腺乳头状癌中央区淋巴结转移预测模型的构建
殷信宇1, 孟雪勤2,4, 张凯2,4, 陈嘉莹3,4, 陈建刚1, 李佳伟2,4,()   
  1. 1 200241 上海,华东师范大学通信与电子工程学院
    2 200032 上海,复旦大学附属肿瘤医院超声科
    3 200032 上海,复旦大学附属肿瘤医院头颈外科
    4 200032 上海,复旦大学上海医学院肿瘤学系
  • 收稿日期:2025-10-13 出版日期:2026-01-01
  • 通信作者: 李佳伟

A multimodal fusion feature-based predictive model for central compartment lymph node metastasis in papillary thyroid carcinoma

Xinyu Yin1, Xueqin Meng2,4, Kai Zhang2,4, Jiaying Chen3,4, Jiangang Chen1, Jiawei Li2,4,()   

  1. 1 School of Communication and Electronic Engineering, East China Normal University, Shanghai 200241, China
    2 Department of Ultrasound, Fudan University Shanghai Cancer Center, Shanghai 200032, China
    3 Department of Head and Neck Surgery, Fudan University Shanghai Cancer Center, Shanghai 200032, China
    4 Department of Oncology, Shanghai Medical College, Fudan University, Shanghai 200032, China
  • Received:2025-10-13 Published:2026-01-01
  • Corresponding author: Jiawei Li
引用本文:

殷信宇, 孟雪勤, 张凯, 陈嘉莹, 陈建刚, 李佳伟. 基于多模态融合特征的甲状腺乳头状癌中央区淋巴结转移预测模型的构建[J/OL]. 中华医学超声杂志(电子版), 2026, 23(01): 30-39.

Xinyu Yin, Xueqin Meng, Kai Zhang, Jiaying Chen, Jiangang Chen, Jiawei Li. A multimodal fusion feature-based predictive model for central compartment lymph node metastasis in papillary thyroid carcinoma[J/OL]. Chinese Journal of Medical Ultrasound (Electronic Edition), 2026, 23(01): 30-39.

目的

本研究旨在基于超声影像组学特征、深度学习特征及临床特征,构建术前预测甲状腺乳头状癌(PTC)患者中央区颈部淋巴结转移(CLNM)的融合模型,并评价其性能。

方法

回顾性分析了2020年12月至2023年3月期间在复旦大学附属肿瘤医院接受手术治疗并经病理证实的510例PTC患者。所有患者术前均接受超声引导下细针穿刺活检。术后病理结果显示,387例患者CLNM为阴性,123例患者为阳性。由经验丰富的超声医师在灰阶超声图像上手工勾画病灶感兴趣区域。采用Pyradiomics提取影像组学特征,利用预训练的 VGG16-BN 模型提取深度学习特征。通过特征筛选与降维获得最终影像组学与深度学习特征,并结合临床特征构建融合特征集。所有病例按4∶1比例划分为训练集与独立测试集,训练阶段采用五折交叉验证进行模型构建与参数优化,最终基于支持向量机(SVM)建立预测模型。模型性能在独立测试集中评估,并计算ROC曲线下面积(AUC)及其95%置信区间。

结果

ROC曲线结果显示,仅影像组学模型的判别能力最弱(AUC=0.63),仅深度学习模型性能显著提升(AUC=0.91),深度学习联合影像组学的双模态融合模型进一步提高(AUC=0.92),全特征融合模型(影像组学+深度学习+临床特征)取得最优交叉验证性能(AUC=0.93)。在独立测试集中,三模态融合模型的AUC为0.962(95%置信区间:0.915~0.994),特异度为 0.987(95%置信区间:0.931~0.999),敏感度为0.583(95%置信区间:0.366~0.779),显示出较好的整体判别能力及较高的阴性排除能力。

结论

融合超声影像组学、深度学习特征及临床危险因素构建的多模态预测模型能够有效提高PTC患者CLNM的术前风险评估能力,具有潜在的临床辅助决策价值,其泛化性能仍需在多中心、大样本研究中进一步验证。

Objective

To develop a preoperative predictive model for central compartment lymph node metastasis (CLNM) in papillary thyroid carcinoma (PTC) by integrating ultrasound radiomics features, deep learning features, and clinical characteristics and to evaluate its performance.

Methods

A retrospective analysis was conducted on 510 pathologically confirmed PTC patients who underwent surgical treatment at Fudan University Shanghai Cancer Center between December 2020 and March 2023. All patients received ultrasound-guided fine-needle aspiration biopsy preoperatively. Postoperative pathology identified 387 CLNM-negative and 123 CLNM-positive cases. Regions of interest were manually delineated on grayscale ultrasound images by experienced radiologists. Radiomics features were extracted using Pyradiomics, and deep learning features were obtained via a pretrained VGG16-BN model. After feature selection and dimensionality reduction, the final radiomics and deep learning features were combined with clinical features to construct a multimodal feature set. All cases were split into training and independent test sets at a 4∶1 ratio. Five-fold cross-validation was applied during training for model construction and hyperparameter optimization, and a support vector machine (SVM)-based predictive model was established. Model performance was evaluated on the independent test set using the area under the receiver operating characteristic curve (AUC) and its 95% confidence interval (CI).

Results

ROC curve analysis showed that the discriminative ability of the radiomics-only model was the weakest (AUC=0.63), while the performance of the deep learning-only model was significantly improved (AUC=0.91). The bimodal fusion model combining deep learning and radiomics further enhanced the performance (AUC=0.92), and the full-feature fusion model (radiomics + deep learning + clinical features) achieved the best cross-validation performance (AUC=0.93). On the independent test set, the trimodal fusion model achieved an AUC of 0.962 (95%CI: 0.915-0.994), a specificity of 0.987 (95%CI: 0.931-0.999), and a sensitivity of 0.583 (95%CI: 0.366-0.779), demonstrating strong overall discriminative ability and high negative exclusion capability.

Conclusion

The multimodal predictive model integrating ultrasound radiomics, deep learning features, and clinical risk factors effectively enhances preoperative risk stratification for CLNM in PTC patients, offering potential clinical decision-support value. Its generalizability warrants further validation in multicenter, large-sample studies.

图1 数据集的划分 注:CLNM为中央区颈部淋巴结转移
图2 基于影像组学特征的不同机器学习模型在测试集上的ROC曲线 注:Logistic Regression为逻辑回归;SVM为支持向量机;Random Forest为随机森林;ExtraTrees为极端随机树;XGBoost为极端梯度提升;LightGBM为轻量梯度提升机;MLP为多层感知器;KNN为k近邻算法;AUC为ROC曲线下面积
表1 基于深度学习特征的不同机器学习模型在测试集上的性能比较
图3 基于支持向量机(SVM)的单模态与融合模型在五折交叉验证上的平均ROC曲线 注:DL-Radiomics为深度学习特征+影像组学特征;DL-only为仅深度学习特征;Radiomics-only为仅影像组学特征;AUC为ROC曲线下面积
图4 深度学习模型的Grad-CAM可解释性热图。图a~d分别为真阳性(TP)、真阴性(TN)、假阳性(FP)、假阴性(FN)四类代表性病例,Grad-CAM热图叠加于超声图像,颜色由冷到暖表示对模型输出贡献由低到高。图a、b的热图均呈现集中、高亮的红色响应区域,模型关注点位于结节内部或边缘,与病灶区域高度重合,提示模型在正确预测时能够有效定位到与诊断相关的影像区域;图c虽存在局灶性高响应,但响应范围偏大且向病灶外扩散,提示模型可能受到病灶周围背景噪声干扰而过度激活;图d整体响应分散、无明显集中区域,提示模型未能捕捉到该病例的关键判别特征,是导致漏诊的可能原因之一
表2 CLNM阳性与阴性病例Grad-CAM热图定量指标的组间差异[MQ1Q3)]
表3 中央区颈部淋巴结转移的单因素分析结果
表4 中央区颈部淋巴结转移的多因素Logistic回归分析结果
图5 基于支持向量机(SVM)的不同特征组合融合模型在五折交叉验证上的ROC曲线 注:DL-Radiomics为纳入深度学习特征+影像组学特征;AllFeatures为纳入深度学习特征+影像组学特征+全部临床特征;AllFeatures-w/o Ca为纳入深度学习特征+影像组学特征+年龄≥50岁+垂直位生长(不含钙化);AllFeatures-w/Ca为纳入深度学习特征+影像组学特征+年龄≥50岁+垂直位生长+钙化
表5 基于SVM的不同特征组合融合模型的五折交叉验证性能比较
1
Siegel RL, Miller KD, Wagle NS, et al. Cancer statistics, 2023[J]. CA Cancer J Clin, 2023, 73(3): 233-254.
2
Lim H, Devesa SS, Sosa JA, et al. Trends in thyroid cancer incidence and mortality in the United States, 1974-2013[J]. JAMA, 2017, 317(13): 1338-1348.
3
Randolph GW, Duh QY, Heller KS, et al. The prognostic significance of nodal metastases from papillary thyroid carcinoma can be stratified based on the size and number of metastatic lymph nodes, as well as the presence of extranodal extension[J]. Thyroid, 2012, 22(11): 1144-1152.
4
Ito Y, Miyauchi A, Kihara M, et al. Patient age is significantly related to the progression of papillary microcarcinoma of the thyroid under observation[J]. Thyroid, 2014, 24(1): 27-34.
5
Choi JS, Kim J, Kwak JY, et al. Preoperative staging of papillary thyroid carcinoma: comparison of ultrasound imaging and CT[J]. AJR Am J Roentgenol, 2009, 193(3): 871-878.
6
Kwak JY, Han KH, Yoon JH, et al. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk[J]. Radiology, 2011, 260(3): 892-899.
7
Cibas ES, Ali SZ. The 2017 Bethesda system for reporting thyroid cytopathology[J]. Thyroid, 2017, 27(11): 1341-1346.
8
Alexander EK, Kennedy GC, Baloch ZW, et al. Preoperative diagnosis of benign thyroid nodules with indeterminate cytology[J]. N Engl J Med, 2012, 367(8): 705-715.
9
Meng X, Hou R, Zhang M, et al. Histopathological findings of 687 thyroid nodules, suspicious for malignancy on ultrasound, with an indeterminate cytopathological diagnosis after the combination of the Bethesda system and BRAF mutation status[J]. Cytojournal, 2025, 22: 1.
10
Tessler FN, Middleton WD, Grant EG, et al. ACR Thyroid Imaging, Reporting and Data System (TI-RADS): white paper of the ACR TI-RADS Committee[J]. J Am Coll Radiol, 2017, 14(5): 587-595.
11
Kwak JY, Jung I, Baek JH, et al. Image reporting and characterization system for ultrasound features of thyroid nodules: multicentric Korean retrospective study[J]. Korean J Radiol, 2013, 14(1): 110-117.
12
Ali SZ, Baloch ZW, Cochand-Priollet B, et al. The 2023 Bethesda system for reporting thyroid cytopathology[J]. Thyroid, 2023, 33(9): 1039-1044.
13
Zwanenburg A, Vallières M, Abdalah MA, et al. The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping[J]. Radiology, 2020, 295(2): 328-338.
14
Lundberg SM, Lee SI. A unified approach to interpreting model predictions[J]. Adv Neural Inf Process Syst, 2017, 30: 4765-4774.
15
Jolliffe IT, Cadima J. Principal component analysis: a review and recent developments[J]. Philos Trans A Math Phys Eng Sci, 2016, 374(2065): 20150202.
16
Zhou H, Jin Y, Dai L, et al. Differential diagnosis of benign and malignant thyroid nodules using deep learning radiomics of thyroid ultrasound images[J]. Eur J Radiol, 2020, 127: 108992.
17
Huang G, Liu Z, Van Der Maaten L, et al. Densely connected convolutional networks[DB/OL].(2018-01-28)[2025-10-13].
18
Feng JW, Liu SQ, Qi GF, et al. Development and validation of clinical-radiomics nomogram for preoperative prediction of central lymph node metastasis in papillary thyroid carcinoma[J]. Acad Radiol, 2024, 31(6): 2292-2305.
19
Gao L, Wen X, Yue G, et al. The predictive value of a nomogram based on ultrasound radiomics, clinical factors, and enhanced ultrasound features for central lymph node metastasis in papillary thyroid microcarcinoma[J]. Ultrason Imaging, 2025, 47(2): 93-103.
20
Zhou SC, Liu TT, Zhou J, et al. An ultrasound radiomics nomogram for preoperative prediction of central neck lymph node metastasis in papillary thyroid carcinoma[J]. Front Oncol, 2020, 10: 1591.
21
Gao Y, Wang W, Yang Y, et al. An integrated model incorporating deep learning, hand-crafted radiomics and clinical and US features to diagnose central lymph node metastasis in patients with papillary thyroid cancer[J]. BMC Cancer, 2024, 24(1): 69.
[1] 莫遵玉, 赖莉萍, 李水平, 葛肖艳. 基于多种超声参数构建乳腺癌高负荷腋窝淋巴结转移的预测模型[J/OL]. 中华乳腺病杂志(电子版), 2026, 20(02): 82-90.
[2] 黎钰敏, 朱晓旭, 陈子昂, 谢晓娜, 张金丽, 张志. 高频超声联合剪切波弹性成像在增生性瘢痕厚度与硬度评估中的应用价值[J/OL]. 中华损伤与修复杂志(电子版), 2026, 21(02): 90-96.
[3] 杨国涛, 毛华杰, 陈志军, 陈金亮, 车军, 江起庭. 超声辅助定位经皮通道松解对慢性腕管综合征的临床疗效分析[J/OL]. 中华损伤与修复杂志(电子版), 2026, 21(02): 97-101.
[4] 李婷, 郭超, 李晨曦, 李柔演, 张一涵, 张雨晗, 陈琰, 斯琴高娃, 龚忠诚. 基于深度学习的上颌阻生尖牙自动分割与体积量化研究[J/OL]. 中华口腔医学研究杂志(电子版), 2026, 20(01): 9-16.
[5] 梅昊楠, 杨瑞, 刘修恒. 人工智能辅助病理学图像分析在前列腺癌诊断中的研究进展[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(01): 1-7.
[6] 蒋钟吉, 郭洪, 王东文. 近红外显影技术在前列腺癌淋巴组织显影及病理评估中的应用[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(01): 8-14.
[7] 邓玉飞, 王志鑫, 娄珂, 张林轩, 马桂春, 港措. 影像组学在肝癌精准诊断、疗效评估及治疗方案决策优化中应用[J/OL]. 中华肝脏外科手术学电子杂志, 2026, 15(02): 172-180.
[8] 东小鸽, 樊海宁, 侯立朝, 杜凯豪, 刘海刚, 汪占金, 薛伟伟, 石亚超, 魏六木, 王展. 三维可视化技术、ICG荧光示踪和术中实时超声在肝癌个性化精准诊疗中应用[J/OL]. 中华肝脏外科手术学电子杂志, 2026, 15(02): 181-189.
[9] 陈小坤, 杜顺达. 影像组学在肝细胞癌中的应用进展及挑战[J/OL]. 中华消化病与影像杂志(电子版), 2026, 16(02): 97-100.
[10] 侯芳红, 贺修宝. 超声介导的雷公藤甲素外泌体靶向给药系统抗结直肠癌的应用评估[J/OL]. 中华消化病与影像杂志(电子版), 2026, 16(01): 13-20.
[11] 李广飞, 李振涛, 刘宝, 胥明婧, 年梦雨. 超声剪切波弹性成像在直肠癌诊断及淋巴结转移评估中的应用研究[J/OL]. 中华消化病与影像杂志(电子版), 2026, 16(01): 21-25.
[12] 王悦扬, 蔡雁. 孕前子宫肌瘤患者高强度超声聚焦治疗后的妊娠结局[J/OL]. 中华产科急救电子杂志, 2026, 15(01): 38-42.
[13] 汪艺宸, 陈涛, 周嘉璇, 李新春, 万齐. 中国肺癌磁共振成像从功能性成像到影像组学的诊断演进[J/OL]. 中华诊断学电子杂志, 2026, 14(01): 38-43.
[14] 钱海舟, 张珊珊, 殷琳玲, 吴智强, 汪露, 杨欢. 经颅多普勒超声在急性前循环大血管闭塞性脑梗死机械取栓后的应用价值[J/OL]. 中华脑血管病杂志(电子版), 2026, 20(01): 61-67.
[15] 李媛媛, 马欣, 董静. 缺血性脑血管病患者卵圆孔未闭多模态影像学诊断的研究进展[J/OL]. 中华脑血管病杂志(电子版), 2026, 20(01): 101-106.
阅读次数
全文


摘要


AI


AI小编
你好!我是《中华医学电子期刊资源库》AI小编,有什么可以帮您的吗?