ARTFEED — Contemporary Art Intelligence

CT Foundation Models Distilled into Editable Concept Bottlenecks for Lung Nodule Malignancy Prediction

ai-technology · 2026-08-11

A new study on arXiv (2608.07857) presents a method that improves how we understand predictions made by CT foundation models by transforming them into concept bottleneck models. This approach connects two fixed representations from the CT foundation model to eight characteristics of pulmonary nodules defined by radiologists, allowing for malignancy predictions based on these attributes and the size of the nodules. The research utilized CT-FM, a self-supervised encoder for 96^3-voxel nodules, and FMCIB, a contrastive encoder for 50-mm crops, developing eight ridge-regression concept heads using 2,610 LIDC-IDRI nodules. Models were trained on LUNA25 and tested against an internal set and the external DLCS cohort, with performance evaluated through R^2 and AUROC metrics. This work aims to improve AI interpretability in medical imaging for lung nodule malignancy predictions.

Key facts

  • Paper on arXiv: 2608.07857
  • Method: Distill CT foundation models into concept bottleneck models
  • Maps two frozen CT foundation-model representations to eight radiologist-defined pulmonary-nodule attributes
  • Predicts malignancy from estimated concepts and nodule size
  • Models: CT-FM (whole-CT self-supervised encoder, 96^3-voxel patch) and FMCIB (nodule-focused contrastive encoder, 50-mm crop)
  • Eight ridge-regression concept heads trained on 2,610 LIDC-IDRI nodules
  • Malignancy models trained on LUNA25, evaluated on internal test set and external DLCS cohort
  • Evaluation metrics: five-fold cross-validated R^2 for concept fidelity, AUROC with 95% CI via patient-grouped bootstrap for malignancy discrimination

Entities

Institutions

  • arXiv
  • LIDC-IDRI
  • LUNA25
  • DLCS

Sources