Differentiable Inverse Rendering Recovers Intrinsic Properties from Intravascular Optical Coherence Tomography
Authors: Ajay Manicka, Karim Kadry, Sebastian Ruiz-Lopera, Maryam Alsharqi, Sanjana Arji, Samuel Ruiperez-Campillo, Nestor Uribe-Patarroyo, Brett E. Bouma, Farhad Nezami, Elazer R. Edelman
Abstract
Medical images encode intrinsic tissue properties that indicate disease progression, yet these properties remain entangled with the system-dependent physics of image formation. Differentiable inverse rendering asks whether they are recoverable by inverting the imaging system's forward physics rather than through post-hoc correction. We address this in optical coherence tomography (OCT), focusing on the optical attenuation coefficient, a per-pixel marker of pathology and cellular composition. Conventional recovery relies on closed-form inversions limited to simplified light-tissue models, or learned methods coupled to specific imaging configurations. We instead recover per-pixel attenuation from a single OCT image by gradient descent through a differentiable physics-based forward model. We verified the method against analytical solutions, validated it on five in vitro phantoms, and applied it without modification to 29{,}269 clinical intravascular OCT images from 128 patients. The inversion needs no training data or segmentations and is portable across platforms and retrospective archives. Replacing the forward model or recovering another optical parameter leaves the optimization procedure unchanged. We demonstrate per-pixel recovery is tractable because gradient information scales to this high-dimensional problem, where gradient-free methods become intractable. Our work supports quantitative tissue characterization from OCT images and provides a framework for extension across imaging modalities and organ systems.
The papers around it, by date and closeness
Higher is closer to this paper; left is older. Lines join papers close to each other: groups of lines are sub-topics. Select a point to see why it is there. Back to the summary of this paper
Papers around this one
Ranked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
Depth-dependent attenuation and backscattering characterization of optical coherence tomography by stationary iterative methodYa-Ning Wang, Shu-Wen Wei, J. U. Kang · 2023 · Journal of Biomedical Optics · cited 8 times · Not summarized yet
The stationary iterative method jointly estimates depth-wise attenuation and backscattering, whereas this paper recovers per-pixel attenuation through differentiable forward-model inversion.
Abstract
Abstract. Significance Extracting optical properties of tissue [e.g., the attenuation coefficient (μ) and the backscattering fraction] from the optical coherence tomography (OCT) images is a valuable tool for parametric imaging and related diagnostic applications. Previous attenuation estimation models depend on the assumption of the uniformity of the backscattering fraction (R) within layers or whole samples, which does not accurately represent real-world conditions. Aim Our aim is to develop a robust and accurate model that calculates depth-wise values of attenuation and backscattering fractions simultaneously from OCT signals. Furthermore, we aim to develop an attenuation compensation mod…
-
Tissue characterization with depth-resolved attenuation coefficient and backscatter term in intravascular optical coherence tomography imagesShengnan Liu, Y. Sotomi, J. Eggermont et al. · 2017 · Journal of Biomedical Optics · cited 57 times · Not summarized yet
The depth-resolved model estimates attenuation and a backscatter-related term per pixel in IVOCT, while this paper optimizes attenuation through a differentiable model.
Abstract
Abstract. An important application of intravascular optical coherence tomography (IVOCT) for atherosclerotic tissue analysis is using it to estimate attenuation and backscatter coefficients. This work aims at exploring the potential of the attenuation coefficient, a proposed backscatter term, and image intensities in distinguishing different atherosclerotic tissue types with a robust implementation of depth-resolved (DR) approach. Therefore, the DR model is introduced to estimate the attenuation coefficient and further extended to estimate the backscatter-related term in IVOCT images, such that values can be estimated per pixel without predefining any delineation for the estimation. In order…
-
End-to-end reconstruction of OCT optical properties and speckle-reduced structural intensity via physics-based learningJing-Lun Yu, Ya-Ning Wang, Wenhan Guo et al. · 2026 · BiOS · cited 2 times · Not summarized yet
The end-to-end network reconstructs optical-property maps and speckle-reduced OCT intensity from simulated training data, unlike this paper’s training-free gradient-based inversion.
Abstract
Inverse scattering in optical coherence tomography (OCT) seeks to recover both structural images and intrinsic tissue optical properties, including refractive index, scattering coefficient, and anisotropy. This inverse problem is challenging due to attenuation, speckle noise, and strong coupling among parameters. We propose a regularized end-to-end deep learning framework that jointly reconstructs optical parameter maps and speckle-reduced OCT structural intensity for layer visualization. Trained with Monte Carlo–simulated ground truth, our network incorporates a physics-based OCT forward model that generates predicted signals from the estimated parameters, providing physics-consistent super…
-
Improving Automated Tissue Characterization in Optical Coherence Tomography by Melding Attenuation Compensation with Deep LearningYa-Nan Niu, Max L. Olender, David Marlevi et al. · 2021 · 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI) · cited 2 times · Not summarized yet
The deep-learning classification method combines attenuation-compensated OCT images with learned tissue characterization, rather than recovering attenuation as its primary output.
Abstract
The added benefit of intravascular imaging, such as optical coherence tomography (OCT), is that lumenography is augmented by lesion micro-morphology. For intravascular image analysis, deep learning methods have achieved satisfactory performance in automatic characterization of micro-morphology and tissue distribution, but have still been restricted by inherent OCT signal attenuation. Leveraging domain knowledge, we demonstrate the benefits of melding deep learning with existing attenuation compensation approaches to achieve more accurate full atherosclerotic tissue classification in OCT images. By combining acquired OCT images with attenuation-compensated and contrast-enhanced equivalents, o…
-
QOCT-Net: A Physics-Informed Neural Network for Intravascular Optical Coherence Tomography Attenuation ImagingZheng Sun, Shuyan Wang, Ying-Sa Hou et al. · 2023 · IEEE journal of biomedical and health informatics · cited 4 times · Not summarized yet
QOCT-Net uses a trained physics-informed network and a multiple-scattering model to infer IVOCT attenuation, unlike this paper’s direct optimization through a single-scattering model.
Abstract
Intravascular optical coherence tomography (IVOCT) provides high-resolution, depth-resolved images of coronary arterial microstructure by acquiring backscattered light. Quantitative attenuation imaging is important for accurate characterization of tissue components and identification of vulnerable plaques. In this work, we proposed a deep learning method for IVOCT attenuation imaging based on the multiple scattering model of light transport. A physics-informed deep network named Quantitative OCT Network (QOCT-Net) was designed to recover pixel-level optical attenuation coefficients directly from standard IVOCT B-scan images. The network was trained and tested on simulation and in vivo datase…
-
Differentiable Imaging Meets Adaptive Neural Dropout: An Advancing Method for Transparent Object TomographyDelong Yang, Shaohui Zhang, Jia-Song Sun et al. · 2025 · Not summarized yet
The ADNN uses differentiable, physics-constrained imaging to reconstruct refractive-index distributions in optical diffraction tomography rather than attenuation in OCT.
Abstract
Label-free tomographic microscopy offers a compelling means to visualize three-dimensional (3D) refractive index (RI) distributions from two-dimensional (2D) intensity measurements. However, limited forward-model accuracy and the ill-posed nature of the inverse problem hamper artifact-free reconstructions. Meanwhile, artificial neural networks excel at modeling nonlinearities. Here, we employ a Differentiable Imaging framework that represents the 3D sample as a multi-layer neural network embedding physical constraints of light propagation. Building on this formulation, we propose a physics-guided Adaptive Dropout Neural Network (ADNN) for optical diffraction tomography (ODT), focusing on net…
-
Depth-resolved model-based reconstruction of attenuation coefficients in optical coherence tomography.Koen A. Vermeer, J. Mo, J. Weda et al. · 2013 · Biomedical Optics Express · cited 353 times · Not summarized yet
The single-scattering model reconstructs pixel-level OCT attenuation from depth profiles and phantom measurements, providing an earlier model-based approach to the property recovered here.
Abstract
We present a method, based on a single scattering model, to calculate the attenuation coefficient of each pixel in optical coherence tomography (OCT) depth profiles. Numerical simulations were used to determine the model's response to different depths and attenuation coefficients. Experiments were performed on uniform and layered phantoms with varying attenuation coefficients. They were measured by a 1300 nm OCT system and their attenuation coefficients were evaluated by our proposed method and by fitting the OCT slope as the gold standard. Both methods showed largely consistent results for the uniform phantoms. On the layered phantom, only our proposed method accurately estimated the attenu…
-
Parameter estimation of atherosclerotic tissue optical properties from three-dimensional intravascular optical coherence tomographyM. Gargesha, Ronny Shalev, D. Prabhu et al. · 2015 · Journal of Medical Imaging · cited 26 times · Not summarized yet
The study estimates attenuation and backscattered intensity of atherosclerotic tissue from clinical IVOCT pullbacks, addressing quantitative tissue optical-property recovery.
Abstract
Abstract. We developed robust, three-dimensional methods, as opposed to traditional A-line analysis, for estimating the optical properties of calcified, fibrotic, and lipid atherosclerotic plaques from in vivo coronary artery intravascular optical coherence tomography clinical pullbacks. We estimated attenuation μt and backscattered intensity I0 from small volumes of interest annotated by experts in 35 pullbacks. Some results were as follows: noise reduction filtering was desirable, parallel line (PL) methods outperformed individual line methods, root mean square error was the best goodness-of-fit, and α-trimmed PL (α-T-PL) was the best overall method. Estimates of μt were calcified (3.84±0.…
Prior work it builds on
-
Noise and bias in optical coherence tomography intensity signal decorrelationN. Uribe-Patarroyo, A. Post, Sebastián Ruiz-Lopera et al. · 2020 · OSA Continuum · cited 24 times · Not summarized yet
The study analyzes noise and bias in OCT intensity decorrelation, a different OCT measurement problem from recovering tissue attenuation.
Abstract
Functional optical coherence tomography (OCT) imaging based on the decorrelation of the intensity signal has been used extensively in angiography and is finding use in flowmetry and therapy monitoring. In this work, we present a rigorous analysis of the autocorrelation function, introduce the concepts of contrast bias, statistical bias and variability, and identify the optimal definition of the second-order autocorrelation function (ACF) g(2) to improve its estimation from limited data. We benchmark different averaging strategies in reducing statistical bias and variability. We also developed an analytical correction for the noise contributions to the decorrelation of the ACF in OCT that ext…
-
Review of methods and applications of attenuation coefficient measurements with optical coherence tomographyShuang Chang, Audrey K. Bowden · 2019 · Journal of Biomedical Optics · cited 79 times · Not summarized yet
The review surveys physical models, estimation methods, and clinical applications for extracting OCT attenuation coefficients.
Abstract
Abstract. The optical attenuation coefficient (AC), an important tissue parameter that measures how quickly incident light is attenuated when passing through a medium, has been shown to enable quantitative analysis of tissue properties from optical coherence tomography (OCT) signals. Successful extraction of this parameter would facilitate tissue differentiation and enhance the diagnostic value of OCT. In this review, we discuss the physical and mathematical basis of AC extraction from OCT data, including current approaches used in modeling light scattering in tissue and in AC estimation. We also report on demonstrated clinical applications of the AC, such as for atherosclerotic tissue chara…
-
Consensus standards for acquisition, measurement, and reporting of intravascular optical coherence tomography studies: a report from the International Working Group for Intravascular Optical Coherence Tomography Standardization and Validation.G. Tearney, E. Regar, T. Akasaka et al. · 2012 · Journal of the American College of Cardiology · cited 1,896 times · Not summarized yet
The consensus report standardizes IVOCT acquisition, measurement, and reporting, providing clinical measurement context rather than an attenuation-recovery method.
Abstract
OBJECTIVES The purpose of this document is to make the output of the International Working Group for Intravascular Optical Coherence Tomography (IWG-IVOCT) Standardization and Validation available to medical and scientific communities, through a peer-reviewed publication, in the interest of improving the diagnosis and treatment of patients with atherosclerosis, including coronary artery disease. BACKGROUND Intravascular optical coherence tomography (IVOCT) is a catheter-based modality that acquires images at a resolution of ~10 μm, enabling visualization of blood vessel wall microstructure in vivo at an unprecedented level of detail. IVOCT devices are now commercially available worldwide, th…
-
Differentiable Imaging: Progress, Challenges, and OutlookNi Chen, David J. Brady, Edmund Y. Lam · 2025 · Advanced Devices & Instrumentation · cited 21 times · Not summarized yet
The overview discusses progress and challenges in differentiable imaging, the broader framework used for this paper’s OCT inversion.
-
Intraoperative 2D/3D Image Registration via Differentiable X-ray RenderingVivek Gopalakrishnan, Neel Dey, Polina Golland · 2023 · Computer Vision and Pattern Recognition · cited 58 times · Not summarized yet
DiffPose uses differentiable physics-based X-ray rendering for self-supervised 2D/3D registration, applying differentiable inverse rendering to a different imaging task.
Abstract
Surgical decisions are informed by aligning rapid portable 2D intraoperative images (e.g. X-rays) to a high-fidelity 3D preoperative reference scan (e.g. CT). However, 2D/3D registration can often fail in practice: conventional optimization methods are prohibitively slow and suscepti-ble to local minima, while neural networks trained on small datasets fail on new patients or require impractical land-mark supervision. We present DiffPose, a self-supervised approach that leverages patient-specific simulation and differentiable physics-based rendering to achieve accurate 2D/3D registration without relying on manually labeled data. Preoperatively, a CNN is trained to regress the pose of a random…
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 16 November 2026.