Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

One of the indicators of early lung cancer is a color change in airway mucosa. Bronchoscopy of the major airways can provide high-resolution color video of the airway tree's mucosal surfaces. In addition, 3D MDCT chest images provide 3D structural information of the airways. Unfortunately, the bronchoscopic video contains no explicit 3D structural and position information, and the 3D MDCT data captures no color or textural information of the mucosa. A fusion of the topographical information from the 3D CT data and the color information from the bronchoscopic video, however, enables realistic 3D visualization, navigation, localization, and quantitative color-topographic analysis of the airways. This paper presents a method for topographic airway-mucosal surface mapping from bronchoscopic video onto 3D MDCT endoluminal views. The method uses registered video images and CT-based virtual endoscopic renderings of the airways. The visibility and depth data are also generated by the renderings. Uniform sampling and over-scanning of the visible triangles are done before they are packed into a texture space. The texels are then re-projected onto video images and assigned color values based on depth and illumination data obtained from renderings. The texture map is loaded into the rendering engine to enable real-time navigation through the combined 3D CT surface and bronchoscopic video data. Tests were performed on pre-recorded bronchoscopy patient video and associated 3D MDCT scans. Results show that we can effectively accomplish mapping over a continuous sequence of airway images spanning several generations of airways.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2006
Subtitle of host publicationVisualization, Image-Guided Procedures, and Display
DOIs
StatePublished - Jun 30 2006
EventMedical Imaging 2006: Visualization, Image-Guided Procedures, and Display - San Diego, CA, United States
Duration: Feb 12 2006Feb 14 2006

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume6141
ISSN (Print)1605-7422

Other

OtherMedical Imaging 2006: Visualization, Image-Guided Procedures, and Display
CountryUnited States
CitySan Diego, CA
Period2/12/062/14/06

Fingerprint

Color
Navigation
Textures
Rendering (computer graphics)
Visibility
Data acquisition
Fusion reactions
Visualization
Lighting
Sampling
Engines
Scanning
Mucous Membrane

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging

Cite this

Rai, L., & Higgins, W. E. (2006). Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views. In Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display [614103] (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 6141). https://doi.org/10.1117/12.651717
Rai, Lav ; Higgins, William Evan. / Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views. Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display. 2006. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE).
@inproceedings{d383cbaa7c8640f0ba6c171b1585f204,
title = "Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views",
abstract = "One of the indicators of early lung cancer is a color change in airway mucosa. Bronchoscopy of the major airways can provide high-resolution color video of the airway tree's mucosal surfaces. In addition, 3D MDCT chest images provide 3D structural information of the airways. Unfortunately, the bronchoscopic video contains no explicit 3D structural and position information, and the 3D MDCT data captures no color or textural information of the mucosa. A fusion of the topographical information from the 3D CT data and the color information from the bronchoscopic video, however, enables realistic 3D visualization, navigation, localization, and quantitative color-topographic analysis of the airways. This paper presents a method for topographic airway-mucosal surface mapping from bronchoscopic video onto 3D MDCT endoluminal views. The method uses registered video images and CT-based virtual endoscopic renderings of the airways. The visibility and depth data are also generated by the renderings. Uniform sampling and over-scanning of the visible triangles are done before they are packed into a texture space. The texels are then re-projected onto video images and assigned color values based on depth and illumination data obtained from renderings. The texture map is loaded into the rendering engine to enable real-time navigation through the combined 3D CT surface and bronchoscopic video data. Tests were performed on pre-recorded bronchoscopy patient video and associated 3D MDCT scans. Results show that we can effectively accomplish mapping over a continuous sequence of airway images spanning several generations of airways.",
author = "Lav Rai and Higgins, {William Evan}",
year = "2006",
month = "6",
day = "30",
doi = "10.1117/12.651717",
language = "English (US)",
isbn = "0819461849",
series = "Progress in Biomedical Optics and Imaging - Proceedings of SPIE",
booktitle = "Medical Imaging 2006",

}

Rai, L & Higgins, WE 2006, Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views. in Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display., 614103, Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 6141, Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, San Diego, CA, United States, 2/12/06. https://doi.org/10.1117/12.651717

Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views. / Rai, Lav; Higgins, William Evan.

Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display. 2006. 614103 (Progress in Biomedical Optics and Imaging - Proceedings of SPIE; Vol. 6141).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views

AU - Rai, Lav

AU - Higgins, William Evan

PY - 2006/6/30

Y1 - 2006/6/30

N2 - One of the indicators of early lung cancer is a color change in airway mucosa. Bronchoscopy of the major airways can provide high-resolution color video of the airway tree's mucosal surfaces. In addition, 3D MDCT chest images provide 3D structural information of the airways. Unfortunately, the bronchoscopic video contains no explicit 3D structural and position information, and the 3D MDCT data captures no color or textural information of the mucosa. A fusion of the topographical information from the 3D CT data and the color information from the bronchoscopic video, however, enables realistic 3D visualization, navigation, localization, and quantitative color-topographic analysis of the airways. This paper presents a method for topographic airway-mucosal surface mapping from bronchoscopic video onto 3D MDCT endoluminal views. The method uses registered video images and CT-based virtual endoscopic renderings of the airways. The visibility and depth data are also generated by the renderings. Uniform sampling and over-scanning of the visible triangles are done before they are packed into a texture space. The texels are then re-projected onto video images and assigned color values based on depth and illumination data obtained from renderings. The texture map is loaded into the rendering engine to enable real-time navigation through the combined 3D CT surface and bronchoscopic video data. Tests were performed on pre-recorded bronchoscopy patient video and associated 3D MDCT scans. Results show that we can effectively accomplish mapping over a continuous sequence of airway images spanning several generations of airways.

AB - One of the indicators of early lung cancer is a color change in airway mucosa. Bronchoscopy of the major airways can provide high-resolution color video of the airway tree's mucosal surfaces. In addition, 3D MDCT chest images provide 3D structural information of the airways. Unfortunately, the bronchoscopic video contains no explicit 3D structural and position information, and the 3D MDCT data captures no color or textural information of the mucosa. A fusion of the topographical information from the 3D CT data and the color information from the bronchoscopic video, however, enables realistic 3D visualization, navigation, localization, and quantitative color-topographic analysis of the airways. This paper presents a method for topographic airway-mucosal surface mapping from bronchoscopic video onto 3D MDCT endoluminal views. The method uses registered video images and CT-based virtual endoscopic renderings of the airways. The visibility and depth data are also generated by the renderings. Uniform sampling and over-scanning of the visible triangles are done before they are packed into a texture space. The texels are then re-projected onto video images and assigned color values based on depth and illumination data obtained from renderings. The texture map is loaded into the rendering engine to enable real-time navigation through the combined 3D CT surface and bronchoscopic video data. Tests were performed on pre-recorded bronchoscopy patient video and associated 3D MDCT scans. Results show that we can effectively accomplish mapping over a continuous sequence of airway images spanning several generations of airways.

UR - http://www.scopus.com/inward/record.url?scp=33745417179&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745417179&partnerID=8YFLogxK

U2 - 10.1117/12.651717

DO - 10.1117/12.651717

M3 - Conference contribution

AN - SCOPUS:33745417179

SN - 0819461849

SN - 9780819461841

T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE

BT - Medical Imaging 2006

ER -

Rai L, Higgins WE. Image-based rendering method for mapping endoscopic video onto CT-basecd endoluminal views. In Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display. 2006. 614103. (Progress in Biomedical Optics and Imaging - Proceedings of SPIE). https://doi.org/10.1117/12.651717