Technique for registering 3D virtual CT images to endoscopic video

J. P. Helferty, William Evan Higgins

Research output: Chapter in Book/Report/Conference proceedingConference contribution

38 Citations (Scopus)

Abstract

We present a multi-modal image registration technique that matches virtual surface renderings, derived from 3D medical data, to corresponding endoscopic video. Our efforts focus on the chest. The views of the two image sources arise from inside the major bronchial airways, as shown in 3D CT chest images and live endoscopic video. Our technique is part of a large system for two-stage assessment of lung cancer. Stage-1 involves 3D CT assessment, which gives planning data for endoscopy. Stage-2 involves live endoscopy, supplemented by CT-based guidance. The registration technique is a critical component of this assessment. The technique draws upon the concept of normalized mutual information (NMI) and works in near real time on standard PCs. An optimization procedure iteratively adjusts the virtual viewpoint rendering until it matches a given video frame's viewpoint. The optimization technique ends when the NMI is maximized. Results are given for phantom and human cases.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on Image Processing
Pages893-896
Number of pages4
Volume2
StatePublished - 2001
EventIEEE International Conference on Image Processing (ICIP) - Thessaloniki, Greece
Duration: Oct 7 2001Oct 10 2001

Other

OtherIEEE International Conference on Image Processing (ICIP)
CountryGreece
CityThessaloniki
Period10/7/0110/10/01

Fingerprint

Endoscopy
Image registration
Planning

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this

Helferty, J. P., & Higgins, W. E. (2001). Technique for registering 3D virtual CT images to endoscopic video. In IEEE International Conference on Image Processing (Vol. 2, pp. 893-896)
Helferty, J. P. ; Higgins, William Evan. / Technique for registering 3D virtual CT images to endoscopic video. IEEE International Conference on Image Processing. Vol. 2 2001. pp. 893-896
@inproceedings{79fe34db84ac4f55a553cd4dcc554726,
title = "Technique for registering 3D virtual CT images to endoscopic video",
abstract = "We present a multi-modal image registration technique that matches virtual surface renderings, derived from 3D medical data, to corresponding endoscopic video. Our efforts focus on the chest. The views of the two image sources arise from inside the major bronchial airways, as shown in 3D CT chest images and live endoscopic video. Our technique is part of a large system for two-stage assessment of lung cancer. Stage-1 involves 3D CT assessment, which gives planning data for endoscopy. Stage-2 involves live endoscopy, supplemented by CT-based guidance. The registration technique is a critical component of this assessment. The technique draws upon the concept of normalized mutual information (NMI) and works in near real time on standard PCs. An optimization procedure iteratively adjusts the virtual viewpoint rendering until it matches a given video frame's viewpoint. The optimization technique ends when the NMI is maximized. Results are given for phantom and human cases.",
author = "Helferty, {J. P.} and Higgins, {William Evan}",
year = "2001",
language = "English (US)",
volume = "2",
pages = "893--896",
booktitle = "IEEE International Conference on Image Processing",

}

Helferty, JP & Higgins, WE 2001, Technique for registering 3D virtual CT images to endoscopic video. in IEEE International Conference on Image Processing. vol. 2, pp. 893-896, IEEE International Conference on Image Processing (ICIP), Thessaloniki, Greece, 10/7/01.

Technique for registering 3D virtual CT images to endoscopic video. / Helferty, J. P.; Higgins, William Evan.

IEEE International Conference on Image Processing. Vol. 2 2001. p. 893-896.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Technique for registering 3D virtual CT images to endoscopic video

AU - Helferty, J. P.

AU - Higgins, William Evan

PY - 2001

Y1 - 2001

N2 - We present a multi-modal image registration technique that matches virtual surface renderings, derived from 3D medical data, to corresponding endoscopic video. Our efforts focus on the chest. The views of the two image sources arise from inside the major bronchial airways, as shown in 3D CT chest images and live endoscopic video. Our technique is part of a large system for two-stage assessment of lung cancer. Stage-1 involves 3D CT assessment, which gives planning data for endoscopy. Stage-2 involves live endoscopy, supplemented by CT-based guidance. The registration technique is a critical component of this assessment. The technique draws upon the concept of normalized mutual information (NMI) and works in near real time on standard PCs. An optimization procedure iteratively adjusts the virtual viewpoint rendering until it matches a given video frame's viewpoint. The optimization technique ends when the NMI is maximized. Results are given for phantom and human cases.

AB - We present a multi-modal image registration technique that matches virtual surface renderings, derived from 3D medical data, to corresponding endoscopic video. Our efforts focus on the chest. The views of the two image sources arise from inside the major bronchial airways, as shown in 3D CT chest images and live endoscopic video. Our technique is part of a large system for two-stage assessment of lung cancer. Stage-1 involves 3D CT assessment, which gives planning data for endoscopy. Stage-2 involves live endoscopy, supplemented by CT-based guidance. The registration technique is a critical component of this assessment. The technique draws upon the concept of normalized mutual information (NMI) and works in near real time on standard PCs. An optimization procedure iteratively adjusts the virtual viewpoint rendering until it matches a given video frame's viewpoint. The optimization technique ends when the NMI is maximized. Results are given for phantom and human cases.

UR - http://www.scopus.com/inward/record.url?scp=0035163967&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035163967&partnerID=8YFLogxK

M3 - Conference contribution

VL - 2

SP - 893

EP - 896

BT - IEEE International Conference on Image Processing

ER -

Helferty JP, Higgins WE. Technique for registering 3D virtual CT images to endoscopic video. In IEEE International Conference on Image Processing. Vol. 2. 2001. p. 893-896