A lattice-based MRF model for dynamic near-regular texture tracking

Wen Chieh Lin, Yanxi Liu

Research output: Contribution to journalArticle

58 Citations (Scopus)

Abstract

A near-regular texture (NRT) is a geometric and photometric deformation from its regular originA-a congruent wallpaper pattern formed by 2D translations of a single tile. A dynamic NRT is an NRT under motion. Although NRTs are pervasive in man-made and natural environments, effective computational algorithms for NRTs are few. This paper addresses specific computational challenges in modeling and tracking dynamic NRTs, including ambiguous correspondences, occlusions, and drastic illumination and appearance variations. We propose a lattice-based Markov-Random-Field (MRF) model for dynamic NRTs in a 3D spatiotemporal space. Our model consists of a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Based on the proposed MRF model, we develop a tracking algorithm that utilizes belief propagation and particle filtering to effectively handle the special challenges of the dynamic NRT tracking without any assumption on the motion types or lighting conditions. We provide quantitative evaluations of the proposed method against existing tracking algorithms and demonstrate its applications in video editing.

Original languageEnglish (US)
Pages (from-to)777-792
Number of pages16
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume29
Issue number5
DOIs
StatePublished - May 1 2007

Fingerprint

Random Field
Texture
Textures
Lighting
Wallpaper pattern
Tile
Particle Filtering
Model
Belief Propagation
Motion
Lattice Structure
Quantitative Evaluation
Computational Algorithm
Congruent
Ambiguous
Occlusion
Illumination
Correspondence
Geometry
Modeling

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Cite this

@article{3447d6da94a34a33b8e0d2c177c1f30f,
title = "A lattice-based MRF model for dynamic near-regular texture tracking",
abstract = "A near-regular texture (NRT) is a geometric and photometric deformation from its regular originA-a congruent wallpaper pattern formed by 2D translations of a single tile. A dynamic NRT is an NRT under motion. Although NRTs are pervasive in man-made and natural environments, effective computational algorithms for NRTs are few. This paper addresses specific computational challenges in modeling and tracking dynamic NRTs, including ambiguous correspondences, occlusions, and drastic illumination and appearance variations. We propose a lattice-based Markov-Random-Field (MRF) model for dynamic NRTs in a 3D spatiotemporal space. Our model consists of a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Based on the proposed MRF model, we develop a tracking algorithm that utilizes belief propagation and particle filtering to effectively handle the special challenges of the dynamic NRT tracking without any assumption on the motion types or lighting conditions. We provide quantitative evaluations of the proposed method against existing tracking algorithms and demonstrate its applications in video editing.",
author = "Lin, {Wen Chieh} and Yanxi Liu",
year = "2007",
month = "5",
day = "1",
doi = "10.1109/TPAMI.2007.1053",
language = "English (US)",
volume = "29",
pages = "777--792",
journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
issn = "0162-8828",
publisher = "IEEE Computer Society",
number = "5",

}

A lattice-based MRF model for dynamic near-regular texture tracking. / Lin, Wen Chieh; Liu, Yanxi.

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 5, 01.05.2007, p. 777-792.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A lattice-based MRF model for dynamic near-regular texture tracking

AU - Lin, Wen Chieh

AU - Liu, Yanxi

PY - 2007/5/1

Y1 - 2007/5/1

N2 - A near-regular texture (NRT) is a geometric and photometric deformation from its regular originA-a congruent wallpaper pattern formed by 2D translations of a single tile. A dynamic NRT is an NRT under motion. Although NRTs are pervasive in man-made and natural environments, effective computational algorithms for NRTs are few. This paper addresses specific computational challenges in modeling and tracking dynamic NRTs, including ambiguous correspondences, occlusions, and drastic illumination and appearance variations. We propose a lattice-based Markov-Random-Field (MRF) model for dynamic NRTs in a 3D spatiotemporal space. Our model consists of a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Based on the proposed MRF model, we develop a tracking algorithm that utilizes belief propagation and particle filtering to effectively handle the special challenges of the dynamic NRT tracking without any assumption on the motion types or lighting conditions. We provide quantitative evaluations of the proposed method against existing tracking algorithms and demonstrate its applications in video editing.

AB - A near-regular texture (NRT) is a geometric and photometric deformation from its regular originA-a congruent wallpaper pattern formed by 2D translations of a single tile. A dynamic NRT is an NRT under motion. Although NRTs are pervasive in man-made and natural environments, effective computational algorithms for NRTs are few. This paper addresses specific computational challenges in modeling and tracking dynamic NRTs, including ambiguous correspondences, occlusions, and drastic illumination and appearance variations. We propose a lattice-based Markov-Random-Field (MRF) model for dynamic NRTs in a 3D spatiotemporal space. Our model consists of a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Based on the proposed MRF model, we develop a tracking algorithm that utilizes belief propagation and particle filtering to effectively handle the special challenges of the dynamic NRT tracking without any assumption on the motion types or lighting conditions. We provide quantitative evaluations of the proposed method against existing tracking algorithms and demonstrate its applications in video editing.

UR - http://www.scopus.com/inward/record.url?scp=34047210162&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34047210162&partnerID=8YFLogxK

U2 - 10.1109/TPAMI.2007.1053

DO - 10.1109/TPAMI.2007.1053

M3 - Article

C2 - 17356199

AN - SCOPUS:34047210162

VL - 29

SP - 777

EP - 792

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

SN - 0162-8828

IS - 5

ER -