Face recognition with contiguous occlusion using Markov Random Fields

Zihan Zhou, Andrew Wagner, Hossein Mobahi, John Wright, Yi Ma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

131 Citations (Scopus)

Abstract

Partially occluded faces are common in many applications of face recognition. While algorithms based on sparse representation have demonstrated promising results, they achieve their best performance on occlusions that are not spatially correlated (i.e. random pixel corruption). We show that such sparsity-based algorithms can be significantly improved by harnessing prior knowledge about the pixel error distribution. We show how a Markov Random Field model for spatial continuity of the occlusion can be integrated into the computation of a sparse representation of the test image with respect to the training images. Our algorithm ef-ficiently and reliably identifies the corrupted regions and excludes them from the sparse representation. Extensive experiments on both laboratory and real-world datasets show that our algorithm tolerates much larger fractions and varieties of occlusion than current state-of-the-art algorithms.

Original languageEnglish (US)
Title of host publication2009 IEEE 12th International Conference on Computer Vision, ICCV 2009
Pages1050-1057
Number of pages8
DOIs
StatePublished - Dec 1 2009
Event12th International Conference on Computer Vision, ICCV 2009 - Kyoto, Japan
Duration: Sep 29 2009Oct 2 2009

Publication series

NameProceedings of the IEEE International Conference on Computer Vision

Conference

Conference12th International Conference on Computer Vision, ICCV 2009
CountryJapan
CityKyoto
Period9/29/0910/2/09

Fingerprint

Face recognition
Pixels
Experiments

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Zhou, Z., Wagner, A., Mobahi, H., Wright, J., & Ma, Y. (2009). Face recognition with contiguous occlusion using Markov Random Fields. In 2009 IEEE 12th International Conference on Computer Vision, ICCV 2009 (pp. 1050-1057). [5459383] (Proceedings of the IEEE International Conference on Computer Vision). https://doi.org/10.1109/ICCV.2009.5459383
Zhou, Zihan ; Wagner, Andrew ; Mobahi, Hossein ; Wright, John ; Ma, Yi. / Face recognition with contiguous occlusion using Markov Random Fields. 2009 IEEE 12th International Conference on Computer Vision, ICCV 2009. 2009. pp. 1050-1057 (Proceedings of the IEEE International Conference on Computer Vision).
@inproceedings{ecc00e49177f4c35b8c6cbd22230850a,
title = "Face recognition with contiguous occlusion using Markov Random Fields",
abstract = "Partially occluded faces are common in many applications of face recognition. While algorithms based on sparse representation have demonstrated promising results, they achieve their best performance on occlusions that are not spatially correlated (i.e. random pixel corruption). We show that such sparsity-based algorithms can be significantly improved by harnessing prior knowledge about the pixel error distribution. We show how a Markov Random Field model for spatial continuity of the occlusion can be integrated into the computation of a sparse representation of the test image with respect to the training images. Our algorithm ef-ficiently and reliably identifies the corrupted regions and excludes them from the sparse representation. Extensive experiments on both laboratory and real-world datasets show that our algorithm tolerates much larger fractions and varieties of occlusion than current state-of-the-art algorithms.",
author = "Zihan Zhou and Andrew Wagner and Hossein Mobahi and John Wright and Yi Ma",
year = "2009",
month = "12",
day = "1",
doi = "10.1109/ICCV.2009.5459383",
language = "English (US)",
isbn = "9781424444205",
series = "Proceedings of the IEEE International Conference on Computer Vision",
pages = "1050--1057",
booktitle = "2009 IEEE 12th International Conference on Computer Vision, ICCV 2009",

}

Zhou, Z, Wagner, A, Mobahi, H, Wright, J & Ma, Y 2009, Face recognition with contiguous occlusion using Markov Random Fields. in 2009 IEEE 12th International Conference on Computer Vision, ICCV 2009., 5459383, Proceedings of the IEEE International Conference on Computer Vision, pp. 1050-1057, 12th International Conference on Computer Vision, ICCV 2009, Kyoto, Japan, 9/29/09. https://doi.org/10.1109/ICCV.2009.5459383

Face recognition with contiguous occlusion using Markov Random Fields. / Zhou, Zihan; Wagner, Andrew; Mobahi, Hossein; Wright, John; Ma, Yi.

2009 IEEE 12th International Conference on Computer Vision, ICCV 2009. 2009. p. 1050-1057 5459383 (Proceedings of the IEEE International Conference on Computer Vision).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Face recognition with contiguous occlusion using Markov Random Fields

AU - Zhou, Zihan

AU - Wagner, Andrew

AU - Mobahi, Hossein

AU - Wright, John

AU - Ma, Yi

PY - 2009/12/1

Y1 - 2009/12/1

N2 - Partially occluded faces are common in many applications of face recognition. While algorithms based on sparse representation have demonstrated promising results, they achieve their best performance on occlusions that are not spatially correlated (i.e. random pixel corruption). We show that such sparsity-based algorithms can be significantly improved by harnessing prior knowledge about the pixel error distribution. We show how a Markov Random Field model for spatial continuity of the occlusion can be integrated into the computation of a sparse representation of the test image with respect to the training images. Our algorithm ef-ficiently and reliably identifies the corrupted regions and excludes them from the sparse representation. Extensive experiments on both laboratory and real-world datasets show that our algorithm tolerates much larger fractions and varieties of occlusion than current state-of-the-art algorithms.

AB - Partially occluded faces are common in many applications of face recognition. While algorithms based on sparse representation have demonstrated promising results, they achieve their best performance on occlusions that are not spatially correlated (i.e. random pixel corruption). We show that such sparsity-based algorithms can be significantly improved by harnessing prior knowledge about the pixel error distribution. We show how a Markov Random Field model for spatial continuity of the occlusion can be integrated into the computation of a sparse representation of the test image with respect to the training images. Our algorithm ef-ficiently and reliably identifies the corrupted regions and excludes them from the sparse representation. Extensive experiments on both laboratory and real-world datasets show that our algorithm tolerates much larger fractions and varieties of occlusion than current state-of-the-art algorithms.

UR - http://www.scopus.com/inward/record.url?scp=77952735430&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77952735430&partnerID=8YFLogxK

U2 - 10.1109/ICCV.2009.5459383

DO - 10.1109/ICCV.2009.5459383

M3 - Conference contribution

AN - SCOPUS:77952735430

SN - 9781424444205

T3 - Proceedings of the IEEE International Conference on Computer Vision

SP - 1050

EP - 1057

BT - 2009 IEEE 12th International Conference on Computer Vision, ICCV 2009

ER -

Zhou Z, Wagner A, Mobahi H, Wright J, Ma Y. Face recognition with contiguous occlusion using Markov Random Fields. In 2009 IEEE 12th International Conference on Computer Vision, ICCV 2009. 2009. p. 1050-1057. 5459383. (Proceedings of the IEEE International Conference on Computer Vision). https://doi.org/10.1109/ICCV.2009.5459383