A Monte Carlo investigation of incomplete pairwise comparison matrices in AHP

Frank J. Carmone, Ali Kara, Stelios H. Zanakis

Research output: Contribution to journalArticle

111 Citations (Scopus)

Abstract

The Analytic Hierarchy Process (AHP) is a decision analysis technique used to evaluate complex multiattribute alternatives among one or more decision makers. It imposes a hierarchical structure on any complex multicriterion problem. However, a major drawback of the AHP is that a large number of pairwise comparisons is needed to calibrate the hierarchy. When there are a few levels and sublevels, the AHP can be applied in a straightforward manner to derive the weights (relative preference for each alternative). As the size of the hierarchy increases, the number of pairwise comparisons increases rapidly. It is well established in the marketing and consumer behavior literature that in a very long interview, even under the best circumstances, the respondent is likely to suffer from information overload. Recognition of this problem was the motivation which led to the investigation of a modification of AHP which required less data collection, i.e., a reduction in the threat of information overload. The first question to be answered is the effect on AHP weights due to different patterns of missing data likely to result from reallife data collection. In this study, a Monte Carlo simulation was conducted, which uses the Incomplete Pairwise Comparisons (IPC) algorithm [14], to investigate the effect of reduced sets of pairwise comparisons in the AHP. Data for the study were generated with known structure and comparisons made between complete and incomplete matrices. The results of the simulation suggest that incomplete sets of pairwise comparison matrices can capture the attribute level weights without significant loss of accuracy and independent of decision model (form and amount of error) considered.

Original languageEnglish (US)
Pages (from-to)538-553
Number of pages16
JournalEuropean Journal of Operational Research
Volume102
Issue number3
DOIs
StatePublished - Nov 1 1997

Fingerprint

Pairwise Comparisons
Analytic hierarchy process
Analytic Hierarchy Process
Overload
Likely
Consumer Behaviour
Consumer behavior
Decision Analysis
Decision theory
Alternatives
Decision Model
Multi-criteria
Hierarchical Structure
Missing Data
Pairwise comparisons
Marketing
Monte Carlo Simulation
Attribute
Evaluate
Simulation

All Science Journal Classification (ASJC) codes

  • Modeling and Simulation
  • Management Science and Operations Research
  • Information Systems and Management

Cite this

Carmone, Frank J. ; Kara, Ali ; Zanakis, Stelios H. / A Monte Carlo investigation of incomplete pairwise comparison matrices in AHP. In: European Journal of Operational Research. 1997 ; Vol. 102, No. 3. pp. 538-553.
@article{e2e82d22ded14009b3aaf65a529b1509,
title = "A Monte Carlo investigation of incomplete pairwise comparison matrices in AHP",
abstract = "The Analytic Hierarchy Process (AHP) is a decision analysis technique used to evaluate complex multiattribute alternatives among one or more decision makers. It imposes a hierarchical structure on any complex multicriterion problem. However, a major drawback of the AHP is that a large number of pairwise comparisons is needed to calibrate the hierarchy. When there are a few levels and sublevels, the AHP can be applied in a straightforward manner to derive the weights (relative preference for each alternative). As the size of the hierarchy increases, the number of pairwise comparisons increases rapidly. It is well established in the marketing and consumer behavior literature that in a very long interview, even under the best circumstances, the respondent is likely to suffer from information overload. Recognition of this problem was the motivation which led to the investigation of a modification of AHP which required less data collection, i.e., a reduction in the threat of information overload. The first question to be answered is the effect on AHP weights due to different patterns of missing data likely to result from reallife data collection. In this study, a Monte Carlo simulation was conducted, which uses the Incomplete Pairwise Comparisons (IPC) algorithm [14], to investigate the effect of reduced sets of pairwise comparisons in the AHP. Data for the study were generated with known structure and comparisons made between complete and incomplete matrices. The results of the simulation suggest that incomplete sets of pairwise comparison matrices can capture the attribute level weights without significant loss of accuracy and independent of decision model (form and amount of error) considered.",
author = "Carmone, {Frank J.} and Ali Kara and Zanakis, {Stelios H.}",
year = "1997",
month = "11",
day = "1",
doi = "10.1016/S0377-2217(96)00250-0",
language = "English (US)",
volume = "102",
pages = "538--553",
journal = "European Journal of Operational Research",
issn = "0377-2217",
publisher = "Elsevier",
number = "3",

}

A Monte Carlo investigation of incomplete pairwise comparison matrices in AHP. / Carmone, Frank J.; Kara, Ali; Zanakis, Stelios H.

In: European Journal of Operational Research, Vol. 102, No. 3, 01.11.1997, p. 538-553.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A Monte Carlo investigation of incomplete pairwise comparison matrices in AHP

AU - Carmone, Frank J.

AU - Kara, Ali

AU - Zanakis, Stelios H.

PY - 1997/11/1

Y1 - 1997/11/1

N2 - The Analytic Hierarchy Process (AHP) is a decision analysis technique used to evaluate complex multiattribute alternatives among one or more decision makers. It imposes a hierarchical structure on any complex multicriterion problem. However, a major drawback of the AHP is that a large number of pairwise comparisons is needed to calibrate the hierarchy. When there are a few levels and sublevels, the AHP can be applied in a straightforward manner to derive the weights (relative preference for each alternative). As the size of the hierarchy increases, the number of pairwise comparisons increases rapidly. It is well established in the marketing and consumer behavior literature that in a very long interview, even under the best circumstances, the respondent is likely to suffer from information overload. Recognition of this problem was the motivation which led to the investigation of a modification of AHP which required less data collection, i.e., a reduction in the threat of information overload. The first question to be answered is the effect on AHP weights due to different patterns of missing data likely to result from reallife data collection. In this study, a Monte Carlo simulation was conducted, which uses the Incomplete Pairwise Comparisons (IPC) algorithm [14], to investigate the effect of reduced sets of pairwise comparisons in the AHP. Data for the study were generated with known structure and comparisons made between complete and incomplete matrices. The results of the simulation suggest that incomplete sets of pairwise comparison matrices can capture the attribute level weights without significant loss of accuracy and independent of decision model (form and amount of error) considered.

AB - The Analytic Hierarchy Process (AHP) is a decision analysis technique used to evaluate complex multiattribute alternatives among one or more decision makers. It imposes a hierarchical structure on any complex multicriterion problem. However, a major drawback of the AHP is that a large number of pairwise comparisons is needed to calibrate the hierarchy. When there are a few levels and sublevels, the AHP can be applied in a straightforward manner to derive the weights (relative preference for each alternative). As the size of the hierarchy increases, the number of pairwise comparisons increases rapidly. It is well established in the marketing and consumer behavior literature that in a very long interview, even under the best circumstances, the respondent is likely to suffer from information overload. Recognition of this problem was the motivation which led to the investigation of a modification of AHP which required less data collection, i.e., a reduction in the threat of information overload. The first question to be answered is the effect on AHP weights due to different patterns of missing data likely to result from reallife data collection. In this study, a Monte Carlo simulation was conducted, which uses the Incomplete Pairwise Comparisons (IPC) algorithm [14], to investigate the effect of reduced sets of pairwise comparisons in the AHP. Data for the study were generated with known structure and comparisons made between complete and incomplete matrices. The results of the simulation suggest that incomplete sets of pairwise comparison matrices can capture the attribute level weights without significant loss of accuracy and independent of decision model (form and amount of error) considered.

UR - http://www.scopus.com/inward/record.url?scp=0031276406&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031276406&partnerID=8YFLogxK

U2 - 10.1016/S0377-2217(96)00250-0

DO - 10.1016/S0377-2217(96)00250-0

M3 - Article

AN - SCOPUS:0031276406

VL - 102

SP - 538

EP - 553

JO - European Journal of Operational Research

JF - European Journal of Operational Research

SN - 0377-2217

IS - 3

ER -