When comparing software programs on the basis of more than one metric a difficulty arises when the metrics are contradictory or if there are no standard acceptance thresholds. An appealing solution in such cases is to incorporate expert opinion to resolve the inconsistencies. A rigorous framework, however, is essential when fusing metrics and expert opinion in this decision-making process. Fortunately, the analytical hierarchy process (AHP) can be used to facilitate rigorous decision-making in this particular problem. In this work a combination of expert opinion and tool-collected measures are used to reason about software programs using AHP. The methodology employed can be adapted to other decision-making problems in software engineering when both metrics data and expert opinion are available, some of which are described.
All Science Journal Classification (ASJC) codes