Comparing hospital mortality in adult patients with pneumonia. A case study of statistical methods in a managed care program

A. R. Localio, B. H. Hamory, T. J. Sharp, S. L. Weaver, T. R. TenHave, J. R. Landis

Research output: Contribution to journalArticle

40 Citations (Scopus)

Abstract

Objective: To compare and contrast a managed care program's analysis of differences in hospital mortality with results obtained by accepted statistical methods. Design: A re-analysis of computerized discharge data using the same method used by a managed care program, and using conventional methods of categorical data analysis. One thousand computer simulations of a method for comparing hospitals by severity-adjusted mortality were done to determine the probability of falsely identifying hospitals as high-mortality outliers. Setting: 22 acute care hospitals in central Pennsylvania. Patients: All adult patients with pneumonia (n = 4587; diagnosis-related groups 089- 090) less than 65 years of age who were discharged from the 22 hospitals in 1989, 1990, and 1991, excluding patients with the acquired immunodeficiency syndrome and transplant recipients. Measurements: In-hospital mortality adjusted for age and severity of illness using MedisGroups admission severity group score. Results: The hospital that had the highest mortality for adult pneumonia according to the managed care program's analysis did not, according to an appropriate analysis, differ significantly from other area hospitals (likelihood ratio test, P = 0.23). Random variation in this sample of patients with a low average mortality rate (3.5%) showed a 60% chance that 1 or more of the 22 hospitals would be falsely identified as a 'high-mortality outlier' when simplistic statistical methods were used. Conclusion: Organizations seeking to compare the quality of hospitals and physicians through outcome data need to recognize that simplistic methods applicable to large samples fail when applied to the outcomes of typical patients, such as those admitted for pneumonia. Although these comparisons are much in demand, careful attention must be paid to their statistical methods to ensure validity and fairness.

Original languageEnglish (US)
Pages (from-to)125-132
Number of pages8
JournalAnnals of internal medicine
Volume122
Issue number2
StatePublished - Jan 1 1995

Fingerprint

Managed Care Programs
Hospital Mortality
Pneumonia
Mortality
Diagnosis-Related Groups
Computer Simulation
Acquired Immunodeficiency Syndrome
Organizations
Physicians

All Science Journal Classification (ASJC) codes

  • Internal Medicine

Cite this

Localio, A. R. ; Hamory, B. H. ; Sharp, T. J. ; Weaver, S. L. ; TenHave, T. R. ; Landis, J. R. / Comparing hospital mortality in adult patients with pneumonia. A case study of statistical methods in a managed care program. In: Annals of internal medicine. 1995 ; Vol. 122, No. 2. pp. 125-132.
@article{f416b7e2955b42e494af0e97118a5583,
title = "Comparing hospital mortality in adult patients with pneumonia. A case study of statistical methods in a managed care program",
abstract = "Objective: To compare and contrast a managed care program's analysis of differences in hospital mortality with results obtained by accepted statistical methods. Design: A re-analysis of computerized discharge data using the same method used by a managed care program, and using conventional methods of categorical data analysis. One thousand computer simulations of a method for comparing hospitals by severity-adjusted mortality were done to determine the probability of falsely identifying hospitals as high-mortality outliers. Setting: 22 acute care hospitals in central Pennsylvania. Patients: All adult patients with pneumonia (n = 4587; diagnosis-related groups 089- 090) less than 65 years of age who were discharged from the 22 hospitals in 1989, 1990, and 1991, excluding patients with the acquired immunodeficiency syndrome and transplant recipients. Measurements: In-hospital mortality adjusted for age and severity of illness using MedisGroups admission severity group score. Results: The hospital that had the highest mortality for adult pneumonia according to the managed care program's analysis did not, according to an appropriate analysis, differ significantly from other area hospitals (likelihood ratio test, P = 0.23). Random variation in this sample of patients with a low average mortality rate (3.5{\%}) showed a 60{\%} chance that 1 or more of the 22 hospitals would be falsely identified as a 'high-mortality outlier' when simplistic statistical methods were used. Conclusion: Organizations seeking to compare the quality of hospitals and physicians through outcome data need to recognize that simplistic methods applicable to large samples fail when applied to the outcomes of typical patients, such as those admitted for pneumonia. Although these comparisons are much in demand, careful attention must be paid to their statistical methods to ensure validity and fairness.",
author = "Localio, {A. R.} and Hamory, {B. H.} and Sharp, {T. J.} and Weaver, {S. L.} and TenHave, {T. R.} and Landis, {J. R.}",
year = "1995",
month = "1",
day = "1",
language = "English (US)",
volume = "122",
pages = "125--132",
journal = "Annals of Internal Medicine",
issn = "0003-4819",
publisher = "American College of Physicians",
number = "2",

}

Comparing hospital mortality in adult patients with pneumonia. A case study of statistical methods in a managed care program. / Localio, A. R.; Hamory, B. H.; Sharp, T. J.; Weaver, S. L.; TenHave, T. R.; Landis, J. R.

In: Annals of internal medicine, Vol. 122, No. 2, 01.01.1995, p. 125-132.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Comparing hospital mortality in adult patients with pneumonia. A case study of statistical methods in a managed care program

AU - Localio, A. R.

AU - Hamory, B. H.

AU - Sharp, T. J.

AU - Weaver, S. L.

AU - TenHave, T. R.

AU - Landis, J. R.

PY - 1995/1/1

Y1 - 1995/1/1

N2 - Objective: To compare and contrast a managed care program's analysis of differences in hospital mortality with results obtained by accepted statistical methods. Design: A re-analysis of computerized discharge data using the same method used by a managed care program, and using conventional methods of categorical data analysis. One thousand computer simulations of a method for comparing hospitals by severity-adjusted mortality were done to determine the probability of falsely identifying hospitals as high-mortality outliers. Setting: 22 acute care hospitals in central Pennsylvania. Patients: All adult patients with pneumonia (n = 4587; diagnosis-related groups 089- 090) less than 65 years of age who were discharged from the 22 hospitals in 1989, 1990, and 1991, excluding patients with the acquired immunodeficiency syndrome and transplant recipients. Measurements: In-hospital mortality adjusted for age and severity of illness using MedisGroups admission severity group score. Results: The hospital that had the highest mortality for adult pneumonia according to the managed care program's analysis did not, according to an appropriate analysis, differ significantly from other area hospitals (likelihood ratio test, P = 0.23). Random variation in this sample of patients with a low average mortality rate (3.5%) showed a 60% chance that 1 or more of the 22 hospitals would be falsely identified as a 'high-mortality outlier' when simplistic statistical methods were used. Conclusion: Organizations seeking to compare the quality of hospitals and physicians through outcome data need to recognize that simplistic methods applicable to large samples fail when applied to the outcomes of typical patients, such as those admitted for pneumonia. Although these comparisons are much in demand, careful attention must be paid to their statistical methods to ensure validity and fairness.

AB - Objective: To compare and contrast a managed care program's analysis of differences in hospital mortality with results obtained by accepted statistical methods. Design: A re-analysis of computerized discharge data using the same method used by a managed care program, and using conventional methods of categorical data analysis. One thousand computer simulations of a method for comparing hospitals by severity-adjusted mortality were done to determine the probability of falsely identifying hospitals as high-mortality outliers. Setting: 22 acute care hospitals in central Pennsylvania. Patients: All adult patients with pneumonia (n = 4587; diagnosis-related groups 089- 090) less than 65 years of age who were discharged from the 22 hospitals in 1989, 1990, and 1991, excluding patients with the acquired immunodeficiency syndrome and transplant recipients. Measurements: In-hospital mortality adjusted for age and severity of illness using MedisGroups admission severity group score. Results: The hospital that had the highest mortality for adult pneumonia according to the managed care program's analysis did not, according to an appropriate analysis, differ significantly from other area hospitals (likelihood ratio test, P = 0.23). Random variation in this sample of patients with a low average mortality rate (3.5%) showed a 60% chance that 1 or more of the 22 hospitals would be falsely identified as a 'high-mortality outlier' when simplistic statistical methods were used. Conclusion: Organizations seeking to compare the quality of hospitals and physicians through outcome data need to recognize that simplistic methods applicable to large samples fail when applied to the outcomes of typical patients, such as those admitted for pneumonia. Although these comparisons are much in demand, careful attention must be paid to their statistical methods to ensure validity and fairness.

UR - http://www.scopus.com/inward/record.url?scp=0028891771&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028891771&partnerID=8YFLogxK

M3 - Article

C2 - 7992987

AN - SCOPUS:0028891771

VL - 122

SP - 125

EP - 132

JO - Annals of Internal Medicine

JF - Annals of Internal Medicine

SN - 0003-4819

IS - 2

ER -