### Abstract

A wide variety of least-squares linear regression procedures used in observational astronomy, particularly investigations of the cosmic distance scale, are presented and discussed. We emphasize that different regression procedures represent intrinsically different functionalities of the data set under consideration and should be used only under specific conditions. Discussion is restricted to least-squares approaches, and for most methods computer codes are located or provided. The classes of linear models considered are (1) unweighted regression lines, some discussed earlier in Paper 1 of this series, with bootstrap and jackknife resampling; (2) regression solutions when measurement error, in one or both variables, dominates the scatter; (3) methods to apply a calibration line to new data; (4) truncated regression models, which apply to flux-limited data sets; and (4) censored regression models, which apply when nondetections are present. For the calibration problem we develop two new procedures: a formula for the intercept offset between two parallel data sets, which propagates slope errors from one regression to the other; and a generalization of the Working-Hotelling confidence bands to nonstandard least-squares lines. They can provide improved error analysis for Faber-Jackson, Tully-Fisher, and similar cosmic distance scale relations. We apply them to a recently published data set, showing that the distance ratio between the Coma and Virgo clusters can be determined to ∼ 1% accuracy. The paper concludes with suggested strategies for the astronomer in dealing with linear regression problems. Precise formulation of the scientific question and scrutiny of the sources of scatter are crucial for optimal statistical treatment.

Original language | English (US) |
---|---|

Pages (from-to) | 55-67 |

Number of pages | 13 |

Journal | Astrophysical Journal |

Volume | 397 |

Issue number | 1 |

DOIs | |

State | Published - Jan 1 1992 |

### Fingerprint

### All Science Journal Classification (ASJC) codes

- Astronomy and Astrophysics
- Space and Planetary Science

### Cite this

}

*Astrophysical Journal*, vol. 397, no. 1, pp. 55-67. https://doi.org/10.1086/171766

**Linear regression in astronomy. II.** / Feigelson, Eric; Babu, G. Jogesh.

Research output: Contribution to journal › Article

TY - JOUR

T1 - Linear regression in astronomy. II

AU - Feigelson, Eric

AU - Babu, G. Jogesh

PY - 1992/1/1

Y1 - 1992/1/1

N2 - A wide variety of least-squares linear regression procedures used in observational astronomy, particularly investigations of the cosmic distance scale, are presented and discussed. We emphasize that different regression procedures represent intrinsically different functionalities of the data set under consideration and should be used only under specific conditions. Discussion is restricted to least-squares approaches, and for most methods computer codes are located or provided. The classes of linear models considered are (1) unweighted regression lines, some discussed earlier in Paper 1 of this series, with bootstrap and jackknife resampling; (2) regression solutions when measurement error, in one or both variables, dominates the scatter; (3) methods to apply a calibration line to new data; (4) truncated regression models, which apply to flux-limited data sets; and (4) censored regression models, which apply when nondetections are present. For the calibration problem we develop two new procedures: a formula for the intercept offset between two parallel data sets, which propagates slope errors from one regression to the other; and a generalization of the Working-Hotelling confidence bands to nonstandard least-squares lines. They can provide improved error analysis for Faber-Jackson, Tully-Fisher, and similar cosmic distance scale relations. We apply them to a recently published data set, showing that the distance ratio between the Coma and Virgo clusters can be determined to ∼ 1% accuracy. The paper concludes with suggested strategies for the astronomer in dealing with linear regression problems. Precise formulation of the scientific question and scrutiny of the sources of scatter are crucial for optimal statistical treatment.

AB - A wide variety of least-squares linear regression procedures used in observational astronomy, particularly investigations of the cosmic distance scale, are presented and discussed. We emphasize that different regression procedures represent intrinsically different functionalities of the data set under consideration and should be used only under specific conditions. Discussion is restricted to least-squares approaches, and for most methods computer codes are located or provided. The classes of linear models considered are (1) unweighted regression lines, some discussed earlier in Paper 1 of this series, with bootstrap and jackknife resampling; (2) regression solutions when measurement error, in one or both variables, dominates the scatter; (3) methods to apply a calibration line to new data; (4) truncated regression models, which apply to flux-limited data sets; and (4) censored regression models, which apply when nondetections are present. For the calibration problem we develop two new procedures: a formula for the intercept offset between two parallel data sets, which propagates slope errors from one regression to the other; and a generalization of the Working-Hotelling confidence bands to nonstandard least-squares lines. They can provide improved error analysis for Faber-Jackson, Tully-Fisher, and similar cosmic distance scale relations. We apply them to a recently published data set, showing that the distance ratio between the Coma and Virgo clusters can be determined to ∼ 1% accuracy. The paper concludes with suggested strategies for the astronomer in dealing with linear regression problems. Precise formulation of the scientific question and scrutiny of the sources of scatter are crucial for optimal statistical treatment.

UR - http://www.scopus.com/inward/record.url?scp=0002594286&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0002594286&partnerID=8YFLogxK

U2 - 10.1086/171766

DO - 10.1086/171766

M3 - Article

AN - SCOPUS:0002594286

VL - 397

SP - 55

EP - 67

JO - Astrophysical Journal

JF - Astrophysical Journal

SN - 0004-637X

IS - 1

ER -