Time series smoother for effect detection

Cheng You, Dennis K.J. Lin, S. Stanley Young

Research output: Contribution to journalArticle

Abstract

In environmental epidemiology, it is often encountered that multiple time series data with a long-term trend, including seasonality, cannot be fully adjusted by the observed covariates. The long-term trend is difficult to separate from abnormal short-term signals of interest. This paper addresses how to estimate the long-term trend in order to recover short-term signals. Our case study demonstrates that the current spline smoothing methods can result in significant positive and negative cross-correlations from the same dataset, depending on how the smoothing parameters are chosen. To circumvent this dilemma, three classes of time series smoothers are proposed to detrend time series data. These smoothers do not require fine tuning of parameters and can be applied to recover short-term signals. The properties of these smoothers are shown with both a case study using a factorial design and a simulation study using datasets generated from the original dataset. General guidelines are provided on how to discover short-term signals from time series with a long-term trend. The benefit of this research is that a problem is identified and characteristics of possible solutions are determined.

Original languageEnglish (US)
Article numbere0195360
JournalPloS one
Volume13
Issue number4
DOIs
StatePublished - Apr 1 2018

Fingerprint

Time series
time series analysis
case studies
Epidemiology
Splines
epidemiology
Tuning
Guidelines
Research
Datasets
methodology

All Science Journal Classification (ASJC) codes

  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)

Cite this

You, Cheng ; Lin, Dennis K.J. ; Young, S. Stanley. / Time series smoother for effect detection. In: PloS one. 2018 ; Vol. 13, No. 4.
@article{a31e61e6bb9643369814350c8d89268b,
title = "Time series smoother for effect detection",
abstract = "In environmental epidemiology, it is often encountered that multiple time series data with a long-term trend, including seasonality, cannot be fully adjusted by the observed covariates. The long-term trend is difficult to separate from abnormal short-term signals of interest. This paper addresses how to estimate the long-term trend in order to recover short-term signals. Our case study demonstrates that the current spline smoothing methods can result in significant positive and negative cross-correlations from the same dataset, depending on how the smoothing parameters are chosen. To circumvent this dilemma, three classes of time series smoothers are proposed to detrend time series data. These smoothers do not require fine tuning of parameters and can be applied to recover short-term signals. The properties of these smoothers are shown with both a case study using a factorial design and a simulation study using datasets generated from the original dataset. General guidelines are provided on how to discover short-term signals from time series with a long-term trend. The benefit of this research is that a problem is identified and characteristics of possible solutions are determined.",
author = "Cheng You and Lin, {Dennis K.J.} and Young, {S. Stanley}",
year = "2018",
month = "4",
day = "1",
doi = "10.1371/journal.pone.0195360",
language = "English (US)",
volume = "13",
journal = "PLoS One",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "4",

}

Time series smoother for effect detection. / You, Cheng; Lin, Dennis K.J.; Young, S. Stanley.

In: PloS one, Vol. 13, No. 4, e0195360, 01.04.2018.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Time series smoother for effect detection

AU - You, Cheng

AU - Lin, Dennis K.J.

AU - Young, S. Stanley

PY - 2018/4/1

Y1 - 2018/4/1

N2 - In environmental epidemiology, it is often encountered that multiple time series data with a long-term trend, including seasonality, cannot be fully adjusted by the observed covariates. The long-term trend is difficult to separate from abnormal short-term signals of interest. This paper addresses how to estimate the long-term trend in order to recover short-term signals. Our case study demonstrates that the current spline smoothing methods can result in significant positive and negative cross-correlations from the same dataset, depending on how the smoothing parameters are chosen. To circumvent this dilemma, three classes of time series smoothers are proposed to detrend time series data. These smoothers do not require fine tuning of parameters and can be applied to recover short-term signals. The properties of these smoothers are shown with both a case study using a factorial design and a simulation study using datasets generated from the original dataset. General guidelines are provided on how to discover short-term signals from time series with a long-term trend. The benefit of this research is that a problem is identified and characteristics of possible solutions are determined.

AB - In environmental epidemiology, it is often encountered that multiple time series data with a long-term trend, including seasonality, cannot be fully adjusted by the observed covariates. The long-term trend is difficult to separate from abnormal short-term signals of interest. This paper addresses how to estimate the long-term trend in order to recover short-term signals. Our case study demonstrates that the current spline smoothing methods can result in significant positive and negative cross-correlations from the same dataset, depending on how the smoothing parameters are chosen. To circumvent this dilemma, three classes of time series smoothers are proposed to detrend time series data. These smoothers do not require fine tuning of parameters and can be applied to recover short-term signals. The properties of these smoothers are shown with both a case study using a factorial design and a simulation study using datasets generated from the original dataset. General guidelines are provided on how to discover short-term signals from time series with a long-term trend. The benefit of this research is that a problem is identified and characteristics of possible solutions are determined.

UR - http://www.scopus.com/inward/record.url?scp=85045931535&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045931535&partnerID=8YFLogxK

U2 - 10.1371/journal.pone.0195360

DO - 10.1371/journal.pone.0195360

M3 - Article

VL - 13

JO - PLoS One

JF - PLoS One

SN - 1932-6203

IS - 4

M1 - e0195360

ER -