Homogeneity structure learning in large-scale panel data with heavy-tailed errors

Di Xiao, Yuan Ke, Runze Li

Research output: Contribution to journalArticlepeer-review

Abstract

Large-scale panel data is ubiquitous in many modern data science applications. Conventional panel data analysis methods fail to address the new challenges, like individual impacts of covariates, endogeneity, embedded low-dimensional structure, and heavy-tailed errors, arising from the innovation of data collection platforms on which applications operate. In response to these challenges, this paper studies large-scale panel data with an interactive effects model. This model takes into account the individual impacts of covariates on each spatial node and removes the exogenous condition by allowing latent factors to affect both covariates and errors. Besides, we waive the sub-Gaussian assumption and allow the errors to be heavy-tailed. Further, we propose a data-driven procedure to learn a parsimonious yet exible homogeneity structure embedded in high-dimensional individual impacts of covariates. The homogeneity structure assumes that there exists a partition of regression coe

Original languageEnglish (US)
JournalJournal of Machine Learning Research
Volume22
StatePublished - 2021

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Statistics and Probability
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Homogeneity structure learning in large-scale panel data with heavy-tailed errors'. Together they form a unique fingerprint.

Cite this