Deepfusion: A deep learning framework for the fusion of heterogeneous sensory data

Hongfei Xue, Wenjun Jiang, Chenglin Miao, Ye Yuan, Fenglong Ma, Xin Ma, Yijiang Wang, Shuochao Yao, Wenyao Xu, Aidong Zhang, Lu Su

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, significant research efforts have been spent towards building intelligent and user-friendly IoT systems to enable a new generation of applications capable of performing complex sensing and recognition tasks. In many of such applications, there are usually multiple different sensors monitoring the same object. Each of these sensors can be regarded as an information source and provides us a unique “view” of the observed object. Intuitively, if we can combine the complementary information carried by multiple sensors, we will be able to improve the sensing performance. Towards this end, we propose DeepFusion, a unified multi-sensor deep learning framework, to learn informative representations of heterogeneous sensory data. DeepFusion can combine different sensors’ information weighted by the quality of their data and incorporate cross-sensor correlations, and thus can benefit a wide spectrum of IoT applications. To evaluate the proposed DeepFusion model, we set up two real-world human activity recognition testbeds using commercialized wearable and wireless sensing devices. Experiment results show that DeepFusion can outperform the state-of-the-art human activity recognition methods.

Original languageEnglish (US)
Title of host publicationMobihoc 2019 - Proceedings of the 2019 20th ACM International Symposium on Mobile Ad Hoc Networking and Computing
PublisherAssociation for Computing Machinery
Pages151-160
Number of pages10
ISBN (Electronic)9781450367646
DOIs
StatePublished - Jul 2 2019
Event20th ACM International Symposium on Mobile Ad Hoc Networking and Computing, MobiHoc 2019 - Catania, Italy
Duration: Jul 2 2019Jul 5 2019

Publication series

NameProceedings of the International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc)

Conference

Conference20th ACM International Symposium on Mobile Ad Hoc Networking and Computing, MobiHoc 2019
CountryItaly
CityCatania
Period7/2/197/5/19

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Computer Networks and Communications
  • Software

Fingerprint Dive into the research topics of 'Deepfusion: A deep learning framework for the fusion of heterogeneous sensory data'. Together they form a unique fingerprint.

  • Cite this

    Xue, H., Jiang, W., Miao, C., Yuan, Y., Ma, F., Ma, X., Wang, Y., Yao, S., Xu, W., Zhang, A., & Su, L. (2019). Deepfusion: A deep learning framework for the fusion of heterogeneous sensory data. In Mobihoc 2019 - Proceedings of the 2019 20th ACM International Symposium on Mobile Ad Hoc Networking and Computing (pp. 151-160). (Proceedings of the International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc)). Association for Computing Machinery. https://doi.org/10.1145/3323679.3326513