Damage assessment from social media imagery data during disasters

Dat T. Nguyen, Ferda Ofli, Muhammad Imran, Prasenjit Mitra

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Citations (Scopus)

Abstract

Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.

Original languageEnglish (US)
Title of host publicationProceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017
EditorsJana Diesner, Elena Ferrari, Guandong Xu
PublisherAssociation for Computing Machinery, Inc
Pages569-576
Number of pages8
ISBN (Electronic)9781450349932
DOIs
StatePublished - Jul 31 2017
Event9th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017 - Sydney, Australia
Duration: Jul 31 2017Aug 3 2017

Publication series

NameProceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017

Other

Other9th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017
CountryAustralia
CitySydney
Period7/31/178/3/17

Fingerprint

Disasters
Neural networks
Learning systems
Tuning

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems

Cite this

Nguyen, D. T., Ofli, F., Imran, M., & Mitra, P. (2017). Damage assessment from social media imagery data during disasters. In J. Diesner, E. Ferrari, & G. Xu (Eds.), Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017 (pp. 569-576). (Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017). Association for Computing Machinery, Inc. https://doi.org/10.1145/3110025.3110109
Nguyen, Dat T. ; Ofli, Ferda ; Imran, Muhammad ; Mitra, Prasenjit. / Damage assessment from social media imagery data during disasters. Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. editor / Jana Diesner ; Elena Ferrari ; Guandong Xu. Association for Computing Machinery, Inc, 2017. pp. 569-576 (Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017).
@inproceedings{c04674490faf4f9e8417f8dedb81a706,
title = "Damage assessment from social media imagery data during disasters",
abstract = "Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.",
author = "Nguyen, {Dat T.} and Ferda Ofli and Muhammad Imran and Prasenjit Mitra",
year = "2017",
month = "7",
day = "31",
doi = "10.1145/3110025.3110109",
language = "English (US)",
series = "Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017",
publisher = "Association for Computing Machinery, Inc",
pages = "569--576",
editor = "Jana Diesner and Elena Ferrari and Guandong Xu",
booktitle = "Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017",

}

Nguyen, DT, Ofli, F, Imran, M & Mitra, P 2017, Damage assessment from social media imagery data during disasters. in J Diesner, E Ferrari & G Xu (eds), Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017, Association for Computing Machinery, Inc, pp. 569-576, 9th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017, Sydney, Australia, 7/31/17. https://doi.org/10.1145/3110025.3110109

Damage assessment from social media imagery data during disasters. / Nguyen, Dat T.; Ofli, Ferda; Imran, Muhammad; Mitra, Prasenjit.

Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. ed. / Jana Diesner; Elena Ferrari; Guandong Xu. Association for Computing Machinery, Inc, 2017. p. 569-576 (Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Damage assessment from social media imagery data during disasters

AU - Nguyen, Dat T.

AU - Ofli, Ferda

AU - Imran, Muhammad

AU - Mitra, Prasenjit

PY - 2017/7/31

Y1 - 2017/7/31

N2 - Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.

AB - Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.

UR - http://www.scopus.com/inward/record.url?scp=85040229335&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040229335&partnerID=8YFLogxK

U2 - 10.1145/3110025.3110109

DO - 10.1145/3110025.3110109

M3 - Conference contribution

AN - SCOPUS:85040229335

T3 - Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017

SP - 569

EP - 576

BT - Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017

A2 - Diesner, Jana

A2 - Ferrari, Elena

A2 - Xu, Guandong

PB - Association for Computing Machinery, Inc

ER -

Nguyen DT, Ofli F, Imran M, Mitra P. Damage assessment from social media imagery data during disasters. In Diesner J, Ferrari E, Xu G, editors, Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. Association for Computing Machinery, Inc. 2017. p. 569-576. (Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017). https://doi.org/10.1145/3110025.3110109