Classifying informative and non-informative tweets from the twitter by adapting image features during disaster
- PDF / 2,448,967 Bytes
- 23 Pages / 439.642 x 666.49 pts Page_size
- 110 Downloads / 203 Views
Classifying informative and non-informative tweets from the twitter by adapting image features during disaster Sreenivasulu Madichetty1 · Sridevi M1 Received: 12 October 2019 / Revised: 8 June 2020 / Accepted: 13 July 2020 / © Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract During the crisis, people post a large number of informative and non-informative tweets on Twitter. Informative tweets provide helpful information such as affected individuals, infrastructure damage, availability and resource requirements, etc. In contrast, non-informative tweets do not provide helpful information related to either humanitarian organizations or victims. Identifying informative tweets is a challenging task during the disaster. People often post images along with text on Twitter during the disaster. In addition to tweet text features, image features are also crucial for identifying informative tweets. However, existing methods use only text features but do not use image features to identify crisis-related tweets during the disaster. This paper proposes a novel approach by considering the image features along with the text features. It includes a text-based classification model, an image-based classification model and a late fusion. The text-based classification model uses the Convolutional Neural Network (CNN) and the Artificial Neural Network ( ANN). CNN is used to extract text features from a tweet and the ANN is used to classify tweets based on extracted text features of CNN. The image-based classification model uses the fine-tuned VGG-16 architecture to extract the image features from the image and classify the image in a tweet. The output of the text-based classification model and the image-based classification model are combined using the late fusion technique to predict the tweet label. Extensive experiments are carried out on Twitter datasets of various crises, such as the Mexico earthquake, California Wildfires, etc., to demonstrate the effectiveness of the proposed method. The proposed method outperforms the state-of-the-art methods on various parameters to identify informative tweets during the disaster. Keywords Artificial neural network · VGG-16 architecture · Disaster · Late fusion.
Sreenivasulu Madichetty
[email protected] Sridevi M [email protected] 1
Department of Computer Science and Engineering, National Institute of Technology, Tiruchirappalli, Tamil Nadu 620015, India
Multimedia Tools and Applications
1 Introduction During disasters, a substantial quantity of information is published on micro-blogging platforms (like Twitter) [10, 21] in the view of the text, picture, audio, etc. The authors of [13, 27] have shown that the use of social media for rapid early damage assessment during disasters and suggested tools to identify critical social media information is very much needed. Various organizations need different types of information [48]. For example, the government or humanitarian organization needs information on the situation updates of how many people have been injur
Data Loading...
