Manifold Learning for Real-World Event Understanding
- 2 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 16 (15566013) , 2957-2972
Abstract
Information coming from social media is vital to the understanding of the dynamics involved in multiple events such as terrorist attacks and natural disasters. With the spread and popularization of cameras and the means to share content through social networks, an event can be followed through many different lenses and vantage points. However, social media data present numerous challenges, and frequently it is necessary a great deal of data cleaning and filtering techniques to separate what is related to the depicted event from contents otherwise useless. In a previous effort of ours, we decomposed events into representative components aiming at describing vital details of an event to characterize its defining moments. However, the lack of minimal supervision to guide the combination of representative components somehow limited the performance of the method. In this paper, we extend upon our prior work and present a learning-from-data method for dynamically learning the contribution of different components for a more effective event representation. The method relies upon just a few training samples (few-shot learning), which can be easily provided by an investigator. The obtained results on real-world datasets show the effectiveness of the proposed ideas.Keywords
Funding Information
- Coordination for the Improvement of Higher Education Personnel (Capes Deep-Eyes)
- São Paulo Research Foundation (DéjàVu 2017/12646-3, 2013/08293-7, 2015/11937-9, 2017/16246-0, 2017/16871-1, 2018/16214-3, 2018/05668-3, 2018/16548-9)
- National Council for Scientific and Technological (400487/2016-0, 425340/2016-3, 304380/2018-0, 304497/2018-5)
This publication has 22 references indexed in Scilit:
- Scalable Person Re-identification: A Benchmark2015
- Semantic content-based image retrieval: A comprehensive studyJournal of Visual Communication and Image Representation, 2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Semantics-preserving hashing for cross-view retrieval2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- An image retrieval scheme with relevance feedback using feature reconstruction and SVM reclassificationNeurocomputing, 2014
- Content based image retrieval based on relative locations of multiple regions of interest using selective regions matchingInformation Sciences, 2014
- Understanding and classifying image tweets2013
- Social media use by government: From the routine to the criticalGovernment Information Quarterly, 2012
- Twitter adoption and use in mass convergence and emergency eventsInternational Journal of Emergency Management, 2009