Design Challenges/Solutions for Environments Supporting the Analysis of Social Media Data in Crisis Informatics Research
Authors:
- Kenneth M. AndersonKAKenneth M. Anderson
- Ahmet Arif AydinAAAhmet Arif Aydin
- Mario BarrenecheaMBMario Barrenechea
- Adam CardenasACAdam Cardenas
- Mazin HakeemMHMazin Hakeem
- Sahar JambiSJSahar Jambi
- 1 January 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15301605,p. 163-172
Abstract
Crisis informatics investigates how society's pervasive access to technology is transforming how it responds to mass emergency events. To study this transformation, researchers require access to large sets of data that because of their volume and heterogeneous nature are difficult to collect and analyze. To address this concern, we have designed and implemented an environment - EPIC Analyze - that supports researchers with the collection and analysis of social media data. Our research has identified the types of components - such as NoSQL, MapReduce, caching, and search - needed to ensure that these services are reliable, scalable, extensible, and efficient. We describe the design challenges encountered - such as data modeling, time vs. Space tradeoffs, and the need for a useful and usable system - when building EPIC Analyze and discuss its scalability, performance, and functionality.Keywords
This publication has 19 references indexed in Scilit:
- Digital mobilization in disaster response2014
- A software architecture for Twitter collection, search and geolocation servicesKnowledge-Based Systems, 2013
- MySQL to NoSQL2012
- Supporting “Everyday Analysts” in Safety- and Time-Critical SituationsThe Information Society, 2011
- ACE: Age Calculation Engine-A Design Environment for Cosmogenic Dating Techniques2007
- Citizen communications in crisis2007
- The eyes have it: a task by data type taxonomy for information visualizations2002
- Towards large-scale information integration2002
- From programming environments to environments for designingCommunications of the ACM, 1995
- Learning from Notes1992