Storing, preprocessing and analyzing tweets: finding the suitable noSQL system
- 17 November 2020
- journal article
- research article
- Published by Taylor & Francis in International Journal of Computers and Applications
- Vol. 44 (6) , 586-595
Abstract
In the past few years, Tweets have been widely used to perform Big Data analysis. However, the incredible amount of data captured by Twitter needs to be stored for further processing which may be a challenging task for many database systems. NoSQL is a generation of databases that aim to handle a large volume of data. However there is a large set of NoSQL systems, each has its own characteristics. Consequently choosing the suitable NoSQL system to handle Tweets is challenging. Based on these motivations, this work is carried out to find the suitable NoSQL system to manage Tweets. This paper presents the requirements of managing Tweets and provides a detailed comparison of five NoSQL systems namely, Redis, Cassandra, MongoDB, Couchbase and Neo4j regarding these requirements. The five NoSQL systems are compared in a real scenario where we collect and analyze 1.000.000 Tweets. The chosen scenario enables to evaluate not only the performance of the read and write operations, but also other requirements related to Tweets management such as scalability, analysis tools support and analysis languages support. The obtained results show that Couchbase is the most suitable NoSQL systems for managing Tweets. GRAPHICAL ABSTRACTKeywords
All Related Versions
This publication has 40 references indexed in Scilit:
- BASE analysis of NoSQL databaseFuture Generation Computer Systems, 2015
- Processing Cassandra Datasets with Hadoop-Streaming Based ApproachesIEEE Transactions on Services Computing, 2015
- The Social Media Index: Measuring the Impact of Emergency Medicine and Critical Care WebsitesWestern Journal of Emergency Medicine, 2015
- Big Data Analysis: Apache Storm PerspectiveInternational Journal of Computer Trends and Technology, 2015
- Travel Recommendation Using Geo-tagged Photos in Social Media for TouristWireless Personal Communications, 2014
- NoSQL databases: a step to database scalability in web environmentInternational Journal of Web Information Systems, 2013
- Electronic word-of-mouth and online reviews in tourism services: the use of twitter by touristsElectronic Commerce Research, 2013
- An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformaticsBMC Bioinformatics, 2010
- CassandraACM SIGOPS Operating Systems Review, 2010
- DynamoACM SIGOPS Operating Systems Review, 2007