Materialized view selection in feed following systems
Authors:
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 442-451
Abstract
Recently emerging feed-following applications generate personalized event streams from various feeds and deliver them to a large number of users. To provide a low-latency service, a feed-following system has to buffer the events in a number of tables, called materialized views, and choosing views to materialize is critical to the system performance. State-of-the-art solutions only consider view selections for each individual user. Due to the existence of very popular feeds and social communities, users often share a lot of feeds that they follow and hence performing a global optimization by considering all the users can significantly enhance the system performance. However, performing such a global optimization needs to choose views for materialization from an exponential number of possible ones. To solve the issue, we propose an effective method to generate candidate views that are potentially beneficial. We then propose several cost-based algorithms to solve the global view selection problem, which adopt a cost model that captures the cost of both user query processing and view maintenance and make use of the containment relationships among the sets of feeds followed by the individual users. We implement the complete approach in a prototype system and perform experiments on a computing cluster using both real and synthetic data. The results indicate that our approach outperforms the state-of-the-art approaches significantly.Keywords
This publication has 18 references indexed in Scilit:
- Feed following2011
- Scalable delivery of stream query resultProceedings of the VLDB Endowment, 2009
- Just-in-time query retrieval over partially indexed data on structured P2P overlays2008
- Materialized View Selection in Data Warehousing2007
- Partial Materialized Views2007
- Efficient Probabilistic Subsumption Checking for Content-Based Publish/Subscribe Systems2006
- Adaptive Reorganization of Coherency-Preserving Dissemination Tree for Streaming Data2006
- The view-selection problem has an exponential-time lower bound for conjunctive queries and views2002
- Answering queries using views: A surveyThe VLDB Journal, 2001
- Materialized view selection and maintenance using multi-query optimization2001