FAUSTA: Scaling Dynamic Analysis with Traffic Generation at WhatsApp
Authors:
- 1 April 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 267-278
Abstract
We introduce Fausta, an algorithmic traffic gener-ation platform that enables analysis and testing at scale. Fausta has been deployed at Meta to analyze and test the WhatsApp plat-form infrastructure since September 2020, enabling WhatsApp developers to deploy reliable code changes to a code base of millions of lines of code, supporting over 2 billion users who rely on WhatsApp for their daily communications. Fausta covers expected and unexpected program behaviors in a privacy-safe controlled environment to support multiple use cases such as reliability testing, privacy analysis and performance regression detection. It currently supports three different algorithmic input generation strategies, each of which construct realistic backend server traffic that closely simulates production data, without replaying any real user data. Fausta has been deployed and closely integrated into the WhatsApp continuous integration process, catching bugs in development before they hit production. We report on the development and deployment of Fausta's reliability use case between September 2020 and August 2021. During this period it has found 1,876 unique reliability issues, with a fix rate of 74%, indicating a high degree of true positive fault revelation. We also report on the distribution of fault types revealed by Fausta, and the correlation between coverage and faults found. Overall, we do find evidence that higher coverage is correlated with fault revelation.Keywords
This publication has 44 references indexed in Scilit:
- WhatsApp network forensics: Decrypting and understanding the WhatsApp call signaling messagesDigital Investigation, 2015
- Moving Fast with Software Verification2015
- A large scale study of programming languages and code quality in github2014
- PUMA2014
- An orchestrated survey of methodologies for automated software test case generationJournal of Systems and Software, 2013
- Tracking the Trackers: Fast and Scalable Dynamic Analysis of Web Content for Privacy Violations2012
- Search Based Software Engineering: Techniques, Taxonomy, Tutorial2012
- EXEACM Transactions on Information and System Security, 2008
- Test input generation with java PathFinder2004
- Detecting Software Defects in Telecom Applications Through Lightweight Static Analysis: A War Story2004