Making Sense of Multi-threaded Application Performance at Scale with NonSequitur
Open Access
- 8 October 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Programming Languages
- Vol. 8 (OOPSLA2) , 2325-2354
Abstract
Modern multi-threaded systems are highly complex. This makes their behavior difficult to understand. Developers frequently capture behavior in the form of program traces and then manually inspect these traces. Existing tools, however, fail to scale to traces larger than a million events. In this paper we present an approach to compress multi-threaded traces in order to allow developers to visually explore these traces at scale. Our approach is able to compress traces that contain millions of events down to a few hundred events. We use this approach to design and implement a tool called NonSequitur. We present three case studies which demonstrate how we used NonSequitur to analyze real-world performance issues with Meta’s storage engine RocksDB and MongoDB’s storage engine WiredTiger, two complex database backends. We also evaluate NonSequitur with 42 participants on traces from RocksDB and WiredTiger. We demonstrate that, in some cases, participants on average scored 11 times higher when performing performance analysis tasks on large execution traces. Additionally, for some performance analysis tasks, the participants spent on average three times longer with other tools than with NonSequitur.Keywords
This publication has 30 references indexed in Scilit:
- TANDEM: A Taxonomy and a Dataset of Real-World Performance BugsIEEE Access, 2020
- Developer Reading Behavior While Summarizing Java Methods: Size and Context Matters2019
- Segmenting large traces of inter-process communication with a focus on high performance computing systemsJournal of Systems and Software, 2016
- SYNCTRACE: Visual thread-interplay analysis2013
- Multiscale visual comparison of execution traces2013
- Performance debugging in the large via mining millions of stack traces2012
- Using compression algorithms to support the comprehension of program traces2010
- An Approach for Detecting Execution Phases of a System for the Purpose of Program Comprehension2010
- Execution trace analysis through massive sequence and circular bundle viewsJournal of Systems and Software, 2008
- Compression techniques to simplify the analysis of large execution traces2003