Tobias Schmidt
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Tobias Schmidt has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Altan Birler
Technische Universität München, Garching, Germany
1 shared publication - Andreas Kipf
University of Technology Nuremberg, Nuremberg, Germany
1 shared publication - Dominik Horn
Amazon Web Services, Munich, Germany
1 shared publication - Gaurav Saxena
Amazon Web Services, Seattle, WA, USA
1 shared publication - Philipp Fent
Technische Universität München
1 shared publication - Thomas Neumann
Technical University of Munich, Munich, Germany
1 shared publication
Latest Publications
- Open Access
- 9 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Simple, Efficient, and Robust Hash Tables for Join Processing
Hash joins play a critical role in relational data processing and their performance is crucial for the overall performance of a database system. Due to the hard to predict nature of intermediate results, an ideal hash join implementation has to be both fast for typical queries and robust against unusual data distributions. In this paper, we present our simple, yet effective unchained in-memory hash table design. Unchained tables combine the techniques of build side partitioning, adjacency array layout, pipelined probes, Bloom filters, and software write-combine buffers to achieve significant improvements in n: m joins with skew, while preserving top-notch performance in 1: n joins. Our hash table outperforms open addressing by 2× on average in relational queries and both chaining and open addressing by up to 20× in graph processing queries.
- 9 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessSimple, Efficient, and Robust Hash Tables for Join Processing
Hash joins play a critical role in relational data processing and their performance is crucial for the overall performance of a database system. Due to the hard to predict nature of intermediate results, an ideal hash join implementation has to be both fast for typical queries and robust against unusual data distributions. In this paper, we present our simple, yet effective unchained in-memory hash table design. Unchained tables combine the techniques of build side partitioning, adjacency array layout, pipelined probes, Bloom filters, and software write-combine buffers to achieve significant improvements in n: m joins with skew, while preserving top-notch performance in 1: n joins. Our hash table outperforms open addressing by 2× on average in relational queries and both chaining and open addressing by up to 20× in graph processing queries.
- Open Access
- 9 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 347-359
Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses
Cloud data warehouses are today's standard for analytical query processing. Multiple cloud vendors offer state-of-the-art systems, such as Amazon Redshift. We have observed that customer workloads experience highly repetitive query patterns, i.e., users and systems frequently send the same queries. In order to improve query performance on these queries, most systems rely on techniques like result caches or materialized views. However, these caches are often stale due to inserts, deletes, or updates that occur between query repetitions. We propose a novel secondary index, predicate caching, to improve query latency for repeating scans and joins. Predicate caching stores ranges of qualifying tuples of base table scans. Such an index can be built on the fly, is lightweight, and can be kept online without recomputation. We implemented a prototype of this idea in the cloud data warehouse Amazon Redshift. Our evaluation shows that predicate caching improves query runtimes by up to 10x on selected queries with negligible build overhead.
- 9 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 347-359
Open AccessPredicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses
Cloud data warehouses are today's standard for analytical query processing. Multiple cloud vendors offer state-of-the-art systems, such as Amazon Redshift. We have observed that customer workloads experience highly repetitive query patterns, i.e., users and systems frequently send the same queries. In order to improve query performance on these queries, most systems rely on techniques like result caches or materialized views. However, these caches are often stale due to inserts, deletes, or updates that occur between query repetitions. We propose a novel secondary index, predicate caching, to improve query latency for repeating scans and joins. Predicate caching stores ranges of qualifying tuples of base table scans. Such an index can be built on the fly, is lightweight, and can be kept online without recomputation. We implemented a prototype of this idea in the cloud data warehouse Amazon Redshift. Our evaluation shows that predicate caching improves query runtimes by up to 10x on selected queries with negligible build overhead.