TATyler Akidau

Tyler Akidau

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Tyler Akidau has a total of 33 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Streaming Democratized: Ease Across the Latency Spectrum with Delayed View Semantics and Snowflake Dynamic Tables

    by Daniel Sotolongo, Daniel Mills, Tyler Akidau, Anirudh Santhiar, Attila-Péter Tóth, Botong Huang, Boyuan Zhang, Igor Belianski, Ling Geng, Matt Uhlar, et al.


  • Open Access

    Continuous Data Ingestion and Transformation in Snowflake

    by Tyler Akidau, Fabian Hueske, Konstantinos Kloudas, Leon Papke, Niklas Semmler, Jan Sommerfeld

    Continuous data growth and the need for close-to-now analytics challenge today's data loading patterns for data warehouses. Traditionally, data is ingested into data warehouses with batch-style loading processes. This also used to be the way to for cloud-based data platforms, such as Snowflake. Data was chunked up into files which were loaded into cloud storage and registered to a table. Subsequently, derived results were fully recomputed if they were based on data sets with new data. Processing inefficiencies and cost concerns prohibited frequent ingestion and refreshes, leaving many latency-sensitive use cases unaddressed. Over the past years, Snowflake has released and improved several features to continuously ingest and transform data. These features ease the definition of declarative data pipelines and enable our users to continuously load huge amounts of data and frequently update derived results in a cost-efficient manner. Snowflake's user interface (UI) provides detailed insights into the operational aspects of data pipelines and supports debugging and failure investigations. With this demo, we show how to seamlessly combine Snowflake's data ingestion and transformation features to built sophisticated data pipelines that cost-efficiently process large amounts of incoming data. Our demo scenario resembles the ingestion and transformation steps of an order analytics system of a B2B retail business. We show and explain the declarative definition of the data pipeline, observe its continuous operation, and leverage Snowflake's UI to dig into details such as query plans for incremental result maintenance.


  • Open Access

    What's the Difference? Incremental Processing with Change Queries in Snowflake

    by Tyler Akidau, Paul Barbier, Istvan Cseri, Fabian Hueske, Tyler Jones, Sasha Lionheart, Daniel Mills, Dzmitry Pauliukevich, Lukas Probst, Niklas Semmler, et al.

    Incremental algorithms are the heart and soul of stream processing. Low latency results depend on the ability to react to the subset of changes in a dataset over time rather than reprocessing the entirety of a dataset as it evolves. But while the SQL language is well suited for representing streams of changes (via tables) and their application to tables over time (via DML), it entirely lacks a method to query the changes to a table or view in the first place. In this paper, we present CHANGES queries and STREAM objects, Snowflake's primitives for querying and consuming incremental changes to table objects over time. CHANGES queries and STREAMs have been in use within Snowflake for three years, and see broad adoption across our customers. We describe the semantics of these primitives, discuss the implementation challenges, present an analysis of their usage at Snowflake, and contrast with other offerings.