Etor Emanuel Lucio-Eceiza
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Etor Emanuel Lucio-Eceiza has a total of 94 co-authors. Here are the top co-authors by number of shared publications:
- Hendrik Feldmann
Institute of Meteorology and Climate Research Troposphere Research (IMKTRO), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
13 shared publications - Jens Grieger
Institute of Meteorology, Freie Universität Berlin, Carl-Heinrich-Becker-Weg 6–10, 12165 Berlin, Germany
12 shared publications - Uwe Ulbrich
Institute of Meteorology, Freie Universität Berlin, Carl-Heinrich-Becker-Weg 6–10, 12165 Berlin, Germany
12 shared publications - Christopher Kadow
German Climate Computing Center (DKRZ), Hamburg, Germany
11 shared publications - Frank Kaspar
Deutscher Wetterdienst, Frankfurter Straße 135, 63067 Offenbach
10 shared publications - Joaquim Ginete Pinto
Institute of Meteorology and Climate Research Tropospheric Research (IMKTRO), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
10 shared publications
Latest Publications
- Open Access
- 30 October 2026
- Published by Copernicus GmbH
- Vol. 2026, 1-31
Reply on RC2
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- 30 October 2026
- Published by Copernicus GmbH
- Vol. 2026, 1-31
Open AccessReply on RC2
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- Open Access
- 30 October 2026
- Published by Copernicus GmbH
- Vol. 2026, 1-31
Reply on RC1
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- 30 October 2026
- Published by Copernicus GmbH
- Vol. 2026, 1-31
Open AccessReply on RC1
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- Open Access
- 7 September 2026
- Published by Copernicus GmbH
- Vol. 2026, 1-31
Comment on egusphere-2026-2697
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- 7 September 2026
- Published by Copernicus GmbH
- Vol. 2026, 1-31
Open AccessComment on egusphere-2026-2697
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- Open Access
- 26 August 2026
- Published by Copernicus GmbH
- p. 1-31
Comment on egusphere-2026-2697
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- 26 August 2026
- Published by Copernicus GmbH
- p. 1-31
Open AccessComment on egusphere-2026-2697
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- Open Access
- 12 June 2026
- Published by Copernicus GmbH in EGUsphere
- Vol. 2026, 1-31
Past and future European atmospheric extreme events under climate change – the ClimXtreme program's structure and results
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- 12 June 2026
- Published by Copernicus GmbH in EGUsphere
- Vol. 2026, 1-31
Open AccessPast and future European atmospheric extreme events under climate change – the ClimXtreme program's structure and results
The meteorological extreme events heatwaves, droughts, heavy precipitation, floods and wind storms affect socio-economic systems and generate considerable attention. The role of anthropogenic climate change in the generation, frequency, and severity of observed and future events triggers mitigation and adaptation questions. Weather-related extremes are rare and embedded into atmospheric dynamics. This sets the frame for a dynamical-statistical analysis coupled to detailed impact or risk studies of rare events. This approach is taken by the German Federal Ministry BMBFTR funded project ClimXtreme-1 with 35 sub-projects. Here we compile the contributions of 21 articles of the inter-journal NHESS/ASCMO/WCD special issue. We connect them to 33 peer reviewed ClimXtreme-1 writings in other journals. For archetypic events over continental areas in mid Europe the individual research results are reported. These involve the use of existing and newly developed indices, analyses of the atmospheric dynamics and process-based chains using global and regional climate models results and statistical detection and attribution studies, with emphasis on establishing a causal relationship between extreme events and anthropogenic climate change. Two overarching conclusions emerge from the joint appraisal of the ClimXtreme-1 publications. Firstly, conclusions on causality show that the attribution analyses of observed events demonstrate the necessary contribution of past anthropogenic climate change to the event while sufficient contributions to future extremes need to be established. Secondly, findings from the dynamic process studies highlight the need to expand the current attribution approaches (statistical vs. storyline) to include the mediator-moderator framework.
- Open Access
- 14 March 2026
- Published by Copernicus GmbH
ClimXtreme addressing heavy precipitation events
ClimXtreme is a research programme funded by the German Federal Ministry of Research, Technology and Space (BMFTR) that comprises 25 individual projects and aims to improve understanding of European extreme weather events and associated uncertainties under anthropogenic climate change. As part of the cross‑project collaboration, a coordinated approach is being established to initiate and sustain targeted stakeholder communication and support it throughout the project period. The aim is to develop information, data and tools targeted to stakeholder needs. To this end, Hazard‑specific Stakeholder Interaction (HaSSi) groups coordinate collaborative work on windstorms, heavy precipitation, and heat/drought. This contribution shows the manifold approaches and perspectives of our research programme to better understand heavy precipitation events in a changing climate.We use observations and climate model data, including large ensembles from global- to kilometre-scale resolution. This improves the understanding of physical processes and scale dependency. Large ensembles also help to deal with the uncertainty of climate change signals across multiple models. Characteristics of extreme precipitation can be analysed by object-oriented approaches. It allows to assess whether climate change will lead to events that will cover larger areas, last longer or travel larger distances. Newly developed statistical methods help to deal with uncertainties and the issue of short data series when investigating extremes. This includes models of spatio-temporal structures of precipitation extremes as well as further developments of Intensity-Duration-Frequency (IDF) relation, where parameters to estimate the IDF relation are functions of large scale variables. To assess impacts of heavy precipitation events, hydrological models for different catchment sizes are applied.This allows ClimXtreme to perform research on various precipitation extremes under climate change as well as to assess individual events as case studies from a variety of perspectives as done for example for a precipitation extreme in June 2024 leading to severe flooding in southern Germany [1]. The study clearly shows that quantities of extremity strongly depend on the exact measure and the methodology used. A comprehensive view on these events is crucial especially when communicating results to stakeholders.[1] http://dx.doi.org/10.17169/refubium-44009
- 14 March 2026
- Published by Copernicus GmbH
Open AccessClimXtreme addressing heavy precipitation events
ClimXtreme is a research programme funded by the German Federal Ministry of Research, Technology and Space (BMFTR) that comprises 25 individual projects and aims to improve understanding of European extreme weather events and associated uncertainties under anthropogenic climate change. As part of the cross‑project collaboration, a coordinated approach is being established to initiate and sustain targeted stakeholder communication and support it throughout the project period. The aim is to develop information, data and tools targeted to stakeholder needs. To this end, Hazard‑specific Stakeholder Interaction (HaSSi) groups coordinate collaborative work on windstorms, heavy precipitation, and heat/drought. This contribution shows the manifold approaches and perspectives of our research programme to better understand heavy precipitation events in a changing climate.We use observations and climate model data, including large ensembles from global- to kilometre-scale resolution. This improves the understanding of physical processes and scale dependency. Large ensembles also help to deal with the uncertainty of climate change signals across multiple models. Characteristics of extreme precipitation can be analysed by object-oriented approaches. It allows to assess whether climate change will lead to events that will cover larger areas, last longer or travel larger distances. Newly developed statistical methods help to deal with uncertainties and the issue of short data series when investigating extremes. This includes models of spatio-temporal structures of precipitation extremes as well as further developments of Intensity-Duration-Frequency (IDF) relation, where parameters to estimate the IDF relation are functions of large scale variables. To assess impacts of heavy precipitation events, hydrological models for different catchment sizes are applied.This allows ClimXtreme to perform research on various precipitation extremes under climate change as well as to assess individual events as case studies from a variety of perspectives as done for example for a precipitation extreme in June 2024 leading to severe flooding in southern Germany [1]. The study clearly shows that quantities of extremity strongly depend on the exact measure and the methodology used. A comprehensive view on these events is crucial especially when communicating results to stakeholders.[1] http://dx.doi.org/10.17169/refubium-44009
- Open Access
- 14 March 2026
- Published by Copernicus GmbH
A Service-Oriented Distributed Zarr Solution for Climate Data Access Across Heterogeneous HPC and Storage Infrastructures
Modern climate archives are increasingly distributed across heterogeneous storage systems, while analysis workflows are becoming more interactive, distributed, and cloud-native. Moreover, many high-performance computing centres (HPC) host large climate datasets on traditional file-based storage infrastructures, whereas computational resources are often located at different sites. This separation between data location and compute resources creates significant barriers to efficient, interactive, and scalable data access.This situation calls for climate data access services that are scalable, flexible, and independent of specific client-side environments, while supporting common climate data formats such as NetCDF, GeoTIFF, Zarr, HDF5, and GRIB. Nevertheless, efficient remote access to large and heterogeneous climate archives remains a major bottleneck for modern scientific workflows.We present aservice, the Freva Data Loader, which implements the logic required to open datasets from diverse storage backends and expose them as Zarr chunks through a lightweight, web-friendly REST interface with modern authentication mechanisms.The Freva Data Loader is implemented as a stateless, worker service exposing a REST interface for dataset access and Zarr endpoint generation. Upon receiving an authenticated request, the service resolves dataset metadata, opens the underlying data from the appropriate storage backend (e.g. POSIX file systems or object storage), and exposes the data as a Zarr-compatible, chunked stream. Authentication and authorisation are handled centrally using OAuth2, ensuring secure and controlled access across institutional boundaries. Requests are coordinated by a Loader component and distributed to worker instances via a message broker (Redis), enabling asynchronous execution and horizontal scalability.The service decouples data access from client-side tooling and enables users and applications to access data stored on traditional posix HPC file systems, tape archives, as well as cloud-based object storage through a unified Zarr interface. Instead of transferring complete files between data centres or downloading them in full, clients retrieve only the required data chunks on demand. Users and client applications can request chunked array access over the network and process data incrementally, supporting interactive exploration and scalable downstream computation using cloud-native, chunked storage semantics, while remaining compatible with existing analysis stacks based on Zarr, xarray, and Dask.
- 14 March 2026
- Published by Copernicus GmbH
Open AccessA Service-Oriented Distributed Zarr Solution for Climate Data Access Across Heterogeneous HPC and Storage Infrastructures
Modern climate archives are increasingly distributed across heterogeneous storage systems, while analysis workflows are becoming more interactive, distributed, and cloud-native. Moreover, many high-performance computing centres (HPC) host large climate datasets on traditional file-based storage infrastructures, whereas computational resources are often located at different sites. This separation between data location and compute resources creates significant barriers to efficient, interactive, and scalable data access.This situation calls for climate data access services that are scalable, flexible, and independent of specific client-side environments, while supporting common climate data formats such as NetCDF, GeoTIFF, Zarr, HDF5, and GRIB. Nevertheless, efficient remote access to large and heterogeneous climate archives remains a major bottleneck for modern scientific workflows.We present aservice, the Freva Data Loader, which implements the logic required to open datasets from diverse storage backends and expose them as Zarr chunks through a lightweight, web-friendly REST interface with modern authentication mechanisms.The Freva Data Loader is implemented as a stateless, worker service exposing a REST interface for dataset access and Zarr endpoint generation. Upon receiving an authenticated request, the service resolves dataset metadata, opens the underlying data from the appropriate storage backend (e.g. POSIX file systems or object storage), and exposes the data as a Zarr-compatible, chunked stream. Authentication and authorisation are handled centrally using OAuth2, ensuring secure and controlled access across institutional boundaries. Requests are coordinated by a Loader component and distributed to worker instances via a message broker (Redis), enabling asynchronous execution and horizontal scalability.The service decouples data access from client-side tooling and enables users and applications to access data stored on traditional posix HPC file systems, tape archives, as well as cloud-based object storage through a unified Zarr interface. Instead of transferring complete files between data centres or downloading them in full, clients retrieve only the required data chunks on demand. Users and client applications can request chunked array access over the network and process data incrementally, supporting interactive exploration and scalable downstream computation using cloud-native, chunked storage semantics, while remaining compatible with existing analysis stacks based on Zarr, xarray, and Dask.
- Open Access
- 14 March 2026
- Published by Copernicus GmbH
Accelerating Data Discovery: Automated, Scalable Harvesting and Indexing of Metadata Across Heterogeneous Storage Backends
The discoverability and access of climate and Earth-system datasets is foundational for effective scientific analysis workflows, yet these datasets are often hosted across diverse storage systems and follow a variety of organisational conventions. Researchers and infrastructure engineers face challenges in ingesting distributed metadata into unified, searchable catalogues without sacrificing interoperability or scalability. Efficient metadata harvesting, normalisation, and ingestion at scale are therefore critical enablers for data discovery and FAIR (Findable, Accessible, Interoperable, and Reusable) data practices.To address this need, we present the Metadata Crawler, a metadata ingestion tool within the designed to automate the collection and indexing of climate dataset metadata across heterogeneous storage backends. The Metadata Crawler supports multi-backend discovery, including POSIX file systems, S3/MinIO object stores, and OpenStack Swift, enabling infrastructure administrators to aggregate metadata from local archives, cloud object storage, and institutional repositories. At its core, the Metadata Crawler implements a two-stage pipeline: harvested metadata are first collected into a temporary catalogue, and then indexed into downstream systems such as Apache Solr or MongoDB. Dataset definitions, directory structures, and extraction logic are governed by a flexible TOML configuration that encodes Data Reference Syntax (DRS) dialects for different standards. Users can make use of pre-defined standards or define their own, making the tool extremely flexible and versatile. This schema-driven approach, combined with path and data specifications, conditional rules, and computed fields, ensures consistent representation of key facets such as temporal coverage, geospatial bounds, and variables and many other metadata specifications.The tool provides both a command-line interface (CLI) and a Python API, supporting synchronous and asynchronous execution as well as multi-threaded crawling, facilitating integration into operational workflows. By normalising and indexing previously siloed metadata into searchable catalogues, the Metadata Crawler enhances data findability and empowers portals and analysis platforms to deliver efficient discovery services. Its modular design also allows deployment in diverse environments and easy extension to additional backends or indexing targets.
- 14 March 2026
- Published by Copernicus GmbH
Open AccessAccelerating Data Discovery: Automated, Scalable Harvesting and Indexing of Metadata Across Heterogeneous Storage Backends
The discoverability and access of climate and Earth-system datasets is foundational for effective scientific analysis workflows, yet these datasets are often hosted across diverse storage systems and follow a variety of organisational conventions. Researchers and infrastructure engineers face challenges in ingesting distributed metadata into unified, searchable catalogues without sacrificing interoperability or scalability. Efficient metadata harvesting, normalisation, and ingestion at scale are therefore critical enablers for data discovery and FAIR (Findable, Accessible, Interoperable, and Reusable) data practices.To address this need, we present the Metadata Crawler, a metadata ingestion tool within the designed to automate the collection and indexing of climate dataset metadata across heterogeneous storage backends. The Metadata Crawler supports multi-backend discovery, including POSIX file systems, S3/MinIO object stores, and OpenStack Swift, enabling infrastructure administrators to aggregate metadata from local archives, cloud object storage, and institutional repositories. At its core, the Metadata Crawler implements a two-stage pipeline: harvested metadata are first collected into a temporary catalogue, and then indexed into downstream systems such as Apache Solr or MongoDB. Dataset definitions, directory structures, and extraction logic are governed by a flexible TOML configuration that encodes Data Reference Syntax (DRS) dialects for different standards. Users can make use of pre-defined standards or define their own, making the tool extremely flexible and versatile. This schema-driven approach, combined with path and data specifications, conditional rules, and computed fields, ensures consistent representation of key facets such as temporal coverage, geospatial bounds, and variables and many other metadata specifications.The tool provides both a command-line interface (CLI) and a Python API, supporting synchronous and asynchronous execution as well as multi-threaded crawling, facilitating integration into operational workflows. By normalising and indexing previously siloed metadata into searchable catalogues, the Metadata Crawler enhances data findability and empowers portals and analysis platforms to deliver efficient discovery services. Its modular design also allows deployment in diverse environments and easy extension to additional backends or indexing targets.
- Open Access
- 15 March 2025
- Published by Copernicus GmbH
An AI-Copilot for JupyterLab for climate data analyses using FrevaGPT
JupyterLab is a web-based interactive development platform that is widely used in the Earth science community. Using Jupyter Notebooks, it is possible to perform data analysis tasks, annotate and visualize results in a way that is easy to reproduce, present and share with others. JupyterLab allows the use of “extensions”, which add functionality to the platform. One of these is Jupyter-AI [1], which allows the use of Large Language Models (LLMs), such as ChatGPT, Claude Sonnet and Ollama, within the JupyterLab environment, through a chat interface or directly within notebooks. By integrating LLMs into JupyterLab, it is possible to leverage their code generation capabilities to assist a user to translate their analysis tasks from an idea to actual executable code in an efficient manner. One drawback of using these LLMs in tasks involving spatio–temporal data is that the models typically do not have access to the data necessary for the analysis task and will often resort to generating fictional data or using placeholders in the code that they create. This requires the user to adapt the provided code to their data, which removes some of the utility provided by the LLM.In this context we make use of FrevaGPT, an approach for using LLMs in climate data analysis that allows for quick, complex and reproducible analyses of data sets, such as decadal climate model forecasts. Leveraging LLM’s capability to write code and using few-shot prompting (in-context learning) allows the LLM to utilize Freva [2,3] (Free Evaluation Framework), a data search and analysis platform, which provides a standardised interface to spatio-temporal datasets hosted on an HPC cluster [4]. FrevaGPT integrates seamlessly into Jupyter-AI and, by making use of the Freva library, combines the code-generating capabilities of LLMs with contextual understanding of how to access relevant datasets on the HPC cluster. This in addition with FrevaGPT’s ability to execute generated code in an isolated environment on an HPC node, annotating and explaining any intermediate results, as well as automatically correcting errors encountered along the way, could serve as a starting ramp for researchers to efficiently produce new analysis products based on spatio-temporal climate data. This PICO will include examples of using FrevaGPT within JupyterLab to analyse spatio-temporal datasets from the climate of the past, as well seasonal to decadal climate predictions. References:[1] Jupyter-AI GitHub Repository: https://github.com/jupyterlab/jupyter-ai[2] Kadow, Christopher, Sebastian Illing, Etor E. Lucio-Eceiza, Martin Bergemann, Mahesh Ramadoss, Philipp S. Sommer, Oliver Kunst, et al.. 2021. “Introduction to Freva – A Free Evaluation System Framework for Earth System Modeling”. Journal of Open Research Software 9 (1): 13. https://doi.org/10.5334/jors.253.[3] Freva GitHub Repository: https://github.com/FREVA-CLINT/freva[4] Public Freva Instance: https://www.freva.dkrz.de/
- 15 March 2025
- Published by Copernicus GmbH
Open AccessAn AI-Copilot for JupyterLab for climate data analyses using FrevaGPT
JupyterLab is a web-based interactive development platform that is widely used in the Earth science community. Using Jupyter Notebooks, it is possible to perform data analysis tasks, annotate and visualize results in a way that is easy to reproduce, present and share with others. JupyterLab allows the use of “extensions”, which add functionality to the platform. One of these is Jupyter-AI [1], which allows the use of Large Language Models (LLMs), such as ChatGPT, Claude Sonnet and Ollama, within the JupyterLab environment, through a chat interface or directly within notebooks. By integrating LLMs into JupyterLab, it is possible to leverage their code generation capabilities to assist a user to translate their analysis tasks from an idea to actual executable code in an efficient manner. One drawback of using these LLMs in tasks involving spatio–temporal data is that the models typically do not have access to the data necessary for the analysis task and will often resort to generating fictional data or using placeholders in the code that they create. This requires the user to adapt the provided code to their data, which removes some of the utility provided by the LLM.In this context we make use of FrevaGPT, an approach for using LLMs in climate data analysis that allows for quick, complex and reproducible analyses of data sets, such as decadal climate model forecasts. Leveraging LLM’s capability to write code and using few-shot prompting (in-context learning) allows the LLM to utilize Freva [2,3] (Free Evaluation Framework), a data search and analysis platform, which provides a standardised interface to spatio-temporal datasets hosted on an HPC cluster [4]. FrevaGPT integrates seamlessly into Jupyter-AI and, by making use of the Freva library, combines the code-generating capabilities of LLMs with contextual understanding of how to access relevant datasets on the HPC cluster. This in addition with FrevaGPT’s ability to execute generated code in an isolated environment on an HPC node, annotating and explaining any intermediate results, as well as automatically correcting errors encountered along the way, could serve as a starting ramp for researchers to efficiently produce new analysis products based on spatio-temporal climate data. This PICO will include examples of using FrevaGPT within JupyterLab to analyse spatio-temporal datasets from the climate of the past, as well seasonal to decadal climate predictions. References:[1] Jupyter-AI GitHub Repository: https://github.com/jupyterlab/jupyter-ai[2] Kadow, Christopher, Sebastian Illing, Etor E. Lucio-Eceiza, Martin Bergemann, Mahesh Ramadoss, Philipp S. Sommer, Oliver Kunst, et al.. 2021. “Introduction to Freva – A Free Evaluation System Framework for Earth System Modeling”. Journal of Open Research Software 9 (1): 13. https://doi.org/10.5334/jors.253.[3] Freva GitHub Repository: https://github.com/FREVA-CLINT/freva[4] Public Freva Instance: https://www.freva.dkrz.de/
- Open Access
- 15 March 2025
- Published by Copernicus GmbH
Post-event assessment of extreme events within an evaluation system framework
The ClimXtreme program[1,2], funded by the German Ministry of Education and Research, consists of 25 subprojects investigating extreme events in central Europe focussing on heat/drought, extreme precipitation and wind storms. Extreme events occurring during project runtime are assessed within the research program by forming a post-event assessment group (PostAG). This group aims at rapid response using both pre-defined methods and workflows as well as cutting edge methods of the research program.The basis for the assessment is the evaluation framework Freva (Free Evaluation System Framework)[3,4] which provides an efficient possibility to handle customisable evaluation systems of large research projects. Several projects and institutions are already using this framework for educational or research purposes. Among them is worthy to mention the Freva instance hosted at the German weather service (DWD) which allows an exchange of methods and assessment workflows between research projects and the DWD. The Freva instance of ClimXtreme[5], hosted at DKRZ, enables the possibility to access more than 10 million data files from models (e.g. CMIP, CORDEX) and observations (e.g. ERA5, HYRAS, stations). Near-realtime data of observations are operationally updated for the PostAG assessment.This contribution shows an interplay of the evaluation framework and scripted workflows to rapidly assess extreme events directly after their occurrence with pre-defined methods (e.g. plugins) providing the option to easily expand the analysis by new methodologies developed by the research program.References:[1] https://www.fona.de/de/massnahmen/foerdermassnahmen/climxtreme.php[2] https://www.climxtreme.de/[3] http://doi.org/10.5334/jors.253[4] https://github.com/FREVA-CLINT/freva[5] https://www.xces.dkrz.de/
- 15 March 2025
- Published by Copernicus GmbH
Open AccessPost-event assessment of extreme events within an evaluation system framework
The ClimXtreme program[1,2], funded by the German Ministry of Education and Research, consists of 25 subprojects investigating extreme events in central Europe focussing on heat/drought, extreme precipitation and wind storms. Extreme events occurring during project runtime are assessed within the research program by forming a post-event assessment group (PostAG). This group aims at rapid response using both pre-defined methods and workflows as well as cutting edge methods of the research program.The basis for the assessment is the evaluation framework Freva (Free Evaluation System Framework)[3,4] which provides an efficient possibility to handle customisable evaluation systems of large research projects. Several projects and institutions are already using this framework for educational or research purposes. Among them is worthy to mention the Freva instance hosted at the German weather service (DWD) which allows an exchange of methods and assessment workflows between research projects and the DWD. The Freva instance of ClimXtreme[5], hosted at DKRZ, enables the possibility to access more than 10 million data files from models (e.g. CMIP, CORDEX) and observations (e.g. ERA5, HYRAS, stations). Near-realtime data of observations are operationally updated for the PostAG assessment.This contribution shows an interplay of the evaluation framework and scripted workflows to rapidly assess extreme events directly after their occurrence with pre-defined methods (e.g. plugins) providing the option to easily expand the analysis by new methodologies developed by the research program.References:[1] https://www.fona.de/de/massnahmen/foerdermassnahmen/climxtreme.php[2] https://www.climxtreme.de/[3] http://doi.org/10.5334/jors.253[4] https://github.com/FREVA-CLINT/freva[5] https://www.xces.dkrz.de/