Cross-sections, common interfaces and cataloging in Jülich

by WarmWorld Office
2025-03-07

The 2025 WarmWorld-Easier meeting is underway these days, hosted by the Jülich Supercomputing Center (FZ Jülich), bringing together the project members to assess the progress achieved in the first half of the project and to directly work on common approaches and novel workflows for ICON and IFS. Discussions focus on several topics improving interoperability, visualization, and data management:

  • Strengthening ICON’s interface with ComIn: Experts from DKRZ, KIT, Uni-Köln and GERICS-HEREON are progressing in integrating ComIn, the ICON Community Interface, with the WarmWorld ICON developments, reducing programming language dependencies and expanding usability across research communities.
  • Enhancing simulation with PAMTRA: The ongoing work on integrating the PAMTRA instrument simulator with ICON for in-situ analysis, improved visualization, and pattern recognition is underway with using the datasets from the HALO-(AC)3 campaign. The Easier members from Uni-Köln, DKRZ, MPI-M aim to further extract flight tracks and satellite overpasses to improve model-observations comparisons, with additional effort on optimizing the experiment execution mkexp setup for use with PAMTRA.
  • Establishing a common catalog data access framework with STAC and ZARR: The unified SpatioTemporal Asset Catalog (STAC) is being integrated to standardize metadata, improve data indexing, and enhance interoperability across infrastructures like DKRZ and JSC. A common data access will be provided through zarr over HTTPS including a new extension of the Fields DataBase (FDB) by ECMWF. The testing ground for this implementation are data from nextGEMS Cycles 3 and 4, as well as selected IFS data.
  • Streamlining workflow management with FREVA: Work continues on FREVA to facilitate dataset searching, standardized analysis, and reproducibility within WarmWorld, a task involving the project members from both DKRZ and JSC. In addition to the already existing DKRZ instance, it is gradually integrated into Jupyter-JSC for a seamless and scalable user-supercomputer interaction, e.g. with the upcoming exascale system Jupiter.

While evaluating the current progress, decisions are also made in terms of short- and medium-term priorities, with the WarmWorld Phase 2 in mind.

group_photo