The DKRZ CMIP Data Pool (DKRZ CDP)

The DKRZ CMIP data pool (DKRZ CDP) contains flagship collections of Earth System Model data.

In 2016, DKRZ made it their mission to create and operate the national CMIP6⁺ Data pool as part of the German Alliance DICAD supported by the Federal Ministry of Education and Research. Today, it provides the largest online data collection of the recent phase 6 of the Coupled Model Intercomparison Project (CMIP6) in Europe, is the data basis for the IPCC report AR6 and contributes to the Copernicus Climate Data Store. The DKRZ CDP supports scientists in browsing, access and processing these high volume data collections. Ongoing activities on analysis services for working with the CDP are coordinated within the IS-ENES3 project.

CMIP is a periodically conducted model intercomparison project with the object to evaluate and compare climate models. CMIP protocols define central basic experiments which build the basis for model evaluation. As endorsed to CMIP6, many additional MIP activites investigate specific research questions (Fig. 1).

cmip6_disk

Fig. 1: Schematic of the CMIP6 experiment design (Eyring et al., 2016). CMIP DECK experiments and the CMIP6 historical simulation form the inner part and are standard experiments. They represent an entry card for models that would like to participate in CMIP and its endorsed MIPs. The middle ring and outer ring connect science topics with corresponding CMIP6-endorsed MIPs.

The CMIP design may vary in scientific targets but the upcoming phases will share the DECK experiments with CMIP6 as they remain the basic experiments (Fig. 2).

cmip_disks

Fig. 2: Future CMIP phases (Eyring et al., ,2016).

The climate research community benefits from the DKRZ CDP in many ways. Most importantly, the CDP is accessible on file system for direct and fast access. This is only possible because the Scientific Steering Commitee has granted a disk space on mistral lustre file system of 5PB for the Consortium project CMIP data pool. In addition to /work disk space, we provide back ups in the HSM archive as well as some collections in the swift object storage.

We offer you support in different fields of data processing that help your data to become part of the CMIP Data pool. Additionally, we perform many tasks required to maintain and host the CMIP dtaa pool. One of our goals is to develop these services towards automizied pipelines. Here is an overview about our activites:

Our range of services

Pipeline

Job

Frequency

Automization

Repository

Preparation

Post-Processing

On demand

No

https://gitlab.dkrz.de/dicad-pp

Ingestion

Data Transfer

First of each month

No

https://gitlab.dkrz.de/dicad-pp/data2esgfbuffer

Ingestion

Quality Assurance

First of each month

No

Ingestion

Publication

On demand

No

Curation

Replication

Daily

Yes

https://gitlab.dkrz.de/dicad-pp/data2esgfbuffer

Curation

Back-up

Half-year

No

Curation

Retraction

On demand

No

Curation

Intake CMIP6

Daily

Cronjob

https://gitlab.dkrz.de/mipdata/intake-esm

Curation

Intake CMIP5

Monthly

Cronjob

https://gitlab.dkrz.de/mipdata/intake-esm

Curation

Intake CORDEX

Monthly

Cronjob

https://gitlab.dkrz.de/mipdata/intake-esm

Parts of these services have been developed in projects which have ended. Due to a lack of permanent positions, its maintance is not supported anymore. They are proceeded as long as no errors occur.

Highlights of data pool news are presented on DKRZ’s blog Subscribe the mailing list ✉ cmip-data-poolATlists.dkrz.de to get the latest news per mail. Contact data-poolATdkrz.de for dedicated support regarding the DKRZ CDP or replication requests.

The DKRZ DM Data Infrastructure team is preparing these documentations of the data pool status. This sphinx format will be integrated into a common DKRZ documentation in the near future.

Publications:

Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J. and Taylor, K. E.: Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9(5), 1937-1958, doi:10.5194/gmd-9-1937-2016, 2016.