Skip to end of metadata
Go to start of metadata

You are viewing an old version of this content. View the current version.

Compare with Current View Version History

Version 1 Next »

This SWOT analysis is the second part of the deliverable D.M.1.1 and is discussed in an online meeting on the 29th of January 2024.

Leads: Beatrice Ellerhoff

Contributors:

Introduction:
For a definition and overall motivation of SWOT analysis in the ITMS project management, see the first part of this deliverable: /wiki/spaces/ITMSM/pages/47054866
This second part of the SWOT analysis is needed to share existing experiences with the systems used and developed in ITMS.
The discussion will aid the benchmarking and reviewing process as well as the planning of the next phase.

SWOT-Analysis for the different contributions to ITMS-M

  1. DWD / KIT contributions to the modelling tasks in ITMS (ICON-ART foward modelling and inversion)

1.1. KIT (DWD-KIT highlights points that are duplicated in 1.2)

Strengths

  • State-of-the-art meteorological transport model ICON-ART [RR] DWD-KIT

  • Continuous and dynamic development of ICON-ART through large development community [RR]

  • Experience in simulating trace substance transport and chemistry [RR]

  • Experience with data assimilation from numerical weather prediction (NWP) [RR] DWD-KIT

Weaknesses

  • Some metrics for model validation still need to be developed [RR]

  • Likewise, the workflow for eliminating model bugs or for implementing improvements in the used model version [RR] DWD-KIT

  • No estimation of model uncertainty regarding chemistry and transport available [RR]

Opportunities

  • The open source release of ICON increases the developer community so that ICON-ART can benefit from improvements outside of ITMS [RR]

Threats

  • High computing time requirement for high resolution simulations with additional tracers [RR]

  • Estimation of model uncertainty regarding chemistry and transport [RR]

1.2. DWD

Strengths

  • Quality of meteorological transport model DWD-KIT

  • Experience in data assimilation from numerical weather prediction (NWP) DWD-KIT

    • Ensemble-approaches, e.g. we can quantify meteorological transport uncertainty

    • DACE-framework for various DA methods (such as LETKF, 3D-VAR, etc.)

  • First working version of a synthesis inversion

  • First 3D-Var-Version for CH4-DA in DACE2

Weaknesses

  • Resolution of urban areas

  • Bugs in the present code base when extending ART forward modelling to long-lived greenhouse gases DWD-KIT

    • Quality and readability of the code and code documentation needs to be improved

  • Standards for code and software management are partly still under development and need to be applied more consequently

    • Other bugs in the DWD ICON-ART experiments that remain to be resolved

      • e.g. differences between the mixing ratios definition in observations and models (e.g., with respect dry air, moist air or, even including mass of hydrometeors as specified in ICON)

  • The uncertainty matrices for the data assimilation and inversion need development

    • More comprehensive and selective treatment of observations (especially their uncertainties and correlations) is needed

    • Currently, no data-based covariance matrix of a priori emissions is available and considered (not needed in current inversion scheme, but will be relevant in the future)

Opportunities

  • Integration of data assimilation and inversion

  • Possibility to run the system as an operational capability building onto the mature NWP system

  • Flexible integration of flux estimates as well as time-varying emissions, as provided by Q&S

  • Improvements in the quality and documentation of code and software will prevent some future weaknesses, increase user-friendliness and help new employees to start their work more easily

  • Strong collaboration with partners with special expertise:

    • EMPA (e.g., ensemble approaches, estimation of uncertainties like B-Matrix, OEM)

    • FEHP (e.g., ICOS measurement uncertainties)

    • EZMW (e.g., 4D-VAR with Ensembles and simultaneous parameter estimation)

    • UBA (e.g., emission uncertainty)

  • Change from CAMS-EGG4 initial and boundary conditions to improved CAMS-Inversion-Optimized product for DWD model experiments

  • Opportunity to use more highly resolved emission data (less aggregated on sector, spatial and temporal levels than currently)

  • Opportunity to use future observation products (e.g. for satellite data) in our DA system

Threats

  • Threats with respects to observation data used in model experiments:

    • Too few observations

    • Unclear representativeness of observations

    • Partially unknown timeliness, quality, and usability of new observation products (e.g., from satellites)

  • Accuracy of externally provided boundary conditions for concentration fields

  • Long-term development vs. short-term schedule based on 3 to 4-year phases

    • The developed DA and the forward-modelling is highly complex and requires training and experiences of employees

  1. IUP Heidelberg contributions to the modelling tasks in ITMS (urban high-resolution CO2 simulation for OSSE)

Strengths

  • Large signals for urban areas

  • Independent model--> no need for icon model development, observations & recent Q&S

Weaknesses

  • Many possible configurations of monitoring strategies prevent analyzing all of them

  • Synthetic study has no direct application for emissions, but only for observation strategies in general

  • Different model used than in the other ITMS-M modules 

Opportunities

  • Link to ITMS-B as well as to ICOS Paul

  • Importance of cities addressed in this WP → role for ITMS phase 2?

  • Potential linkage to the WP “Multi-Tracer”

Threats

  • Difference of German cities may prevent clear suggestions across cities

  • No necessary links to other ITMS-M WPs, however synergies

  1. MPI-BGC contributions to the modelling tasks in ITMS (CarbonScale Regional Inversion)

Strengths

  • History of inversions from global to regional scale

  • STILT as regional transport model to generate transport adjoint (footprints) using NWP products from ECMWF

  • Long time scales with single “assimilation window” over 15 years

  • Maturity of CarboScope-Regional is developing, soon allowing contribution to the inventory report appendix.

    • Maturity requires consistency in flux estimates from consecutive inversions for overlapping periods.

  • Evaluation of GHG transport using profile information from aircraft (IAGOS, HALO missions)

Weaknesses

  • Not easily adoptable for remote sensing due to computational effort required to generate footprints

  • Transport resolution not very high

  • Link to global inversion through two-step scheme, requiring careful alignment of observational datasets (list of stations) used for both steps (global and regional)

  • Rn as tracer for transport - uncertainties for exhalation rates are larger than expected

    • Needs joint inversion using realistic uncertainties for fluxes of Rn and tracer of interest (CO2, CH4, …)

Opportunities

  • Backbone system for comparisons with DWD ICON GHG data assimilation

  • Utilization of DWD ICON meteorological output

  • Augmentation to methane

  • 14C based fossil CO2 inversion to estimate emissions - external task by ICOS-D

  • Detailed comparison of STILT and FLEXPART to improve regional atmospheric transport models

Threats

  • Observation density too low when only using tall tower data and ground based stations

Summary of discussion:

We conducted a SWOT analysis that provided valuable insights into our current ITMS-M status and potential areas for improvement. Here is a summary of our findings and the discussion on January 29, 2024:

Commonalities:

  • Uncertainty treatment is identified as a weakness in many systems, indicating the need for future improvement.

  • Model validation necessitates more standardized test experiments to identify bugs and quantify uncertainties. Ongoing efforts are underway, but continuous attention, application, and improvement on these standards are crucial.

  • Discussion of observations and the selection of observational data for model comparison are essential. However, there is likely a low observation density, emphasizing the need for careful consideration:

    • Close collaboration with ITMS-B and their satellite experts is key strength in this regard

    • Opportunities for evaluation of greenhouse gas transport using profile information from aircraft missions (IAGOS, HALO missions)

    • Discussions with experimenters are necessary to identify error-prone observations

  • Inter-model comparison requires standardized protocols. This could also involve new types of model experiments, such as simulating radon in ICON-ART to compare it to the MPI-BGC system.

  • Good documentation is essential to cope with the complexity of our modelling, DA and inversion tasks. Improved documentation and standards are a key opportunity that is expected to result in fewer bugs and better control as well as understanding of uncertainties.

Additional Comments:

  • The IUP currently holds a unique position in their experience with the role of emissions from cities. There is untapped potential for closer links to other work packages and ITMS-B.

In summary, we can deduce two main suggestions to overcome current weaknesses, prevent threats and make use of opportunities: First, it is important to continue the efforts on standardized test experiments and good documentation. This also includes the planning and application of additional protocols, e.g. for inter-model comparison or uncertainty quantification. Second, discussions and close links between work packages and modules will help explore the best possible usage of observational data and a priori emission data, as well as enhance the learning from different modeling experiences present in ITMS.

For a more detailed protocol of the meeting (by RA), see https://itmsgermany.atlassian.net/l/cp/7ai4bh0G.

There is an update on the test cases and the protocols for making consistent evaluations inspired as a result of this SWOT analysis. See /wiki/spaces/ITMSM/pages/137789472 for more details and to contribute with ideas.

Next SWOT-Analysis:

Repeating the SWOT on a yearly bases helps ensure a robust and effective approach in our modelling tasks. The next SWOT analysis is due 28th of February 2025.

  • No labels