History and future

Versions

A summary of the versions and changes.

  • v1.0
    Initial release.
    (2020-06)
  • v1.1
    Support averaging of grid cells over footprints.
    Added output options for horizontal mapping info, model concentrations at native layers, and simulated profile.
    (2020-09)
  • v1.2
    Updates for retrieval products including apriori profiles.
    (2020-10)
  • v1.3
    Added operator for mapping vertical profiles.
    (2020-10)
  • v1.4
    Create listing files not as part of convert job but in a seperate job.
    Use weights expressed in area in horizontal mapping.
    Added tools to create gridded averages.
    (2020-11)
  • v1.5
    Added option to search for orbit files collected in tar files.
    Fixes for mapping information.
    (2020-11)
  • v1.6
    Put out user defined variables over pixels from a simulation model.
    (2021-01)
  • v1.7
    Introduced formula definitions for operations on pixel data.
    Support airmass factor corrections as used for NO2 products.
    (2021-05)
  • v1.8
    Replaced default download method for OpenSearch API.
    Added HCHO basic rc file.
    Extended support for DLR TROPOMI products.
    Add adjoint operations and adjoint test.
    (2021-06)
  • v2.0
    Added --single flag to run script to allow running just one job step.
    Introduced config directories to store settings.
    (2023-03)

To be included

Features available in branches, that should be included in master version.

  • Create map plots as a list of pixels, in case track information is not available. (E.D.)

  • Regrid data using CSO Python routines rather than using mapping information saved from Fortran operator. (E.D.)

To be done

A wishlist of developments.

  • Regridding following Kuhlman et al. (2014).

  • Include time range in all filenames?

    • Proposal: use names similar to the original S5p files, up to the collection number:

      S5P_NRTI_L2__NO2____20140101T000000_20140102T000000_00099_01.nc

    • Also output by observation operator could use the same basename.

  • Add all S5p filename parts to listingfile, see Product User Manual.

  • Add offline tool to re-create listing files.

    • Scan directories based on filename patterns.

    • Eventually specify order, thus RPRO if available, otherwise OFFL or NRTI.

  • If the original track is saved, add flags to log which selection criterium was used to exclude a pixel.

  • Packing and deflation options for netCDF files.

  • Store covariances as sparse matrix (diagonal?) if possible.

  • Storage of additional observation representation errors by assimilation system.