TNO Intern

Skip to content
CHANGELOG 7.05 KiB
Newer Older
CSO - CAMS Satellite Operator
Arjo Segers's avatar
Arjo Segers committed
=============================


Version tags
------------
See "History" chapter in documentation for overview of versions.
Detailled changes per version are listed below.
Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed
Updated documentation.
  doc/source/documentation.rst
  doc/source/s5p-so2.rst

Improved MPI data type selection.
  oper/src/cso_comm.F90
  oper/src/cso_ncfile.F90

Properly count user defined variables.
  oper/src/cso_pixels.F90

Fixed deallocation.
  oper/src/cso_sat.F90

Only setup exchange between domains if needed.
  oper/src/cso_sat.F90

Optional limit output variables to selection.
  oper/src/cso_sat.F90

Trap non-existing or empty listing files when creating catalogue of converted data.
  py/cso_catalogue.py

Updated documentation of special conversions.
  py/cso_s5p.py

Templates for S5p/CO product.
  doc/samples/S5p_OFFL_L2__CO____*.txt
  py/cso_s5p.py
Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed
Processing of NO2 superobservations provided by KNMI.
  doc/source/figs/NO2_superobs
  doc/source/index.rst
  doc/source/obsoper.rst
  doc/source/pymod-cso_s5p_superobs.rst
  doc/source/s5p-no2-superobs.rst
  py/cso.py
  py/cso_s5p.py
  py/cso_s5p_superobs.py

Support timeseries with different resolution.
  py/cso_catalogue.py
  py/cso_index.py

Updated documentation.
  doc/source/s5p-no2.rst
  doc/README.md

Read data on root, scatter to processes.
  oper/src/cso_comm.F90
  oper/src/cso_domains.F90
  oper/src/cso_ncfile.F90
  oper/src/cso_pixels.F90
  oper/src/cso_sat.F90
Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed
Create gridded averages using mapping functions similar as used in observation operator.
  py/cso_gridded.py
  py/cso_mapping.py
  py/cso_constants.py
  doc/source/gridding.rst
  doc/source/pymod-cso_mapping.rst
  doc/source/pymods.rst
  
Add time dimension to gridded averages to allow temporal averaging.
  py/cso_gridded.py
Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed
When mapping footprints to grid cells, split triangles into 2 new triangles 
based on the longest edge 
  py/cso_mapping.py

Retry reading of S5p data, sometimes fails for unknown reason.
  py/cso_s5p.py

Added class to create plot of S5p versions downloaded from SciHub.
  py/cso_scihub.py

Support processing of S5p/NO2 data from PAL.
Arjo Segers's avatar
Arjo Segers committed
  py/cso_pal.py
Arjo Segers's avatar
Arjo Segers committed
  
Changed S5p conversion class to download files while converting.
Eventually downloaded files are removed after conversion.
  py/cso_s5p.py
  py/cso_scihub.py
Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed
Aggregation over regions.
  py/cso_regions.py
  data/country-codes*.csv
  doc/source/pymod-cso_regions.rst
  doc/source/pymods.rst
  doc/source/gridding.rst

Support for S5p/Glyoxal product.
  config/ESA-S5p/cso-s5p-glyox.rc
  doc/source/s5p-glyoxal.rst
  doc/source/figs/GLYOX/
  doc/samples/S5P_OFFL_L2__CHOCHO___20200601T001519_20200601T015649_13643_01_010000_20210128.txt
  doc/source/index.rst

Arjo Segers's avatar
Arjo Segers committed
Support batch job for Sun Grid Engine.
  py/utopya_jobscript.py
  py/utopya_jobtree.py

Improved inquire tasks for SciHub and PAL portals.
Arjo Segers's avatar
Arjo Segers committed
  py/cso_scihub.py
Arjo Segers's avatar
Arjo Segers committed
  py/cso_pal.py
  py/cso.py
  py/cso_inquire.py
  doc/source/pymod-cso_inquire.rst
  doc/source/pymod-cso_pal.rst

Updated documentations for inquire tasks.
  doc/source/tutorial.rst
  doc/source/s5p-so2.rst
  doc/source/s5p-no2.rst
  doc/source/s5p-hcho.rst
  config/tutorial/tutorial.rc

Support computation of grid cell areas for 2D arrays.
  py/cso_mapping.py

Added class to create super-observations.
  py/cso_superobs.py
  py/cso.py
  doc/source/pymod-cso_superobs.rst
  doc/source/pymods.rst

Specify output file template for catalogue figures rather than output directory.
Support steps over year when plotting series of gridded observations.
  py/cso_catalogue.py

Write files with packing and compression.
  py/cso_file.py
  py/cso_s5p.py
  oper/src/

Added class to create temporal means of gridded averages.
  py/cso_gridded.py
  doc/source/gridding.rst

Read Timestamp object from rcfile settings.
  py/rc.py

Support index timeseries over years.
  py/utopya_index.py

Updated product description of S5p/Glyoxal.
  doc/source/s5p-glyoxal.rst

Updated template settings.
  config/tutorial/tutorial.rc

Arjo Segers's avatar
Arjo Segers committed
Added tools to collect and plot time series of co-located pixel averages.
  py/cso_colocate.py
Arjo Segers's avatar
Arjo Segers committed
  py/cso.py
Arjo Segers's avatar
Arjo Segers committed
  py/cso_mapping.py
  doc/source/index.rst
  doc/source/colocate.rst
  doc/source/pymods.rst
  doc/source/pymod-cso_colocate.rst
  doc/source/documentation.rst

Create output directory if necessary.
  py/cso_inquire.py

Trap errors from plotting coastlines and country borders.
  py/cso_plot.py

Updated user guide.
  doc/source/figs/footprints_nc4_levels_and_area.png
  doc/source/obsoper.rst

Added option to plot specific layer of gridded averages.
Adhoc fix to trap nans in some files.
  py/cso_catalogue.py 

Support packed output for gridded averages.
  py/cso_gridded.py

Updated documentation.
  py/cso.py

Arjo Segers's avatar
Arjo Segers committed
Removed depricated DHUS downloads.
  py/cso_scihub.py

Define environment variable CSO_PREFIX.
  bin/cso
  
Use environment variable for installation prefix, use own filename for settings.
    config/tutorial/tutorial.rc
Arjo Segers's avatar
Arjo Segers committed
Changes for v2.2
----------------

Option to create gridded fields from orbit files in listing.
  py/cso_gridded.py
  py/cso_file.py
  config/tutorial/tutorial.rc


Changes for v2.3
----------------

Added collection level to inquire overview plots.
  py/cso_inquire.py

Convert selected orbit files based on selection query.
  py/cso_s5p.py

Synchronized template settings for Copernicus S5P products.
  config/Copernicus/

Updated User guide.
  doc/source/


Arjo Segers's avatar
Arjo Segers committed

Added 'black' target to Makefile, including convention for maximum line length.
Reformatted files following new convention.
  Makefile
  py/*


Arjo Segers's avatar
Arjo Segers committed

Fixed definition of CSO_PREFIX environment variable.  
  bin/cso

Updated tutorial.
  config/tutorial/tutorial.rc
  doc/source/tutorial.rst

Define lon/lat axes of gridded output as floats.
  py/cso_gridded.py

Use pandas concat to combine dataframes.
  py/cso_pal.py

Replaced `where` concstructs by loops after memory errors in output filling.
Arjo Segers's avatar
Arjo Segers committed
  oper/src/cso_ncfile.F90
Arjo Segers's avatar
Arjo Segers committed
  
Check on `pix_all` value to know if pixels are assigned to any of the sub-domains.
  src/tutorial_oper_S5p.F90
Arjo Segers's avatar
Arjo Segers committed

Arjo Segers's avatar
Arjo Segers committed
Migration from Copernicus SciHub to DataSpace.
  bin/dhusget.sh
  doc/source/*
  py/*
  config/*


Patch 2.5.1
~~~~~~~~~~~

Fixed bug in S5P orbit selection.
  py/cso_s5p.py

Arjo Segers's avatar
Arjo Segers committed
Support SO2-COBRA product from PAL website.


v2.7
----

Fixed averaging over time values when creating super-observations.
  py/cso_superobs.py

Improved output of packed variables.
Support files with "sample" coordinate instead of "pixel".
  oper/

Use cartopy for map plots.
  py/cso_plot.py
  py/cso_catalogue.py

Support orbits that overlap with dateline.
  py/cso_s5p.py
  py/cso_gridded.py
  py/cso_superobs.py


Removed suppored for NO2-superobs, now create these using own classes.
  py/cso_s5p_superobs.py
  py/cso.py
  config/EMEP/emep-tropomi-superobs.rc
  doc/source/index.rst
  doc/source/pymod-cso_s5p_superobs.rst
  doc/source/s5p-no2-superobs.rst

Removed depricated references to S5p-Hub.
Arjo Segers's avatar
Arjo Segers committed
Removed whitespace from lines for easier comparison with other versions.
  py/
Synchronized layout with CSO public version for easier synchronization.
Synchronized change logs in source files between master and development versions.
  py/