Subscriber 1.9.0

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog

[1.9.0]

Added

• check if file exists before downloading a file. 17
• added automated regression testing

Changed

• Implemented Search After CMR interface to allow granule listings > 2000 15
• Retry CMR queries on server error using random exponential backoff max 60 seconds and 10 retries
• Refresh token if CMR returns 401 error
• Converted print statements to log statements

Deprecated

Removed

Fixed

Security

Subscriber 1.8.0

Added

• limit to set limit of downloads- useful for testing
• cycle based downloads to the podaac-data-downloader. 41
• conftest.py added to force module inclusion for pytest
• podaac-data-downloader script for bulk data downloading

Changed

• created library of common access mechanisms to split between subscriber and downloader capabilities
• added .tar.gz to list of default extensions. 40
• Ignore error if destination directory already exists. 46
• Updated the naming convention of .update file. 44
• one of -m, -sd, or -ed must be given to subscriber. Previously -m 60 was the default if nothing was specified.

Deprecated

• use of ".update" file naming convention. This will still work, but will be renamed to .update__COLLECTIONNAME after a successful run. the ".update" file will need to be manually cleaned up. See issue 44

Removed

Fixed

• issue where only specifying an end data cause issues in subscriber. 39

Security

Subscriber 1.7.2

[1.7.2]

Added

Changed

• Made number of files to download a non-verbose default printout. 33

Deprecated

Removed

Fixed

Security

Subscriber 1.7.1

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog

[1.7.1]

Added

• Auto build and deploy to pypi on tag/release.

Changed

Deprecated

Removed

Fixed

Security

[1.7.0]

Added

• Added ability to call a process on downlaoded files. Thank to Joe Sapp.

Changed

• Turned -e option into 'additive' mode (multiple -e options allowed.) Thanks to Joe Sapp

Deprecated

Removed

Fixed

• issue not being able to find granuleUR #28

Security

[1.6.1]

Added

• added warning for more than 2k granules

Changed

Deprecated

Removed

Fixed

• strip newline characters from .update to fix #25

Security

[1.6.0]

Added

• added --offset flag for timestamp shift when creating DOY folder - (resolves #23)

Changed

Deprecated

Removed

Fixed

Security

[1.5.0] - 2021-10-12

Added

• added ability to change the provider using the -p/--provider flag. Default is 'POCLOUD'
• added pyproject info and setup.py fixes to enable pypi pushes

Changed

• added pytest and flake8 fixes for automated builds

Deprecated

Removed

Fixed

Security

[1.4.0] - 2021-10-05

Added

Changed

• changed changing created_at to updated_since to allow for re-download of updated granules based on collection redeliveries - (resolves #18)

Deprecated

Removed

Fixed

Security

[1.3.0] - 2021-08-26

Added

• added additional non-flat output directory option of -dy - (resolves #13)

Changed

Deprecated

Removed

Fixed

Security

[1.2.0] - 2021-08-15

Added

• Added logging capability using the SUBSCRIBER_LOGLEVEL environment variable
• Added -st and -ed flags and respect the .update flag

Changed

Deprecated

Removed

• removed the -ds flag as it caused confusion.

Fixed

Security

[1.1.2] - 2021-06-20

Added

• added default layouts for non-flat output directories - (resolves #6)
• Added logging capability using the SUBSCRIBER_LOGLEVEL environment variable
• added additional non-flat output directory option of -dy - (resolves #13)

Changed

Deprecated

Removed

Fixed

Security

[1.1.1] - 2021-06-06

Added

Changed

Deprecated

Removed

Fixed

Security

• updated urllib3>=1.26.5 (fixes GHSA-q2q7-5pp4-w6pg)

[1.1.0] - 2021-05-28

Added

• User Agent to request so we can determine better support posture based on metrics

Changed

Deprecated

Removed

Fixed

Security

[1.0.0] - 2021-05-13

Added

• data subscriber functionality

Changed

Deprecated

Removed

Fixed

Security

Subscriber 1.7.0

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog

[1.7.0]

Added

• Added ability to call a process on downlaoded files. Thank to Joe Sapp.

Changed

• Turned -e option into 'additive' mode (multiple -e options allowed.) Thanks to Joe Sapp

Deprecated

Removed

Fixed

• issue not being able to find granuleUR #28

Security