Skip to content

Commit

Permalink
update to 1.13.1 to fix library issue (packaging) (#132)
Browse files Browse the repository at this point in the history
* Issues/91 (#92)

* added citation creation tests and functionality to subscriber and downloader

* added verbose option to create_citation_file command, previously hard coded

* updated changelog (whoops) and fixed regression test:
1. Issue where the citation file now downloaded affected the counts
2. Issue where the logic for determining if a file modified time was changing or not was picking up the new citation file which _always_ gets rewritten to update the 'last accessed' date.

* updated request to include exec_info in warning; fixed issue with params not being a dictionary caused errors

* changed a warning to debug for citation file. fixed test issues

* Enable debug logging during regression tests and set max parallel workflows to 2

* added output to pytest

* fixed test to only look for downlaoded data files not citation file due to 'random' cmr errors when creating a citation.

* added mock testing and retry on 503

* added 503 fixes

Co-authored-by: Frank Greguska <[email protected]>

* fixed issues where token was not proagated to CMR queries (#95)

* Misc fixes (#101)

* added ".tiff" to default extensions to address #100

* removed 'warning' message on not downloading all data to close #99

* updated help documentation for start/end times to close #79

* added version update, updates to CHANGELOG

* added token get,delete, refresh and list operations

* Revert "added token get,delete, refresh and list operations"

This reverts commit 15aba90.

* Update python-app.yml

* updated poetry version 

Version matches build/test versions.

* Issues/98 (#107)

* added token get,delete, refresh and list operations

* Revert "added token get,delete, refresh and list operations"

This reverts commit 15aba90.

* added  EDL (not cmr-token) based get, list,delete, refresh token

* updated token regression tests

* updates and tests for subscriber moving to EDL.

* marked tests as regression test

* Update subscriber/podaac_data_downloader.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_data_subscriber.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_access.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_access.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_access.py

Co-authored-by: Frank Greguska <[email protected]>

* added exec info to errors, cleaned up some log statements

Co-authored-by: Frank Greguska <[email protected]>

* Issues/109 (#111)

* Develop (#103)

* Issues/91 (#92)

* added citation creation tests and functionality to subscriber and downloader

* added verbose option to create_citation_file command, previously hard coded

* updated changelog (whoops) and fixed regression test:
1. Issue where the citation file now downloaded affected the counts
2. Issue where the logic for determining if a file modified time was changing or not was picking up the new citation file which _always_ gets rewritten to update the 'last accessed' date.

* updated request to include exec_info in warning; fixed issue with params not being a dictionary caused errors

* changed a warning to debug for citation file. fixed test issues

* Enable debug logging during regression tests and set max parallel workflows to 2

* added output to pytest

* fixed test to only look for downlaoded data files not citation file due to 'random' cmr errors when creating a citation.

* added mock testing and retry on 503

* added 503 fixes

Co-authored-by: Frank Greguska <[email protected]>

* fixed issues where token was not proagated to CMR queries (#95)

* Misc fixes (#101)

* added ".tiff" to default extensions to address #100

* removed 'warning' message on not downloading all data to close #99

* updated help documentation for start/end times to close #79

* added version update, updates to CHANGELOG

* added token get,delete, refresh and list operations

* Revert "added token get,delete, refresh and list operations"

This reverts commit 15aba90.

* Update python-app.yml

Co-authored-by: Frank Greguska <[email protected]>

* updated poetry version 

Version matches build/test versions.

* Update README.md

* Update podaac_data_downloader.py

Fixing for issues 109 - adding capability to download by granule-name

* Update Downloader.md

Fixed the help file

* added changelog entries, regressiont ests

* added poetry lock cleanup

Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: sureshshsv <[email protected]>

* added README information and updates (#113)

* fixed pymock issues... again

* Extension regex (#121)

* extend -e option to handle regular expressions (#115)

* Develop into Main (1.12.0) (#114)

* Issues/91 (#92)

* added citation creation tests and functionality to subscriber and downloader

* added verbose option to create_citation_file command, previously hard coded

* updated changelog (whoops) and fixed regression test:
1. Issue where the citation file now downloaded affected the counts
2. Issue where the logic for determining if a file modified time was changing or not was picking up the new citation file which _always_ gets rewritten to update the 'last accessed' date.

* updated request to include exec_info in warning; fixed issue with params not being a dictionary caused errors

* changed a warning to debug for citation file. fixed test issues

* Enable debug logging during regression tests and set max parallel workflows to 2

* added output to pytest

* fixed test to only look for downlaoded data files not citation file due to 'random' cmr errors when creating a citation.

* added mock testing and retry on 503

* added 503 fixes

Co-authored-by: Frank Greguska <[email protected]>

* fixed issues where token was not proagated to CMR queries (#95)

* Misc fixes (#101)

* added ".tiff" to default extensions to address #100

* removed 'warning' message on not downloading all data to close #99

* updated help documentation for start/end times to close #79

* added version update, updates to CHANGELOG

* added token get,delete, refresh and list operations

* Revert "added token get,delete, refresh and list operations"

This reverts commit 15aba90.

* Update python-app.yml

* updated poetry version 

Version matches build/test versions.

* Issues/98 (#107)

* added token get,delete, refresh and list operations

* Revert "added token get,delete, refresh and list operations"

This reverts commit 15aba90.

* added  EDL (not cmr-token) based get, list,delete, refresh token

* updated token regression tests

* updates and tests for subscriber moving to EDL.

* marked tests as regression test

* Update subscriber/podaac_data_downloader.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_data_subscriber.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_access.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_access.py

Co-authored-by: Frank Greguska <[email protected]>

* Update subscriber/podaac_access.py

Co-authored-by: Frank Greguska <[email protected]>

* added exec info to errors, cleaned up some log statements

Co-authored-by: Frank Greguska <[email protected]>

* Issues/109 (#111)

* Develop (#103)

* Issues/91 (#92)

* added citation creation tests and functionality to subscriber and downloader

* added verbose option to create_citation_file command, previously hard coded

* updated changelog (whoops) and fixed regression test:
1. Issue where the citation file now downloaded affected the counts
2. Issue where the logic for determining if a file modified time was changing or not was picking up the new citation file which _always_ gets rewritten to update the 'last accessed' date.

* updated request to include exec_info in warning; fixed issue with params not being a dictionary caused errors

* changed a warning to debug for citation file. fixed test issues

* Enable debug logging during regression tests and set max parallel workflows to 2

* added output to pytest

* fixed test to only look for downlaoded data files not citation file due to 'random' cmr errors when creating a citation.

* added mock testing and retry on 503

* added 503 fixes

Co-authored-by: Frank Greguska <[email protected]>

* fixed issues where token was not proagated to CMR queries (#95)

* Misc fixes (#101)

* added ".tiff" to default extensions to address #100

* removed 'warning' message on not downloading all data to close #99

* updated help documentation for start/end times to close #79

* added version update, updates to CHANGELOG

* added token get,delete, refresh and list operations

* Revert "added token get,delete, refresh and list operations"

This reverts commit 15aba90.

* Update python-app.yml

Co-authored-by: Frank Greguska <[email protected]>

* updated poetry version 

Version matches build/test versions.

* Update README.md

* Update podaac_data_downloader.py

Fixing for issues 109 - adding capability to download by granule-name

* Update Downloader.md

Fixed the help file

* added changelog entries, regressiont ests

* added poetry lock cleanup

Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: sureshshsv <[email protected]>

* added README information and updates (#113)

* fixed pymock issues... again

Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: sureshshsv <[email protected]>

* extend -e option to handle regular expressions

formerly, -e could not handle PTM_\d+ extensions without the user explicitly
calling all of them.

---------

Co-authored-by: mike-gangl <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: sureshshsv <[email protected]>

* added dcoumentation and tests for regex

* converted defaults to regexes, added gtiff test

---------

Co-authored-by: Peter Mao <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: sureshshsv <[email protected]>

* closes 118. retries was never hit because range is not end inclusive. (#119)

* closes 118. retries was never hit ebcause range is not end inclusive.

* updated test to catch now-thrown exception

* added --dry-run option, docs, and test cases (#124)

* added --dry-run option, docs, and test cases

* Update subscriber/podaac_data_downloader.py

Added more elegant way of download limit application

Co-authored-by: Stepheny Perez <[email protected]>

---------

Co-authored-by: Stepheny Perez <[email protected]>

* Issues/70 (#117)

* added code for updating version

* added chagnelog

* moved version check into __main__ instead of on import of the module

* added sorting of releases from github to find latest release.

* added authenticated (option) access to github API to rpevent rate limiting

* separate out auth/token regression tests

* Issues/127 (#128)

* added token sensitivity filter to remove tokens from CMR queries

* added changelog updates

* updated some lingering merge issues (huh?)

* updated regression test

* updated ubuntu versions

* removed 18.04 ubuntu from workflows/actions

* version and documentation updates (#130)

* 1.13.1 changelog and dependecny updates

* fixed formatting from unsaved merges

---------

Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: Frank Greguska <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: sureshshsv <[email protected]>
Co-authored-by: Peter Mao <[email protected]>
Co-authored-by: Stepheny Perez <[email protected]>
  • Loading branch information
7 people committed Apr 28, 2023
1 parent 8b10e16 commit f4e9f51
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 2 deletions.
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,10 @@ All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/)

## 1.13.1
### Fixed
- Fixed an issue where a required library wasn't being included in the installation.

## 1.13.0
### Added
- Added --dry-run option to subscriber and downloader to view the files that _would_ be downloaded without actuall downloading them. [102](https://github.com/podaac/data-subscriber/issues/102)
Expand Down
3 changes: 2 additions & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "podaac-data-subscriber"
version = "1.13.0"
version = "1.13.1"
description = "PO.DAAC Data Subscriber Command Line Tool"
authors = ["PO.DAAC <[email protected]>"]
readme = "README.md"
Expand All @@ -15,6 +15,7 @@ packages = [
python = "^3.7"
requests = "^2.27.1"
tenacity = "^8.0.1"
packaging = "^23.0"

[tool.poetry.dev-dependencies]
pytest = "^7.1.2"
Expand Down
2 changes: 1 addition & 1 deletion subscriber/podaac_access.py
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
import tenacity
from datetime import datetime

__version__ = "1.13.0"
__version__ = "1.13.1"
extensions = ["\\.nc", "\\.h5", "\\.zip", "\\.tar.gz", "\\.tiff"]
edl = "urs.earthdata.nasa.gov"
cmr = "cmr.earthdata.nasa.gov"
Expand Down

0 comments on commit f4e9f51

Please sign in to comment.