Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NASA:Update] Distributed dace cache (rework) #16

Merged
merged 71 commits into from
Sep 11, 2023

Commits on Jan 27, 2023

  1. Configuration menu
    Copy the full SHA
    6d78659 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0a3e857 View commit details
    Browse the repository at this point in the history
  3. 1. Add qcld to the list of tracers beings advected

    2. Made GEOS specific changes to thresholds in saturation adjustment
    pchakraborty committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    0a8d705 View commit details
    Browse the repository at this point in the history
  4. Accumulate diss_est

    pchakraborty committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    3b73d71 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2023

  1. Configuration menu
    Copy the full SHA
    a68d160 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2023

  1. Configuration menu
    Copy the full SHA
    33ba53f View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2023

  1. Configuration menu
    Copy the full SHA
    8968698 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2023

  1. Make kernel analysis run a copy stencil to compute local bandwith

    Parametrize tool with backend, output format
    FlorianDeconinck committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    2327cbe View commit details
    Browse the repository at this point in the history
  2. Move constant on a env var

    Add saturation adjustement threshold to const
    FlorianDeconinck committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    cb4ec5f View commit details
    Browse the repository at this point in the history
  3. lint

    FlorianDeconinck committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    7348922 View commit details
    Browse the repository at this point in the history
  4. lint

    FlorianDeconinck committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    e234d16 View commit details
    Browse the repository at this point in the history
  5. More linting

    FlorianDeconinck committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    131a2af View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    dce3fb7 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. Configuration menu
    Copy the full SHA
    8982542 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    da2f902 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f2799d8 View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2023

  1. Add guard for bdt==0

    Fix bad merge for bdt with GEOS_Wrapper
    FlorianDeconinck committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    27fae1c View commit details
    Browse the repository at this point in the history
  2. Remove unused code

    FlorianDeconinck committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    2f8ebac View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. Configuration menu
    Copy the full SHA
    5d9e0a0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b8edbf2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f54b231 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. Fix theroritical timings

    Lint
    FlorianDeconinck committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    81d00ce View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. Configuration menu
    Copy the full SHA
    4891d56 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. Configuration menu
    Copy the full SHA
    fafbfc7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4fc5b4d View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. Configuration menu
    Copy the full SHA
    2245027 View commit details
    Browse the repository at this point in the history
  2. Revert "Set default cache path for orchestrated DaCe to respect GT_CA…

    …CHE_* env"
    
    This reverts commit 4fc5b4d.
    FlorianDeconinck committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    4f8fdc3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    47421a0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d51bc11 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    6bdd595 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. Configuration menu
    Copy the full SHA
    80cbb01 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. Configuration menu
    Copy the full SHA
    40f2440 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. Protect constant selection more rigorusly.

    Clean abort on unknown constant given
    FlorianDeconinck committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    cae25a9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    915993e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c3e355c View commit details
    Browse the repository at this point in the history
  4. Merge pull request #11 from GEOS-ESM/debug/pchakrab/aquaplanet/root-3…

    …58b60d
    
    Bug fixes, GEOS specific changes and documentation updates
    FlorianDeconinck committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    08f6e68 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. Replace all logger with pace_log

    Introduce PACE_LOGLEVEL to control log level from outside
    FlorianDeconinck committed May 2, 2023
    Configuration menu
    Copy the full SHA
    cde11e8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9e6bbb6 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #13 from GEOS-ESM/feature/logger

    Feature/logger
    pchakraborty committed May 2, 2023
    Configuration menu
    Copy the full SHA
    6695cec View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. Devops/GitHub actions on (#15)

    * Linting on PR
    
    * Run main unit test
    
    * Update python to available 3.8.12
    
    * Remove cd to pace
    
    * Lint: git submodule recursive
    
    * Typo
    
    * Add openmpi to the image
    
    * Linting
    
    * Fix unit tests (remove dxa, dya rely on halo ex)
    
    * typo
    
    * Change name of jobs
    FlorianDeconinck committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    7e449cd View commit details
    Browse the repository at this point in the history
  2. Distributed compilation on orchestrated backend for NxN layouts (#14)

    * Adapt orchestration distribute compile for NxN layout
    
    * Remove debug code
    
    * Add a more descriptive string base postfix for cache naming
    Identify the code path for all cases
    Consistent reload post-compile
    Create a central space for all caches generation logic
    No more original layout check required
    
    * Add a test on caches relocatability
    
    * Verbose todo
    
    * Linting on PR
    
    * Run main unit test
    
    * Update python to available 3.8.12
    
    * Remove cd to pace
    
    * Lint: git submodule recursive
    
    * Typo
    
    * Add openmpi to the image
    
    * Linting
    
    * Fix unit tests (remove dxa, dya rely on halo ex)
    
    * typo
    
    * Change name of jobs
    
    * Missing enum
    
    * Lint imports
    
    * Fix unit tests
    
    * Deactivate relocability test due to Python crash
    Logged as issyue 16
    
    * Typo
    
    * Raise for 1,X and X,1 layouts which requires a new descriptor
    FlorianDeconinck committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    e40d356 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2023

  1. Configuration menu
    Copy the full SHA
    286ad00 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Configuration menu
    Copy the full SHA
    fea7ae6 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Configuration menu
    Copy the full SHA
    c1e011c View commit details
    Browse the repository at this point in the history
  2. lint

    FlorianDeconinck committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    c58a2a1 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. Configuration menu
    Copy the full SHA
    8e362a2 View commit details
    Browse the repository at this point in the history
  2. Typo + lint

    FlorianDeconinck committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    adc5ee5 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Configuration menu
    Copy the full SHA
    a306e66 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Configuration menu
    Copy the full SHA
    39ff8ea View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. Lint

    FlorianDeconinck committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    f2d171d View commit details
    Browse the repository at this point in the history
  2. Clean up

    FlorianDeconinck committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    ac70398 View commit details
    Browse the repository at this point in the history
  3. Log info GEOS bridge (#18)

    * Add floating point precision to GEOS bridge init
    
    * lint
    
    * Add device PCI bus id (for MPS debug)
    
    * Typo + lint
    
    * Try to detect MPS reading the "log" pipe
    
    * Lint
    
    * Clean up
    FlorianDeconinck committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    0a4163f View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. Merge pull request #22 from GEOS-ESM/feature/bridge_info

    Improve GEOS wrapper logging
    FlorianDeconinck committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    e1f8a94 View commit details
    Browse the repository at this point in the history
  2. Update geos/develop to grab NOAA PR9 results (#21)

    * Verbose choice of block/grid size
    
    * added build script for c5
    
    * updated repo to NOAA
    
    * GEOS integration (#9)
    
    * Initialize GeosDycoreWrapper with bdt (timestep)
    
    * Use GEOS version of constants
    
    * 1. Add qcld to the list of tracers beings advected
    2. Made GEOS specific changes to thresholds in saturation adjustment
    
    * Accumulate diss_est
    
    * Allow GEOS_WRAPPER to process device data
    
    * Add clear to collector for 3rd party use. GEOS pass down timings to caller
    
    * Make kernel analysis run a copy stencil to compute local bandwith
    Parametrize tool with backend, output format
    
    * Move constant on a env var
    Add saturation adjustement threshold to const
    
    * Remove unused if leading to empty code block
    
    * Restrict dace to 0.14.1 due to a parsing bug
    
    * Add guard for bdt==0
    Fix bad merge for bdt with GEOS_Wrapper
    
    * Remove unused code
    
    * Fix theroritical timings
    
    * Fixed a bug where pkz was being calculated twice, and the second calc was wrong
    
    * Downgrade DaCe to 0.14.0 pending array aliasing fix
    
    * Set default cache path for orchestrated DaCe to respect GT_CACHE_* env
    
    * Remove previous per stencil override of default_build_folder
    
    * Revert "Set default cache path for orchestrated DaCe to respect GT_CACHE_* env"
    
    * Revert "Remove previous per stencil override of default_build_folder"
    
    * Read cache_root in default dace backend
    
    * Document faulty behavior with GT_CACHE_DIR_NAME
    
    * Fix bad requirements syntax
    
    * Check for the string value of CONST_VERSION directly instead of enum
    
    * Protect constant selection more rigorusly.
    Clean abort on unknown constant given
    
    * Log constants selection
    
    * Refactor NQ to constants.py
    
    * Fix or explain inlined import
    
    * Verbose runtime error when bad dt_atmos
    
    * Verbose warm up
    
    * re-initialize heat_source and diss_est each call, add do_skeb check to accumulation
    
    ---------
    
    Co-authored-by: Purnendu Chakraborty <[email protected]>
    Co-authored-by: Oliver Elbert <[email protected]>
    
    ---------
    
    Co-authored-by: Rusty Benson <[email protected]>
    Co-authored-by: Oliver Elbert <[email protected]>
    Co-authored-by: Purnendu Chakraborty <[email protected]>
    Co-authored-by: Oliver Elbert <[email protected]>
    5 people committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    9d6d2f9 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2023

  1. [NOAA:Update] Bring back #15 & doubly periodic domain (#25)

    * Feature/dp driver (#13)
    
    * initial commit
    
    * adding test config
    
    * adding the rest of driver and util code
    
    * updating history.md
    
    * move u_max to dycore config
    
    * uncomment assert
    
    * added comment explaining the copy of grid type to dycore config
    
    * Turn main unit test  & lint on PR, logger clean up [NASA:Update]  (#15)
    
    * Initialize GeosDycoreWrapper with bdt (timestep)
    
    * Use GEOS version of constants
    
    * 1. Add qcld to the list of tracers beings advected
    2. Made GEOS specific changes to thresholds in saturation adjustment
    
    * Accumulate diss_est
    
    * Allow GEOS_WRAPPER to process device data
    
    * Add clear to collector for 3rd party use. GEOS pass down timings to caller
    
    * Make kernel analysis run a copy stencil to compute local bandwith
    Parametrize tool with backend, output format
    
    * Move constant on a env var
    Add saturation adjustement threshold to const
    
    * Restrict dace to 0.14.1 due to a parsing bug
    
    * Add guard for bdt==0
    
    * Fix theroritical timings
    
    * Fixed a bug where pkz was being calculated twice, and the second calc was wrong
    
    * Downgrade DaCe to 0.14.0 pending array aliasing fix
    
    * Set default cache path for orchestrated DaCe to respect GT_CACHE_* env
    
    * Remove previous per stencil override of default_build_folder
    
    * Revert "Set default cache path for orchestrated DaCe to respect GT_CACHE_* env"
    
    * Read cache_root in default dace backend
    
    * Document faulty behavior with GT_CACHE_DIR_NAME
    
    * Check for the string value of CONST_VERSION directly instead of enum
    
    * Protect constant selection more rigorusly.
    Clean abort on unknown constant given
    
    * Log constants selection
    
    * Refactor NQ to constants.py
    
    * Introduce PACE_LOGLEVEL to control log level from outside
    
    * Code guidelines clean up
    
    * Devops/GitHub actions on (#15)
    
    * Linting on PR
    
    * Run main unit test
    
    * Update python to available 3.8.12
    
    * Fix unit tests (remove dxa, dya rely on halo ex)
    
    * Update HISTORY.md
    
    * Adapt log_level in driver.run
    
    * Verbose the PACE_CONSTANTS
    
    * Doc log level hierarchical nature
    
    ---------
    
    Co-authored-by: Purnendu Chakraborty <[email protected]>
    Co-authored-by: Purnendu Chakraborty <[email protected]>
    
    * Lint
    
    ---------
    
    Co-authored-by: Oliver Elbert <[email protected]>
    Co-authored-by: Purnendu Chakraborty <[email protected]>
    Co-authored-by: Purnendu Chakraborty <[email protected]>
    4 people committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    2031b9e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b579437 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    52f0913 View commit details
    Browse the repository at this point in the history
  4. lint

    FlorianDeconinck committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    2f9bbe9 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    8f6ba7c View commit details
    Browse the repository at this point in the history
  6. Missed commit

    FlorianDeconinck committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    31c4844 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2023

  1. Update dsl/pace/dsl/caches/codepath.py

    Co-authored-by: Oliver Elbert <[email protected]>
    FlorianDeconinck and oelbert committed Aug 25, 2023
    Configuration menu
    Copy the full SHA
    08f3033 View commit details
    Browse the repository at this point in the history
  2. Lint

    FlorianDeconinck committed Aug 25, 2023
    Configuration menu
    Copy the full SHA
    d63a0f0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6de1b3c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    33ac533 View commit details
    Browse the repository at this point in the history
  5. Clean up

    FlorianDeconinck committed Aug 25, 2023
    Configuration menu
    Copy the full SHA
    7955695 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Configuration menu
    Copy the full SHA
    1252736 View commit details
    Browse the repository at this point in the history
  2. Update requirements to include external/dace

    Include boost into main test
    FlorianDeconinck committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    8de32bc View commit details
    Browse the repository at this point in the history
  3. Typo

    FlorianDeconinck committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    6ef8b60 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    51fca6e View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Configuration menu
    Copy the full SHA
    132e2c4 View commit details
    Browse the repository at this point in the history
  2. Update comment

    FlorianDeconinck committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    689f4b0 View commit details
    Browse the repository at this point in the history