Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat outer lr scheduler #20

Draft
wants to merge 15 commits into
base: main
Choose a base branch
from
Draft

Feat outer lr scheduler #20

wants to merge 15 commits into from

Commits on Aug 22, 2024

  1. fix torch compile log act (#23) 

    * fix renaming logic for key

* fix stuff

* fix exploding norm

* remove print
    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    f6748dd View commit details
    Browse the repository at this point in the history

  2. add warmup steps

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    9d03959 View commit details
    Browse the repository at this point in the history

  3. do not update lr scheduler during warmup

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    ac54218 View commit details
    Browse the repository at this point in the history

  4. do not update lr scheduler during warmup

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    ce6f82b View commit details
    Browse the repository at this point in the history

  5. add outer lr scheduler

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    e91cbda View commit details
    Browse the repository at this point in the history

  6. add div by 4

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    d0dc44c View commit details
    Browse the repository at this point in the history

  7. support none outer lr

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    532af19 View commit details
    Browse the repository at this point in the history

  8. fix outer lr schedulng

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    da41f5b View commit details
    Browse the repository at this point in the history

  9. fix outer lr schedulng

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    16357ca View commit details
    Browse the repository at this point in the history

  10. update divide

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    4ea2735 View commit details
    Browse the repository at this point in the history

  11. add ckpt for outer schedler

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    1e43b47 View commit details
    Browse the repository at this point in the history

  12. add ckpt for outer schedler

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    7328d7d View commit details
    Browse the repository at this point in the history

  13. change div

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    392a015 View commit details
    Browse the repository at this point in the history

  14. remove min olr

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    b2b3119 View commit details
    Browse the repository at this point in the history

  15. remove divi

    @samsja
    samsja committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    bf21c13 View commit details
    Browse the repository at this point in the history