Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tweak the ConvLSTM architecture until it works #14

Merged
merged 42 commits into from
May 28, 2024
Merged

Tweak the ConvLSTM architecture until it works #14

merged 42 commits into from
May 28, 2024

Commits on May 2, 2024

  1. Implement LSTM

    @rhaps0dy
    rhaps0dy committed May 2, 2024
    Configuration menu
    Copy the full SHA
    4717422 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. LSTM reference test

    @rhaps0dy
    rhaps0dy committed May 3, 2024
    Configuration menu
    Copy the full SHA
    f677f9d View commit details
    Browse the repository at this point in the history

Commits on May 4, 2024

  1. Tests say it's fine.

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    9a9d233 View commit details
    Browse the repository at this point in the history

  2. Fix ConvLSTM config

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    94be8b4 View commit details
    Browse the repository at this point in the history

  3. Check that the CLI parses without launching it

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    c39576e View commit details
    Browse the repository at this point in the history

  4. Can we straightforwardly compensate for LSTM low variance?

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    0cd099b View commit details
    Browse the repository at this point in the history

  5. Incorporate the vision shortcut

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    2a54374 View commit details
    Browse the repository at this point in the history

  6. Hackily set up the devbox

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    155a9df View commit details
    Browse the repository at this point in the history

  7. Remove multiplier

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    47176e3 View commit details
    Browse the repository at this point in the history

  8. Try and make the ConvLSTM more balanced in variance

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    64e701e View commit details
    Browse the repository at this point in the history

  9. Use horizontal connections for pool-and-inject

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    aa179e9 View commit details
    Browse the repository at this point in the history

  10. pool_and_inject_horizontal

    @rhaps0dy
    rhaps0dy committed May 4, 2024
    Configuration menu
    Copy the full SHA
    a11fd26 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. Squash missing head_scale bug

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    1cc9423 View commit details
    Browse the repository at this point in the history

  2. Get rid of generics and work around NiklasRosenstein/python-databind#66

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    9b4b8dd View commit details
    Browse the repository at this point in the history

  3. Try more things

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    765482e View commit details
    Browse the repository at this point in the history

  4. Change notebook params

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    31cc510 View commit details
    Browse the repository at this point in the history

  5. Torch initialization maybe

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    1436bfd View commit details
    Browse the repository at this point in the history

  6. Go back to separated convs

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    1f45d9e View commit details
    Browse the repository at this point in the history

  7. More architectural variation for the ConvLSTM

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    760f29f View commit details
    Browse the repository at this point in the history

  8. Fencepad

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    d4ae3c3 View commit details
    Browse the repository at this point in the history

  9. Copy hyperparams from the best lstm runs

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    d3587f3 View commit details
    Browse the repository at this point in the history

  10. Config reflects actual practice

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    0fd2af6 View commit details
    Browse the repository at this point in the history

  11. Wild variations experiment

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    a5326b8 View commit details
    Browse the repository at this point in the history

  12. Run good one for longer

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    cfd7831 View commit details
    Browse the repository at this point in the history

  13. Store RMS gradient of every parameter

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    e9dc974 View commit details
    Browse the repository at this point in the history

  14. Have to commit new variations

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    bda7fd3 View commit details
    Browse the repository at this point in the history

  15. Try updating the actor again

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    0ec2666 View commit details
    Browse the repository at this point in the history

  16. What if it's a residual LSTM

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    497430b View commit details
    Browse the repository at this point in the history

  17. Try again

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    ac9b919 View commit details
    Browse the repository at this point in the history

  18. Tweak the residual stream

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    2803e78 View commit details
    Browse the repository at this point in the history

  19. Load_path

    @rhaps0dy
    rhaps0dy committed May 5, 2024
    Configuration menu
    Copy the full SHA
    56756b5 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Continue the old run hopefully

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    578f999 View commit details
    Browse the repository at this point in the history

  2. Load_path maybe loads now

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    014e7d3 View commit details
    Browse the repository at this point in the history

  3. don't pin commit

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    39b8361 View commit details
    Browse the repository at this point in the history

  4. Unreplicate loss before proceeding

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    d76a7b0 View commit details
    Browse the repository at this point in the history

  5. Even more tweaks

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    568a40a View commit details
    Browse the repository at this point in the history

  6. Unreplicate train_state

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    fb95771 View commit details
    Browse the repository at this point in the history

  7. Reduce randomness in planning evaluations

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    f79b5cb View commit details
    Browse the repository at this point in the history

  8. Test that the new evaluation is well-behaved

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    a10f956 View commit details
    Browse the repository at this point in the history

  9. Get more planners

    @rhaps0dy
    rhaps0dy committed May 6, 2024
    Configuration menu
    Copy the full SHA
    3cd1daf View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Delete empty file

    @rhaps0dy
    rhaps0dy committed May 9, 2024
    Configuration menu
    Copy the full SHA
    bc2bb2e View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Fix version for farconf

    @rhaps0dy
    rhaps0dy committed May 28, 2024
    Configuration menu
    Copy the full SHA
    e032380 View commit details
    Browse the repository at this point in the history