Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Daily Smoketests #1287

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open

Daily Smoketests #1287

wants to merge 18 commits into from

Conversation

claravanstaden
Copy link
Contributor

@claravanstaden claravanstaden commented Sep 13, 2024

  • Moves the smoke test GA to the snowbridge repo instead of the polkadot-sdk repo (because our team will no longer work off a forked repo).
  • Daily run of the smoketests on the production release polkadot-sdk branch

Resolves: SNO-1080

@claravanstaden claravanstaden marked this pull request as ready for review September 16, 2024 13:29
@claravanstaden
Copy link
Contributor Author

claravanstaden commented Sep 16, 2024

@yrong This should work for running smoketests daily. To see if the tests pass, I used our polkadot-sdk fork. I think we should be using paritytech/polkadot-sdk branches https://github.com/paritytech/polkadot-sdk/tree/release-crates-io-v1.7.0 (currently in production) and https://github.com/paritytech/polkadot-sdk/tree/release-crates-io-v1.14.0 (being upgraded to in https://polkadot.polkassembly.io/referenda/1143). Neither of those branches have the Westend config. Perhaps we can add it?

@yrong
Copy link
Contributor

yrong commented Sep 16, 2024

For westend I'll just run some smoke tests(maybe only a subset) against the live network(not the local setup). That's why I initialized light client on Westend in #1286.

I think it should be fine run current smoke tests against another network. Just need some change to make sure envs point to the config on westend.

Updates: #1291 FYI.

Comment on lines +28 to +34
- uses: actions/checkout@v2
with:
# repository: paritytech/polkadot-sdk
# ref: release-crates-io-v1.7.0 # TODO change back to this branch once Westend code is merged upstream
repository: Snowfork/polkadot-sdk
ref: snowbridge
path: ./polkadot-sdk
Copy link
Contributor

@yrong yrong Sep 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we just run tests against master branch of paritytech/polkadot-sdk?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could, but it would be best to run against the branch that is in production. The reason for this is to catch imminent production changes. For example, the checked hash extension change was merged into master, which we knew, but it was also merged into the production branch, which caught us off-guard.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

run against the branch that is in production.

Or run against the next/upcoming release for production? I would assume there is no need to test the current release which should definitely work?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The current release changes all the time as changes are merged in (fixes/backported features). So it is definitely needed to run against the current production release branch.

@claravanstaden
Copy link
Contributor Author

envs

Sure, makes sense. I think we should have this PR as well, for the reason explained in #1287 (comment).

Copy link
Contributor

@yrong yrong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants