Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store code migration progress in multiworkspace history log and visualize in dashboard #3112

Draft
wants to merge 86 commits into
base: main
Choose a base branch
from

Conversation

JCZuurmond
Copy link
Member

@JCZuurmond JCZuurmond commented Nov 1, 2024

Changes

Store code migration progress in multiworkspace history log and visualize in dashboard

Linked issues

Resolves #3045

Functionality

  • modified existing workflow: migration-process

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • verified on staging environment (screenshot attached)

@JCZuurmond JCZuurmond added the feat/migration-progress Issues related to the migration progress workflow label Nov 1, 2024
@JCZuurmond JCZuurmond self-assigned this Nov 1, 2024
@JCZuurmond JCZuurmond requested review from nfx and asnare November 1, 2024 15:56
Copy link
Member Author

@JCZuurmond JCZuurmond left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comments below

]
return records


@pytest.fixture
def catalog_populated( # pylint: disable=too-many-arguments
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Expand name to be more explicit about that it is populated with the data fixture above, e.g. rename to make_catalog_with_test_data(catalog_name: str)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If a fixture is longer than 10 lines, it should be make_

runtime_ctx.direct_filesystem_access_progress.append_inventory_snapshot(dfsas)
del runtime_ctx.direct_filesystem_access_progress
runtime_ctx.used_table_progress.append_inventory_snapshot(used_tables)
del runtime_ctx.used_table_progress
return runtime_ctx.ucx_catalog


Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rename dashboard_metadata to make_dummy_dashboard (or something alike)

JCZuurmond added a commit that referenced this pull request Nov 15, 2024
github-merge-queue bot pushed a commit that referenced this pull request Nov 19, 2024
## Changes
Follow the more common pattern of expect objects in a class signature.
Those objects are passed on from the context. Makes testing more
straightforward

Breaking down the linked PR below.

### Linked issues
Progresses #3045
Breaks up #3112

### Tests

- [x] modified unit tests
- [x] modified integration tests
JCZuurmond added a commit that referenced this pull request Dec 17, 2024
JCZuurmond added a commit that referenced this pull request Dec 17, 2024
JCZuurmond added a commit that referenced this pull request Dec 20, 2024
JCZuurmond added a commit that referenced this pull request Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat/migration-progress Issues related to the migration progress workflow
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

[FEATURE] Visualize code migration in migration-progress dashboard
1 participant