Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AIP-7418 Remove KFP cluster create #257

Merged
merged 3 commits into from
Oct 16, 2023

Conversation

talebzeghmi
Copy link
Collaborator

@talebzeghmi talebzeghmi commented Oct 8, 2023

This PR removes the ability for WFSDK to create sticky long term k8s resources in the k8s cluster such as the WorkflowTemplate and CronWorkflow.

The reason for this is that k8s garbage collection and pruning policy becomes much more difficult to manage than Gitlab projects that have environments, and PRs that get merged with attached cleanup jobs and corresponding pruning steps by label.

TODO

  • update the flow_tiggering_flow.py test to use kubectl to create a yaml generated workflow template to trigger instead of the previous create command

metaflow/plugins/kfp/kfp_cli.py Outdated Show resolved Hide resolved
* AIP-7385 rename KFP to AIP plugin

* friendly error message for "kfp run"

* AIP-7393 Add Flow labels to Workflow for ArgoUI (#259)

* AIP-7393 Add Flow labels to Workflow for ArgoUI

* PR feedback

* AIP-7726 add default cards (#260)

* AIP-7726 add default cards

* param fix

* PR feedback
- comment archive none
- add card id to support current.card.append()
- add example of notebook card & multiple cards

* aip.zillowgroup.net/aip-pod-default -> aip.zillowgroup.net/aip-wfsdk-pod

* logging.zgtools.net/index -> logging.zgtools.net/topic

* fix card pathspec for nested foreach

* fix github test.yml branches

* resources_flow.py label fixes

* PR Feedback

* update test.yml
@talebzeghmi talebzeghmi merged commit 3e9a549 into feature/kfp-argo Oct 16, 2023
7 checks passed
@talebzeghmi talebzeghmi deleted the tz/AIP-7418-remove-create branch October 16, 2023 23:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants