Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Flyte components #6110

Merged
merged 3 commits into from
Dec 17, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions CHANGELOG/CHANGELOG-v1.14.1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# Flyte 1.14.1 Release Notes

* Update flytestdlib and affected tools (copilot) for missing config.

## What's Changed
* docs: Refactor merge sort code example to use literalinclude by @davidlin20dev in https://github.com/flyteorg/flyte/pull/6091
* [DOCS] Using ImageSpec in ContainerTask by @machichima in https://github.com/flyteorg/flyte/pull/6095
* Eager doc updates by @wild-endeavor in https://github.com/flyteorg/flyte/pull/6099
* Revert "fix: return the config file not found error" by @eapolinario in https://github.com/flyteorg/flyte/pull/6100
* Remove notes on deprecated Batch size by @wild-endeavor in https://github.com/flyteorg/flyte/pull/6102
* Upstream: Add labels to published execution events by @katrogan in https://github.com/flyteorg/flyte/pull/6104
* Fix: Make distributed error aggregation opt-in by @fg91 in https://github.com/flyteorg/flyte/pull/6103
* Add default labels and annotations to Ray worker pods too. by @katrogan in https://github.com/flyteorg/flyte/pull/6107
* Fix: Remove the default search dialog if it exists (on CMD + K) by @chmod77 in https://github.com/flyteorg/flyte/pull/6106

## New Contributors
* @chmod77 made their first contribution in https://github.com/flyteorg/flyte/pull/6106

**Full Changelog**: https://github.com/flyteorg/flyte/compare/v1.14.0...v1.14.1
2 changes: 1 addition & 1 deletion charts/flyte-binary/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ Chart for basic single Flyte executable deployment
| configuration.auth.oidc.clientId | string | `""` | |
| configuration.auth.oidc.clientSecret | string | `""` | |
| configuration.co-pilot.image.repository | string | `"cr.flyte.org/flyteorg/flytecopilot"` | |
| configuration.co-pilot.image.tag | string | `"v1.14.0"` | |
| configuration.co-pilot.image.tag | string | `"v1.14.1"` | |
| configuration.database.dbname | string | `"flyte"` | |
| configuration.database.host | string | `"127.0.0.1"` | |
| configuration.database.options | string | `"sslmode=disable"` | |
Expand Down
2 changes: 1 addition & 1 deletion charts/flyte-binary/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -167,7 +167,7 @@ configuration:
# repository CoPilot sidecar image repository
repository: cr.flyte.org/flyteorg/flytecopilot # FLYTECOPILOT_IMAGE
# tag CoPilot sidecar image tag
tag: v1.14.0 # FLYTECOPILOT_TAG
tag: v1.14.1 # FLYTECOPILOT_TAG
# agentService Flyte Agent configuration
agentService:
defaultAgent:
Expand Down
12 changes: 6 additions & 6 deletions charts/flyte-core/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -110,8 +110,8 @@ helm install gateway bitnami/contour -n flyte
| configmap.clusters.clusterConfigs | list | `[]` | |
| configmap.clusters.labelClusterMap | object | `{}` | |
| configmap.console | object | `{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"}` | Configuration for Flyte console UI |
| configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.0","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration |
| configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.0","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) |
| configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.1","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration |
| configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.1","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) |
| configmap.core | object | `{"manager":{"pod-application":"flytepropeller","pod-template-container-name":"flytepropeller","pod-template-name":"flytepropeller-template"},"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","literal-offloading-config":{"enabled":true},"max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}}` | Core propeller configuration |
| configmap.core.manager | object | `{"pod-application":"flytepropeller","pod-template-container-name":"flytepropeller","pod-template-name":"flytepropeller-template"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/manager/config#Config). |
| configmap.core.propeller | object | `{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","literal-offloading-config":{"enabled":true},"max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/controller/config). |
Expand Down Expand Up @@ -145,7 +145,7 @@ helm install gateway bitnami/contour -n flyte
| datacatalog.extraArgs | object | `{}` | Appends extra command line arguments to the main command |
| datacatalog.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| datacatalog.image.repository | string | `"cr.flyte.org/flyteorg/datacatalog"` | Docker image for Datacatalog deployment |
| datacatalog.image.tag | string | `"v1.14.0"` | Docker image tag |
| datacatalog.image.tag | string | `"v1.14.1"` | Docker image tag |
| datacatalog.nodeSelector | object | `{}` | nodeSelector for Datacatalog deployment |
| datacatalog.podAnnotations | object | `{}` | Annotations for Datacatalog pods |
| datacatalog.podEnv | object | `{}` | Additional Datacatalog container environment variables |
Expand Down Expand Up @@ -182,7 +182,7 @@ helm install gateway bitnami/contour -n flyte
| flyteadmin.extraArgs | object | `{}` | Appends extra command line arguments to the serve command |
| flyteadmin.image.pullPolicy | string | `"IfNotPresent"` | |
| flyteadmin.image.repository | string | `"cr.flyte.org/flyteorg/flyteadmin"` | Docker image for Flyteadmin deployment |
| flyteadmin.image.tag | string | `"v1.14.0"` | |
| flyteadmin.image.tag | string | `"v1.14.1"` | |
| flyteadmin.initialProjects | list | `["flytesnacks","flytetester","flyteexamples"]` | Initial projects to create |
| flyteadmin.nodeSelector | object | `{}` | nodeSelector for Flyteadmin deployment |
| flyteadmin.podAnnotations | object | `{}` | Annotations for Flyteadmin pods |
Expand Down Expand Up @@ -253,7 +253,7 @@ helm install gateway bitnami/contour -n flyte
| flytepropeller.extraArgs | object | `{}` | Appends extra command line arguments to the main command |
| flytepropeller.image.pullPolicy | string | `"IfNotPresent"` | |
| flytepropeller.image.repository | string | `"cr.flyte.org/flyteorg/flytepropeller"` | Docker image for Flytepropeller deployment |
| flytepropeller.image.tag | string | `"v1.14.0"` | |
| flytepropeller.image.tag | string | `"v1.14.1"` | |
| flytepropeller.manager | bool | `false` | |
| flytepropeller.nodeSelector | object | `{}` | nodeSelector for Flytepropeller deployment |
| flytepropeller.podAnnotations | object | `{}` | Annotations for Flytepropeller pods |
Expand Down Expand Up @@ -285,7 +285,7 @@ helm install gateway bitnami/contour -n flyte
| flytescheduler.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files |
| flytescheduler.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| flytescheduler.image.repository | string | `"cr.flyte.org/flyteorg/flytescheduler"` | Docker image for Flytescheduler deployment |
| flytescheduler.image.tag | string | `"v1.14.0"` | Docker image tag |
| flytescheduler.image.tag | string | `"v1.14.1"` | Docker image tag |
| flytescheduler.nodeSelector | object | `{}` | nodeSelector for Flytescheduler deployment |
| flytescheduler.podAnnotations | object | `{}` | Annotations for Flytescheduler pods |
| flytescheduler.podEnv | object | `{}` | Additional Flytescheduler container environment variables |
Expand Down
10 changes: 5 additions & 5 deletions charts/flyte-core/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ flyteadmin:
image:
# -- Docker image for Flyteadmin deployment
repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE
tag: v1.14.0 # FLYTEADMIN_TAG
tag: v1.14.1 # FLYTEADMIN_TAG
pullPolicy: IfNotPresent
# -- Additional flyteadmin container environment variables
#
Expand Down Expand Up @@ -148,7 +148,7 @@ flytescheduler:
# -- Docker image for Flytescheduler deployment
repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTESCHEDULER_TAG
tag: v1.14.1 # FLYTESCHEDULER_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytescheduler deployment
Expand Down Expand Up @@ -214,7 +214,7 @@ datacatalog:
# -- Docker image for Datacatalog deployment
repository: cr.flyte.org/flyteorg/datacatalog # DATACATALOG_IMAGE
# -- Docker image tag
tag: v1.14.0 # DATACATALOG_TAG
tag: v1.14.1 # DATACATALOG_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Datacatalog deployment
Expand Down Expand Up @@ -311,7 +311,7 @@ flytepropeller:
image:
# -- Docker image for Flytepropeller deployment
repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE
tag: v1.14.0 # FLYTEPROPELLER_TAG
tag: v1.14.1 # FLYTEPROPELLER_TAG
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytepropeller deployment
resources:
Expand Down Expand Up @@ -807,7 +807,7 @@ configmap:
# -- Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig)
co-pilot:
name: flyte-copilot-
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.0 # FLYTECOPILOT_IMAGE
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.1 # FLYTECOPILOT_IMAGE
start-timeout: 30s

# -- Core propeller configuration
Expand Down
16 changes: 8 additions & 8 deletions charts/flyte/README.md

Large diffs are not rendered by default.

10 changes: 5 additions & 5 deletions charts/flyte/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ flyte:
# -- Docker image for Flyteadmin deployment
repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTEADMIN_TAG
tag: v1.14.1 # FLYTEADMIN_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Additional flyteadmin container environment variables
Expand Down Expand Up @@ -83,7 +83,7 @@ flyte:
# -- Docker image for Flytescheduler deployment
repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTESCHEDULER_TAG
tag: v1.14.1 # FLYTESCHEDULER_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytescheduler deployment
Expand Down Expand Up @@ -128,7 +128,7 @@ flyte:
# -- Docker image for Datacatalog deployment
repository: cr.flyte.org/flyteorg/datacatalog # DATACATALOG_IMAGE
# -- Docker image tag
tag: v1.14.0 # DATACATALOG_TAG
tag: v1.14.1 # DATACATALOG_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Datacatalog deployment
Expand Down Expand Up @@ -177,7 +177,7 @@ flyte:
# -- Docker image for Flytepropeller deployment
repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTEPROPELLER_TAG
tag: v1.14.1 # FLYTEPROPELLER_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytepropeller deployment
Expand Down Expand Up @@ -473,7 +473,7 @@ flyte:
# -- Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig)
co-pilot:
name: flyte-copilot-
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.0 # FLYTECOPILOT_IMAGE
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.1 # FLYTECOPILOT_IMAGE
start-timeout: 30s

# -- Core propeller configuration
Expand Down
2 changes: 1 addition & 1 deletion charts/flyteagent/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ A Helm chart for Flyte agent
| fullnameOverride | string | `""` | |
| image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| image.repository | string | `"cr.flyte.org/flyteorg/flyteagent"` | Docker image for flyteagent deployment |
| image.tag | string | `"1.13.14"` | Docker image tag |
| image.tag | string | `"1.14.2"` | Docker image tag |
| nameOverride | string | `""` | |
| nodeSelector | object | `{}` | nodeSelector for flyteagent deployment |
| podAnnotations | object | `{}` | Annotations for flyteagent pods |
Expand Down
2 changes: 1 addition & 1 deletion charts/flyteagent/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ image:
# -- Docker image for flyteagent deployment
repository: cr.flyte.org/flyteorg/flyteagent # FLYTEAGENT_IMAGE
# -- Docker image tag
tag: 1.13.14 # FLYTEAGENT_TAG
tag: 1.14.2 # FLYTEAGENT_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
ports:
Expand Down
2 changes: 1 addition & 1 deletion deployment/agent/flyte_agent_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ spec:
- pyflyte
- serve
- agent
image: "cr.flyte.org/flyteorg/flyteagent:1.13.14"
image: "cr.flyte.org/flyteorg/flyteagent:1.14.2"
imagePullPolicy: "IfNotPresent"
name: flyteagent
volumeMounts:
Expand Down
30 changes: 15 additions & 15 deletions deployment/eks/flyte_aws_scheduler_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -436,7 +436,7 @@ data:
plugins:
k8s:
co-pilot:
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.0
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.1
name: flyte-copilot-
start-timeout: 30s
core.yaml: |
Expand Down Expand Up @@ -879,7 +879,7 @@ spec:
- /etc/flyte/config/*.yaml
- migrate
- run
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: run-migrations
securityContext:
Expand All @@ -900,7 +900,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: seed-projects
securityContext:
Expand All @@ -918,7 +918,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: sync-cluster-resources
securityContext:
Expand All @@ -935,7 +935,7 @@ spec:
- mountPath: /etc/secrets/
name: admin-secrets
- name: generate-secrets
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
command: ["/bin/sh", "-c"]
args:
Expand All @@ -962,7 +962,7 @@ spec:
- --config
- /etc/flyte/config/*.yaml
- serve
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: flyteadmin
ports:
Expand Down Expand Up @@ -1069,7 +1069,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- run
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -1199,7 +1199,7 @@ spec:
- /etc/datacatalog/config/*.yaml
- migrate
- run
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.0"
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: run-migrations
volumeMounts:
Expand All @@ -1217,7 +1217,7 @@ spec:
- --config
- /etc/datacatalog/config/*.yaml
- serve
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.0"
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: datacatalog
ports:
Expand Down Expand Up @@ -1280,7 +1280,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "7c75b4d396049b3c0c3d425f22aaa11c5517e44d62a4e4a9e181327cd4693f5"
configChecksum: "d506150c845dea702ff708615390d9ed7dfac19b77a88429ed888b08fc6c9db"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -1308,7 +1308,7 @@ spec:
valueFrom:
fieldRef:
fieldPath: metadata.namespace
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.0"
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: flytepropeller
ports:
Expand Down Expand Up @@ -1362,9 +1362,9 @@ spec:
labels:
app: flyte-pod-webhook
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.14.0
app.kubernetes.io/version: v1.14.1
annotations:
configChecksum: "7c75b4d396049b3c0c3d425f22aaa11c5517e44d62a4e4a9e181327cd4693f5"
configChecksum: "d506150c845dea702ff708615390d9ed7dfac19b77a88429ed888b08fc6c9db"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand All @@ -1378,7 +1378,7 @@ spec:
serviceAccountName: flyte-pod-webhook
initContainers:
- name: generate-secrets
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.0"
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.1"
imagePullPolicy: "IfNotPresent"
command:
- flytepropeller
Expand All @@ -1405,7 +1405,7 @@ spec:
mountPath: /etc/flyte/config
containers:
- name: webhook
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.0"
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.1"
imagePullPolicy: "IfNotPresent"
command:
- flytepropeller
Expand Down
Loading
Loading