Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added support for TLS to MLMD GRPC Server #683

Merged
merged 1 commit into from
Sep 24, 2024

Conversation

hbelmiro
Copy link
Contributor

@hbelmiro hbelmiro commented Aug 9, 2024

The issue resolved by this Pull Request:

Resolves https://issues.redhat.com/browse/RHOAIENG-4971

This PR depends on:

Description of the changes:

Added support for TLS to MLMD GRPC Server

Testing instructions

There are 2 scenarios for testing:

TLS Enabled
  1. Deploy the following DSPA

    apiVersion: datasciencepipelinesapplications.opendatahub.io/v1alpha1
    kind: DataSciencePipelinesApplication
    metadata:
      name: dspa
    spec:
      dspVersion: v2
      podToPodTLS: true
      apiServer:
        image: "quay.io/opendatahub/ds-pipelines-api-server:pr-72"
        argoDriverImage: "quay.io/opendatahub/ds-pipelines-driver:pr-72"
        argoLauncherImage: "quay.io/opendatahub/ds-pipelines-launcher:pr-72"
        enableSamplePipeline: true
      persistenceAgent:
        image: "quay.io/opendatahub/ds-pipelines-persistenceagent:pr-72"
      scheduledWorkflow:
        image: "quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-72"
      mlmd:  
        deploy: true  # Optional component
        grpc:
          image: "quay.io/opendatahub/mlmd-grpc-server:latest"
        envoy:
          image: "registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2"
      mlpipelineUI:
        deploy: true  # Optional component 
        image: "quay.io/opendatahub/ds-pipelines-frontend:pr-72"
      objectStorage:
        minio:
          deploy: true
          image: 'quay.io/opendatahub/minio:RELEASE.2019-08-14T20-37-41Z-license-compliance'
  2. Run the sample pipeline

  3. The run must complete successfully

TLS Disabled
  1. Deploy the following DSPA

    apiVersion: datasciencepipelinesapplications.opendatahub.io/v1alpha1
    kind: DataSciencePipelinesApplication
    metadata:
      name: dspa
    spec:
      dspVersion: v2
      podToPodTLS: false
      apiServer:
        image: "quay.io/opendatahub/ds-pipelines-api-server:pr-72"
        argoDriverImage: "quay.io/opendatahub/ds-pipelines-driver:pr-72"
        argoLauncherImage: "quay.io/opendatahub/ds-pipelines-launcher:pr-72"
        enableSamplePipeline: true
      persistenceAgent:
        image: "quay.io/opendatahub/ds-pipelines-persistenceagent:pr-72"
      scheduledWorkflow:
        image: "quay.io/opendatahub/ds-pipelines-scheduledworkflow:pr-72"
      mlmd:  
        deploy: true  # Optional component
        grpc:
          image: "quay.io/opendatahub/mlmd-grpc-server:latest"
        envoy:
          image: "registry.redhat.io/openshift-service-mesh/proxyv2-rhel8:2.3.9-2"
      mlpipelineUI:
        deploy: true  # Optional component 
        image: "quay.io/opendatahub/ds-pipelines-frontend:pr-72"
      objectStorage:
        minio:
          deploy: true
          image: 'quay.io/opendatahub/minio:RELEASE.2019-08-14T20-37-41Z-license-compliance'
  2. Run the sample pipeline

  3. The run must complete successfully

Checklist

  • The commits are squashed in a cohesive manner and have meaningful messages.
  • Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
  • The developer has manually tested the changes and verified that the changes work

@dsp-developers
Copy link
Contributor

A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-683
An OCP cluster where you are logged in as cluster admin is required.

To use this image run the following:

cd $(mktemp -d)
git clone [email protected]:opendatahub-io/data-science-pipelines-operator.git
cd data-science-pipelines-operator/
git fetch origin pull/683/head
git checkout -b pullrequest 85a6ca9ebb69f28e05780de54509b0d3855cb533
oc new-project opendatahub
make deploy IMG="quay.io/opendatahub/data-science-pipelines-operator:pr-683"

More instructions here on how to deploy and test a Data Science Pipelines Application.

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-683

@hbelmiro hbelmiro marked this pull request as ready for review August 30, 2024 19:27
@VaniHaripriya
Copy link
Contributor

VaniHaripriya commented Sep 4, 2024

/verified
/lgtm
Deployed DSPO and verified the two scenarios mentioned in the testing instructions. Created pipeline runs and they completed successfully.

controllers/dspipeline_params.go Outdated Show resolved Hide resolved
controllers/dspipeline_params.go Outdated Show resolved Hide resolved
controllers/dspipeline_params.go Outdated Show resolved Hide resolved
controllers/config/defaults.go Outdated Show resolved Hide resolved
@openshift-ci openshift-ci bot removed the lgtm label Sep 6, 2024
controllers/mlmd.go Outdated Show resolved Hide resolved
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-683

1 similar comment
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-683

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-683

@hbelmiro hbelmiro force-pushed the RHOAIENG-4971 branch 2 times, most recently from 3571282 to 9cc9ff7 Compare September 17, 2024 17:00
@gmfrasca
Copy link
Member

gmfrasca commented Sep 20, 2024

this is silly/trivial, but we should remove the UPSTREAM: <carry> prefixes in some of the commits messages/PR title... this repo is the upstream so we're not carrying anything here :)

controllers/util/util.go Outdated Show resolved Hide resolved
@gregsheremeta
Copy link
Contributor

gregsheremeta commented Sep 20, 2024

we should remove the UPSTREAM: prefixes in some of the commits messages/PR title

+1, <carry> and friends is only applicable to DSP

Copy link
Contributor

@gregsheremeta gregsheremeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm after a few nitpicks and questions are addressed. Very nice!

controllers/mlmd.go Show resolved Hide resolved
controllers/mlmd.go Show resolved Hide resolved
controllers/mlmd.go Show resolved Hide resolved
@hbelmiro hbelmiro changed the title UPSTREAM: <carry>: Added support for TLS to MLMD GRPC Server Added support for TLS to MLMD GRPC Server Sep 23, 2024
@hbelmiro
Copy link
Contributor Author

@gmfrasca

this is silly/trivial, but we should remove the UPSTREAM: <carry> prefixes in some of the commits messages/PR title... this repo is the upstream so we're not carrying anything here :)

Removed and commits squashed.

controllers/dspipeline_controller.go Outdated Show resolved Hide resolved
controllers/dspipeline_controller.go Show resolved Hide resolved
controllers/mlmd.go Show resolved Hide resolved
@HumairAK
Copy link
Contributor

/lgtm
/approve

@openshift-ci openshift-ci bot added the lgtm label Sep 24, 2024
Copy link
Contributor

openshift-ci bot commented Sep 24, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: HumairAK

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-bot openshift-merge-bot bot merged commit 52bd7d1 into opendatahub-io:main Sep 24, 2024
7 checks passed
@hbelmiro hbelmiro deleted the RHOAIENG-4971 branch September 24, 2024 21:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants