Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create UC schema from DAB without development mode name prefix #1779

Open
jamuska opened this issue Sep 18, 2024 · 2 comments
Open

Create UC schema from DAB without development mode name prefix #1779

jamuska opened this issue Sep 18, 2024 · 2 comments
Labels
DABs DABs related issues Enhancement New feature or request

Comments

@jamuska
Copy link

jamuska commented Sep 18, 2024

When deploying UC schemas with mode: development, the schema name gets the same dev prefix as workflow or pipeline names.

In our case, we are already using separate dev catalogs, so the prefixed schema name does not bring any additional value. Rather it makes the schema list more difficult to read and annoys the developers who have to write a long schema name. I would like to have the option to deploy the schema without the prefix.

@jamuska jamuska added the DABs DABs related issues label Sep 18, 2024
@shreyas-goenka
Copy link
Contributor

Thanks for reaching out @jamuska! DABs has the configurable presets.name_prefix that you can set to "" to turn off prefixes for all resources on your DAB.

That, however, will not solve your problem of just turning off the prefix for just UC schemas. One workaround I can recommend for now is to add a separate target to your DAB where presets.name_prefix is set to the empty string. Developers can then deploy both targets to avoid the prefix.

As for a native solution to allow selective prefixing, it's something we will have to evaluate. One of the intentions behind mode: development is to provide isolated namespacing for users, and I'm not sure whether we want to introduce yet another knob here just yet.

I'll keep this issue open to receive feedback incase other users also run into this issue.

@jamuska
Copy link
Author

jamuska commented Sep 24, 2024

Thanks for the input @shreyas-goenka

I get your point about namespacing with development mode. I really like the feature for workflows and pipelines, where I'm most of the time just clicking on them in a list and there is no other native way of separating those to "collections". With UC resources the situation in my opinion is a bit different, since UC natively offers different layers for organizing objects. Including user name in each of the resources (which I suppose is required to avoid having duplicate object names for different developers) makes the object names very long and cumbersome to use in queries.

Correct me if I'm wrong, but using a separate target without name_prefix to deploy the schemas would require me to define all the shared resources separately for every other target to avoid deploying several copies of workflows and pipelines with duplicate names. Or is there some way I could exclude resources for a single target?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DABs DABs related issues Enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants