Snapshot

Snapshot build of the main branch. Updated automatically on each commit.

v0.237.0

Bundles:

• Allow overriding compute for non-development mode targets (#1899).
• Avoid panic if Config.Workspace.CurrentUser.User is not set (#1993).
• Show an error when using a cluster override with 'mode: production' (#1994).

Internal:

API Changes:

• Added databricks account federation-policy command group.
• Added databricks account service-principal-federation-policy command group.
• Added databricks aibi-dashboard-embedding-access-policy delete command.
• Added databricks aibi-dashboard-embedding-approved-domains delete command.

OpenAPI commit a6a317df8327c9b1e5cb59a03a42ffa2aabeef6d (2024-12-16)
Dependency updates:

• Upgrade TF provider to 1.62.0 (#2030).
• Upgrade Go SDK to 0.54.0 (#2029).
• Bump TF codegen dependencies to latest (#1961).
• Bump golang.org/x/term from 0.26.0 to 0.27.0 (#1983).
• Bump golang.org/x/sync from 0.9.0 to 0.10.0 (#1984).
• Bump github.com/databricks/databricks-sdk-go from 0.52.0 to 0.53.0 (#1985).
• Bump golang.org/x/crypto from 0.24.0 to 0.31.0 (#2006).
• Bump golang.org/x/crypto from 0.30.0 to 0.31.0 in /bundle/internal/tf/codegen (#2005).

v0.236.0

New features for Databricks Asset Bundles:

This release adds support for managing Unity Catalog volumes as part of your bundle configuration.

Bundles:

• Add DABs support for Unity Catalog volumes (#1762).
• Support lookup by name of notification destinations (#1922).
• Extend "notebook not found" error to warn about missing extension (#1920).
• Skip sync warning if no sync paths are defined (#1926).
• Add validation for single node clusters (#1909).
• Fix segfault in bundle summary command (#1937).
• Add the bundle_uuid helper function for templates (#1947).
• Add default value for volume_type for DABs (#1952).
• Properly read Git metadata when running inside workspace (#1945).
• Upgrade TF provider to 1.59.0 (#1960).

Internal:

• Breakout variable lookup into separate files and tests (#1921).
• Add golangci-lint v1.62.2 (#1953).

Dependency updates:

• Bump golang.org/x/term from 0.25.0 to 0.26.0 (#1907).
• Bump github.com/Masterminds/semver/v3 from 3.3.0 to 3.3.1 (#1930).
• Bump github.com/stretchr/testify from 1.9.0 to 1.10.0 (#1932).
• Bump github.com/databricks/databricks-sdk-go from 0.51.0 to 0.52.0 (#1931).

v0.235.0

Note: the bundle generate command now uses the .<resource-type>.yml
sub-extension for the configuration files it writes. Existing configuration
files that do not use this sub-extension are renamed to include it.

Bundles:

• Make TableName field part of quality monitor schema (#1903).
• Do not prepend paths starting with ~ or variable reference (#1905).
• Fix workspace extensions filer accidentally reading notebooks (#1891).
• Fix template initialization when running on Databricks (#1912).
• Source-linked deployments for bundles in the workspace (#1884).
• Added integration test to deploy bundle to /Shared root path (#1914).
• Update filenames used by bundle generate to use .<resource-type>.yml (#1901).

Internal:

• Extract functionality to detect if the CLI is running on DBR (#1889).
• Consolidate test helpers for io/fs (#1906).
• Use fs.FS interface to read template (#1910).
• Use filer.Filer to write template instantiation (#1911).

v0.234.0

Bundles:

• Do not execute build on bundle destroy (#1882).
• Add support for non-Python ipynb notebooks to DABs (#1827).

API Changes:

• Added databricks credentials command group.
• Changed databricks lakeview create command with new required argument order.

OpenAPI commit d25296d2f4aa7bd6195c816fdf82e0f960f775da (2024-11-07)
Dependency updates:

• Upgrade TF provider to 1.58.0 (#1900).
• Bump golang.org/x/sync from 0.8.0 to 0.9.0 (#1892).
• Bump golang.org/x/text from 0.19.0 to 0.20.0 (#1893).
• Bump golang.org/x/mod from 0.21.0 to 0.22.0 (#1895).
• Bump golang.org/x/oauth2 from 0.23.0 to 0.24.0 (#1894).
• Bump github.com/databricks/databricks-sdk-go from 0.49.0 to 0.51.0 (#1878).

v0.233.0

CLI:

• Clean host URL in the auth login command (#1879).

Bundles:

• Fix bundle run when run interactively (#1880).
• Fix relative path resolution for dashboards on Windows (#1881).

Internal:

• Address goreleaser deprecation warning (#1872).
• Update actions/github-script to v7 (#1873).
• Use Go 1.23 (#1871).
• [Internal] Always write message for manual integration test trigger (#1874).
• Add cmd-exec-id to user agent (#1808).
• Added E2E test to run Python wheels on interactive cluster created in bundle (#1864).

Dependency updates:

• Bump github.com/hashicorp/terraform-json from 0.22.1 to 0.23.0 (#1877).

v0.232.1

This patch release fixes the following error observed when deploying to /Shared root folder:

Error: Path (/Shared/.bundle/.../resources) doesn't exist

Bundles:

• Fixed adding /Workspace prefix for resource paths (#1866).

v0.232.0

New features for Databricks Asset Bundles:

This release adds support for managing AI/BI dashboards as part of your bundle configuration. The bundle generate command is updated to support producing dashboard bundle configuration as well as a serialized JSON representation of the dashboard.

You can find an example configuration and walkthrough at https://github.com/databricks/bundle-examples/tree/main/knowledge_base/dashboard_nyc_taxi

CLI:

• Add privacy notice to README (#1841).

Bundles:

• Add support for AI/BI dashboards (#1743).
• Added validator for folder permissions (#1824).
• Add bundle generate variant for dashboards (#1847).
• Use SetPermissions instead of UpdatePermissions when setting folder permissions based on top-level ones (#1822).

Internal:

• Attempt to reduce test flakiness on Windows (#1845).
• Reuse resource resolution code for the run command (#1858).
• [Internal] Automatically trigger integration tests on PR (#1857).
• [Internal] Add test instructions for external contributors (#1863).
• Add libs/dyn/jsonsaver (#1862).

Dependency updates:

• Bump github.com/fatih/color from 1.17.0 to 1.18.0 (#1861).

v0.231.0

CLI:

• Added JSON input validation for CLI commands (#1771).
• Support Git worktrees for sync (#1831).

Bundles:

• Add bundle summary to display URLs for deployed resources (#1731).
• Added a warning when incorrect permissions used for /Workspace/Shared bundle root (#1821).
• Show actionable errors for collaborative deployment scenarios (#1386).
• Fix path to repository-wide exclude file (#1837).
• Fixed typo in converting cluster permissions (#1826).
• Ignore metastore permission error during template generation (#1819).
• Handle normalization of dyn.KindTime into an any type (#1836).
• Added support for pip options in environment dependencies (#1842).
• Fix race condition when restarting continuous jobs (#1849).
• Fix pipeline in default-python template not working for certain workspaces (#1854).
• Add "output" flag to the bundle sync command (#1853).

Internal:

• Move utility functions dealing with IAM to libs/iamutil (#1820).
• Remove unused IS_OWNER constant (#1823).
• Assert SDK version is consistent in the CLI generation process (#1814).
• Fixed unmarshalling json input into interface{} type (#1832).
• Fix TestAccFsMkdirWhenFileExistsAtPath in isolated Azure environments (#1833).
• Add behavioral tests for examples from the YAML spec (#1835).
• Remove Terraform conversion function that's no longer used (#1840).
• Encode assumptions about the dashboards API in a test (#1839).
• Add script to make testing of code on branches easier (#1844).

API Changes:

• Added databricks disable-legacy-dbfs command group.

OpenAPI commit cf9c61453990df0f9453670f2fe68e1b128647a2 (2024-10-14)
Dependency updates:

• Upgrade TF provider to 1.54.0 (#1852).
• Bump github.com/databricks/databricks-sdk-go from 0.48.0 to 0.49.0 (#1843).

v0.230.0

Notable changes for Databricks Asset Bundles:

Workspace paths are automatically prefixed with /Workspace. In addition, all usage of path strings such as /Workspace/${workspace.root_path}/... in bundle configuration is automatically replaced with ${workspace.root_path}/... and generates a warning as part of bundle validate.

More details can be found here: https://docs.databricks.com/en/release-notes/dev-tools/bundles.html#workspace-paths

Bundles:

• Add an error if state files grow bigger than the export limit (#1795).
• Always prepend bundle remote paths with /Workspace (#1724).
• Add resource path field to bundle workspace configuration (#1800).
• Add validation for files with a .(resource-name).yml extension (#1780).

Internal:

• Remove deprecated or readonly fields from the bundle schema (#1809).

API Changes:

• Changed databricks git-credentials create, databricks git-credentials delete, databricks git-credentials get, databricks git-credentials list, databricks git-credentials update commands .
• Changed databricks repos create, databricks repos delete, databricks repos get, databricks repos update command .

OpenAPI commit 0c86ea6dbd9a730c24ff0d4e509603e476955ac5 (2024-10-02)
Dependency updates:

• Upgrade TF provider to 1.53.0 (#1815).
• Bump golang.org/x/term from 0.24.0 to 0.25.0 (#1811).
• Bump golang.org/x/text from 0.18.0 to 0.19.0 (#1812).
• Bump github.com/databricks/databricks-sdk-go from 0.47.0 to 0.48.0 (#1810).