dbfs_file_paths.md

subcategory
Storage

databricks_dbfs_file_paths Data Source

-> Note If you have a fully automated setup with workspaces created by databricks_mws_workspaces or azurerm_databricks_workspace, please make sure to add depends_on attribute in order to prevent default auth: cannot configure default credentials errors.

This data source allows to get list of file names from get file content from Databricks File System (DBFS).

Example Usage

data "databricks_dbfs_file_paths" "partitions" {
  path      = "dbfs:/user/hive/default.db/table"
  recursive = false
}

Argument Reference

• path - (Required) Path on DBFS for the file to perform listing
• recursive - (Required) Either or not recursively list all files

Attribute Reference

This data source exports the following attributes:

• path_list - returns list of objects with path and file_size attributes in each

Related Resources

The following resources are used in the same context:

• End to end workspace management guide.
• databricks_dbfs_file data to get file content from Databricks File System (DBFS).
• databricks_dbfs_file_paths data to get list of file names from get file content from Databricks File System (DBFS).
• databricks_dbfs_file to manage relatively small files on Databricks File System (DBFS).
• databricks_library to install a library on databricks_cluster.
• databricks_mount to mount your cloud storage on dbfs:/mnt/name.