Skip to content

Catalog creation on Databricks Free #5695

Description

@pocelka

Describe the issue

DABs should support catalogs creation. One of the required parameters is storage_root. However on Databricks Free, I can't set this as I don't have access to underlying storage.

Configuration

bundle:
  name: poc
  engine: direct

workspace:
  host: 
  root_path: /Workspace/Users/user@gmail.com/.bundle/${bundle.target}/catalogs/${bundle.name}

targets:
  prod:
    mode: production
    default: true

resources:
  catalogs:
    poc:
      name: poc
      comment: "Proof of concept catalog for development purposes"
      lifecycle:
        prevent_destroy: true

Steps to reproduce the behavior

  1. Run databricks bundle deploy ...
  2. See error

Expected Behavior

There should be an option to create catalog without specifying storage_root parameter.

Actual Behavior

Uploading bundle files to /Workspace/Users/user@gmail.com/.bundle/prod/catalogs/poc/files...
Deploying resources...
Error: cannot create resources.catalogs.poc: Metastore storage root URL does not exist. Default Storage is enabled in your account. You can use the UI to create a new catalog using Default Storage, or please provide a storage location for the catalog (for example 'CREATE CATALOG myCatalog MANAGED LOCATION '<location-path>'). (400 INVALID_STATE)

Endpoint: POST https://....cloud.databricks.com/api/2.1/unity-catalog/catalogs
HTTP Status: 400 Bad Request
API error_code: INVALID_STATE
API message: Metastore storage root URL does not exist. Default Storage is enabled in your account. You can use the UI to create a new catalog using Default Storage, or please provide a storage location for the catalog (for example 'CREATE CATALOG myCatalog MANAGED LOCATION '<location-path>').

OS and CLI version

OS: Fedora
CLI: v1.4.0

Is this a regression?

n/a - trying for the first time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    DABsDABs related issues

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions