Databricks Partner Connect - Start Here

When you first open the Lightup app from Databricks Partner Connect, you'll see one workspace that contains one datasource.

Annotated image of first screen after navigating from Databricks' site to Lightup as a Partner Connect trial user
  1. The workspace's name is your account's first name, an underscore, and then your Databricks Workspace ID. This workspace is selected when you first open Lightup, so its contents are displayed on the Explorer tab.

  2. A datasource named DatabricksPC is connected to the schemas you selected when you set up the trial on Databricks.

As a Databricks trial participant, you have the App Editor role, which grants you the ability to create workspaces, and the Workspace Admin role in the initial workspace, which grants full control inside the workspace.

For more information, see Collaborate in workspaces based on roles.

Start working on data quality

You've got a datasource, but at first it looks empty. Before you start creating metrics, you need the data assets to be Active. Data assets exist in a hierarchy that reflects the data structures in your connected datasources; this hierarchy appears in the Explorer tree - the tab labeled Explorer in the main part of the page.

You can create metrics at three levels of the data hierarchy: schema, tables, and columns.

  1. In the Explorer tree, select the DatabricksPC datasource.

  2. On the right, on the Actions menu, select Manage metrics. A dialog opens and displays the schema in your datasource, similar to the following image.

The "Manage metrics" modal for a datasource

3. In the dialog, under Active, slide the toggle to the right to make the schema Active. It may take a few moments for Lightup to scan the schema.

4. New toggles appear for any applicable schema autometrics. To enable an autometric, slide its toggle to the right.

The "Manage metrics" modal for a schema

After you make your schema Active, you'll see it under your datasource in the Explorer tree, where you can then make its tables active and enable table autometrics.

Annotated image of 1) an Active schema in the Explorer tree and 2) the "Actions" menu for the schema
  1. Select your schema in the Explorer tree.

  2. On the Actions menu, select Manage metrics.

From here, your experience depends on what tables and columns you have, but the pattern is essentially the same: select a data asset in the Explorer tree, use Actions > Manage metrics to make any of its child data assets active and enable relevant autometrics, then repeat for each data asset you make Active.

To learn more about setting up data assets, go to Prepare tables for data quality monitoring. From there, follow the content to learn how to set up metrics, monitors, and other data quality monitoring features.

Last updated