Skip to main content Skip to complementary content
Qlik Resources

Creating a Databricks MLflow connection

Databricks MLflowconnections are created in Data load editor or Script.

Once you have created a connection, you can select data from the available tables to send to Databricks MLflow for calculations, and then load that data into your app. This connection can be used in your data load script and in chart expressions to call model endpoints and perform real-time chart expression calculations.

You must know the settings and access credentials to the Databricks MLflow service that you want to connect to.

Configurable settings

The following settings can be configured in the Connection dialog:

Configurable settings in the connection dialog
Field Description
Select Configuration

Configuration: Select the version of Databricks MLflow that your model uses. The following options are available:

  • MLflow 1.0: The model is created using Databricks MLflow 1.x.

  • MLflow 2.0: The model is created using Databricks MLflow 2.x.

    Information note For models created with Databricks MLflow 2.0 (versions 2.x), data is sent to Databricks in the dataframe_split JSON format, which is the preferred format for structured data in Databricks MLflow.
Model

Model URL: URL to the Databricks MLflow platform where the Databricks MLflow model is deployed.
Authentication

Provides the Databricks API Token.

All models on Databricks MLflow are authenticated with Databricks token-based authentication enabled. This requires an API token to be generated that has access to the model resource.
Response Table

Name of Returned Table: Name of the returned table from the deployed machine learning model.
Response Fields

  • Load all available fields: Enable loading of all available fields returned by the machine learning endpoint. Disabling this, will allow you to specify the table fields and values to load into the app.

    When developing apps, it is recommended to first load all fields returned from the model endpoint, and then potentially remove the fields that are not needed for the analysis in the app.

  • Table Fields (JMESPath): The Table fields can be specified by adding:

    • Name: the name of the table that will be loaded in the app.

    • Value: the name of the response row in the JSON response array.

    JMESPath query language can be used to parse the JSON response array.
Association

  • Association Field: A field from the input data table containing a unique identifier.

    Including this field in the source data is required when making an endpoint request for the results table returned to be associated with the source field table using a key. The designated field will be returned as a field in the response and enable the predictions to be associated with the source data in the data model. This can be any field with a unique ID, from the source data, or as part of the table load process.

  • Send Association Field: When selected, the field specified as the association field will be both returned to Qlik Sense and included in the fields sent to the endpoint

    If the field belongs to the source data and is expected by the model, it must be sent to the model by enabling Send Association Field.
Name The name of the connection. The default name is used if you don't enter a name.

Creating a new connection

Do the following:

  1. Access the connector through Data load editor or Script.

  2. Click Create new connection.

  3. Under Space, select the space where the connection will be located.

  4. Select Databricks MLflow from the list of data connectors.

  5. Fill out the connection dialog fields.

  6. Click Create.

Your connection is now listed under Data connections in Data load editor or Script.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!

Leave your feedback here