Defining Landing Zones connections

In a Data Lake project, you can define any number of Landing Zone connections. Defining multiple Landing Zone connections is necessary if the data that you eventually want to be available in your Storage Zone is located in several Landing Zones.

The Landing Zone connection settings tell Compose where thesource tables from the Replicate task are located. Since the Landing Zone is always located on the Storage Zone Server and the Storage Zone connection details have already been defined, you do not need to provide them again.

For more information on defining a Storage Zone connection, see Defining a connection to the Storage Zone.

To define a Landing Zone connection:

1. Open your project and click Manage in the Databases panel.

   The Manage Databases window opens.

2. Click the New toolbar button.

   The New Data Source window opens.

3. In the Name field, specify a display name for your Landing Zone. 

4. From the Content type drop-down list, choose whether the content in the landing zone is Full Load Only, Change Processing or Full Load and Change Processing (according to the Qlik Replicate task definition).

5. Specify the name of the Unity Catalog in the Catalog field, according to the following guidelines:

   • If the Replicate task is Full Load and Store Changes, both the catalog name defined in the Replicate Databricks (Cloud Storage) target endpoint and the catalog name defined in landing settings must be hive_metastore.
   • If the Replicate task is Full Load only, the name must be the same as the catalog name defined in the Replicate Databricks (Cloud Storage) target endpoint.
   Information note

   • Relevant for Databricks only.

   • If the storage connection settings were defined without a catalog, then the landing connection settings must also be defined without a catalog.

6. In the Database name field, select the database that was defined in the Replicate target endpoint settings. If you specified a catalog (above), only databases in the catalog will be available for selection.

   For more information, see Defining a Qlik Replicate task.

7. Associate with Replicate Task - This is required. Select this to associate your Data Lake project with the related Replicate task. Replicate tasks replicate the relevant tables from the source database to the Landing Zone. Specifying the Replicate task name will enable you to monitor and control that task from within Compose.

   Information note

   Before you can choose a Replicate task however, you first need to define the connection settings to the Qlik Replicate Server machine. To do this, click the Replicate Server Settings link below the Task field and then configure the settings as described in Replicate Server settings.

   Once you have configured connectivity to at least one Replicate Server, you can then proceed to select a Replicate task.

   To select a Replicate task:

   1. Click the browse button to the right of the Associate with Replicate task field.

      The Select Replicate Task window opens.

   2. Select a Replicate Server from the Server drop-down list.

      The Replicate Tasks list is populated with all tasks defined on the selected server.

   3. Select the task that is replicating the source tables to the landing zone and then click OK.

   The name of the selected task is shown as read-only in the Associate with Replicate task field.

8. Click Test Connection and then, if the connection is successful, click OK to save your settings.