Skip to main content

Defining a Qlik Replicate task

In order to work with Compose for Data Warehouses, you first need to define a Qlik Replicate task that replicates the source tables from the source endpoint to a "landing area" in the data warehouse. The landing area should then be defined as the data source in the Compose project.

Note:

The steps below highlight the settings that are required when using Qlik Replicate with Compose for Data Warehouses. For a full description of setting up tasks in Qlik Replicate, please refer to the Qlik Replicate Help

Warning: When Oracle is defined as the source endpoint in the Replicate task, full supplemental logging should be defined for all source table columns that exist on the target and any source columns referenced in filters, data quality rules, lookups, and expressions.
  1. Open Qlik Replicate and define a new task.

    • To enable Full Load and Change Processing replication, enable the Full Load and Store Changes options (the Apply Changes option should not be enabled).
    • To enable Full Load replication only, make sure that only the Full Load option is enabled.
    • To enable Change Processing replication only, make sure that only the Store Changes option is enabled. Note that this option should only be selected if the Full Load tables and data already exist in the landing area.
    • To enable change processing for lookup tables that already exist in the landing area and are not part of the Compose model, enable the Apply Changes option only. Note that such a task should be defined in addition to the Full Load and Store Changes replication task described above. For more information on updating standalone lookup tables, see Using lookup tables that do not have an ETL Set for CDC mapping.
  2. Open the Manage Databases dialog box and define a source and target endpoint. The target endpoint must be the database where you want Compose for Data Warehouses to create the data warehouse.
  3. Add the endpoints to the Qlik Replicate task and then select which source tables to replicate.
  4. In the Task Settings’ Target Metadata tab, specify a Target table schema name.
  5. Run the task. Wait for the Full Load replication to complete and then continue the workflow in Compose for Data Warehouses as described in the Qlik Compose for Data Warehouses tutorial below and inAdding and managing projects .

Note:

Replicate allows you to define global transformations that are applied to source/Change tables during task runtime. The following global transformations, however, should not be defined (as they are not compatible with Compose for Data Warehouses tasks):

  • Rename Change Table
  • Rename Change Table schema