Skip to main content Skip to complementary content

Registering data that is already on the data platform

You can register data that already exists on the data platform to curate and transform data, and create data marts. This lets you use data that is onboarded with other tools than Qlik Cloud Data Integration, for example, Qlik Replicate.

When you register data, two data tasks are created.

  • Registered data

    Registering the data involves creating views to prepare the data to be ready for creating datasets.

  • Storage

    This involves generating and storing datasets based on the registered data.

    Generating and storing datasets

When you have registered the data, you can use the generated datasets in several ways.

  • You can use the datasets in an analytics app.

  • You can create transformations.

  • You can create a data mart.

Register data

You can register data that exists in the cloud data warehouse defined in the data project. The generated datasets will be stored in the same cloud data warehouse.

For more information about data projects, see Creating a data pipeline in a data project.

  1. Click Add new and then Register data.

  2. Add Name and Description for the data task.

    Click Next.

  3. Select data to register.

    Selecting data to include

    Click Next.

    Settings is displayed.

  4. Select how the data is updated in Data loading.

    • Use Full load when the data was only loaded once, or if it is updated using full reloads.

    • Use Incremental loading with Qlik Replicate storing changes when the data is replicated using a Qlik Replicate task that is storing changes.

      Recommended Qlik Replicate configuration

  5. Preview the two data tasks that are created in Summary, and rename them if you prefer.

    Tip noteThe names are used when naming database schemas in the storage data task. As a schema can only be associated with one task, consider using names that are unique to avoid conflicts with data tasks in other data projects using the same data platform.
  6. Select if you want to open the registered data task, or return to the data project.

    When you are ready, Click Finish.

The two data tasks are now created. To start replicating data you need to:

  • Prepare the registered data task.

    Click Prepare in the data task.

    When artifacts have been created, the data task status is Registered.

  • Prepare and run the storage data task.

    For more information, see Generating and storing datasets

Selecting data to include

When you select data to include, you can select specific tables or views, or use selection rules to include or exclude groups of tables.

Use % as a wildcard to define a selection criteria for schemas and tables.

  • %.% defines all tables in all schemas.

  • Public.% defines all tables in the schema Public.

Selection criteria gives you a preview based on your selections.

You can now either:

  • Create a rule to include or exclude a group of tables based on the selection criteria.

    Click Add rule from selection criteria to create a rule, and select either Include or Exclude.

    You can see the rule under Selection rules.

  • Select one or more datasets, and click Add selected datasets.

    You can see the added datasets under Explicitly selected datasets.

Selection rules only apply to the current set of tables and views, not to tables and views that are added in the future.

Registered data settings

You can set properties for the registered data task.

  • Click Settings.


  • Database

    Database to use in the target.

  • Data asset schema

    You can change the name of the data asset schema.

Recommended Qlik Replicate configuration

These Qlik Replicate task settings are recommended when registering data that is replicated using a Qlik Replicate task storing changes.

  • The Qlik Replicate task should be configured with options Full Load and Store Changes.

  • In Store Changes Settings > Change Tables, make sure that the following change table columns are included, using their default names:

    • [header__]change_seq

    • [header__]change_oper

    • [header__] timestamp

  • In Store Changes Settings > Change Tables, set On UPDATE to Store after image only.

    This reduces the space for each update as the before image is not included. Use this option if you do not plan to use the before image.

  • In Store Changes Settings > Change Tables, set Suffix to the default value __ct.

  • Do not apply the following global transformations:

    • Rename Change Table

    • Rename Change Table Schema

  • If a primary key in a source table can be updated, enable DELETE and INSERT when updating a primary key column option in Change Processing Tuning.

    History of the old record will not be preserved in the new record.

    Information noteThis option is supported from Qlik Replicate November 2022 .

Operations on the registered data task

You can perform the following operations on a registered data task from the task menu.

  • Open

    This opens the data task. You can view the table structure and details about the data task.

  • Edit

    You can edit the name and the description of the task, and add tags.

  • Delete

    You can delete the data task.

    The source data is not deleted.

  • Sync datasets

    This syncs design changes that cannot be automatically adjusted.

  • Recreate tables

    This recreates the datasets from the source.

    You must also recreate all downstream data tasks that consume this data task.

  • Store data

    You can create a storage data task that uses data from this landing data task.

Data capacity considerations

  • If a registered table has no primary key, a full reload will be executed for every run. This will be counted towards your monthly registered data capacity quota. This is because the storage will need to compare all records to find changes.

  • Data capacity for registered data is counted in the storage. This means a delete in the registered data is translated to an insert or update of the storage (a soft delete) and counted in the data capacity.

  • Soft deletes, inserts, and updates will be counted twice towards data capacity if a table from registered data is used in two storage data tasks.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!