Skip to main content Skip to complementary content

Enabling lineage collection for Job tasks

Data Integration Jobs published from Talend Studio to Talend Management Console can generate input and output datasets and lineage, which can be sent to Qlik Cloud.

In the Catalog page of Qlik Cloud, you can view the lineage of your data that tracks the transformations backwards to the original source.

Before you begin

About this task

The maximum number of datasets is set to 50 and the maximum number of lineage to 500.

Procedure

  1. Go to the Processing step when creating or editing your task.
  2. Under Lineage, select the Allow lineage collection of this task check box.
    Selection of the Allow lineage collection of this task check box.
  3. Save your changes.
    You can see Lineage collection enabled in the Configuration box from the task details page.

Results

During the next run, the Job artifact will generate datasets and lineage to Qlik Cloud. The lineage is generated at run time when the task is executed for the first time, or after the task is modified. For more information, see Publishing datasets and lineage to Qlik Cloud.

To view the datasets, you can open the Catalog page in Qlik Cloud. Select Lineage for a dataset to view the lineage graph of your data. For more information, see Browsing datasets from the Catalog and Analyzing lineage in Analytics.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!