Skip to main content Skip to complementary content
Qlik Resources
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal

Testing lineage locally

Before publishing a Job to Talend Management Console, you can test lineage generation locally in Talend Studio to identify and resolve any lineage issues.

Before you begin

  • You have a Qlik Talend Cloud Premium Edition or Qlik Talend Cloud Enterprise Edition license.
  • You have already configured the connection and authentication from Talend Management Console to Qlik Cloud. For more information, see Configuring Talend Cloud with Qlik Cloud.
  • The components you used in the Job support lineage in Qlik Cloud. For more information, see the list of supported Talend Studio components for lineage in Qlik Cloud in Enabling lineage collection for Job tasks.
  • Runtime lineage is enabled for the Job. For more information, see Enabling runtime lineage for Jobs.

Procedure

  1. In the design workspace, open the Job you want to test.
  2. Open the Run view.
  3. Click the Lineage Testing button.
    The Lineage Testing dialog box opens.
  4. Select the Lineage Testing checkbox to enable lineage testing for the Job.
  5. In the Logs storage section, specify the folder where lineage logs are saved:
    • Accept the default folder (${user.home}/talend_lineage_logs).
    • Click Browse to select a different folder.
  6. Click Close.
    The Lineage Testing button icon changes to indicate that lineage testing is enabled for the Job.
  7. Click Run to execute the Job.

    When the Job runs with lineage testing enabled, the system automatically sets the log level to INFO and generates JSON files containing lineage metadata in the configured logs folder.

    Information noteImportant: If the Job does not support dataset and lineage generation, a warning message appears in the console: Lineage-producer - The Job artifact does not support dataset and lineage generation.
  8. Navigate to the logs folder to review the generated lineage files.
    The lineage files are saved in JSON format with the naming pattern: <Job_ID>.json.

What to do next

After verifying that lineage is generated correctly, you can publish the Job to Talend Cloud and enable lineage collection in Talend Management Console. For more information, see Publishing datasets and lineage to Qlik Cloud.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here