# tDQRules / tDataQualityRules

Validates data using data quality rules by connecting Talend Studio to Qlik Talend Data Integration, or to a Talend app.

Information noteAttention: From Talend Studio 8.0 R2025-06, the tDataQualityRules Standard component is replaced by tDQRules. This component lets you use the rules from:

* Qlik Talend Data Integration.
* Talend Cloud Data Inventory.
* Talend Cloud Data Stewardship.
* The hybrid version of Talend Data Stewardship 8.0 R2022-07 and greater.

For Apache Spark Jobs, you can only use tDataQualityRules with the Talend apps.

For more information on each app, see the corresponding documentation:

* For Qlik Talend Data Integration, see [Working with validation rules](https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/DataProducts/Working-with-validation-rules.htm) in Qlik Cloud documentation.
* For Talend Cloud Data Stewardship, see [What is a data quality rule?](https://help.qlik.com/talend/r/en-US/Cloud/data-stewardship-user-guide/tds-dqr) in the Talend Cloud Data Stewardship User Guide.
* For the hybrid version of Talend Data Stewardship 8.0 R2022-07 and greater, see the [What is a data quality rule?](https://help.qlik.com/talend/r/en-US/8.0/data-stewardship-user-guide/tds-dqr) in the Talend Data Stewardship User Guide. For more information on the hybrid version, see [What is hybrid for Talend Cloud?](https://help.qlik.com/talend/r/en-US/Cloud/hybrid-installation-guide-windows/what-is-hybrid-for-talend-cloud).
* For Talend Cloud Data Inventory, see the [What is a data quality rule?](https://help.qlik.com/talend/r/en-US/Cloud/data-inventory-user-guide/data-quality-rules) in the Talend Cloud Data Inventory User Guide. You can connect to this app in Talend Studio 8.0 R2023-06 and greater.

A data quality rule is a set of business requirements which defines the values your data must comply with.

To retrieve the data quality rules into a JAR file, tDQRules connects Talend Studio to one of the app listed above. Talend Studio uses the retrieved library so you can apply data quality rules to your data. For more information on how the component works with Talend apps, see [Description of the local and Cloud/hybrid process](https://help.qlik.com/talend/en-US/components/8.0/validation/tdqrules-local-cloud-process "You can retrieve data quality rules by connecting Talend Studio to Qlik Talend Data Integration, or a Talend app.").

The following table describes the categories and subcategories into which the component returns the data:

| Output categories | tDataQualityRules | tDQRules |
| --- | --- | --- |
| Valid<br><br>These data follow the Main<br>flow. | <ul> <li>Valid: The data fulfill the condition and the validation expression                              or the data fulfill the alternative validation expression only.</li> <li>Not applicable (NA): The data do not fulfill the condition. The rule                           cannot be applied to the data.</li> </ul> | The data fulfill the condition and the validation expression or the data<br>fulfill the alternative validation expression only. |
| Invalid<br><br>These data follow the Reject<br>flow. | <ul> <li>Invalid: The data fulfill the condition but not the validation                              expression.</li> <li>Not executable (NE): The rule cannot be executed on the data. For                              example, when the data types do not match.</li> </ul> | <ul> <li>Invalid: The data fulfill the condition but not the validation                              expression.</li> <li>Not executable (NE): The rule cannot be executed on the data. For                              example, when the data types do not match.</li> <li>When there is no result, it means there is no result to return</li> </ul><br><br>. |
| Not Applicable<br><br>These data follow the<br>Not\_Applicable flow. | Not applicable to this component | The data do not fulfill the condition. The rule cannot be applied to the<br>data. |

When two or more rules are used, the data is categorized depending on the results of each rule and the component you are using. The following tables describe the results of the validation logic:

Validation logic of tDQRulesValidation logic of tDQRules

|  | Valid | Invalid | Not Applicable |
| --- | --- | --- | --- |
| Valid | Valid | Invalid | Valid |
| Invalid | Invalid | Invalid | Invalid |
| Not applicable | Valid | Invalid | Not applicable |

Validation logic of tDataQualityRulesValidation logic of tDataQualityRules

|  | Valid | Invalid | Not Applicable |
| --- | --- | --- | --- |
| Valid | Valid | Invalid | Valid |
| Invalid | Invalid | Invalid | Invalid |
| Not applicable | Valid | Invalid | Valid |

This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see [Installing features using the Feature Manager](https://help.qlik.com/talend/r/en-US/8.0/studio-user-guide/install-features-to-talend-studio).

You need the Qlik Talend Cloud Enterprise Edition to use the tDQRules / tDataQualityRules component.

Apache Spark tDataQualityRules supports:

* In local mode, Apache Spark 3.0 and greater.
* Cloudera Data Engineering service with Apache Spark 3.1 or 3.2.

## Standard properties

These properties are used to configure tDQRules and tDataQualityRules running in the standard Job framework.

The standard tDQRules and tDataQualityRules components belong to the Data Quality family.

Information noteImportant:

If you are using tDataQualityRules, see [Basic settings for tDataQualityRules](https://help.qlik.com/talend/en-US/components/8.0/validation/tdqrules#basic-tdataqualityrules). This component has been combined with tDQRules from Talend Studio 8.0 R2025-06 but the properties of tDataQualityRules are the same. They do not depend on the version you are using.

## Basic settings for tDQRules

| Properties | Description |
| --- | --- |
| Cloud | Select the app from which you want to retrieve the rules:<br><br><ul> <li><span>Qlik Talend Cloud Data Integration</span></li> <li><span>Talend Cloud Data Inventory or Stewardship</span></li> </ul><br><br>Click Apply to enable more settings.<br><br>If you<br>selected Talend Cloud Data Inventory or Stewardship, you<br>are using tDataQualityRules, see [Basic settings for<br>tDataQualityRules](https://help.qlik.com/talend/en-US/components/8.0/validation/tdqrules#basic-tdataqualityrules). |
| Property Type | Select the way the file path and the schema will be set.<br><br><ul> <li> <p> <span>Built-In</span>: The file path and the schema will be                                set locally for this component.</p> </li> <li> <p> <span>Repository</span>: The file details stored centrally                                in <span><span>Repository</span><abbr> &gt; </abbr><span>Metadata</span></span> will be reused by this component.</p> <p>You need to click                                the <span>[...]</span> button next to it and in the pop-up                                    <span>Repository Content</span> dialog box, select the                                file to be reused, and all related properties will be automatically                                filled in.</p> </li> </ul> |
| Schema and Edit schema | A schema is a row description that defines the number of fields (columns) to be<br>processed and passed on to the next component.<br><br>Click Sync<br>columns to retrieve the schema from the previous component connected in the<br>Job.<br><br>Select the Schema type:<br><br><ul> <li> <p> <span>Built-In</span>: You create and store the schema locally for this component                only.</p> </li> <li> <p> <span>Repository</span>: You have already created the schema and stored it in the                Repository. You can reuse it in various projects and Job designs.</p> </li> </ul><br><br>Click Edit<br>schema to make changes to the schema. If the current schema is of the Repository type, three options are available:<br><br><br>View schema: choose this<br>option to view the schema only.<br><br><br>Change to built-in property:<br>choose this option to change the schema to Built-in for local changes.<br><br><br>Update repository connection:<br>choose this option to change the schema stored in the repository and decide whether<br>to propagate the changes to all the Jobs upon completion.<br><br>The supported types are: Boolean, Date, Double, Dynamic, Float, Integer,<br>Long, Short, and String. |
| URL | Information noteImportant: You need the Rules - View<br>permission to retrieve the rules.<br><br>Enter the URL of the app. For example,<br>https://qcs.us.qlikcloud.com/. |
| API key | Enter your API key. To generate one, see [Generating an API key](https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Admin/mc-generate-api-keys.htm). |
| Rule library timestamp | After you entered the URL and token, click Fetch<br>rules.<br><br>If the URL and token are correct, the rules are retrieved<br>into Talend Studio: yyyy-MM-dd hh:mm:ss (library\_number).<br><br>When you click Fetch rules, a<br>JAR file containing the rule definition is<br>created<br>in:<br><br>```<br>studio-path\configuration\.m2\repository\org\talend\libraries\rule-number<br>```<br><br>When you update the rules in the app, click Fetch<br>rules to retrieve the latest version. |
| Rule name | This option is available until Talend Studio 8.0 R2025-12.<br><br>Select the rule from the list and click Refresh table. |
| Rules | This option is available from Talend Studio<br>8.0 R2026-01.<br><br>Select one or more rules and click Refresh<br>table. |
| Rule content | Associate the variables of the rule with the input data.<br><br>The rule<br>is retrieved from the library:<br><br><ul> <li><span>Rule name</span> (from <span>Talend Studio</span> 8.0 R2026-01): The rule name retrieved from the Cloud app.</li> <li><span>Rule variable</span>: The variable from the Cloud                           app.</li> <li><span>Input column</span>: The input column from <span>Talend Studio</span>.</li> <li><span>Fact column</span>: The input column from <span>Talend Studio</span> when the column is dynamic.</li> </ul><br><br><br>When no rules or input columns are available, verify that:<br><br><ul> <li>Rules have been retrieved in <span>Rule library                        timestamp</span>.</li> <li>The input schema is correct.</li> </ul> |

## Basic settings for tDataQualityRules

| Properties | Description |
| --- | --- |
| Cloud | This option is available from Talend Studio 8.0 R2025-06.<br><br><br>Select the app from which you want to retrieve the rules:<br><br><ul> <li><span>Qlik Talend Cloud Data Integration</span></li> <li><span>Talend Cloud Data Inventory or Stewardship</span></li> </ul><br><br>Click Apply to enable more settings.<br><br>If you<br>selected Qlik Talend Cloud Data Integration, you are<br>using tDQRules, see [Basic settings for tDQRules](https://help.qlik.com/talend/en-US/components/8.0/validation/tdqrules#basic-tdqrules). |
| Schema and Edit schema | A schema is a row description that defines the number of fields (columns) to be<br>processed and passed on to the next component.<br><br>Click Sync<br>columns to retrieve the schema from the previous component connected in the<br>Job.<br><br>Select the Schema type:<br><br><ul> <li> <p> <span>Built-In</span>: You create and store the schema locally for this component                only.</p> </li> <li> <p> <span>Repository</span>: You have already created the schema and stored it in the                Repository. You can reuse it in various projects and Job designs.</p> </li> </ul><br><br>Click Edit<br>schema to make changes to the schema. If the current schema is of the Repository type, three options are available:<br><br><br>View schema: choose this<br>option to view the schema only.<br><br><br>Change to built-in property:<br>choose this option to change the schema to Built-in for local changes.<br><br><br>Update repository connection:<br>choose this option to change the schema stored in the repository and decide whether<br>to propagate the changes to all the Jobs upon completion.<br><br>The supported types are: Boolean, Date, Double, Dynamic, Float, Integer,<br>Long, Short, and String. |
| Application | Select the application from which you want to retrieve the data quality<br>rules. You can select one or more rules. |
| URL | Information noteImportant: You need the Rules - View<br>permission to retrieve the rules.<br><br>Enter the URL of the selected app. For example,<br>https://qcs.us.qlikcloud.com/ for Qlik Talend Data Integration.<br><br>For Talend apps, the following URLs are supported:<br><br><ul> <li><span>Talend Cloud Data Stewardship</span>, or the hybrid version of <span>Talend Data Stewardship</span> 8.0 R2022-07 and greater: <pre><code><pre><code><code>https://tds.&lt;env&gt;.cloud.talend.com/rulerepository/api/v1https://tds.&lt;env&gt;.cloud.talend.com/rulerepository/api/v1/https://tds.&lt;env&gt;.cloud.talend.com/rulerepositoryhttps://tds.&lt;env&gt;.cloud.talend.com/rulerepository/https://tds.&lt;env&gt;.cloud.talend.com (Only for <span>Talend Cloud Data Stewardship</span>)https://tds.&lt;env&gt;.cloud.talend.com/ (Only for <span>Talend Cloud Data Stewardship</span>)</code></code></pre></code></pre> <p>When you use the hybrid version, you can use a URL with the                                          IP address or the hostname:</p><div> <pre><code><pre><code><code>https://ip:19999/rulerepository/api/v1https://ip:19999/rulerepository/api/v1/https://ip:19999/rulerepositoryhttps://ip:19999/rulerepository/https://hostname:19999/rulerepository/api/v1https://hostname:19999/rulerepository/api/v1/         https://hostname:19999/rulerepositoryhttps://hostname:19999/rulerepository/</code></code></pre></code></pre> </div> </li> <li><span>Talend Cloud Data Inventory</span>, from <span>Talend Studio</span> 8.0                                    R2023-06:<pre><code><pre><code><code>https://tdc.&lt;env&gt;.cloud.talend.com/rulerepository/api/v1https://tdc.&lt;env&gt;.cloud.talend.com/rulerepository/api/v1/https://tdc.&lt;env&gt;.cloud.talend.com/rulerepositoryhttps://tdc.&lt;env&gt;.cloud.talend.com/rulerepository/https://tdc.&lt;env&gt;.cloud.talend.comhttps://tdc.&lt;env&gt;.cloud.talend.com/ </code></code></pre></code></pre></li> </ul> |
| Token | Enter your token. To generate one, see [Generating a Personal Access<br>Token](https://help.qlik.com/talend/r/en-US/Cloud/management-console-user-guide/cloud-access-token). |
| DQ rule library timestamp | After you entered the URL and token, click<br>Refresh.<br><br>If the URL and token are correct, the rules<br>are retrieved into Talend Studio: yyyy-MM-dd hh:mm:ss (library\_number).<br><br>When you click Fetch rules, a<br>JAR file containing the rule definition is<br>created<br>in:<br><br>```<br>studio-path\configuration\.m2\repository\org\talend\libraries\rule-number<br>```<br><br>When you update the rules in the Cloud or hybrid application, click<br>Refresh to retrieve the latest version. |
| Configure DQ rules | Associate the variables of the rule with the input data.<br><br>The rules are<br>retrieved from the library:<br><br><ul> <li> <span>DQ Rule</span>: Select the rule.</li> <li> <span>Rule variable</span>: The variables of the rule are                           automatically retrieved.</li> <li> <span>Input column</span>: Select the column that contains the                           values that must replace the variable.</li> <li> <span>Dynamic column selection</span>: When you selected a                           dynamic column as <span>Input column</span>, enter the column                           name between double quotes.<div><span>Information note</span><span>Restriction:</span> You can associate a rule                  variable to one column only. Enter one column only in <span>Dynamic column                        selection</span>.</div> </li> </ul><br><br>If no rules or input columns are available, verify that:<br><br><ul> <li>Data quality rules have been retrieved in <span>DQ rule library                                    timestamp</span>.</li> <li>The input schema is correct.</li> </ul><br><br>You can associate the data types from Talend Studio with some data types from the apps. See [Associating data types](https://help.qlik.com/talend/en-US/components/8.0/validation/tdqrules#associating-data-types) below.<br><br>To apply more rules, click ![Add icon](https://help.qlik.com/talend/en-US/components/8.0/Resources/images/add.svg). |

## Associating data types

The following table describes the data types you can associate.

| Rule variable from the app\* | Input column (from Talend Studio) |
| --- | --- |
| Number | Double, Float, Integer, Long, Short, and String |
| Boolean | Boolean |
| Text | String |
| Date | Date |
| Any data types supported in the application | Dynamic |
| \* You can enter the URL of:<br><br><ul> <li><span>Talend Cloud Data Stewardship</span>.</li> <li>The hybrid version of <span>Talend Data Stewardship</span> 8.0 R2022-07 and greater.</li> <li><span>Talend Cloud Data Inventory</span>, from <span>Talend Studio</span> 8.0 R2023-06.</li> </ul> |  |

For Qlik Talend Data Integration, see the types supported on the app in [Working with data quality rules](https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/DataProducts/Working-with-validation-rules.htm#operators).

When using the date/time operators in the tDQRules component, you cannot use some words as the column names because they are reserved keywords. For more information, see [Language definition](https://github.com/google/cel-spec/blob/master/doc/langdef.md).

## Advanced Settings

| Properties | Description |
| --- | --- |
| tStatCatcher<br>statistics | Select this checkbox to gather the Job processing metadata at the Job level<br>as well as at each component level. |