# tDSInput / tDataStewardshipTaskInput

Connects to Qlik Talend Data Integration or Talend Data Stewardship and retrieves the data stored in campaigns in the form of tasks.

Information noteAttention: From Talend Studio 8.0 R2025-12, the tDataStewardshipTask\* components are replaced by the tDS\* components:

* tDataStewardshipTaskInput becomes tDSInput.
* tDataStewardshipTaskOutput becomes tDSOutput.
* tDataStewardshipTaskDelete becomes tDSDelete.

These components let you connect Talend Studio to [Qlik Talend Data Integration](https://help.qlik.com/en-US/cloud-services/csh/client/qdi_stewardship_create_job) and [Talend Data Stewardship](https://help.qlik.com/talend/en-US/data-stewardship-user-guide/Cloud/talend-cloud-data-stewardship-introduction).

tDSInput retrieves tasks according to certain search criteria. All retrieved tasks must belong to the same sprint/campaign and must have the same schema. You can then process this data and/or write it into target applications or systems.

You can set proxy settings to connect to Talend Data Stewardship by using the tSetProxy component.

This component is not shipped with your Talend Studio by default. You need to install it using the Feature Manager. For more information, see [Installing features using the Feature Manager](https://help.qlik.com/talend/r/en-US/8.0/studio-user-guide/install-features-to-talend-studio).

## Standard properties

These properties are used to configure the tDSInput and tDataStewardshipTaskInput components which run in the Standard Job framework.

The Standard tDSInput and tDataStewardshipTaskInput components belong to the Data Stewardship family.

The component in this framework is available in all subscription-based Talend products.

## Basic settings to retrieve data from a Qlik Talend Data Integration sprint

| Properties | Description |
| --- | --- |
| Cloud | Select Qlik Data Stewardship and click<br>Apply. |
| Property Type | Either Built-in or Repository.<br><br><br>Built-In: You create and store the schema locally for this component<br>only.<br><br><br>Repository: You have already created the schema and stored it in the<br>Repository. You can reuse it in various projects and Job designs. |
| Schema and Edit<br>schema | A schema is a row description. It defines the number of fields<br>(columns) to be processed and passed on to the next component. When you create a Spark<br>Job, avoid the reserved word line when naming the<br>fields.<br><br>Click Edit<br>schema to make changes to the schema. If the current schema is of the Repository type, three options are available:<br><br><ul> <li> <p> <span>View schema</span>: choose this                option to view the schema only.</p> </li> <li> <p> <span>Change to built-in property</span>:                choose this option to change the schema to <span>Built-in</span> for local changes.</p> </li> <li> <p> <span>Update repository connection</span>:                choose this option to change the schema stored in the repository and decide whether                to propagate the changes to all the Jobs upon completion.</p> <p>If you just want to                propagate the changes to the current Job, you can select <span>No</span> upon completion and choose this schema metadata                again in the <span>Repository Content</span>                window.</p> </li> </ul><br><br>The columns below are automatically added to the schema of this component and<br>are read-only. They give the task metadata:<br><br><ul> <li><samp>QDS_ID</samp>: Task identifier.</li> <li><samp>QDS_STATE</samp>: Current state of the task.</li> <li><samp>QDS_PRIORITY</samp>: Value which represents the                           priority level of the task in the web application.</li> <li><samp>QDS_ASSIGNEE_ID</samp>: Identifier of the task                           assignee.</li> <li><samp>QDS_ASSIGNEE_NAME</samp>: Name of the task                           assignee.</li> <li><samp>QDS_ASSIGNEE_EMAIL</samp>: Email of the task                           assignee.</li> <li><samp>QDS_CREATION</samp>: Task creation date.</li> <li><samp>QDS_LAST_UPDATE</samp>: Task last update.</li> <li><samp>QDS_LAST_UPDATED_BY_ID</samp>: Identifier of the                           user who last updated the task.</li> <li><samp>QDS_LAST_UPDATED_BY_NAME</samp>: Name of the user                           who last updated the task.</li> <li><samp>QDS_LAST_UPDATED_BY_EMAIL</samp>: Email of the                           user who last updated the task.</li> <li><samp>QDS_TAGS</samp>: The tags assigned to the task                           retrieved as a list of comma-separated values.</li> <li><samp>QDS_EXTERNAL_ID</samp>: Helps you set an                           Identifier of your choice on tasks so that you can retrieve them easily                           from any other system.</li> </ul> |
| URL | Enter the address of your Qlik Cloud<br>tenant, for example https://qcs.us.qlikcloud.com/. |
| API key | Enter your API key. To generate one, see [Generating an API key](https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Admin/mc-generate-api-keys.htm). |
| Sprint | Click [...] and select the sprint from<br>which you want to retrieve the data. |
| States | Select from the list the states in the workflow at which you want to retrieve<br>the tasks.<br><br>This list displays the names of all the states you define in the sprint<br>workflow. It shows the initial and final states and any validation state you<br>add when creating the sprint in Qlik Talend Data Integration. |
| Assignee | Select the sprint participant whose tasks you want to retrieve.<br><br><br>No Assignee retrieves the tasks which are<br>not assigned to any data steward, while Any Assignee<br>retrieves the tasks without taking any assignee into account. |
| Priority (optional) | Select any of the priorities. Otherwise, select Custom and set a custom expression in the<br>Custom field that is displayed.<br><br>If no<br>level is selected, Medium is used by<br>default. |
| Tags (optional) | Enter the tags to associate with the tasks you want to retrieve.<br>You can use the tags to filter the tasks. |

## Advanced settings to retrieve data from a Qlik Talend Data Integration sprint

| Properties | Description |
| --- | --- |
| tStatCatcher Statistics | Select this checkbox to gather the Job processing metadata at the Job level<br>as well as at each component level. |
| Maximum number of retries | Set the number of request retries before throwing a timeout exception and<br>killing the Job. |
| Batch Size | Set the number of lines you want to have in each processed<br>batch.<br><br>Do not change the default value unless you are facing performance<br>issues. Increasing the batch size can improve the performance but setting a too<br>high value could cause Job failures. |

## Basic settings to retrieve data from Talend Data Stewardship

| Properties | Description |
| --- | --- |
| Cloud | Select Talend Data Stewardship and click<br>Apply. |
| Property Type | Either Built-in or Repository.<br><br><br>Built-In: You create and store the schema locally for this component<br>only.<br><br><br>Repository: You have already created the schema and stored it in the<br>Repository. You can reuse it in various projects and Job designs. |
| Schema and Edit schema | A schema is a row description. It defines the number of fields<br>(columns) to be processed and passed on to the next component. When you create a Spark<br>Job, avoid the reserved word line when naming the<br>fields.<br><br>Click Edit<br>schema to make changes to the schema. If the current schema is of the Repository type, three options are available:<br><br><ul> <li> <p> <span>View schema</span>: choose this                option to view the schema only.</p> </li> <li> <p> <span>Change to built-in property</span>:                choose this option to change the schema to <span>Built-in</span> for local changes.</p> </li> <li> <p> <span>Update repository connection</span>:                choose this option to change the schema stored in the repository and decide whether                to propagate the changes to all the Jobs upon completion.</p> <p>If you just want to                propagate the changes to the current Job, you can select <span>No</span> upon completion and choose this schema metadata                again in the <span>Repository Content</span>                window.</p> </li> </ul><br><br>The columns below are automatically added to the schema of this<br>component and are read-only. They give the task metadata.<br><br><ul> <li> <p> <em>TDS_ID </em>: task identifier.</p> </li> <li> <p> <em>TDS_STATE </em>: current state of the                        task.</p> </li> <li> <p> <em>TDS_ASSIGNEE </em>: task assignee.</p> </li> <li> <p> <em>TDS_CREATION </em>: task creation date.</p> </li> <li> <p> <em>TDS_LAST_UPDATE</em>: task last update                        date.</p> </li> <li> <p> <em>TDS_LAST_UPDATED_BY </em>: identifier of                        the user who last updated the task.</p> </li> <li> <p> <em>TDS_PRIORITY</em>: numeric value which                        represents the priority level of the task in the web application. Each                        numeric value is retrieved from a text value as below:</p> <ul> <li> <p> <span>Very                                    Low</span> = 0</p> </li> <li> <p> <span>Low</span> =                                1</p> </li> <li> <p> <span>Medium</span>                                = 2</p> </li> <li> <p> <span>High</span> =                                3</p> </li> <li> <p> <span>Very                                    High</span> = 3</p> </li> </ul> <p>The <span>No Priority</span> is set by default to <span>Medium</span> = 2.</p> </li> <li> <p> <em>TDS_TAGS</em>: the tag(s) assigned to                        the task retrieved as a list of comma-separated values.</p> </li> <li> <p> <em>TDS_ARBITRATION</em>: (Available only                        when an<span>ARBITRATION</span>                        campaign is selected) the choice assigned to the task in enumeration                        values.</p> </li> <li> <p> <em>TDS_ARBITRATION_LABEL</em>: (Available only when an <span>ARBITRATION</span> or a <span>GROUPING</span> campaign is selected) the choice                        assigned to the task as displayed in <span>Talend Data Stewardship</span>.</p> </li> <li> <p> <em>TDS_MASTER</em>: (Available only when a                            <span>MERGING</span>                        campaign is selected) indicator to whether the record is a master                        record.</p> </li> <li> <p> <em>TDS_SOURCE</em>: (Available only when a                            <span>MERGING</span>                        campaign is selected) name of the source of the record.</p> </li> <li> <p> <em>TDS_SCORE</em>: (Available only when a <span>GROUPING</span> or a <span>MERGING</span> campaign is selected) the calculated                        distance between the input and the master record according to the matching                        algorithm.</p> </li> <li> <p> <em>TDS_RATING</em>: (Available only when a <span>MERGING</span> campaign is selected) provides the                        trust score per source record you set at task creation. This score overrides                        the score you define at campaign creation, if any. It is an integer value,                        which represents a percentage between 0 and 100.</p> </li> <li> <p> <em>TDS_EXTERNAL_ID</em>: helps you set an Identifier of your choice on tasks                        so that you can retrieve them easily from any other system.</p> </li> </ul> |
| URL | Enter the address to access the Talend Data Stewardship server suffixed with<br>*/data-stewardship/*, for example<br>http://&lt;server\_address&gt;:19999/data-stewardship/.<br><br>If you are working with Talend Cloud Data Stewardship, use the URL for the<br>corresponding data center suffixed with */data-stewardship/* to access the<br>application, for example, https://tds.us.cloud.talend.com/data-stewardship for the AWS US<br>data center.<br><br>For the URLs of available data<br>centers, see [Accessing Talend Cloud applications](https://help.qlik.com/talend/en-US/installation-guide-windows/Cloud/talend-cloud-application-url). |
| Username and Password | Enter the authentication information to log in to Talend Data Stewardship.<br><br>To enter the password, click the [...] button<br>next to the password field, enter the password in double quotes in the pop-up dialog box,<br>and click OK to save the settings.<br><br>If you are working with Talend Cloud Data Stewardship and if:<br><br><ul> <li>SSO is enabled, enter an access token in the field.</li> <li>SSO is not enabled, enter in the field either: <ul> <li>an access token.</li> <li>your password (deprecated).</li> </ul> </li> </ul> |
| Campaign | Click Find a<br>campaign to open a list of all the campaigns available in Talend Data Stewardship, and select the name of the campaign holding the tasks. This is an<br>informative read-only field. |
| Type | A read-only list which shows the campaign type out of the<br>predefined types once the campaign is selected. |
| Override enforcement of data model | Select this checkbox if you want to process data on the Talend Data Stewardship server even if the schema type is not valid, no input validation of<br>the schema is performed. |
| State | Select from the list the state in the workflow at which you want to retrieve<br>the tasks.<br><br>This list displays the names of all the states you define in the campaign<br>workflow. It shows the initial and final states and any validation state you<br>add when creating the campaign in Talend Data Stewardship.<br><br>Use the Any State option to retrieve all tasks whatever<br>is their state.<br><br>Use the Custom option to specify different states of the<br>tasks to be retrieved separated by commas, for example<br>"New,toValidate1,Resolved". You must enter the exact<br>label of the state you define in the workflow. |
| Assignee | Select the campaign participant whose tasks you want to retrieve.<br><br><br>No Assignee retrieves the tasks which are not assigned<br>to any data steward, while Any Assignee retrieves the<br>tasks without taking any assignee into account.<br><br><br>Custom enables you to assign tasks dynamically to the<br>data stewards part of the campaign by defining context variables in the field<br>which is displayed. The expected value is the steward's login.<br><br>You can use this option to assign the tasks to specific stewards based on a<br>given attribute of the incoming data. For example, you can assign French<br>customers to Jacques Bocuse, a French steward, and US customers to Cale<br>Carolina, a US steward, or assign them based on the customer support level<br>Platinum for the support team lead and Gold for experts. |
| Priority, Choice and<br>Tags | Priority (optional): Select any of the task priorities.<br>Otherwise, select Custom and set a custom expression in<br>the field that appears.<br><br>If no level is selected, Any Priority retrieves all<br>tasks whatever is their priority.<br><br><br>Choice (optional, available only when an<br>ARBITRATION campaign is selected): Select any of the<br>choice options set on the records in the campaign.<br><br><br>No Choice retrieves the tasks for which no choice has<br>been selected by data stewards, while Any Choice<br>retrieves all tasks whatever is the selected choice.<br><br><br>Tags (optional): Enter the tag(s) to associate with the<br>tasks you want to retrieve. You can use the tag(s) to filter the tasks. |
| Query | Enter the query statement you want to use to filter the tasks to retrieve from<br>the campaign.<br><br>The condition is composed of a field name, an operator and a value. When<br>referencing record data, the name of the field must be prefixed by<br>record.. You should use simple quotes around strings, and<br>precede quotes within the string with a backslash. For example: to filter tasks<br>by assignee and first name value when having a *FirstName* field in the<br>record, use assignee='user1@talend.com' in the<br>Assignee field and<br>record.firstName='De\'wayne' in the<br>Query field.<br><br>For more information, see [The query<br>language used with data stewardship components and the REST API](https://help.qlik.com/talend/r/en-US/7.3/data-stewardship-user-guide/tql-with-tds-components-api). |
| Retrieve golden record only | Select this checkbox to read only the golden records which are the results of<br>the merging process.<br><br>This option is available only with the MERGING campaigns<br>and is selected by default. |

## Advanced settings to retrieve data from Talend Data Stewardship

| Properties | Description |
| --- | --- |
| Campaign ID | Displays the technical name of the campaign once it is selected<br>in the basic settings. However, you can modify the field value to replace it with a<br>context parameter for example and pass context variables to the Job at runtime. This<br>technical name is always used to identify a campaign when the Job communicates with<br>Talend Data Stewardship whatever is the value in the Campaign<br>field. |
| HTTP client configuration | Connect Timeout: Set the time in milliseconds (ms) you<br>want to wait before the connection attempt fails and the Job is killed.<br><br><br>Request Timeout: Set the time in milliseconds (ms) you<br>want to wait before the request attempt fails and the Job is killed.<br><br>The value 0 is interpreted as infinite waiting time. |
| Use ID based pagination | This option improves performances when fetching tasks by relying on the last<br>task ID of a batch to fetch the next one. |
| Batch Size | Set the number of lines you want to have in each processed batch.<br><br>Do not change the default value unless you are facing performance issues.<br>Increasing the batch size can improve the performance but setting a too high<br>value could cause Job failures. |
| Consume tasks when they are read | This checkbox is selected by default to mark tasks as consumed on the<br>Talend Data Stewardship<br>server once they are retrieved by the component. These tasks will<br>not be retrieved a second time when you rerun the Job with the same filter<br>criteria.<br><br>Make sure to clear this checkbox only for very specific use cases, otherwise<br>there is a very high risk of processing twice the same tasks.<br><br>Information noteNote: This option<br>only applies to resolved tasks. |
| Max request attempts | Set the number of request attempts before throwing a timeout exception and<br>killing the Job. |
| tStatCatcher Statistics | Select this checkbox to gather the Job processing metadata at the Job level<br>as well as at each component level. |

## Global variables

| Variable | Description |
| --- | --- |
| NB\_LINE | The number of messages processed. This is an After variable and it returns an<br>integer. |
| NB\_REJECT | The number of rows rejected. This is an After variable and it returns an<br>integer. |
| NB\_SUCCESS | The number of rows successfully processed. This is an After variable and it returns<br>an integer. |
| ERROR\_MESSAGE | The error message generated by the component when an error occurs. This is an<br>After variable and it returns a string. This variable functions only if the Die on error checkbox is cleared, if the component has this<br>checkbox. |

## Usage

| Usage guidance | Description |
| --- | --- |
| Usage Rule | This component is usually used as a start component of a Job or<br>subJob and it always needs an output link. |

**Related concepts**

* [Retrieving tasks from Talend Data Stewardship](https://help.qlik.com/talend/en-US/components/8.0/data-stewardship/tdatastewardshiptaskinput-tlogrow-retrieving-tasks-from-talend-data-stewardship-standard-component-enterprise "This Job reads the tasks stored in Talend Data Stewardship according to the criteria you define in the basic settings of the tDataStewardshipTaskInput component.")