Component-specific settings for tUniqRow
The following table describes the Job script functions and parameters that you can define in the setSettings {} function of the component.
Function/parameter | Description | Mandatory? |
---|---|---|
UNIQUE_KEY {} |
In this function, use the following parameters to specify each column on which de-duplication will be carried out:
|
Yes |
ONLY_ONCE_EACH_ DUPLICATED_KEY |
Set this parameter to true to have only the first duplicated entry in the column(s) defined as key(s) sent to the output flow for duplicates. By default, this parameter is set to false. |
No |
IS_VIRTUAL_COMPONENT |
Set this parameter to true to enable generating temporary files on the hard disk when processing a large amount of data. This helps to prevent Job execution failure caused by memory overflow. With this this parameter set to true, you need also to define the BUFFER_SIZE and TEMP_DIRECTORY parameters. By default, this parameter is set to false. |
No |
BUFFER_SIZE |
Use this parameter to specify the buffer size, namely the number of rows that can be buffered in the memory before a temporary file is generated on the hard disk. Acceptable values:
|
Yes when IS_VIRTUAL_COMPONENT is set to true |
TEMP_DIRECTORY |
Use this parameter to specify the location where the temporary files should be stored. Information noteWarning:
Make sure that you specify an existing directory for temporary files; otherwise your Job execution will fail. |
Yes when IS_VIRTUAL_COMPONENT is set to true |
CHANGE_HASH_AND_ EQUALS_FOR_ BIGDECIMAL |
Set this parameter to true to ignore trailing zeros for Big Decimal data. By default, this parameter is set to false. |
No |
TSTATCATCHER_STATS |
Set this parameter to true to gather the processing metadata at the Job level as well as at each component level. By default, this parameter is set to false. |
No |
LABEL |
Use this parameter to specify a text label for the component. |
No |