tFuzzyUniqRow Standard properties

Schema and Edit schema

A schema is a row description, it defines the number of fields to be processed and passed on to the next component. The schema is either Built-in or stored remotely in the Repository.

Built-in: You create and store the schema locally for this component only. Related topic: see Talend Studio User Guide.

Repository: You have already created the schema and stored it in the Repository. Thus, you can reuse it in various projects and job designs. Related topic: see Talend Studio User Guide.

Column

List of all columns in the input flow.

Key attribute

Select the check boxes next to the columns you want to check.

Matching type

Select the relevant matching algorithm from the list:

Exact Match: matches each processed entry to all possible reference entries with exactly the same value.

Levenshtein: Based on the edit distance theory. It calculates the number of insertion, deletion or substitution required for an entry to match the reference entry.

Metaphone: Based on a phonetic algorithm for indexing entries by their pronunciation. It first loads the phonetics of all entries of the lookup reference and checks all entries of the main flow against the entries of the reference flow. It does not support Chinese characters.

Double Metaphone: a new version of the Metaphone phonetic algorithm that produces more accurate results than the original algorithm. It can return both a primary and a secondary code for a string. This accounts for some ambiguous cases as well as for multiple variants of surnames with common ancestry. It does not support Chinese characters.

Min. Distance

Only for Levenshtein. Set the minimum number of changes allowed to match the reference. If set to 0, only perfect matches(Exact Match) are returned.

Max. Distance

Only for Levenshtein. Set the maximum number of changes allowed to match the reference.

tStat Catcher Statistics

Select this check box to collect log data at the component level.

Global Variables

NB_UNIQUES: the number of unique rows. This is an After variable and it returns an integer.

NB_DUPLICATES: the number of duplicate rows. This is an After variable and it returns an integer.

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl + Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio User Guide.

Usage rule

This component is not startable (green background) and it requires an input component and two output components.