tGenKey
Generates a functional key from the input columns, by applying different types of algorithms on each column and grouping the computed results in one key, then outputs this key with the input columns.
tGenKey enables you to apply several kinds of algorithms on each input column and use the computed results to generate a functional key, which can be used, for example, to narrow down your data filter/matching results. These algorithms can be key or optional algorithms.
The values returned by the key algorithms will be concatenated, according to the column order in the Key composition table.
In local mode, Apache Spark 1.3, 1.4, 1.5, 1.6, 2.0, 2.3, 2.4 and 3.0 are supported.
For more technologies supported by Talend, see Talend components.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Standard: see tGenKey Standard properties.
The component in this framework is available in Talend Data Management Platform, Talend Big Data Platform, Talend Real Time Big Data Platform, Talend Data Services Platform, and in Talend Data Fabric.
-
MapReduce: see tGenKey MapReduce properties (deprecated).
The component in this framework is available in all Talend Platform products with Big Data and in Talend Data Fabric.
-
Spark Batch: see tGenKey properties for Apache Spark Batch.
The component in this framework is available in all Talend Platform products with Big Data and in Talend Data Fabric.
-
Spark Streaming: see tGenKey properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.