tPatternMasking
Masks data that follows a specific pattern and can transform the original data in consistent manner, if needed.
If you need to mask heterogeneous data, you can use the tDataMasking component. For more information, see tDataMasking.
If you need to mask heterogeneous data, you can use the tDataMasking component. For more information, see the tDataMasking documentation on Talend Help Center (https://help.talend.com).
tPatternMasking replaces pattern-specific and generic data with random characters from a specified range of date and numeric values or a set of named values. The actual data is protected and the substitute data is functional for occasions when it is not advisable to show sensitive real data.
Data will keep looking real and consistent and will remain usable for purposes such as testing and training. The most common data type which may need masking method is where the data contains Personally Identifiable Information (PII) or Sensitive Personal Data (SPD).
- The component identifies spaces, slashes (/), dashes (-) and points (.) in the input as separators.
- The component preserves the pattern of the input values in the masked output.
- The component generates one row for each input row.
For example, the masked output for 615/67/7489 could be 379/48/1789.
When the input data does not match the pattern you defined, tPatternMasking outputs null.
In local mode, Apache Spark 1.6, 2.2, 2.3, 2.4 and 3.0 are supported.
For more technologies supported by Talend, see Talend components.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Standard: see tPatternMasking Standard properties.
The component in this framework is available in Talend Data Management Platform, Talend Big Data Platform, Talend Real Time Big Data Platform, Talend Data Services Platform, and in Talend Data Fabric.
-
Spark Batch: see tPatternMasking properties for Apache Spark Batch.
The component in this framework is available in all Talend Platform products with Big Data and in Talend Data Fabric.
-
Spark Streaming: see tPatternMasking properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.