tSchemaComplianceCheck
Ensures the data quality of any source data against a reference data source.
tSchemaComplianceCheck validates all input rows against a reference schema or check types, nullability, length of rows against reference values. The validation can be carried out in full or partly.
For more technologies supported by Talend, see Talend components.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Standard: see tSchemaComplianceCheck Standard properties.
The component in this framework is available in all Talend products.
-
MapReduce: see tSchemaComplianceCheck MapReduce properties (deprecated).
The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.
-
Spark Batch: see tSchemaComplianceCheck for Apache Spark Batch.
The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.
-
Spark Streaming: see tSchemaComplianceCheck for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.