tHDFSConfiguration
Enables the reuse of the connection configuration to HDFS in the same Job.
tHDFSConfiguration provides HDFS connection information for the file system related components used in the same Spark Job. The Spark cluster to be used reads this configuration to eventually connect to HDFS.
For more technologies supported by Talend, see Talend components.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Spark Batch: see tHDFSConfiguration properties for Apache Spark Batch.
The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.
-
Spark Streaming: see tHDFSConfiguration properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.