tS3Configuration
Reuses the connection configuration to S3N or S3A in the same Job. The Spark cluster to be used reads this configuration to eventually connect to S3N (S3 Native Filesystem) or S3A.
Only one tS3Configuration component is allowed per Job.
Depending on the Talend product you are using, this component can be used in one, some or all of the following Job frameworks:
-
Spark Batch: see tS3Configuration properties for Apache Spark Batch.
The component in this framework is available in all subscription-based Talend products with Big Data and Talend Data Fabric.
-
Spark Streaming: see tS3Configuration properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.