Configuring Spark connection using the Job script API
In addition to the visual Spark configuration interface available when designing a
Spark Job in Talend Studio, a Job
script is another way to do this configuration.
Talend Studio enables you to create Jobs directly by writing their script. As a Job design, a Job script can be made of one or several components linked together. The properties of each component and connection require to be configured individually, in order to function properly.
This chapter provides specific information about configuring Spark connection for your Job
using Job scripts.
-
For general information about designing a Job using Job scripts, see: Designing Jobs using the Job script API.
-
For components-specific Job script properties, see Job script properties of frequently used components.
-
For examples of creating Jobs using Job scripts, see Job script examples.