Adding a new Hadoop connection context manually to the built Job
You can manually add a Hadoop environment to the Job, without the help of the Studio.
Following the example described in Creating a new Hadoop configuration context outside the Studio (optional), add a Prod Hadoop environment.
Before you begin
-
This Job must be using contextualized Hadoop connections. This means that your Job is using the Repository property type to reuse the Hadoop connection for which contexts have been defined.
You can search for further information about how to use metadata in a Job on Talend Help Center.
For further information about how to define contexts for a Hadoop connection in the Studio, see Contextualizing the Hadoop connection parameters.
-
The Job you need to deploy must have been properly built from the Studio and is unzipped.
You can search for further information about how to build Jobs to deploy and execute them on any server, independent of Talend Studio, on Talend Help Center.
Procedure
- In the contexts folder, duplicate the Dev.properties and rename it Prod.properties.
- In the lib folder, duplicate the hadoop-conf-cdh5100_Dev.jar and rename it hadoop-conf-cdh5100_Prod.jar.
- Open the hadoop-conf-cdh5100_Prod.jar and replace the configuration files with those from the production cluster.
Results
You can then use the Prod context in the command to load the Prod configuration in the Job.