Using the Multi-thread Execution feature to run Jobs in parallel
Based on the previous use case Using the output stream feature, this use case give an example of how to use the Multi-thread Execution feature to run two Jobs in parallel to display the employees information in both the testing and production environments at the same time. When handling large data volumes, this feature can significantly optimize the Job execution performance of the Talend Studio.
For more information, see Using parallelization to optimize Job performance.
Preparing Jobs to read employees data in different contexts
Procedure
-
In the Repository tree view,
right-click the Job created in the use case Using the output stream feature and select Duplicate from the context menu. Then, in the Duplicate dialog box enter a new name for the Job,
employees_testing in this example, and click OK.
-
Open the new Job, and label the components to better reflect their
roles.
-
Create another Job named employees_production
by repeating the steps above.
-
On Extra tab of the Job view of the Job
employees_testing, fill the Table
Name field of database settings with
db_testing; on the Extra tab of the Job view of
the Job employees_production, fill the Table Name field with
db_production.
Set up a parent Job to run the Jobs in parallel
Procedure
-
Create a new Job and add two tRunJob components on the design workspace, and label the
components to better reflect their roles.
-
Configure the other tRunJob component to run
the other Job, employees_production.
Executing the Jobs
Procedure
-
In the parent Job, press F6 of
click Run on the Run view to start execution of the child Jobs.
The child Jobs are executed in parallel, reading employees data from both databases and displaying the data on the console.
