Setting up the Job
Set up the Job by linking the components to construct the data flow.
Procedure
- In the Integration perspective of Talend Studio, create an empty Spark Streaming Job from the Job Designs node in the Repository tree view.
- In the workspace, enter the name of the components to be used and select these components from the list that appears. In this scenario, the components are tSetKeystore, tKafkaInputAvro, tWindow, tFilterRow, tAggregateRow, and tLogRow.
- Connect tKafkaInputAvro to tWindow, and then connect tWindow to tFilterRow using the link.
- Connect tFilteRow to tAggregateRow using the link.
- Connect tAggregateRow to tLogRow using the link.
- Leave the tSetKeyStore component alone without any connection.