Linking the components
Procedure
- In the Integration perspective of Talend Studio, create an empty Spark Streaming Job from the Job Designs node in the Repository tree view.
- In the workspace, enter the name of the component to be used and select this component from the list that appears. In this scenario, the components are tHDFSConfiguration, tKafkaInput, tWindow, tExtractJSONFields, tMap, tAggregateRow, tTop and tLogRow.
- Connect tKafkaInput, tWindow, tExtractJSONFields and tMap using the Row > Main link.
- Connect tMap to tAggregateRow using the Row > Main link and name this connection in the dialog box that is displayed. For example, name it to hashtag.
- Connect tAggregateRow, tTop and tLogRow using the Row > Main link.
- Leave the tHDFSConfiguration component alone without any connection.