Receiving messages from a list of URLs

This scenario applies only to Talend ESB, Talend Data Services Platform, Talend MDM Platform, Talend Real Time Big Data Platform, and Talend Data Fabric.

For more technologies supported by Talend, see Talend Mediation Components.

In this scenario, we will use the Camel component HTTP4 and the cContentEnricher component to retrieve messages from a list of URLs. To do this, we need to build two sub-routes, one to read a file with a list of URLs and send the messages to the local file system, the other to retrieve the messages on these URLs.

In this use case, we will take a list of URLs on the local Tomcat server as the example. So we need to start Apache Tomcat before executing the Route.

A TXT file URLlist is used to provide the list of URLs, as shown below.

docs/introduction.html
docs/setup.html