Skip to main content Skip to complementary content

Retrieving fixed fields from a Data Stewardship campaign

This scenario aims at helping you set up and use connectors in a pipeline. You are advised to adapt it to your environment and use case.

Example of a pipeline created from the instructions below.

Before you begin

  • You have created a Test connection and dataset that will hold the output logs. See Test connection properties for more information.
  • A task assigned to the data steward, that is fixing customer data with empty emails in a Resolution campaign, has been completed.
  • You have the Campaign owner role that allows you to display and retrieve the campaign in Talend Cloud Pipeline Designer. See this documentation for more information.

Procedure

  1. Click Add pipeline on the Pipelines page. Your new pipeline opens.
  2. Give the pipeline a meaningful name.

    Example

    Retrieve corrections from Stewardship campaign
  3. Click ADD SOURCE and go the Campaigns tab to retrieve the Resolution campaign in which the task that consisted in fixing empty email fields has been completed.
    Campaigns tab in the select a source menu.
    You can see that the campaign task retrieved has the RESOLVED state and the FIXED tag, which means the fields with invalid emails where fixed by the data steward assigned to this task:
    Configuration tab of the source item
  4. Click add processor and add a Field Selector processor to the pipeline in order to select and keep only the ID and EMAIL fields. The configuration panel opens.
  5. Give a meaningful name to the processor.

    Example

    select ID and EMAIL fields
  6. In the Selectors area of the Advanced mode:
    1. Select .ID in the Input list and enter ID in the Output field, as you want to select the fields corresponding to customer identifiers.
    2. Click the + sign to add a new element and select .EMAIL in the Input list and enter EMAIL in the Output field, as you want to select the fields corresponding to customer emails.
    3. Click Save to save your configuration.
      The selected fields (including the fixed emails) are kept and renamed according to your configuration.
      In the Output data preview, only the selected fields appear.
  7. Click the ADD DESTINATION item and select the Test dataset that will hold the output logs..
  8. Give a meaningful name to the destination; output logs for example.
  9. In the Configuration tab of the destination, click the Main tab:
    1. Enable the Log records to STDOUT option to capture the logs into this output destination.
    2. Click Save to save your configuration.
  10. On the top toolbar of Talend Cloud Pipeline Designer, click the Run button to open the panel allowing you to select your run profile.
  11. Select your run profile in the list (for more information, see Run profiles), then click Run to run your pipeline.

Results

Your pipeline is being executed, the fixed customer emails have been retrieved and the logs are captured in the destination you have defined.

What to do next

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here