Skip to main content Skip to complementary content

Populating an existing MySQL table with leads from Michigan

Example of a pipeline created from the instructions below.

Before you begin

  • You have previously created a Test connection to store your source data.

  • You have previously added the dataset holding your source data, here new leads information such as their ID, first name, last name, city and state.

  • You also have created the connection and the related dataset that will hold the new leads, here a MySQL database table.

Procedure

  1. Click Add pipeline on the Pipelines page. Your new pipeline opens.
  2. Give the pipeline a meaningful name; Populate MySQL table with test data for example.
  3. Click ADD SOURCE to open the panel allowing you to select your source data, here a list of 30 new lead information.
  4. Select your dataset and click Select in order to add it to the pipeline. Rename it if needed.

    Example

    List of the new lead information.
  5. Click add processor and add a Filter processor to the pipeline that will allow you to only keep the leads that live in the Michigan state. The configuration panel opens.
  6. Give a meaningful name to the processor; filter on Michigan leads for example.
  7. In the Filter area:
    1. Select .state in the Input list, as you want to process customer states.
    2. Select None in the Apply a function first list, as you do not want to apply a function while filtering records.
    3. Select == in the Operator list and type in Michigan in the Value list as you want to filter on customers who live in the Michigan state.
  8. Click Save to save your configuration.

    The data is filtered and only leads living in Michigan are kept.

    In the Output data preview, 6 records match the criteria.
  9. Click the ADD DESTINATION item on the pipeline to open the panel allowing to select the dataset that will hold your output data (MySQL table).
  10. Give a meaningful name to the Destination; MySQL Michigan lead table for example.
  11. In the Action field of the MySQL destination configuration, select INSERT as you want to insert the data in the existing MySQL table.
  12. Click Save to save your configuration.
  13. On the top toolbar of Talend Cloud Pipeline Designer, click the Run button to open the panel allowing you to select your run profile.
  14. Select your run profile in the list (for more information, see Run profiles), then click Run to run your pipeline.

Results

Your pipeline is being executed, the leads are being filtered and the output flow is sent to the MySQL table listing leads from Michigan.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here