Concatenating customer names on Marketo and inserting them in a Snowflake table
This scenario aims at helping you set up and use connectors in a pipeline. You are
advised to adapt it to your environment and use case.
Procedure
Click Connections > Add
connection.
In the panel that opens, select the type of connection you
want to create.
Example
marketo
Select your engine
in the Engine list.
Information noteNote:
It is recommended to use the Remote Engine Gen2 rather than
the Cloud Engine for Design for advanced
processing of data.
If no Remote Engine Gen2 has been created from Talend Management Console or if it exists but appears as unavailable
which means it is not up and running, you will not be able to select
a Connection type in the list nor to
save the new connection.
The list of available connection types depends on the engine you
have selected.
Select the type of connection you want to create.
Here, select Marketo.
Fill in the connection properties to access your Marketo account as described
in Marketo properties, check the connection and click
ADD DATASET.
In the Add a new dataset
panel, name your dataset. In this example, the entity contains customer data
collected during a marketing campaign.
Example
customers on
marketo
Fill in the required properties to access the table located in
your database and click VIEW SAMPLE to
see a preview of your dataset sample.
Click Validate to save your dataset.
Do the same to add the Snowflake database and table that will be used as
Destination in your pipeline. Fill in the connection properties as described in
Snowflake properties.
In this example, a Snowflake table named CAMPAIGN_FULLNAMES is
used.
Click Add
pipeline on the Pipelines page. Your new pipeline opens.
Give the pipeline a meaningful name.
Example
From Marketo to Snowflake - concatenate & insert
Click ADD SOURCE and
select your source dataset, customers on marketo in the panel that opens.
Click to add processors to the pipeline, for example a
Python processor to concatenate first names and last names
and give them a meaningful name.
Click the ADD DESTINATION item on the pipeline to open
the panel allowing to select the Snowflake table in which your output data will
be inserted.
Give a meaningful name to the Destination; load in
Snowflake for example.
In the Configuration
tab of the destination, click Main and
select INSERT in the Action list to insert the data into the table
when executing the pipeline.
Click Save to
save your configuration.
(Optional) Click the last processor to preview the processed
data.
On the top toolbar of Talend Cloud Pipeline Designer,
click the Run button to open the panel allowing you to select
your run profile.
Select your run profile in the list (for more information, see Run profiles), then click Run to
run your pipeline.
Results
Your pipeline is being executed, the customer data that was stored on Marketo has been
processed and the output flow is inserted into the Snowflake target table you have defined.
Did this page help you?
If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!
to add processors to the pipeline, for example a
Python processor to concatenate first names and last names
and give them a meaningful name.
