Talend Snowflake Components

tSnowflakeConnection and tJDBCConnection

Take a closer look at how Snowflake works within Talend Jobs.

In this first example, the tSnowflakeConnection component establishes the connection. Use it either by specifying the connection definition and all the required parameters (refer to the details described under Snowflake Connectivity), or preferably, change the Property Type connection setting from Built-In to Repository and select one of the defined connections you previously created.

Alternatively, the second example shows use of the tJDBCConnection component. Fill in the required fields, or change from the Built-In to the Repository Property Type and select one of the defined connections you previously created.

In either case, use the suggested best practice to check for a valid connection in the Job design, and exit if a connection cannot be made at runtime.

tWarn and tDie

A best practice is to incorporate the tWarn and tDie components. Additionally, once a Job design incorporates a Snowflake connection, it can be used by the other components needed for data manipulation.

tSnowflakeClose and tJDBCClose

A best practice when using Snowflake connections is to ensure that you close the connection before exiting the Talend Job. Use the tSnowflakeClose component or the tJDBCClose component to accomplish this.

They are typically triggered by the tPostJob component.

tSnowflakeInput and tSnowflakeOutput

The final steps involve using the tSnowflakeInput and tSnowflakeOutput components to manipulate data on a Snowflake connection. Both of these components allow the selection of the Property Type connection setting for Built-In or Repository. Alternatively, you may choose from a connection object created in the Talend Job, as shown previously. These two components work very much like many of the other database components found on the Studio Palette supporting Oracle, MS SQL Server, MySQL, and others. If you are familiar with using those, these new Snowflake components behave in a very similar manner.

This example shows the tSnowflakeInput component using a connection declared within the Job. The Schema selected determines the table name, and the Condition allows a filter (similar to a WHERE clause) to be added to the retreival of data. The tSnowflakeInput component is also shown being used for a lookup into a tMap component, which will make the appropriate SQL join based upon its design.

The next example shows the tSnowflakeOutput component where the connection is selected from the Project Repository, essentially making the actual connection for the specific component at runtime. Once the operation of the component is complete (the dataset being passed in has finished being inserted) the connection will close. This technique provides the Job designer a choice for connection management.

As you likely imagined, the corresponding JDBC tJDBCInput and tJDBCOutput components can be used instead, though these operations will process through the JDBC driver and bypass the native connectivity provided by the Snowflake components.

tJDBCRow

The last, tJDBCRow component can be used to process specific SQL statements against a JDBC Snowflake connection. A corresponding native tSnowflakeRow component is not available in this release; it may appear in a future release of Talend Studio.