New features
Application integration
Feature | Description |
---|---|
Transaction support for cSQL component | You can now enable transaction for SQL connections in the cSQLConnection
component by selecting the Use Transaction check box in the
Basic settings view.![]() Two new components, cTransaction and cRollback, are added to control the transaction behavior. |
Big Data
Feature | Description |
---|---|
Support for OAuth 2.0 authentication with Databricks | Talend Studio
now supports the OAuth 2.0 authentication in Spark Batch and Spark Streaming Jobs
using Databricks. This authentication is available with AWS, Azure, and GCP on
Spark Universal 3.1.x to 3.4.x versions. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard. ![]() |
Support for partition evolution in tIcebergTable in Spark Batch Jobs | The tIcebergTable component now supports partition evolution in Spark Batch
Jobs. The new Add partitions, Drop
partitions, and Replace partitions
parameters are available when you select Alter from the
Action on table drop-down list, and allow you to perform
several actions on the table partitions.![]() |
Data Mapper
Feature | Description |
---|---|
Improvement of the Flattening Map creation wizard | When you create a new flattening map and choose the parameters of the
flattening process, the selection of pivots is improved. If the structure
contains several possible pivots, you now need to select the pivot by
right-clicking the relevant node and clicking Set Pivot.
You can also click the If the structure contains only one possible pivot, it is selected by default. ![]() |
Data Quality
Feature | Description |
---|---|
Support for Hive 3 |
You can now use Hive 3 to profile your data. ![]() |