Big Data
|
Feature |
Description |
Available in |
|---|---|---|
| Support for Databricks runtime 13.x with Spark Universal 3.4.x | You can now run your Spark Batch and Streaming Jobs on job and all-purpose
Databricks clusters on Google Cloud Platform (GCP), AWS, and Azure using Spark
Universal with Spark 3.4.x. You can configure it either in the Spark
Configuration view of your Spark Jobs or in the
Hadoop Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Databricks 13.x version. 
|
All subscription-based Talend products with Big Data |
| Support for CDP Private Cloud Base 7.1.9 | Talend Studio now supports CDP Private Cloud Base 7.1.9 with Spark Universal 3.3.x in Spark Batch and Spark Streaming Jobs. |
All subscription-based Talend products with Big Data |
| New tIcebergCatalog component in Standard Jobs | The tIcebergCatalog component is now available for your Standard Jobs,
allowing you to configure a custom catalog with Hive or Hadoop. A new check box is also available in tIcebergTable Basic settings view, Set catalog, allowing you to specify a catalog to be used to create the table into. 
|
All subscription-based Talend products with Big Data |
| Support for INSERT OVERWRITE in tIcebergOutput in Standard Jobs | The tIcebergOutput now supports the INSERT OVERWRITE
feature in Standard Jobs. The new Use insert overwrite
check box allows you either to replace all data from an Iceberg table with the
All rows from source table option, or to replace data
in an Iceberg table with the result of a custom query with the Use a
custom query option.
|
All subscription-based Talend products with Big Data |
| Support for Azure Active Directory authentication for HDInsight | Talend Studio now supports the Azure Active Directory authentication in your Spark Batch
and Spark Streaming Jobs with both ADLS Gen2 and Azure storage. You can
configure it either in the Spark Configuration view of
your Spark Jobs or in the Hadoop Cluster Connection
metadata wizard. Talend Studio is compatible with:
|
All subscription-based Talend products with Big Data |