Skip to main content

Big Data

Feature Description Available in
Support for new Iceberg components in Spark Batch Jobs Iceberg components are now available in Spark Batch Jobs in Talend Studio. The following components are available from the Databases family in the Palette:
  • tIcebergCatalog, which allows you to configure catalogs.
  • tIcebergInput, which allows you to read data from an Iceberg table by performing a SELECT * SQL operation.
  • tIcebergOutput, which allows you to write to tables using data frames.

All subscription-based Talend products with Big Data
Availability-noteBeta
Support for CDP Public Cloud Data Hub 7.2.17 with Spark Universal 3.3.x		 You can now run your Spark Batch Jobs on CDP Public Cloud Data Hub using Spark Universal with Spark 3.3.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.

When you select this mode, Talend Studio is compatible with CDP Public Cloud Data Hub 7.2.17 version.

With the beta version of this feature, the Check Services option is not available in the Hadoop Cluster Connection metadata wizard.

All subscription-based Talend products with Big Data
Support for Kafka with Spark Universal in Spark Streaming Jobs Talend Studio now supports the following Kafka versions in Spark Streaming Jobs:
  • Kafka 3.3.1 with Spark Universal 3.3x
  • Kafka 3.4.0 with Spark Universal 3.4.x

All subscription-based Talend products with Big Data

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here