Skip to main content

Big Data

Feature Description
New tIcebergTable component in Spark Batch Jobs The tIcebergTable component is now available for your Spark Batch Jobs in Talend Studio.
tIcebergTable allows you to perform different actions such as:
  • creation of Iceberg tables, tags, and branches
  • deletion of Iceberg tables, tags, and branches
  • replacement of Iceberg tables, tags and branches
Information noteNote: Branching and tagging is only supported with Iceberg 1.3.0 in Spark frameworks, and is not supported with Spark Universal 3.0 in Local mode. For more information on Iceberg versions, check on vendor side.
tIcebergTable Basics settings view in a Spark Batch Job.
Support for HDInsight 5.1 with Spark Universal 3.3.x You can now run your Spark Batch and Spark Streaming Jobs on HDInsight with Spark Universal 3.3.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard, with either ADLS Gen2 storage or Azure storage.

When you select this mode, Talend Studio is compatible with HDInsight 5.1 version.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here