Big Data
Feature | Description | Available in |
---|---|---|
Support for Local mode with Spark Universal 3.5.x | You can now run your Spark Batch and Streaming Jobs using Spark Universal with Spark 3.5.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard. |
All subscription-based Talend products with Big Data |
Support for CDP Public Cloud Data Hub 7.2.17 with Spark Universal 3.3.x | You can now run your Spark Batch and Spark Streaming Jobs on CDP Public
Cloud Data Hub with AWS using Spark Universal with Spark 3.3.x. You can
configure it either in the Spark Configuration view of
your Spark Jobs or in the Hadoop Cluster Connection
metadata wizard. When you select this mode, Talend Studio is compatible with CDP Public Cloud Data Hub 7.2.17 version. With this feature, HBase and Knox authentication are not supported. |
All subscription-based Talend products with Big Data |
Support for HDInsight 5.0 with Spark Universal 3.1.x | You can now run your Spark Batch and Spark Streaming Jobs on HDInsight with
Spark Universal 3.1.x. You can configure it either in the Spark
Configuration view of your Spark Jobs or in the
Hadoop Cluster Connection metadata wizard, with
either ADLS Gen2 storage or Azure storage. When you select this mode, Talend Studio is compatible with HDInsight 5.0 version. |
All subscription-based Talend products with Big Data |