Supported Big Data platform distribution versions for Talend Jobs

Regular Hadoop distributions and dynamic support for Hadoop distributions

To find the compatibility between regular Hadoop distributions and Talend-supported Big Data elements, click on a Big Data related element below.

Old versions of the supported Big Data platforms are being retired by their vendors. Talend ceases to support a version once this version reaches its date of end of support set by its vendor.

Talend and its community provide you with the convenience to keep using a version its vendor ceases to support in Talend products. For this reason, this version could be still listed in the following tables and available in the products but Talend stops providing support for this version.

Talend supports the minor versions of the distribution versions listed in the following tables.

Note: For Cloudera distribution, Talend recommends you to use CDP 7.x built-in distributions rather than CDP dynamic distribution. With CDP dynamic distribution, Talend supports the version up to 7.1.8; CDP 7.1.9 Private Cloud Base and 7.2 Public Cloud are not supported. If you want to use CDP 7.1.9 Private Cloud Base, CDP 7.2 Public Cloud, or a later version, Talend recommends you to use the Spark Universal feature. For more information, see Running a Job with Spark Universal.

Supported Hadoop distributions with HBase
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	Availability-noteDeprecated 6.1.1	Yes
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No

Supported Hadoop distributions with HCatalog
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	Availability-noteDeprecated 6.1.1	Yes
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No

Supported Hadoop distributions with HDFS
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	Availability-noteDeprecated 6.1.1	Yes
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No

Supported Hadoop distributions with Hive
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.14.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	Availability-noteDeprecated 6.1.1	Yes
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No

Restriction: The Profiling perspective does not support the Embedded connection mode on Hive distributions. This mode is available mainly for test purposes done by Hadoop developers. Talend Studio may not be able to run correctly with the embedded mode.

Supported Hadoop distributions with Sqoop
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.1.4.12-1	Yes
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No
Cloudera	Availability-noteDeprecated 6.1.1	Yes
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No
Cloudera	7.1.1	Yes
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No

Supported Hadoop distributions with Spark
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.1.4.12-1	No	Availability-noteDeprecated v2.3	Yes (YARN only)
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No	No	No
Cloudera	Availability-noteDeprecated 6.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No	No	No
Cloudera	7.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No	v2.4 (YARN cluster only)	No

Supported Hadoop distributions with Azure Data Lake Storage Gen2 (ADLS Gen2)
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab
HDP	Availability-noteDeprecated v3.1.4.12-1	No	Availability-noteDeprecated v2.3	Yes (YARN only)
HDP	The other 3.x versions - compatible through Dynamic Distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic Distributions.	No	No	No
Cloudera	Availability-noteDeprecated 6.1.1	v2.4	v2.4	Yes (YARN only)
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No	No	No

If you need information about the Big Data Cloud platforms supported by Talend with ADLS Gen2, see the following section called Supported Cloud Big Data platform distribution versions for Jobs.

Supported Hadoop distributions with Kafka in Spark Streaming Jobs
Hadoop distribution	Version	Works with Spark Stand-alone	Works with Spark YARN	Supports Kerberos Kinit and Keytab	Kafka versions
HDP	Availability-noteDeprecated v3.1.4.12-1	No	Availability-noteDeprecated v2.3	Yes (YARN only)	v2.x
HDP	Availability-noteDeprecated The other 3.x versions - compatible through Dynamic Distributions	No	No	No	No
Cloudera	Availability-noteDeprecated 6.1.1	v2.4	v2.4	Yes (YARN only)	v2.x
Cloudera	Availability-noteDeprecated The other 6.x versions - compatible through Dynamic Distributions	No	No	No	No
Cloudera	7.1.1	v2.4	v2.4	Yes (YARN only)	v2.x
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No	No	No	No

Supported Hadoop distributions with Kudu in Spark Batch Jobs
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
Cloudera	7.1.1	No
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No

Supported Hadoop distributions with Impala
Hadoop distribution	Version	Supports Kerberos Kinit and Keytab
Cloudera	7.1.1	No
Cloudera	The other 7.1.x versions - Adding the latest Big Data Platform dynamically (Dynamic Distributions)	No

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here