Supported Big Data platform distribution versions for Talend Jobs
To find the compatibility between regular Hadoop distributions and Talend-supported Big Data elements, click on a Big Data related element below.
- HBase
- HCatalog
- HDFS
- Hive
- Sqoop
- Spark
- Azure Data Lake Storage Gen2
- Kafka in Spark Streaming Jobs
- Kudu in Spark Batch Jobs
- Impala
Old versions of the supported Big Data platforms are being retired by their vendors. Talend ceases to support a version once this version reaches its date of end of support set by its vendor.
Talend and its community provide you with the convenience to keep using a version its vendor ceases to support in Talend products. For this reason, this version could be still listed in the following tables and available in the products but Talend stops providing support for this version.
Talend supports the minor versions of the distribution versions listed in the following tables.
Information noteNote: With CDP dynamic distribution, Talend
supports the version up to 7.1.8; CDP 7.1.9 Private Cloud Base and 7.2 Public Cloud are
not supported. If you want to use CDP 7.1.9 Private Cloud Base, CDP 7.2 Public Cloud, or
a later version, Talend
recommends you to use the Spark Universal feature. For more information, see Spark Universal support for Hadoop distributions in Talend Studio.
Supported Hadoop distributions with HBase
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | 3.14.12-1 | Yes |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No |
| Cloudera |
|
Yes |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8)
available with dynamic distributions Information noteNote: For dynamic distributions,
Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |
Supported Hadoop distributions with HCatalog
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | 3.14.12-1 | Yes |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No |
| Cloudera | 6.1.1 | Yes |
| Cloudera | 6.x available with dynamic distributions
Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |
Supported Hadoop distributions with HDFS
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | 3.14.12-1 | Yes |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No |
| Cloudera |
|
Yes |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8)
available with dynamic distributions Information noteNote: For dynamic distributions,
Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |
Supported Hadoop distributions with Hive
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | 3.14.12-1 | Yes |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No |
| Cloudera |
|
Yes |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8)
available with dynamic distributions Information noteNote: For dynamic distributions,
Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |
Information noteRestriction: The Profiling
perspective does not support the Embedded connection mode on Hive distributions. This
mode is available mainly for test purposes done by Hadoop developers. Talend Studio may
not be able to run correctly with the embedded mode.
Supported Hadoop distributions with Sqoop
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | 3.1.4.12-1 | Yes |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No |
| Cloudera |
|
Yes |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8)
available with dynamic distributions Information noteNote: For dynamic distributions,
Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |
Supported Hadoop distributions with Spark
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab |
|---|---|---|---|---|
| HDP | 3.1.4.12-1 | No | 2.3 | Yes (YARN only) |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No | No | No |
| Cloudera |
|
2.4 | 2.4 | Yes (YARN only) |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8)
available with dynamic distributions Information noteNote: For dynamic distributions,
Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No | 2.4 (YARN cluster only) | No |
Supported Hadoop distributions with Azure Data Lake Storage Gen2 (ADLS Gen2)
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab |
|---|---|---|---|---|
| HDP | 3.1.4.12-1 | No | 2.3 | Yes (YARN only) |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No | No | No |
| Cloudera |
|
2.4 | 2.4 | Yes (YARN only) |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8) available
with dynamic distributions Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No | 2.4 (YARN cluster only) | No |
If you need information about the Big Data Cloud platforms supported by Talend with ADLS Gen2, see the following section called Supported Cloud Big Data platform distribution versions for Jobs.
Supported Hadoop distributions with Kafka in Spark Streaming Jobs
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab |
|---|---|---|---|---|
| HDP | 3.1.4.12-1 | No | 2.3 | Yes (YARN only) |
| HDP | 3.x versions available with dynamic
distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through
Dynamic Distributions.
|
No | No | No |
| Cloudera |
|
2.4 | 2.4 | Yes (YARN only) |
| Cloudera | 6.x and 7.1.x versions (up to 7.1.8) available
with dynamic distributions Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No | 2.4 (YARN cluster only) | No |
Supported Hadoop distributions with Kudu in Spark Batch Jobs
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| Cloudera | 7.1.1 | No |
| Cloudera | 7.1.x versions (up to 7.1.8) available with
dynamic distributions Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |
Supported Hadoop distributions with Impala
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| Cloudera | 7.1.1 | No |
| Cloudera | 7.1.x versions (up to 7.1.8) available with
dynamic distributions Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This may
result in not supporting all the distribution versions available on
provider side.
|
No |