Supported Big Data platform distribution versions for Talend Jobs
Regular Hadoop distributions and dynamic support for Hadoop distributions
To find the compatibility between regular Hadoop distributions and Talend-supported Big Data elements, click on a Big Data related element below.
- HBase
- HCatalog
- HDFS
- Hive
- Sqoop
- Spark
- Azure Data Lake Storage Gen2
- Kafka in Spark Streaming Jobs
- Kudu in Spark Batch Jobs
- Impala
Old versions of the supported Big Data platforms are being retired by their vendors. Talend ceases to support a version once this version reaches its date of end of support set by its vendor.
Talend and its community provide you with the convenience to keep using a version its vendor ceases to support in Talend products. For this reason, this version can be still listed in the following tables and available in the products but Talend stops providing support for this version.
Talend supports the minor versions of the distribution versions listed in the following tables.
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | v2.5.0 (deprecated) | Yes |
| v2.6.0 (deprecated) | Yes | |
| v2.6.0.3-8 (deprecated) | Yes | |
| v3.14.12-1 | Yes | |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | |
| Cloudera | 5.5 (YARN mode) (deprecated) | Yes |
| 5.6 (YARN mode) (deprecated) | Yes | |
| 5.7 (YARN mode) (deprecated) | Yes | |
| 5.8 (YARN mode) (deprecated) | Yes | |
| 5.10 (YARN mode) (deprecated) | Yes | |
| 5.12.1 (YARN mode) (deprecated) | Yes | |
| 5.13.0 (deprecated) | Yes | |
|
The other 5.x versions - Dynamic distributions |
- | |
|
6.1.1 |
Yes | |
|
The other 6.x versions - Dynamic distributions |
- | |
| 7.1.1 | Yes | |
| The other 7.1.x versions (up to 7.1.8) - Dynamic distributions
Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This
may result in not supporting all the distribution versions available
on provider side.
|
- | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | Yes |
| 5.1.0 (YARN mode) (deprecated) | Yes | |
| 5.2.0 (YARN mode) (deprecated) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | v2.5.0 (deprecated) | Yes |
| v2.6.0 (deprecated) | Yes | |
| v2.6.0.3-8 (deprecated) | Yes | |
| v3.14.12-1 | Yes | |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | |
| Cloudera | 5.5 (YARN mode) (deprecated) | Yes |
| 5.6 (YARN mode) (deprecated) | Yes | |
| 5.7 (YARN mode) (deprecated) | Yes | |
| 5.8 (YARN mode) (deprecated) | Yes | |
| 5.10 (YARN mode) (deprecated) | Yes | |
| 5.12.1 (YARN mode) (deprecated) | Yes | |
| 5.13.0 (deprecated) | Yes | |
|
The other 5.x versions - Dynamic distributions |
- | |
|
6.1.1 |
Yes | |
|
The other 6.x versions - Dynamic distributions |
- | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | Yes |
| 5.1.0 (YARN mode) (deprecated) | Yes | |
| 5.2.0 (YARN mode) (deprecated) | Yes | |
| 6.0.0 (YARN mode) (deprecated) | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) (deprecated) | Yes | |
| 6.1 / MEP 6.1 (deprecated) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | v2.5.0 (deprecated) | Yes |
| v2.6.0 (deprecated) | Yes | |
| v2.6.0.3-8 (deprecated) | Yes | |
| v3.14.12-1 | Yes | |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | |
| Cloudera | 5.5 (YARN mode) (deprecated) | Yes |
| 5.6 (YARN mode) (deprecated) | Yes | |
| 5.7 (YARN mode) (deprecated) | Yes | |
| 5.8 (YARN mode) (deprecated) | Yes | |
| 5.10 (YARN mode) (deprecated) | Yes | |
| 5.12.1 (YARN mode) (deprecated) | Yes | |
| 5.13.0 (deprecated) | Yes | |
|
The other 5.x versions - Dynamic distributions |
- | |
|
6.1.1 |
Yes | |
|
The other 6.x versions - Dynamic distributions |
- | |
| 7.1.1 | Yes | |
| The other 7.1.x versions (up to 7.1.8) - Dynamic distributions
Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This
may result in not supporting all the distribution versions available
on provider side.
|
- | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | Yes |
| 5.1.0 (YARN mode) (deprecated) | Yes | |
| 5.2.0 (YARN mode) (deprecated) | Yes | |
| 6.0.0 (YARN mode) (deprecated) | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) (deprecated) | Yes | |
| 6.1 / MEP 6.1 (deprecated) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | v2.5.0 (deprecated) | Yes |
| v2.6.0 (deprecated) | Yes | |
| v2.6.0.3-8 (deprecated) | Yes | |
| v3.14.12-1 | Yes | |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | |
| Cloudera | 5.5 (YARN mode) (deprecated) | Yes |
| 5.6 (YARN mode) (deprecated) | Yes | |
| 5.7 (YARN mode) (deprecated) | Yes | |
| 5.8 (YARN mode) (deprecated) | Yes | |
| 5.10 (YARN mode) (deprecated) | Yes | |
| 5.12.1 (YARN mode) (deprecated) | Yes | |
| 5.13.0 (deprecated) | Yes | |
|
The other 5.x versions - Dynamic distributions |
- | |
|
6.1.1 |
Yes | |
|
The other 6.x versions - Dynamic distributions |
- | |
| 7.1.1 | Yes | |
| The other 7.1.x versions (up to 7.1.8) - Dynamic distributions
Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This
may result in not supporting all the distribution versions available
on provider side.
|
- | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | Yes |
| 5.1.0 (YARN mode) (deprecated) | Yes | |
| 5.2.0 (YARN mode) (deprecated) | Yes | |
| 6.0.0 (YARN mode) (deprecated) | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) (deprecated) | Yes | |
| 6.1 / MEP 6.1 (deprecated) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| HDP | v2.5.0 (deprecated) | Yes |
| v2.6.0 (deprecated) | Yes | |
| v2.6.0.3-8 (deprecated) | Yes | |
| v3.1.4.12-1 | Yes | |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | |
| Cloudera | 5.5 (YARN mode) (deprecated) | Yes |
| 5.6 (YARN mode) (deprecated) | Yes | |
| 5.7 (YARN mode) (deprecated) | Yes | |
| 5.8 (YARN mode) (deprecated) | Yes | |
| 5.10 (YARN mode) (deprecated) | Yes | |
| 5.12.1 (YARN mode) (deprecated) | Yes | |
| 5.13.0 (deprecated) | Yes | |
|
The other 5.x versions - Dynamic distributions |
- | |
|
6.1.1 |
Yes | |
|
The other 6.x versions - Dynamic distributions |
- | |
| 7.1.1 | Yes | |
| The other 7.1.x versions (up to 7.1.8) - Dynamic distributions
Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This
may result in not supporting all the distribution versions available
on provider side.
|
- | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | Yes |
| 5.1.0 (YARN mode) (deprecated) | Yes | |
| 5.2.0 (YARN mode) (deprecated) | Yes | |
| 6.0.0 (YARN mode) (deprecated) | Yes | |
| 6.0.1 MEP 5.0 (YARN mode) (deprecated) | Yes | |
| 6.1 / MEP 6.1 (deprecated) | Yes |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab |
|---|---|---|---|---|
| HDP | v2.5.0 (deprecated) | - | v1.6 (Deprecated) | Yes (YARN only) |
| v2.6.0 (deprecated) | - | v1.6 (Deprecated) / v2.1 (deprecated) | Yes (YARN only) | |
| v2.6.0.3-8 (deprecated) | - | v1.6 (Deprecated) / v2.1 (deprecated) | Yes (YARN only) | |
| v3.1.4.12-1 | - | v2.3 (deprecated) | Yes (YARN only) | |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | - | - | |
| Cloudera | 5.5 (YARN mode) (deprecated) | v1.5 (Deprecated) | v1.5 (Deprecated) | Yes (YARN only) |
| 5.6 (YARN mode) (deprecated) | v1.5 (Deprecated) | v1.5 (Deprecated) | Yes (YARN only) | |
| 5.7 (YARN mode) (deprecated) | v1.6 (Deprecated) | v1.6 (Deprecated) | Yes (YARN only) | |
| 5.8 (YARN mode) (deprecated) | v1.6 (Deprecated) | v1.6 (Deprecated) / v2.1 (deprecated) | Yes (YARN only) | |
| 5.10 (YARN mode) (deprecated) | v1.6 (Deprecated) / 2.1 (deprecated) | v1.6 (Deprecated) / v2.1 (deprecated) | Yes (YARN only) | |
| 5.12.1 (YARN mode) (deprecated) | v2.2 (deprecated) | v2.2 (deprecated) | Yes (YARN only) | |
| 5.13.0 (deprecated) | v2.2 (deprecated) | v2.2 (deprecated) | Yes (YARN only) | |
|
The other 5.x versions - Dynamic distributions |
- | - | - | |
| 6.1.1 | v2.4 | v2.4 | Yes (YARN only) | |
|
The other 6.x versions - Dynamic distributions |
- | - | - | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | v1.3 (Deprecated) | v1.3 (Deprecated) | Yes (YARN only) |
| 5.1.0 (YARN mode) (deprecated) | v1.5 (Deprecated) | v1.5 (Deprecated) | Yes (YARN only) | |
| 5.2.0 (YARN mode) (deprecated) | v1.6 (Deprecated) | v1.6 (Deprecated) | Yes (YARN only) | |
| 6.0.0 (YARN mode) (deprecated) | v2.1 (deprecated) | v2.1 (deprecated) | Yes (YARN only) | |
| 6.0.1 MEP 5.0 (YARN mode) (deprecated) | v2.2 (deprecated) | v2.2 (deprecated) | Yes (YARN only) | |
| 6.1 / MEP 6.1 (deprecated) | v2.3 (deprecated) | v2.3 (deprecated) | Yes (YARN only) | |
| 6.1 / MEP 6.1.1 (deprecated) | v2.3 (deprecated) | v2.3 (deprecated) | Yes (YARN only) |
1. For all MapR versions prior to v6.0, the MapR security ticket mechanism is supported by the Studio.
2. In MapR v6.0, HBase support has been removed in favor of MapR-DB. For more information, see https://maprdocs.mapr.com/home/ReleaseNotes/install_upgrade_notes.html.
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab |
|---|---|---|---|---|
| HDP | v3.1.4.12-1 | - | v2.3 (deprecated) | Yes (YARN only) |
|
The other 3.x versions - Dynamic distributions Information noteNote: HDP 3.0 and lower distributions are deprecated through Dynamic
Distributions.
|
- | - | - | |
| Cloudera |
6.1.1 |
v2.4 | v2.4 | Yes (YARN only) |
|
The other 6.x versions - Dynamic distributions |
- | - | - |
If you need information about the Big Data Cloud platforms supported by Talend with ADLS Gen2, see the following section called Supported Cloud Big Data platform distribution versions for Talend Jobs of your installation guide.
| Hadoop distribution | Version | Works with Spark Stand-alone | Works with Spark YARN | Supports Kerberos Kinit and Keytab | Kafka versions |
|---|---|---|---|---|---|
| HDP | v2.5.0 (deprecated) | - | v1.6 (Deprecated) | Yes (YARN only) | v0.10 |
| v2.6.0 (deprecated) | - | v1.6 (Deprecated) / v2.1 | Yes (YARN only) | v0.10 | |
| v2.6.0.3-8 (deprecated) | - | v1.6 (Deprecated) / v2.1 | Yes (YARN only) |
v1.x |
|
| v3.1.4.12-1 | - | v2.3 (deprecated) | Yes (YARN only) |
v2.x |
|
|
The other 3.x versions - Dynamic distributions |
- | - | - | - | |
| Cloudera | 5.5 (YARN mode) (deprecated) | v1.5 (Deprecated) | v1.5 (Deprecated) | Yes (YARN only) | v0.10 |
| 5.6 (YARN mode) (deprecated) | v1.5 (Deprecated) | v1.5 (Deprecated) | Yes (YARN only) | v0.10 | |
| 5.7 (YARN mode) (deprecated) | v1.6 (Deprecated) | v1.6 (Deprecated) | Yes (YARN only) | v0.10 | |
| 5.8 (YARN mode) (deprecated) | v1.6 (Deprecated) | v1.6 (Deprecated) / v2.1 | Yes (YARN only) | v0.10 | |
| 5.10 (YARN mode) (deprecated) | v1.6 (Deprecated) / 2.1 | v1.6 (Deprecated) / v2.1 | Yes (YARN only) | v0.10 | |
| 5.12.1 (YARN mode) (deprecated) | v2.2 | v2.2 (deprecated) | Yes (YARN only) | v0.10 | |
| 5.13.0 (deprecated) | v2.2 | v2.2 (deprecated) | Yes (YARN only) | v0.10 | |
|
The other 5.x versions - Dynamic distributions |
- | - | - | - | |
|
6.1.1 |
v2.4 | v2.4 | Yes (YARN only) |
v2.x |
|
|
The other 6.x versions - Dynamic distributions |
- | - | - | - | |
| 7.1.1 | v2.4 | v2.4 | Yes (YARN only) |
v2.x |
|
| The other 7.1.x versions (up to 7.1.8) - Dynamic distributions
Information noteNote: For dynamic distributions, Talend Studio depends on the provider repository to fetch the dependencies. This
may result in not supporting all the distribution versions available
on provider side.
|
- | - | - | - | |
| MapR 1, 2 | 5.0.0 (YARN mode) (deprecated) | v1.3 (Deprecated) | v1.3 (Deprecated) | Yes (YARN only) | v0.10 |
| 5.1.0 (YARN mode) (deprecated) | v1.5 (Deprecated) | v1.5 (Deprecated) | Yes (YARN only) | v0.10 | |
| 5.2.0 (YARN mode) (deprecated) | v1.6 (Deprecated) | v1.6 (Deprecated) | Yes (YARN only) | v0.10 | |
| 6.0.0 (YARN mode) (deprecated) | v2.1 | v2.1 (deprecated) | Yes (YARN only) | v0.10 | |
| 6.0.1 MEP 5.0 (YARN mode) (deprecated) | v2.2 | v2.2 (deprecated) | Yes (YARN only) | v0.10 | |
| 6.1 / MEP 6.1 (deprecated) | v2.3 | v2.3 (deprecated) | Yes (YARN only) |
v1.x |
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| Cloudera |
7.1.1 |
- |
| The other 7.1.x versions - Dynamic distributions | - |
| Hadoop distribution | Version | Supports Kerberos Kinit and Keytab |
|---|---|---|
| Cloudera |
7.1.1 |
- |
| The other 7.1.x versions - Dynamic distributions | - |