What's new in R2022-11

Big Data: new features

Feature	Description	Available in
Support for Spark Universal 3.3.x in local mode	You can now run your Spark Batch and Streaming Jobs using Spark Universal with Spark 3.3.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.	All subscription-based Talend products with Big Data
Support for Cloudera CDE 1.15 on AWS and Azure with Spark Universal 3.2.x	You can now run your Spark Batch and Streaming Jobs on Cloudera Data Engineering experience, on both AWS and Azure, using Spark Universal with Spark 3.2.x. You can configure it in the Spark Configuration view of your Spark Jobs. When you select this mode, Talend Studio is compatible with CDE 1.15 version.	All subscription-based Talend products with Big Data
Enhancement of tAvroInput to support dynamic schema in Spark Batch Jobs	You can now add a dynamic column to the schema of tAvroInput in your Spark Batch Jobs. The dynamic schema functionality allows you to configure a schema in a non-static way, so you will not have to redesign your Spark Job for future schema alteration while ensuring it will work all the time.	All subscription-based Talend products with Big Data
Availability-noteBeta Support for Databricks runtime 11.x with Spark Universal 3.3.x	You can now run your Spark Batch and Streaming Jobs on job and all-purpose Databricks clusters on Google Cloud Platform (GCP), AWS, and Azure using Spark Universal with Spark 3.3.x. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard. When you select this mode, Talend Studio is compatible with Databricks 11.x version. With this feature, there are known issues related to the following components: tGSConfiguration does not work in Spark Streaming Jobs tS3Configuration does not work as a storage component for tAvroInput when using AWS tAzureFSConfiguration does not work as a storage component for tAvroInput when using Azure tFileInputDelimited, tFileInputJSON, tFileInputParquet, tFileInputPositional, tFileInputRegex, and tFileInputXML do not work with tGSConfiguration when using GCP	All subscription-based Talend products with Big Data

Data Integration: new features

Feature	Description	Available in
Improved storage method for Git objects in local repositories (Beta)	We introduce a new Git storage mode based on the standard Git storage and improve the way we store the Git objects for your repositories and projects. This helps save the disk space and allows you to use Git commands in Git tools to manage your repositories and projects. You will get a Git storage mode notification in the bottom right corner after you install the update. The standard Git storage mode is disabled by default after installing the update. You can enable it via a new Enable the standard Git storage mode option in Talend Studio Preferences dialog box or by adding a new -Dgit.mode.standard parameter in the Talend Studio .ini file. Information noteWarning: In a future release, the standard Git storage mode will be applied automatically, and the old customized Git storage mode will not be supported anymore. For more information, see Enabling the standard Git storage mode.	All subscription-based Talend products with Talend Studio
Improved project analysis report to list invalid items	The experimental project analysis tool in Talend Studio can now check if there are any invalid items in your project via a new InvalidItemsAnalysisTask task and list the invalid items in the analysis report. For more information, see Analyzing projects.	All subscription-based Talend products with Talend Studio
New option to import direct dependencies when editing libraries for a routine, a bean, a custom routine jar, or a custom bean jar	A new Add direct dependencies check box is provided in the Module dialog box when editing libraries for a global routine, a custom routine jar, a global bean, or a custom bean jar, which allows you to import direct dependencies of a library file or a POM file. For more information, see Editing user routine libraries and Editing Bean libraries.	All subscription-based Talend products with Talend Studio
New option for ELT map components to enclose table and schema names with delimited characters in the generated SQL query	A new Add quotes in table names when generating query check box is provided in the Property Settings dialog box in the ELT Map Editor of the tELTMap component, which allows you to add quotes for the table and schema names in the generated SQL query. The Delimited identifiers check box in the Property Settings dialog box in the ELT Map Editor of all ELT map components except tELTSAPMap, which allows you to add quotes for the column names in the generated SQL query, is renamed to Add quotes in columns when generating query.	All subscription-based Talend products with Talend Studio
MIMB OEM cumulative patch upgrade for Talend Metadata Bridge	The MIMB OEM cumulative patch for Talend Metadata Bridge has been upgraded from MIMB-OEM-CumulativePatch-1010-20220622-1543.zip to MIMB-OEM-CumulativePatch-1100-20220926-1631.zip.	All subscription-based Talend products with Talend Studio
New timeout option in tKafkaCreateTopic	You can now set a timeout in milliseconds in the Advanced settings view of tKafkaCreateTopic. This property is available for all Kafka versions: for Kafka 2.2.1 and backwards versions, this property allows you to set values for both ZooKeeper session and connection timeouts for Kafka 2.4.x and onwards versions, this property allows you to set the amount of time to wait for the result	All subscription-based Talend products with Big Data
New OAuth flow in Microsoft CRM components to retrieve authentication token	The tMicrosoftCrmInput component and the tMicrosoftCrmOutput component support the Resource Owner Password Credentials (ROPC) authentication flow for retrieving the authentication token when the authentication type is ON_PREMISE and CRM version is CRM 2016. To use the ROPC authentication flow, select Resource Owner Password Credentials from the Flow drop-down list, set the token endpoint in the Token endpoint field, and enter OAuth resource URL in the Resource field (optional).	All subscription-based Talend products with Talend Studio
Enhancement of tELTNetezzaOutput and tELTTeradataOutput to support merge operations	The tELTNetezzaOutput component and the tELTTeradataOutput component provide the Merge option in the Action on data drop-down list, allow you to perform merge insert, merge update, and merge delete data actions to entries in a database table.	All subscription-based Talend products with Talend Studio
New component to import data to a Neo4j 4.x database	This release provides the tNeo4jv4ImportTool component, allowing you to import data to a Neo4j 4.x database.	All subscription-based Talend products with Talend Studio
Availability-noteBeta New messaging components to establish connections to Apache ActiveMQ and IBM WebSphere systems and perform commit and rollback operations	This release provides these messaging components: tMessagingClose, tMessagingCommit, tMessagingConnection, tMessagingInput, tMessagingOutput, and tMessagingRollback.	All subscription-based Talend products with Talend Studio

Data Mapper: new features

Feature	Description	Available in
New FormatNumber function	A new function allows you to create a string from a numeric value and format it using a specific pattern.	All Talend Platform and Data Fabric products

Application Integration: new features

Feature	Description	Available in
New mediation components to facilitate schema and database operations	This release provides the following new mediation components: cSQL: Reads any database using a SQL connection and extracts fields based on a query. cSQLConnection: Opens a connection to the specified database that can then be reused in the subsequent subRoute. cJsonParser: Extracts the desired data from JSON format. cJsonWriter: Transforms the incoming data into JSON format. cXmlParser: Extracts the desired data from XML format. cXmlWriter: Transforms the incoming data into XML format. cJsonValidator: Validates the data based on the given JSON schema. cXmlValidator: Validates the data based on the given XML schema.	All subscription-based Talend products with ESB
Automatic refresh of the Cloud Artifact view when selecting a Job or Route	The Cloud Artifact view is now updated automatically when selecting a Job or Route in the repository tree view.	All subscription-based Talend products with ESB

Continuous Integration: new features

Feature	Description	Available in
Talend CI Builder upgraded to version 8.0.10	Talend CI Builder is upgraded from version 8.0.9 to version 8.0.10. Use Talend CI Builder 8.0.10 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released.	All subscription-based Talend products with Talend Studio
New parameter to discover all dependencies of filtered items	You can now use the parameter filter.include.dependencies to discover all dependencies of your project items during the POM generation step of the CI build. Only applies to the main project when the itemFilter parameter is used. For more information, read the documentation.	All subscription-based Talend products with Talend Studio

Feature

Description

Available in

Talend CI Builder upgraded to version 8.0.10

Talend CI Builder is upgraded from version 8.0.9 to version 8.0.10.

Use Talend CI Builder 8.0.10 in your CI commands or pipeline scripts from this monthly version onwards until a new version of Talend CI Builder is released.

All subscription-based Talend products with Talend Studio

New parameter to discover all dependencies of filtered items

You can now use the parameter filter.include.dependencies to discover all dependencies of your project items during the POM generation step of the CI build. Only applies to the main project when the itemFilter parameter is used.

For more information, read the documentation.

All subscription-based Talend products with Talend Studio

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here