Skip to main content Skip to complementary content

New features

Shared features

Feature Description
Support for more components for Job lineage in Qlik Cloud Talend Studio can now generate datasets and lineage to Qlik Cloud for the tSplitRow component.
Support for new authentication modes in Google BigQuery metadata The BigQuery metadata wizard now supports additional authentication modes: Workload Identity Federation, Application Default Credentials, OAuth2 - Authorization Code grant, OAuth Access Token, and Service account.
Support for lineage local test before Qlik Cloud deployment You can now test lineage generation locally before publishing Jobs to Talend Management Console. A new Lineage Testing button in the Run view allows you to enable lineage testing for Jobs that support runtime lineage. When enabled, the system automatically sets the log level to INFO and generates lineage data in JSON format in a configured folder, allowing you to identify and resolve lineage issues before deployment to Qlik Cloud.

For more information, see Testing lineage locally.

Big Data

Feature Description
Support for Amazon Athena connectivity that allows interoperability with Open Lakehouse in Spark Batch Jobs Amazon Athena is now supported in your Spark Batch Jobs with the following components:
  • tAthenaConfiguration
  • tAthenaInput

You can connect to Athena and read data. Writing data to Athena is not available.

Support for Spark Universal 4.0.2 in Spark Batch Jobs in Local runtime mode You can now run your Spark Batch Jobs with Spark 4.0.x in Local mode. You can configure it either in the Spark Configuration view of your Spark Jobs or in the Hadoop Cluster Connection metadata wizard.
The following components are not supported with Spark 4.0.x:
  • Amazon DynamoDB
  • Amazon Redshift
  • Cassandra
  • ElasticSearch
  • Google BigQuery
  • MongoDB
  • Snowflake
Spark Universal 4.0.x in Spark Batch Job in Local runtime mode.

Data Integration

Feature Description
Support for Amazon Athena connectivity that allows interoperability with Open Lakehouse in Standard Jobs
The generic database components now officially support connecting to Amazon Athena, and the following components are added to the palette:
  • tAthenaClose
  • tAthenaCommit
  • tAthenaConnection
  • tAthenaInput
  • tAthenaOutput
  • tAthenaRollback
  • tAthenaRow
Support for S3 Express One Zone and Directory buckets for Amazon S3 components in Standard Jobs The S3 components now support Amazon S3 Express One Zone directory buckets. Directory buckets require standard AWS credentials and appropriate IAM permissions for regional endpoint operations.
New authorization method for BigQuery components to use recommended OAuth 2.0 authorization code in Standard Jobs The OAuth 2.0 (Authorization Code grant) authentication mode has been added to the BigQuery components. Authorization is completed via a one-time browser flow launched from the Run console, and the configuration is then saved so subsequent Job runs can access BigQuery without repeating the setup.
New property in tEmbeddingAI component to allow users to define the base URL for AI platforms in Standard Jobs The Base URL option has been added to the Advanced settings of the tEmbeddingAI component, allowing you to enter the base URL address of the API server you want to access. This option is available for the Ali Bailian, Cohere, Hugging Face, and Mistral AI platforms.

Data Mapper

Feature Description
Support for copying and pasting schema columns from a component to a structure You can now copy schema columns from Talend Studio components and paste them as elements in hierarchical mapper structures. The schema columns are automatically converted to structure elements with the appropriate data types. You can paste columns either as child elements or as sibling elements.

For more information, see Copying schema columns from Studio components.

Support for HTTP and HTTPS schemes in ReadURL function in the non-Eclipse runtime The ReadURL function now supports HTTP and HTTPS schemes in the non-Eclipse runtime.
Enhancement of schema column output options in tDSQL4JSON The Set output column(s) option is enhanced allowing you to select how to map your JSON transformation results. With the new Output column mode dropdown list, you can now either choose to map your JSON output to multiple schema columns or in a single column.
New Output column mode option in tDSQL4JSON component.

Data Quality

Feature Description
Support for more operators in tDQRules You can now use the following operators in the tDQRules component:
  • Matches regex / Does not match regex
  • Is one of / Is not one of
  • Is before / Is after
  • Is before or equal to / Is after or equal to
  • Is equal to / Is not equal to

The case sensitivity in the String operators is also now supported.

Displaying recent items You can now display the recent items.
Overview of the recent items

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!