Talend Dynamic Engine

Dynamic Engine 0.23.0 is generally available.

New features

Feature	Description
Global email notifications	You can enable global email notifications from your profile preferences when certain events occur for your Dynamic Engines and Dynamic Engine environments. Depending on your roles or permissions, you can be notified when: a Dynamic Engine environment is not ready. a Dynamic Engine has been created or deleted. a Dynamic Engine is not available. For more information, see Enabling global email notifications.
Dynamic Engine v0.23.0 and v0.23.1	Dynamic Engine v0.23.0 introduces an enhanced logging model, a streamlined update process for Data Services and Routes tasks, and security improvements: Enhanced logging model with Fluent Bit: Fluent Bit is now used to load logs of data integration Jobs in batches and forward them in a single request. This improvement replaces the Log4j HttpAppender model, reducing network traffic and improving throughput. Updates for Data Services and Routes tasks: Updating a data service Job or Route task does not require undeploying and redeploying the task anymore. Patch versions have been progressively released: Dynamic Engine v0.23.1 enhances engine stability during upgrades. For the full changelogs and included services, see Dynamic Engine v0.23.0 release Dynamic Engine v0.23.1 release

Feature

Description

Global email notifications

You can enable global email notifications from your profile preferences when certain events occur for your Dynamic Engines and Dynamic Engine environments. Depending on your roles or permissions, you can be notified when:

a Dynamic Engine environment is not ready.
a Dynamic Engine has been created or deleted.
a Dynamic Engine is not available.

For more information, see Enabling global email notifications.

Dynamic Engine v0.23.0 and v0.23.1

Dynamic Engine v0.23.0 introduces an enhanced logging model, a streamlined update process for Data Services and Routes tasks, and security improvements:

Enhanced logging model with Fluent Bit: Fluent Bit is now used to load logs of data integration Jobs in batches and forward them in a single request. This improvement replaces the Log4j HttpAppender model, reducing network traffic and improving throughput.
Updates for Data Services and Routes tasks: Updating a data service Job or Route task does not require undeploying and redeploying the task anymore.

Patch versions have been progressively released:

Dynamic Engine v0.23.1 enhances engine stability during upgrades.

For the full changelogs and included services, see

Known limitations

Azure File shares billing for logs:

When Dynamic Engine is deployed on Azure and uses Azure file shares as persistent storage, you may see increased costs on your Azure bill. Azure charges based on the number of API calls. The Dynamic Engine services generate frequent directory-listing calls for logs when interacting with the storage, which can significantly increase the number of API calls.

Impact scope	Workaround
All Dynamic Engine versions	Review your Azure storage usage and costs and deactivate the logs as explained in: Helm deployment: Deactivating logs and metrics transfer upon deployment or upgrade. Standard Kubectl deployment: Deactivating log and metrics transfers from a Dynamic Engine to Talend Management Console.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here