Talend Management Console account limits
In this article, find the list of limits applying to your account as general terms of usage of Talend Management Console (TMC).
This will help you validate your usage of Talend Management Console over time, in particular, your designs to integrate your systems with Talend API, for whatever purposes, such as, external scheduling, monitoring, debugging, analytics boards, etc.
These limits are intended to evolve. Keep an eye on any release announcement for updates.
| Capacity Limit | Description | Value |
|---|---|---|
| Component metrics threshold | Maximum timeframe in which task execution data is collected for component metrics analysis. Therefore, component metrics are not fully available for executions lasting more than this timeframe. | 24 days |
| Concurrent executions on same Remote Engine |
Default value set for the maximum concurrent executions assigned to a
single Remote Engine. This value is configurable on the Remote Engine
side.
This parameter allows you to tune maximum workload assigned to your Remote Engine: bear in mind that it should be set according to the resources available on your Remote Engine and also taking into account the average or maximum artifact size, execution durations, and disk and memory allocations you inspect the Jobs you assign to it. Clean-up configuration can also be tuned accordingly. |
3 |
| Concurrent executions workload |
Maximum number of concurrent task and plan executions
Excessive executions are skipped and aborted event activities are logged. |
200 |
| Drift delay |
Maximum drift delay in nominal case(**) between a scheduled
time and the actual execution start time of a task or a plan
Retry attempts of a task or a plan are rescheduled using the exponential backoff technique, that is to say, 1 minute after the first attempt, 2 minutes after the second attempt, then 4 minutes and finally 8 minutes. This way, the maximum drift for executions is clearly defined as the sum of the delays of those retry attempts. (**) Extra network delays on your side are not taken into account. |
15 minutes |
| Maximum orphan schedules | Maximum number of schedules not associated with any tasks or plans allowed per environment | 200 |
| Maximum tasks and plans | Maximum number of tasks and plans | 30000 |
| Maximum triggers |
Maximum number of triggers for your tasks and plans on a specific tenant
Note that you can have several triggers on a same task or plan. All elementary triggers (CRON, Daily, Monthly, Webhook, etc.) are counted. |
5000 |
| Number of retry |
Maximum number of retries when a task or a plan fails to be deployed and
executed on an engine, for any reason
When a task or a plan cannot be deployed and executed on an engine, some retry attempts are automatically scheduled. |
4 |
| Retention period of task run history | Maximum retention time for your task run history. Run history older than
this retention timeframe is automatically deleted. If you need to keep the older history, following this procedure to export the logs regularly to store them in a third party system of your choice. |
Information noteTip: The retention timeframe is only about the run history, in
other words, the execution logs. Tasks triggered prior to this timeframe
remain unaffected and are not subject to deletion.
|
| Same task executions threshold | Maximum number of executions of the same task in the running state during the last hour | 50 |
| Scheduling threshold |
Maximum concurrent scheduled executions per minute Note that Webhook triggers, manual executions and API executions are not scheduled executions; thus they do not apply here. |
200 |
| Scheduling frequency | Minimal interval between two scheduled executions of the same task | 5 minutes |
| Task artifact size | Maximum size of an artifact | 400 MB |
| TMC API workload threshold | Maximum Transaction Per Minute (TPM) of API calls from a single IP address |
|