Monitoring capacity usage by executions with detailed consumption reports
With the Data Capacity Reporting App in Qlik Cloud, you can monitor capacity consumption by Job executions in Talend Management Console.
The feature provides insights into resource usage of your Talend Management Console accounts or tenants, measured by number of executions and duration of executions, displaying current and historical monthly capacity usage.
Prerequisites:
- Configure Qlik Cloud and Talend Management Console. See this section for instructions and the complete list of prerequisites.
- Distribute the reporting app to ensure it contains up-to-date consumption data.
The Qlik Cloud administrator distributes the Data Capacity Reporting App from the Settings page in Qlik Cloud, making it available in their personal space and sharing it with report users. To include the latest information, the administrator must regularly regenerate and share the app.
By distributing the app, the administrator generates a consumption report in their personal space.
Job executions
Job executions refer to Job task runs in Talend Management Console.
The Job Executions page presents your current month's usage of the capacity, overview of historical usage of last 12 months, and detailed usage of up to last 3 months.
Only started executions are taken into account for this measurement. Therefore, an execution that fails to deploy does not count. For the started executions, those with the Failed status (DEPLOY_FAILED and EXECUTION_FAILED in API responses) are also excluded from the measurement, thus consuming none of your capacity.
-
Usage overview:
The bar charts provide a consolidated overview of all your tenants, without the option to filter them by individual tenants.
As indicated in the legend of the charts, the dotted line represents the maximum capacity you expected to consume, and any part of the bar that exceeds this line turns red.
Detailed view:
For detailed usage, you can filter information by months, tenants, environments, workspaces, and engines.
Job duration
Job duration refers to the execution time of a Job task in Talend Management Console.
Along with Job executions, the total duration of your Job executions also serves as a value meter to measure your monthly capacity consumption.
- Only the failed punctual executions are excluded from the measurement. Streaming Jobs, including Routes, data service Jobs, and Spark streaming Jobs, are always taken into account. A failed streaming Job task is considered to be completed.
-
For streaming Jobs, the duration is measured in hours starting from the Start Execution time and accounted for in each of the months the Job has been running. The actual duration is converted to a chargeable metric using a progressive conversion scale:
- For the first 24,000 hours in a month, a 5% conversion rate is applied, resulting in 1,200 effective chargeable hours.
- For any remaining hours beyond 24,000 in a month, a 1% conversion rate is applied.
For example, a user with streaming Jobs that ran for 43,000 actual hours in a month is only be charged for 1,390 hours towards their capacity plan.Calculate chargeable hours Actual hours Conversion rate Chargeable hours Effective conversion rate 24,000 5.00% 1,200 5.00%
19,000 1.00% 190 1.00% Total: 43,000 1,390 3.23%
