Monitoring Data Lake tasks

You can view general information on the progress of Compose Full Load or Change Processing operations in the Task Dashboard, located to the right of the task list.

The top of the dashboard provides buttons for stopping and starting task(s), and viewing task log files. The following information about the task is also provided:

• The task name and state
• A link to the Compose project
• Source: The Landing Zone name and type in a Data Storage task or the project name and Landing Zone type in a Provisioning task.
• Target: The task name and target type in a Provisioning task or the project name and Landing Zone type in a Data Storage task.

The Loading tab in the right pane shows the following general progress information:

• Load Duration: The duration of the loading operation.
• Ended: When the loading operation completed.
• Overall Progress bar: The overall progress of the loading operation.

• Table bars: The status of the tables being loaded, which can be:

  • Completed - The number of tables that have been loaded into the target.
  • Loading - The number of tables that are currently being loaded into the target.
  • Queued - The number of tables that are waiting to be loaded into the target.

  • Error - The number of tables that could not be loaded due to an error

    See Messages and notifications and Data error handling for more information about error messages.

  Information note

  With Compose tasks, canceled tables are reflected in the Total Tables counter but not in the Completed/Loading/Queued/Error counters. Therefore, when one or more tables is canceled in a task, the sum of these counters will be less than the Total Tables.

• The number of Commands Completed out of the Total Commands.