Skip to main content Skip to complementary content

Defining the maximum memory size threshold

From Talend Studio, you can control memory usage when using the Java engine to run two types of analyses: column analysis and the analysis of a set of columns.

If you use column analysis or column set analysis to profile very big sets of data or data with many problems, you may run out of memory and end up with a Java heap error. By defining the maximum memory size threshold for these analyses, Talend Studio will stop the analysis execution when the memory limit size is reached and provide you with the analysis results that were measured on the data before the analysis execution was terminated by the memory limit size.

Procedure

  1. From the Profiling perspective, on the menu bar, select Window > Preferences to display the Preferences window.
  2. Perform one of the following steps:
    • Expand Talend > Profiling and select Analysis tuning, or,
    • Start typing analysis tuning in the dynamic filter field.
    The Analysis tuning view is displayed.
  3. In the Memory area, select the Enable analysis thread memory control check box.
  4. Move the slider to the right to define the memory limit at which the analysis execution will be stopped.

Results

The execution of any column analysis or column set analysis will be stopped if it exceeds the allocated memory size. The analysis results given in Talend Studio will cover the data analyzed before the interruption of the analysis execution.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here