Specifying the number of MB used in each streaming chunk by Talend Data Mapper
Big Data Platform
Cloud API Services Platform
Cloud Big Data Platform
Cloud Data Fabric
Cloud Data Integration
Cloud Data Management Platform
Data Fabric
Data Management Platform
Data Services Platform
MDM Platform
Qlik Talend Cloud Enterprise Edition
Qlik Talend Cloud Premium Edition
Real-Time Big Data Platform
When running Jobs which contain maps created using Talend Data Mapper and
which stream data, it is possible to specify the number of MB used in each streaming chunk.
The default is 10 MB, but you can increase this amount if you have more memory to devote to
the transformation.
Procedure
In the Run view, in the Advanced
settings tab, select the Use specific JVM
arguments checkbox.
Click the New button and then, in the Set the
VM Argument dialog box that opens, enter the argument to
use.
For example, use -DTDM_STREAM_MEMORY_LIMIT=20 to stream in
chunks of 20 MB.
Click OK to add the argument.
Did this page help you?
If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!
