Known limitations of Dynamic Engine
The Dynamic Engine solution
still has the following known limitations:
- Dynamic Engine supports only data integration and big data Job tasks. Routes and data service Jobs are not supported.
- Dynamic Engine in the Azure United States - West region (us-west) is still in Beta.
- Each Kubernetes cluster can only have one Dynamic Engine by design. A Dynamic Engine provides the core infrastructure services for task and plan executions.
- There is no mechanism to prevent deploying more than one Dynamic Engine in a Kubernetes cluster. Doing this may cause unexpected connectivity and performance issues for Talend Management Console, Dynamic Engines, and Dynamic Engine environments.
- You must use the manifest files generated by Talend Management Console to deploy Dynamic Engines and Dynamic Engine environments. Custom manifest files are not supported.
- The Kubernetes cluster in which Dynamic Engine is deployed must have access to public internet.
- The following task execution features for data integration Jobs are not supported:
- Remote debugging of a Data Integration Job on Dynamic Engines
- User impersonation
- Custom signature check
- All components using local file system to access data for processing are not supported, such as tFileInput and tFileOutput. Instead, use API services through cloud storage components such as the S3 components or the Azure components to access data.
- The tSystem components is not supported.