Which engine is used and is it healthy?
Engines used to calculate data samples
- How do I know which engine is used?In Talend Cloud Pipeline Designer, the engine used to calculate data samples is displayed on the Runs on badge in the preview panel:
The calculation of the sample is happening on the previewrunner container, and the engine that is used is the one you have selected when creating the connection of the source or destination dataset.
- How do I know if the engine is healthy?
You can check the status of the engine in Talend Management Console (or in your Docker logs if you can access them).
Engines used to display data preview
- How do I know which engine is used?In Talend Cloud Pipeline Designer, the engine used to calculate data preview is displayed on the Runs on badge in the preview panel:
The calculation of the preview is happening on the previewrunner container, and the engine that is used is the one you have selected when creating the connection of the source or destination dataset.
By default, the engine used is the one you have selected when creating the connection of the source dataset, which may be different from the one associated with the run profile. This engine is responsible for calculating the preview, displaying the list of available processors, editing their configuration, etc. If you want to change the engine used for the calculation of the preview, you have to replace the source with another dataset that uses a different engine, or to change the connection in the existing source to use another engine.Information noteNote: If you are using a Join processor in Talend Cloud Pipeline Designer and you join one source named dataset1 (from the main flow) with another source named dataset2 (by lookup, and it might use another engine), the engine that will be used to calculate the preview is the engine associated with dataset1). - How do I know if the engine is healthy?
You can check the status of the engine in Talend Management Console (or in your Docker logs if you can access them). In Talend Cloud Pipeline Designer, you can also enable or disable semantic types in the preview panel.
Engines used to execute pipelines
- How do I know which engine is used?
In Talend Cloud Pipeline Designer, the engine on which the pipeline will be executed when running the pipeline is always the engine associated with the selected run profile at run time.
If your execution fails, make sure the engine associated with the source dataset contains all the connectors and processors used in the pipeline.Information noteNote: When publishing a pipeline to Talend Management Console, the engine used is the one you have selected when creating the connection of the source dataset. - How do I know if the engine is healthy?
You can check the status of the engine as well as other information, such as the number of running and queued pipelines on the engine, in the [Run - Select a run profile] window in Talend Cloud Pipeline Designer.
Engines associated with connections and datasets
- How do I know which engine is used?
Source datasets: the engine used is the one you have selected when creating the connection of the source dataset.
Destination datasets: the engine used is the one you have selected when creating the connection of the destination dataset.
- How do I know if the engine is healthy?
You can check the status of the engine in Talend Management Console.