# Remote Engine configuration files

This document presents the Remote Engine configuration files that are most relevant to daily usage of your engine.

| Configuration files | Description |
| --- | --- |
| /etc/keystores | Remote Engine generates its own key pair (RSA/4096 bits) during the pairing<br>process. With Talend Remote Engine v2.12.5 onwards, this key pair is stored in a Java keystore in<br>etc/keystores, secured with a password defined in a<br>dedicated configuration file or as an environment variable.<br><br>If no password is defined, a random value is generated instead to ensure that<br>the private key is still stored encrypted at rest.<br><br>This pair of keys is used to protect the information transferred between<br>Talend Remote Engine and Talend Management Console. |
| /etc/org.apache.karaf.management.cfg | Activate JMX access to Remote Engine. See [Remote access with JMX](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/enabling-remote-access-using-jmx-optional). |
| /etc/org.apache.karaf.shell.cfg | Activate SSH access to Remote Engine. See [Remote access with SSH](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/enabling-remote-access-using-ssh-optional). |
| /etc/org.ops4j.pax.logging.cfg and<br>/tec/org.talend.ipaas.rt.logs.cfg | <ul> <li>Activate or deactivate log transmission from Remote Engine to <span>Talend Management Console</span>. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/stop-sending-logs-to-cloud" target="_blank">Preventing the engines from sending logs to Talend Cloud</a>.</li> <li>Send logs to a third-party system, such as a JMS appender, a Syslog appender                     or an external folder. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/custom-logging-config-in-re" target="_blank">Setting up custom logging</a>.</li> <li>Change engine log filters to include or exclude artifact execution logs.                        See <a href="https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/automatic-task-log-cleanup#activate-execution-log-duplicating" target="_blank">Restoring execution log                        duplication</a>.</li> </ul> |
| /etc/org.ops4j.pax.web.cfg | <ul> <li>Add <span>org.osgi.service.http.enabled = false</span> to prevent the                        Remote Engine from listening on port 8043 (HTTP) and use the secure Remote                        Engine port instead (9004). <p>For further information about how to access                           this port using trusted client certificate, see <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/creating-trusted-client-certificate" target="_blank">Creating trusted client                              certificate</a>.</p></li> <li>Enable remote access to Remote Engine from other machines. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/enabling-remote-access-using-http-optional" target="_blank">Remote access to Remote                        Engine</a>.</li> </ul> |
| /etc/org.talend.ipaas.rt.deployment.agent.cfg | This file stores the artifact deployment parameters.<br><br><ul> <li>The <span>local.maven.clean.interval.days</span> parameter controls                        automatic cleanup of unused artifacts in your engine. For further                        information about your Remote Engine's resilience settings, see <a href="https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/purge-artifacts-in-remote-engine" title="Enable your Remote Engine to regularly and automatically delete useless artifacts to free up storage space.">Automating artifact cleanup for better performance of your Remote Engine</a>.</li> <li>Set maximum number of parallel runs on a single engine or a engine cluster.                        For further information about parallel runs on a Remote Engine, see <a href="https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/run-tasks-in-parallel-on-remote-engine" title="A Talend Remote Engine has always been able to run different tasks in parallel. From v2.12.0 onwards, it also supports concurrent run of identical tasks.">Running tasks in parallel on Remote Engine</a>.</li> <li>Set up a regular cleanup process to automatically delete unused artifacts. See                           <a href="https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/purge-artifacts-in-remote-engine" title="Enable your Remote Engine to regularly and automatically delete useless artifacts to free up storage space.">Automating artifact cleanup for better performance of your Remote Engine</a>.</li> </ul> |
| /etc/org.talend.ipaas.engine.metrics.storage.cfg | Configure lineage history retention and cleanup on the engine. See [Configuring lineage history<br>retention](https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/configuring-lineage-history-retention). |
| /etc/org.talend.ipaas.rt.dsrunner.cfg | <ul> <li>(Linux only) Configure impersonate users to run data service or Route tasks                        and activate the <span>sudo</span> feature. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/configuring-impersonate-users-for-microservice-esb-jobs" target="_blank">Impersonate users for data service or                           Route tasks</a> and <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/starting-talend-remote-engine-sudo" target="_blank">Start Remote Engine with sudo</a>.</li> <li>Set custom bundle deployment directory for <span>Talend Runtime</span>.</li> </ul> |
| /etc/org.talend.ipaas.rt.dsrunner.talendruntime.client.cfg | Define credentials to secure the access to Talend Runtime. |
| /etc/org.talend.ipaas.rt.keypair.manager.cfg | Define your own password to replace the random one to encrypt and secure the<br>access to the keystore. This requires engine unpairing and the removal of the<br>previously generated key pairs and keystores for that pairing.<br><br>For further<br>information about how to define your own password to encrypt the keystore, see<br>[Securing keystores to access Remote<br>Engine](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-windows/securing-keystore-access-remote-engines). |
| /etc/org.talend.ipaas.rt.job.commandline.handler.cfg | Add the stdout and the stderr logs of your<br>Job executions to the Log4j logs to display the information in Talend Management Console<br><br>See [Display standard system logs in Talend Management Console](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/displaying-standard-log-in-tmc). |
| /etc/org.talend.ipaas.rt.jobserver.client.cfg | <ul> <li>Add the following parameter to mask the locked connection parameters in the                        task run logs:<pre><code><pre><code><code>job.log.msg.sensitive.hidden=true</code></code></pre></code></pre><p>For                           further information, see <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/securing-masking-hiding-encrypting-sensitive-secret-password-in-the-context-parameters-sent-by-remote-engines" target="_blank">Sensitive information in                              logs</a>.</p></li> <li>Add the following parameters to mitigate CPU and memory consumption spike:<ul> <li><span>job.log.msg.size.max</span></li> <li><span>job.log.msg.buffer.size.max</span></li> <li><span>thread.timeout</span></li> </ul><p>For further information, see the troubleshooting section in <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/securing-masking-hiding-encrypting-sensitive-secret-password-in-the-context-parameters-sent-by-remote-engines" target="_blank">Sensitive information in                        logs</a>.</p></li> <li>With Remote Engine v2.12.9 onwards, add the following parameter to encrypt                        the password type context parameters of a Job                        task:<pre><code><pre><code><code>job.ctx.params.file.sensitive.values.encrypted=true</code></code></pre></code></pre></li> <li>Change the <span>Talend Remote Engine</span> Job log level. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/changing-talend-remote-engine-job-log-level" target="_blank">Adjusting Remote Engine Job log                        levels</a>.</li> <li>Adjust the log cleanup lifecycle. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/automatic-task-log-cleanup" target="_blank">Automatic task log cleanup</a>.</li> <li>Use logging configuration from <span>Talend Studio</span>. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/enabling-custom-logging" target="_blank">Using the custom logging configuration                           that is defined in Talend Studio</a>.</li> </ul> |
| /etc/org.talend.remote.jobserver.server.cfg | This file contains the parameters for configuring the JobServer embedded in<br>the engine, which executes data integration tasks. The settings you can define or<br>update include:<br><br><ul> <li>Add the configuration to be used to create connection between <span>Talend Studio</span> and <span>Talend Remote Engine</span>.<p>For further information, see <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/configuring-connection-between-talend-studio-and-talend-remote-engine" target="_blank">Configuring connection between Talend                              Studio and Remote Engine</a>.</p></li> <li>Set up JobServer server configuration for an SSL connection between the                        JobServer server and the JobServer client inside a Remote Engine. The                        JobServer client configuration is added in                           <span>etc/system.properties</span>.<p>For further information                           about SSL connection in a Remote Engine, see <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/enabling-ssl-connection" target="_blank">Activating SSL connection</a>.                        </p></li> <li>(Linux only) Configure impersonate users to run data integration tasks and                        activate the <span>sudo</span> feature. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/configuring-impersonate-users-for-di-jobs" target="_blank">Impersonate users for data integration                           tasks</a> and <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/starting-talend-remote-engine-sudo" target="_blank">Start Remote Engine with sudo</a>.</li> <li>Make Remote Engines use your own signing key to verify artifact signatures.                        See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/verifying-artifact-signature" target="_blank">Remote Engines use a custom signing                           key</a>.</li> <li>Set harder limits for folders and file names to mitigate or prevent Denial                        of Service attacks. See <a href="https://help.qlik.com/talend/en-US/installation-guide-windows/Cloud/security-setup-for-remote-engine#remote-engine-jobserver-improving-security-malicious-archive-content" target="_blank">Improving security against malicious                           archive content</a>.</li> </ul><br><br><br>You can find an exhaustive list of the parameters and read their<br>documentation in the configuration file itself. |
| /etc/preauthorized.key.cfg | This file stores the remote engine pairing key, that is to say, the<br>pre-authorization key and the description of the engine to be paired.<br><br>For<br>further information about how to pair your engine using this file, see [Pairing Remote Engines with the configuration<br>file](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-windows/pairing-remote-engines-with-configuration-file). |
| /etc/system.properties | <ul> <li>Activate graceful reboot. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/gracefull-remote-engine-reboot-on-linux" target="_blank">Graceful reboot on Linux</a>.</li> <li>Add the client configuration and the server configuration of your JobServer                        to separate files to establish an SSL connection between the JobServer                        server and the JobServer client inside a Remote Engine. The client                        configuration should be added to this                           <span>/etc/system.properties</span> file, while the server                        configuration should be added to                           <span>/etc/org.talend.remote.jobserver.server.cfg</span>. <p>For                           further information about SSL connection in a Remote Engine, see <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/enabling-ssl-connection" target="_blank">Activating SSL                        connection</a>.</p></li> <li>Configure proxy settings for a Remote Engine. See <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/configuring-proxy-settings-for-remote-engines" target="_blank">Proxy settings for Remote Engines</a>                        and <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/configuring-remote-engine-proxy-authentication" target="_blank">Proxy authentication</a>.</li> <li>Disable the default Java version fallback when using adaptive mode by                        adding the following line:                        <pre><code><pre><code><code>reuse.self.jvm.version=false</code></code></pre></code></pre>This property prevents                        the engine startup Java version from being used as a fallback for Java                        versions not explicitly configured in adaptive mode. For more information,                        see <a href="https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/java-21-tasks-run-on-java-17-adaptive-mode-re" title="When a Talend Remote Engine with adaptive mode enabled inherits Java 17 as its startup Java version, such as from installation, upgrade, or you custom configuration, tasks built with Java 21 may be executed on Java 17 instead of Java 21, even though Java 17 may not appear in the adaptive mode configuration.">Tasks built with Java 21 run on Java 17 when adaptive mode is enabled on Talend Remote Engine</a>.</li> </ul> |
| /etc/talend-remote-engine-wrapper.conf | This configuration file serves as a wrapper, based on [the Karaf wrapper configuration file](https://karaf.apache.org/manual/latest-3.0.x/wrapper#_configuration).<br>This file enables the integration of the engine in your operating system as a<br>service. For this reason, it is available only when you have installed your Remote<br>Engine as a Windows service or a Linux service. If you have not done so and need<br>guidance on installation, see [for Windows](https://help.qlik.com/talend/r/en-US/Cloud/installation-guide-linux/installing-and-uninstalling-remote-engine-service-systemd) or [for Linux](https://help.qlik.com/talend/r/en-US/Cloud/installation-guide-linux/installing-and-uninstalling-remote-engine-service-system-v).<br><br>In this file, if necessary,<br>define the specific system environment properties to be used by the engine. For<br>example:<br><br><ul> <li>In the <span>JVM parameters</span> section of this wrapper file,                        specify the JVM settings to be used by the engine. Note that these JVM                        settings determine the resources to be allocated to the engine as a service,                        while the JVM settings defined in a Run profile in <span>Talend Management Console</span> refer to the resources allocated to that specific execution.</li> <li>If the Job to be run on a Remote Engine relies on third-party tools, such                        as an SDK, or MelissaData, specify the paths to these tools in this Remote                        Engine wrapper configuration file using the following                        format:<pre><code><pre><code><code>set.PATH=&lt;PATH_TO_SDK&gt;;%PATH%</code></code></pre></code></pre>This line                        informs the engine about the location to the third-party tool while                        retaining the existing content of the PATH environment variable. For further                        information, see <a href="https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-windows/enabling-execution-of-jobs-using-external-tools-sdk" target="_blank">Enabling the execution of Jobs using                           external tools (SDK)</a>.</li> <li>Starting from v2.14.1, on Windows, the SSL keystore password used for JobServer SSL                        communication is stored in this file using the following                        format:<pre><code><pre><code><code>set.TMC_ENGINE_JOB_SERVER_SSL_KEY_STORE_PASSWORD=&lt;password&gt;</code></code></pre></code></pre>For                        further information, see <a href="https://help.qlik.com/talend/en-US/remote-engine-user-guide-linux/Cloud/enabling-ssl-connection" title="Set up a secure connection between the JobServer server and the JobServer client within a Remote Engine.">Enabling SSL communication between your Remote Engine and                           its JobServer</a>.</li> </ul> |
| /etc/users.properties | The default security configuration uses a property file located at<br>&lt;RemoteEngineInstallationDirectory&gt;/etc/users.properties<br>to store authorized users and their passwords.<br><br>For further information, see<br>[Managing Remote Engine users and<br>passwords](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/managing-users-and-passwords). |
| /TalendJobServersFiles | A Remote Engine needs to access Job task dependencies such as the Job<br>artifacts, the logs and the working folders stored in a folder called<br>TalendJobServersFiles. When you deploy multiple engines,<br>ensure that each Remote Engine instance has its separate<br>TalendJobServersFiles folder.<br><br>For further information<br>about how to deploy multiple engines, see [Deploying multiple<br>engines](https://help.qlik.com/talend/r/en-US/Cloud/remote-engine-user-guide-linux/deploying-multiple-remote-engines). |
| /TalendJobServersFiles/jobexecutions/logs/ | Logs of the task runs are stored in this directory. |