Skip to main content Skip to complementary content

Adding a remote harvesting server connected to a cloud-based Talend Data Catalog server

Perform the following procedure each time you have installed a new remote harvesting server connected to a cloud-based Talend Data Catalog server.

Both the cloud-based application server and the remote harvesting server installed on premises use a shared secret.

In the Over the Web (Cloud) mode, the harvesting is invoked according to a schedule on the remote harvesting server and the result is pushed up to the cloud.

Before you begin

  • You have been assigned a global role with the Application Administration capability.
  • You have installed a remote harvesting server following one of the previous deployment procedures.
  • You have installed and configured a remote harvesting server with the same version as the Talend Data Catalog application server.
  • You have applied the same patches on the Talend Data Catalog application server and the remote harvesting server.

Procedure

  1. Go to MANAGE > Servers.
  2. In the Heartbeat Frequency field, select the frequency of the heartbeat to check the status of the servers.

    Talend Data Catalog sends a notification email when a server goes down once the maximum number of missed heartbeats specified in the server properties is reached.

    By default, this feature is disabled and no notifications will be sent.
  3. Click Add.
  4. In the New Server dialog box, fill in the following fields.
    Field Action
    Name Type in the name of the remote harvesting server.
    Type Select Over the Web (Cloud).

    It applies to a remote harvesting server connected to a Talend Data Catalog server on the cloud, where a secure firewall is in place.

    The remote harvesting server connects proactively over HTTP on regular basis to a dedicated remote Talend Data Catalog server to perform any metadata import/export activities.
    Shared secret

    Enter the shared secret which is a string and must match the M_AGENT_SHARED_SECRET assigned to the remote harvesting server as defined in the agent.properties configuration file.

    The shared secret is used to ensure proper authentication of the remote server by the application server for Over the Web (Cloud) remote harvesting servers.

    The M_AGENT_SHARED_SECRET also acts as an identifier. It must be made unique for a given application server.
    Definition Type in a description.
    Max missed heartbeats Set the maximum number of missed heartbeats (regular contact) from the remote harvesting server before it is considered disconnected.

    Talend Data Catalog sends an email notification when the harvesting server goes down once the maximum number of missed heartbeats is reached. You need to define the duration between each heartbeat check in the Heartbeat Frequency field.
    Compress Data Select the check box to use data compression for the communication between the servers.
    Set as Default Select the check box to define the remote harvesting server as the default when harvesting metadata.
  5. Click CREATE.

Results

When the remote harvesting server is connected, you can see a Connected icon in the Status column.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here