Skip to main content Skip to complementary content

Centralizing Big Data metadata

You can store Google Cloud credentials in the Repository and reuse them across Jobs without reconfiguring them each time.

About this task

The Big Data Configurations node in the Metadata folder of the Repository tree view allows you to create a centralized Google Cloud Configuration. The configuration holds a Google Cloud Project ID and the associated authentication credentials. You can then drag and drop the configuration onto a Job to automatically create the tGSConfiguration component.

Context variables are supported for the configuration parameters.

Procedure

  1. In the Repository tree view of Talend Studio, expand Metadata and then right-click Big Data Configurations.
  2. Select Create Google Cloud Configuration from the contextual menu to open the configuration wizard.
  3. Fill in the general information for the configuration, such as Name and Description, and click Next.
  4. On the configuration page, fill in the following fields:
    • Project ID: Enter the ID of your Google Cloud project.

    • Authentication: Specify the authentication method and credentials to use to access the Google Cloud project.

  5. Click Finish to save the configuration.

Results

The Google Cloud Configuration appears under the Big Data Configurations node in the Metadata folder. You can drag and drop it onto a Spark Batch Job to automatically create the required Google Cloud components.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!