Google Cloud Storage

Google Cloud Storage can be used as:

• A cloud staging area when using Databricks as a data pipeline target. The cloud staging area is where data and changes are staged before being applied and stored.

• A target in a replication task.

  • For an explanation of how to replicate data to Google Cloud Storage with Standard, Premium, and Enterprise subscriptions, see Landing data in a data lake with a Standard, Premium, or Enterprise subscription.
  • For an explanation of how to replicate data to Google Cloud Storage with the Starter subscription, see Replicating data with a Qlik Talend Cloud Starter subscription.

Limitations and considerations

The following limitations apply:

• Full LOB Mode is not supported.
• Database names, schema names, or table names containing slash (/) or backslash (\) characters are not supported.

Prerequisites

The JSON credentials specified in the connector settings must be for an account that has read and write access to the specified bucket.

Setting Google Cloud Storage connection properties

To configure the connector, do the following:

1. In Connections, click Create connection.

2. Select the Google Cloud Storage target connector and then provide the following settings:

Data target

Data gateway: Select the Data Movement gateway that will be used to test the connection to Google Cloud Storage. This should be the same Data Movement gateway deployed to land data from the data source.

Connection properties

• Service account key: The JSON credentials for the service account key with read and write access to the Google Cloud Storage bucket. Click Upload and select the JSON file with the service account key.

  Information noteThe specified account key must have read and write access to the specified bucket and folder.
• Bucket name: The Google Cloud Storage bucket.

Internal properties

Internal properties are for special use cases and are therefore not exposed in the dialog. You should only use them if instructed by Qlik Support.

Use the and buttons to the right of the fields to add or remove properties as needed.

Name

The display name for the connection.

Data type mapping

The following table shows the default mapping from Qlik Cloud data types to Google Cloud Storage data types.

Mapping from Qlik Cloud data types to Google Cloud Storage

Mapping from Qlik Cloud data types to Parquet

When Parquet is set as the file format, due to the limited number of data types supported by Parquet, the data type mappings will be as follows: