Setting general connection properties

This section describes how to configure general connection properties. For an explanation of how to configure advanced connection properties, see Setting advanced connection properties.

To add a Google Cloud BigQuery target endpoint to Qlik Replicate:

1. In Tasks view, click Manage Endpoint Connections to open the Manage Endpoints Connections dialog box. Then click the New Endpoint Connection button. For more information on adding an endpoint to Qlik Replicate, see Defining and managing endpoints.
2. In the Name field, type a name for your database. This can be any name that will help to identify the database being used.
3. In the Description field, type a description that helps to identify the Google Cloud BigQuery database. This is optional.

4. Select Target as the database role.

5. From the Type drop-down list, select Google Cloud BigQuery.

6. In the Service account key field, paste the contents of the JSON file (including curly brackets) that was downloaded when you created your BigQuery service account key.

7. Loading method: Choose one of the following:

   • Batch Loading: This is the default. Source data is written to files, which are then loaded into Google Cloud BigQuery.

     • Max file size (KB): Select or type the maximum size (in KB) of a CSV file before the file is loaded into Google Cloud BigQuery.

   • Streaming: When this method is selected, records will be streamed into the database in batches, using the committed stream for Full Load and the default stream for CDC. For more information on these stream types, see Stream data using the Storage Write API. The Streaming method has several benefits over the Batch Loading method including lower costs, better performance, and once-only delivery. However, make sure you are aware of the limitations and considerations before selecting Streaming.

     For a full list of benefits, see Introduction to the BigQuery Storage Write API.

     • Max batch size (KB): The maximum size of each batch to send.

8. To verify that the connection information you entered is correct, click Test Connection.

   If the connection is successful a confirmation will be displayed at the top of the dialog box. If Replicate is unable to connect to the endpoint, an error message will be displayed instead.