Setting general connection properties
This section describes how to configure general connection properties. For an explanation of how to configure advanced connection properties, see Setting advanced connection properties.
To add a Microsoft Fabric target to Qlik Replicate:
- In the Qlik Replicate Console, click Manage Endpoint Connections to open the Manage Endpoints Connections dialog box.
- In the Manage Endpoint Connections dialog box, click New Endpoint Connection.
- In the Name field, type a name for your Microsoft Fabric Synapse Analytics [service]. This can be any name that will help to identify your Microsoft Fabric database.
- In the Description field, type a description that helps to identify the Microsoft Fabric target database. This is optional.
- Select Target as the role.
- Select Microsoft Fabric as the Type.
-
Choose Data Warehouse or Mirrored Database for the Database Type.
Information noteBefore you can use the Mirrored Database option, your DBA must create a mirrored database and start its replication.Information noteThe Mirrored Database option is in Preview. -
Configure the settings as described below.
Information noteThe available settings depend on the selected Database type.
Fabric Access
When Data Warehouse is selected as the Database type, the following settings will be shown:
- Server name: The name of the Microsoft Fabric server you are using.
-
Azure Active Directory Service Principal
Then provide your Client ID and Client Secret in the designated fields.
-
Azure Active Directory User Principal
Then provide a User name and Password in the designated fields.
Authentication method: Select one of the following:
-
Database name: The target database name.
When Mirror Database is selected as the Database type, the following setting will be shown:
-
OneLake landing zone: Enter the URL of your OneLake landing zone.
Example:
https://onelake.dfs.fabric.microsoft.com/<workspace-id>/<mirrored-database-id>/Files/LandingZone.
Staging on Azure
When Data Warehouse is selected as the Database type, the following settings will be shown:
-
ADLS Gen2 Storage Account: Specify the full name of your ADLS Gen2 storage account.
Example:
myaccount.dfs.core.windows.net
- Container: The container containing your folders and files.
- Azure Active Directory Tenant ID: The Azure Active Directory tenant ID.
- Application Registration Client ID: The application registration client ID.
- Application Registration Secret: The application registration secret.
- Staging directory: The directory in which to create data files on ADLS.
When Mirror Database is selected as the Database type, the following settings will be shown:
- Azure Active Directory Tenant ID: The Azure Active Directory tenant ID.
- Application Registration Client ID: The application registration client ID.
- Application Registration Secret: The application registration secret.
Data Loading
When Data Warehouse is selected as the Database type, the following settings will be shown:
-
SAS token: The SAS token that will be used by Microsoft Fabric to access the ADLS storage account.
-
Max file size (MB): Relevant for Full Load and CDC. The maximum size a file can reach before it is loaded/applied to the target. If you encounter performance issues, try adjusting this parameter.
Information noteWhen using compression, the actual file size will be smaller. - Compression: Select None (the default) or Gzip. Selecting None will usually provide the best performance, as it leverages Microsoft's CSV parser 2.0. However, selecting Gzip (which is not supported by CSV parser 2.0) might improve loading performance in certain environments. It really depends on environment-specific factors such as latency from the Replicate machine to ADLS staging, the number of CSV files, and their size.
- Number of files to apply in a batch: Relevant for Full Load only. The number of files to apply in a single batch. If you encounter performance issues, try adjusting this parameter.
- Batch load timeout (seconds): If you encounter frequent timeouts when loading the files, try increasing this value.
When Mirror Database is selected as the Database type, the following settings will be shown:
-
Max file size (MB): Relevant for Full Load and CDC. The maximum size a file can reach before it is loaded/applied to the target. If you encounter performance issues, try adjusting this parameter.