Prerequisites

Before you begin to work with Microsoft Azure HDInsight as a target in Qlik Replicate, make sure that the following prerequisites have been met:

• General:

  • The ADLS or Blob storage location (whichever you are using) must be accessible from the Qlik Replicate machine.
  • The user specified in the Microsoft Azure HDInsight target endpoint's Hive access settings must have access to HiveServer2.

• ODBC Driver when Replicate Server is running on Windows: Microsoft Hive ODBC Driver 2.06.12.1012 or later must be installed on the Qlik Replicate Server machine.

• ODBC Driver when Replicate Server is running on Linux:

1. Install Cloudera ODBC driver for Apache Hive 2.06.09.1009 or later on the Replicate Server machine.

2. Afterthe driver is installed, edit the hortonworks.hiveodbc.ini file as follows:

   DriverManagerEncoding=UTF-16

   ODBCInstLib=libodbcinst.so

• Permissions:
  • The "Storage account" (when using Blob storage) or "Azure Active Directory application ID" (when using ADLS) specified in the Microsoft Azure HDInsight endpoint's Storage settings must have write access to the specified Blob/ADLS storage target folder.
  • In the Access Control (IAM) settings for the ADLS Gen2 file system, assign the “Storage Blob Data Contributor” role to Replicate (AD App ID). It may take a few minutes for the role to take effect.
  • Hive table permissions: Replicate requires permissions to perform the following operations on Hive tables: CREATE, DROP, DESCRIBE, and ALTER table. ALTER table may also include RENAME table, ADD/RENAME column, and CREATE/DROP partitions on tables.

Supported blob storage types

The following blob storage types are supported:

• Standard storage with block blobs
• Premium storage with block blobs only