The Apache Spark Connector is used for direct SQL and HiveQL access to Apache Hadoop/Spark distributions. The connector transforms an SQL query into the equivalent form in HiveQL and passes the query through to the database for processing.
Information noteIndustry-accepted best practices must be followed when using or allowing access through the ODBC Connector. Administrators must follow The Principle of Least Privilege when setting up source database privileges and permissions.
Information noteThis data source is not available in Qlik Sense Business or Qlik Cloud Analytics Standard.
Supported Apache Spark versions
The followings database versions are supported:
-
1.6
-
2.1 through 2.4
-
3.0
Supported Apache Spark data types
The following Apache SPARK data types are supported by the Apache Spark Connector.
- BigInt
- Boolean
- Date
- Decimal
- Double
- Float
- Integer
- SmallInt
- String
- Timestamp
- TinyInt
- Varchar