The Apache Spark Connector is used for direct SQL and HiveQL access to Apache Hadoop/Spark distributions. The connector transforms an SQL query into the equivalent form in HiveQL and passes the query through to the database for processing.
Nota informativaIndustry-accepted best practices must be followed when using or allowing access through the ODBC Connector. Administrators must follow The Principle of Least Privilege when setting up source database privileges and permissions.
Supported Apache Spark versions
The followings database versions are supported:
-
1.6
-
2.1 through 2.4
-
3.0
Supported Apache Spark data types
The following Apache SPARK data types are supported by the Apache Spark Connector.
- BigInt
- Binary
- Boolean
- Date
- Decimal
- Double
- Float
- Integer
- SmallInt
- String
- Timestamp
- TinyInt
- Varchar