tIcebergSQL properties for Apache Spark Batch | Talend Components for Jobs Help
Skip to main content Skip to complementary content
Qlik Resources
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal

tIcebergSQL properties for Apache Spark Batch

Last updated: 8/27/2026

These properties are used to configure tIcebergSQL running in the Spark Batch Job framework.

The Standard tIcebergSQL component belongs to the Big Data family.

The component in this framework is available in all Talend products.

This component is available when you have installed the 8.0.1-R2025-05 Studio Monthly or a later one provided by Talend. For more information, check with your administrator.

Basic settings

Properties Description
Action
Select the type of operation to perform from the drop-down list:
  • Create namespace
  • Select operation
  • Insert operation
Namespace name Enter the name of the namespace to be created or to be used for Input and Output operations.
Schema Select the type of schema from the drop-down list:

  • Built-In: You create and store the schema locally for this component only.

  • Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs.

Information noteImportant: In Dataset-mode Spark Batch Jobs on Databricks, if an Iceberg table contains a Spark VariantType column, define the corresponding column in the component schema as String. The VariantType value is materialized as JSON text.

This property is only available when you select Select operation from the Action drop-down list.
Edit schema

Click Edit schema to make changes to the schema. If you make changes, the schema automatically becomes built-in.

This property is only available when you select Select operation from the Action drop-down list.
Select statement

Enter the SELECT query statement. Pay attention to correctly sequence the fields in order to match the target table definition.

This property is only available when you select Select operation from the Action drop-down list.
Insert statement

Enter the INSERT query statement. Pay attention to correctly sequence the fields in order to match the target table definition.

This property is only available when you select Insert operation from the Action drop-down list.

Global Variables

Variables Description

ERROR_MESSAGE

The error message generated by the component when an error occurs. This is an After variable and it returns a string.

Usage

Usage guidance Description
Usage rule This component is generally used with other Iceberg components.
Storage providers tIcebergSQL is enabled for Databricks and works with AWS, Google Cloud Platform (GCP), and Azure as providers.
The following configurations must be done on the machine running the Job:
  • For AWS, set the variables AWS_REGION, AWS_ACCESS_KEY_ID, and AWS_SECRET_ACCESS_KEY as environment variables, or use the AWS CLI to set the variables on the credentials and config files.
  • For Google Cloud Platform (GCP), set the variable GOOGLE_APPLICATION_CREDENTIALS as environment variable. This variable should contain the path to GCP application credentials JSON file.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here