tIcebergInput properties for Apache Spark Batch

These properties are used to configure tIcebergInput running in the Spark Batch Job framework.

The Spark Batch tIcebergInput component belongs to the Big Data family.

The component in this framework is available in all Talend products.

This component is available when you have installed the 8.0.1-R2024-04 Studio Monthly or a later one provided by Talend. For more information, check with your administrator.

Basic settings

Properties	Description
Schema	Select the type of schema from the drop-down list: Built-In: You create and store the schema locally for this component only. Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs.
Edit schema	Click Edit schema to make changes to the schema. If you make changes, the schema automatically becomes built-in.
Table	Enter the table name from which you want to read data from.
Use time travel	Select this check box to read data by specifying: a specific branch name with the Read branch option a specific tag name with the Read tag option a specific date and time with the Read datetime option a specific snapshot ID with the Read snapshot ID option
Catalog and Schema	To retrieve a dataset from Unity Catalog, specify the following parameters: Catalog: enter the name of the catalog to be used. Schema: enter the name of the schema to be used. These fields are available only when you select Enable Unity Catalog with Databricks in the Spark Configuration tab of your Spark Batch Job.

Global Variables

Variables	Description
ERROR_MESSAGE	The error message generated by the component when an error occurs. This is an After variable and it returns a string.

Usage

Usage guidance	Description
Usage rule	This component is generally used with other Iceberg components.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here