tIcebergTable Standard properties

These properties are used to configure tIcebergTable running in the Standard Job framework.

The Standard tIcebergTable component belongs to the Big Data family.

The component in this framework is available in all Talend products.

This component is available when you have installed the 8.0.1-R2023-11 Studio Monthly or a later one provided by Talend. For more information, check with your administrator.

Basic settings

Connection	Select from the drop-down list the tIcebergConnection component by which the desired connection is established.
Table name	Enter the name of the Iceberg table on which you want to work.
Action on table	Select the action you want to perform on the Iceberg table from the drop-down list: Alter: modifies columns of the table. This parameter is only available when you have installed the 8.0.1-R2024-01 Studio Monthly or a later one provided by Talend. For more information, check with your administrator. Create: creates a table. Create if not exists: creates a table only if no table already exists. Drop: removes table. Drop if exists: removes a table only if it already exists. Truncate: deletes the table content.
Create like	Select this check to create a table based on an existing table. The existing table name needs to be specified in the Source table parameter. For more information, see Create table like table from Apache Iceberg documentation. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list, and when the Create as select check box is not selected.
Create as select	Select this check box to create a table at the beginning of a query execution. The query needs to be specified in the As select query parameter. For more information, see Create table as select from Apache Iceberg documentation. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list, and when the Create like check box is not selected.
Schema and Edit schema	A schema is a row description that defines the number of fields (columns) to be processed and passed on to the next component. Select the type of schema from the drop-down list: Built-In: You create and store the schema locally for this component only. Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs. Click Edit schema to make changes to the schema. If you make changes, the schema automatically becomes built-in. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list.
Set format	Select this check box to specify the file format, and then select the format from the drop-down list: AVRO ORC PARQUET This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list, and when the Create like and Create as select check boxes are not selected.
Create external table	Select this check box to create an external table. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list.
Set partitions	Select this check box to create partitions inside the table, and then specify the new schema in the Schema parameter that appears. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list.
Set catalog	Select this check box to specify a catalog to be used to create the table into. This property is only available when you have installed the 8.0.1-R2024-02 Studio Monthly or a later one provided by Talend. For more information, check with your administrator.
Set location	Select this check box to specify a location path in which you want the table to be created. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list.
Table properties	Enter any extra configuration properties following the key and values format by clicking the plus button. For example, you can add properties such as format-version. For more information on available configuration properties, see Configuration from Apache Iceberg documentation. This parameter is only available when you select Create or Create if not exists from the Action on table drop-down list.
Alter table action	Select from the drop-down list the action you want to perform on the table: Add columns: adds columns that are in the schema list from the New columns parameter. You can edit this schema by clicking Edit schema. Change columns: updates columns by adding parameters in the Column mapping table. Drop columns: removes columns that are not in the schema list from the Remaining columns parameter. You can edit this schema by clicking Edit schema. Set partitions: updates the partitioning schema by adding parameters in the Partitions table. Create branch: creates a branch either Using default properties, At a specific snapshot ID, Using system time, or Using specific tag. You can also specify a number of snapshot retentions when creating a branch by selecting the Set number of snapshot retentions checkbox. Drop branch: removes a branch. Drop branch if exists: removes a branch without failing if the branch does not exist. Create tag: creates a tag either Using default properties, At a specific snapshot ID, or Using system time. Drop tag: removes a tag. Drop tag if exists: removes a tag without failing if the branch does not exist. For more information about branches and tags, see Branches and tags from the Iceberg documentation. This parameter is only available when you select Alter from the Action on table drop-down list. This parameter is only available when you have installed the 8.0.1-R2024-01 Studio Monthly or a later one provided by Talend. The branch and tag options are only available when you have installed the 8.0.1-R2024-06 Studio Monthly or a later one provided Talend. For more information, check with your administrator.

Advanced settings

tStatCatcher Statistics	Select this check box to collect the log data at a component level.

Global Variables

ERROR_MESSAGE	The error message generated by the component when an error occurs. This is an After variable and it returns a string.

Usage

Usage rule	This component is generally used with other Iceberg components.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here