tIcebergCatalog properties for Apache Spark Structured Streaming | Talend Components for Jobs Help
Skip to main content Skip to complementary content

tIcebergCatalog properties for Apache Spark Structured Streaming

Last updated: 9/30/2026

These properties are used to configure tIcebergCatalog running in the Spark Structured Streaming Job framework.

The Spark Structured Streaming tIcebergCatalog component belongs to the Databases family.

The streaming version of this component is available in Talend Real-Time Big Data Platform and in Talend Data Fabric.

Basic settings

Properties Description
Register new catalog Select this check box to register a new catalog.
Replace default spark_catalog with Iceberg's SparkSessionCatalog Select this check box to replace the default Spark catalog. For more information, see Replacing the session catalog from Iceberg documentation.
Name Enter the name of the catalog.
Type Select the type of catalog from the drop-down list:
  • Hadoop: creates an Iceberg catalog loading tables from a Hadoop warehouse.
  • Hive: creates an Iceberg catalog loading tables from a Hive metastore.
  • Rest: creates an Iceberg catalog loading tables from a REST metastore.
  • Custom: creates an Iceberg catalog loading tables from a custom metastore.
Warehouse path Enter the root path to the warehouse in which the catalog is stored.

This property is only available when you select Hadoop from the Type drop-down list.

Uri Enter the metastore URI string.

This property is only available when you select Hive or Rest from the Type drop-down list.

Catalog implementation Enter the custom catalog implementation to be used.

This property is only available when you select Custom from the Type drop-down list.

Catalog properties Enter additional properties for the catalog. For more information, see Configuration from the Iceberg documentation.

This property is only available when the Register new catalog check box is selected.

Usage

Usage guidance Description
Usage rule

This component works standalone in a subJob to register Iceberg catalogs for the whole Spark Structured Streaming Job.

This component, along with the Spark Structured Streaming component Palette it belongs to, appears only when you are creating a Spark Structured Streaming Job.

Spark Connection

You need to use the Structured Streaming Configuration tab in the Run view to define the connection to a Spark cluster for the whole Job.

This connection is effective on a per-Job basis.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!