tIcebergOutput properties for Apache Spark Structured Streaming | Talend Components for Jobs Help
Skip to main content Skip to complementary content

tIcebergOutput properties for Apache Spark Structured Streaming

Last updated: 9/30/2026

These properties are used to configure tIcebergOutput running in the Spark Structured Streaming Job framework.

The Spark Structured Streaming tIcebergOutput component belongs to the Databases family.

The streaming version of this component is available in Talend Real-Time Big Data Platform and in Talend Data Fabric.

Basic settings

Properties Description
Table Enter the name of the Iceberg table in which to write the streaming data.
Output mode Select the output mode from the drop-down list:
  • Append: adds new rows to the output table without modifying existing rows.
  • Complete: overwrites the entire output table with the updated result after every trigger. Complete mode requires an aggregation stage before writing to Iceberg.
Checkpoint location Enter the path to the directory where Spark stores checkpoint data for the streaming query. Checkpointing enables fault tolerance and allows a failed query to resume from where it stopped.

To use a cloud storage path, add the corresponding configuration component to the Job. For example, use tS3Configuration for Amazon S3, tGSConfiguration for Google Cloud Storage, or tAzureFSConfiguration for Azure Data Lake Storage.

Set trigger Select this check box to configure how often the streaming query processes data. When selected, choose one of the following trigger types:
  • Available now: processes all available data in a single batch, then stops the query.
  • Fixed interval: runs the query at a fixed time interval. Enter the interval duration in the field that appears, for example 10 seconds.
Set query name Select this check box to assign a name to the streaming query. In the Query name field, enter the name.

Usage

Usage guidance Description
Usage rule

This component is used as an end component and requires an input link.

This component is generally used with other Iceberg components.

This component, along with the Spark Structured Streaming component Palette it belongs to, appears only when you are creating a Spark Structured Streaming Job.

Spark Connection

You need to use the Structured Streaming Configuration tab in the Run view to define the connection to a Spark cluster for the whole Job.

This connection is effective on a per-Job basis.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!