tWriteJSONFields properties for Apache Spark Structured Streaming | Talend Components for Jobs Help
Skip to main content Skip to complementary content
Qlik Resources
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal

tWriteJSONFields properties for Apache Spark Structured Streaming

Last updated: 9/30/2026
Feature in preview

Use these properties to configure tWriteJSONFields running in the Spark Structured Streaming Job framework.

The Spark Structured Streaming tWriteJSONFields component belongs to the Processing family.

The streaming version of this component is available in Talend Real-Time Big Data Platform and in Talend Data Fabric.

Basic settings

Properties Description
Output type Select the output format of the serialized JSON from the drop-down list:
  • byte[]: outputs the JSON as a binary byte array.
  • String: outputs the JSON as a UTF-8 string.
Schema and Edit schema

A schema is a row description. It defines the fields (columns) processed by the component. When you create a Spark Job, avoid the reserved word line when naming fields.

  • Built-In: create and store the schema locally for this component only.

  • Repository: reuse a schema created and stored in the Repository across projects and Job designs.

Click Edit schema to modify the schema. If you modify a Repository schema, the available options include:

  • View schema: view the schema without modifying it.

  • Change to built-in property: change the schema to Built-in for local changes.

  • Update repository connection: modify the Repository schema and choose whether to propagate the changes to other Jobs.
Use data column as partition key Select this check box to use a data column as the partition key when writing to a downstream component such as tKinesisOutput.
Editor Click ... to open the JSON mapping editor, where you define the JSON structure by mapping input columns to JSON paths. The editor supports three mapping tables:
  • Root: defines the top-level JSON structure and maps input columns to root-level JSON fields.
  • Group: defines intermediate grouping nodes in the JSON structure.
  • Loop: defines the repeated elements that are serialized as a JSON array, with one entry per grouped row.
Group by Add the input columns used to group rows when building nested JSON arrays in the loop table. Click the plus button to add a column.
Remove root node Select this check box to output the JSON content without the root element wrapper. This check box is selected by default.

Usage

Usage guidance Description
Usage rule

This component is used as an intermediate step.

This component, along with the Spark Structured Streaming component Palette it belongs to, appears only when you are creating a Spark Structured Streaming Job.

Spark Connection

You need to use the Structured Streaming Configuration tab in the Run view to define the connection to a Spark cluster for the whole Job.

This connection is effective on a per-Job basis.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here