tBoundedStreamInput properties for Apache Spark Streaming

Schema and Edit Schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

• View schema: choose this option to view the schema only.

• Change to built-in property: choose this option to change the schema to Built-in for local changes.

• Update repository connection: choose this option to change the schema stored in the repository and decide whether to propagate the changes to all the Jobs upon completion.

  If you just want to propagate the changes to the current Job, you can select No upon completion and choose this schema metadata again in the Repository Content window.

Built-In: You create and store the schema locally for this component only.

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs.

Mode

Select the mode that you want to use to generate the data stream.

• Use Inline Content: enter the data that you want to generate.

• Use context variable: enter the name of variable to be used to provide data. This variable must have been defined in the Context view of the current Job.

  The syntax to call a variable is context.VariableName.

In either mode, the data you provide must use the separators you have defined in the Row separator, Field Separator and Micro batch separator fields.

Usage rule

This component is used as a start component and requires an output link.

This component is added automatically to a test case being created to provide input data.

Spark Connection

This connection is effective on a per-Job basis.