tSetDynamicSchema Standard properties

Schema and Edit schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields.

Built-In: You create and store the schema locally for this component only.

Repository: You have already created the schema and stored it in the Repository. You can reuse it in various projects and Job designs.

Click Edit schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

• View schema: choose this option to view the schema only.

• Change to built-in property: choose this option to change the schema to Built-in for local changes.

• Update repository connection: choose this option to change the schema stored in the repository and decide whether to propagate the changes to all the Jobs upon completion.

  If you just want to propagate the changes to the current Job, you can select No upon completion and choose this schema metadata again in the Repository Content window.

This option is not available if you select the Guess schema from file option or the Read schema from file option.

Click to synchronize the output file schema with the input file schema. The Sync function is available only when the component is linked with an input component using a Row connection.

Guess schema from file

Select this option to generate the schema from a csv file. You need to enter the path to the csv file in the Filename field manually or by clicking the [...] button and navigating to the csv file.

This option is not available if the component is linked with an input component using a Row connection or if you select the Read schema from file option.

Read schema from file

Select this option to generate the schema from a schema definition file. You need to enter the path to the schema definition file in the Filename field manually or by clicking the [...] button and navigating to the file.

This option is not available if the component is linked with an input component using a Row connection or if you select the Guess schema from file option.

This table contains two columns.

• Property: Property of the schema entry: ColumnName, DBName, Type, DBType, Length, Precision, Nullable, Key, or ExtendedConfiguration.
• Value: Value assigned to this property.

This option is not available if you select the Guess schema from file option or the Read schema from file option.

Row limit

Specify the number of rows in the csv file to guess schema from.

This field is available if you select the Guess schema from file option in the Basic settings view.

tStatCatcher Statistics

Select this check box to gather the Job processing metadata at a Job level as well as at each component level.

Global Variables

DYNAMIC: the last row of the data retrieved using the defined dynamic schema. This is an After variable and it returns a dynamic.

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl+Space to access the variable list and choose the variable to use from it.

For more information about variables, see Using contexts and variables.

Usage rule

This component can be used as the end component or be used independently in a subJob.

Limitation

To work with tSetDynamicSchema, components should have the option of Use existing dynamic, which allows you to select the tSetDynamicSchema component from the list.