# tFilterRow properties for Apache Spark Structured Streaming

[Preview](https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Introduction/feature-preview-program-overview.htm)

Use these properties to configure tFilterRow running in the Spark Structured Streaming Job framework.

The Spark Structured Streaming tFilterRow component belongs to the Processing family.

The streaming version of this component is available in Talend Real-Time Big Data Platform and in Talend Data Fabric.

## Basic settings

| Properties | Description |
| --- | --- |
| Schema and Edit schema | A schema is a row description. It defines the number of fields<br>(columns) to be processed and passed on to the next component. When you create a Spark<br>Job, avoid the reserved word line when naming the<br>fields.<br><br><ul> <li> <p> <span>Built-In</span>: You create and store the schema locally for this component                only.</p> </li> <li> <p> <span>Repository</span>: You have already created the schema and stored it in the                Repository. You can reuse it in various projects and Job designs.</p> </li> </ul><br><br>Click Edit schema to make changes to<br>the schema. If you make changes, the schema automatically becomes built-in.<br><br><ul> <li> <p> <span>View schema</span>: choose this                option to view the schema only.</p> </li> <li> <p> <span>Change to built-in property</span>:                choose this option to change the schema to <span>Built-in</span> for local changes.</p> </li> <li> <p> <span>Update repository connection</span>:                choose this option to change the schema stored in the repository and decide whether                to propagate the changes to all the Jobs upon completion.</p> <p>If you just want to                propagate the changes to the current Job, you can select <span>No</span> upon completion and choose this schema metadata                again in the <span>Repository Content</span>                window.</p> </li> </ul> |
| Logical operator used to combine conditions | Select a logical operator to combine simple conditions and the filter<br>results of both modes when you define advanced<br>conditions.<br><br>And: Returns true if all conditions<br>are true; otherwise false. The second condition is evaluated only if the<br>first is true.<br><br>Or: Returns true if any<br>condition is true; otherwise false. The second condition is evaluated<br>only if the first is false. |
| Conditions | Click + to add simple conditions. Based on the<br>selected logical operator, the component evaluates conditions sequentially for<br>each row and returns true or false.<br><br>Input column: Select the<br>schema column to apply the function to.<br><br>Function:<br>Select the function from the list.<br><br>Operator:<br>Select the operator to bind the input column with the<br>value.<br><br>Value: Enter the filter value, in<br>quotation marks if required. |
| Use advanced mode | Select this check box when standard functions cannot perform the required<br>operations. Enter a regular expression in the text field.<br><br>If<br>multiple advanced conditions are defined, use a logical operator to combine<br>conditions:<br><br>&& (logical AND): Returns<br>true if both conditions are true. The second condition is evaluated<br>only if the first is true.<br><br>\|\| (logical OR): Returns<br>true if either condition is true. The second condition is evaluated<br>only if the first is false. |

## Usage

| Usage guidance | Description |
| --- | --- |
| **Usage rule** | This component is used as an intermediate step.<br><br>This component, along with the Spark Structured Streaming component Palette it belongs to,<br>appears only when you are creating a Spark Structured Streaming Job. |
| Spark Connection | You need to use the Structured Streaming Configuration<br>tab in the Run view to define the connection to a Spark cluster for<br>the whole Job.<br><br>This connection is effective on a per-Job basis. |