tFilterRow MapReduce properties (deprecated)

Schema and Edit Schema

A schema is a row description. It defines the number of fields (columns) to be processed and passed on to the next component. When you create a Spark Job, avoid the reserved word line when naming the fields.

Logical operator used to combine conditions

Select a logical operator to combine simple conditions and to combine the filter results of both modes if any advanced conditions are defined.

And: returns the boolean value of true if all conditions are true; otherwise false. For each two conditions combined using a logical AND, the second condition is evaluated only if the first condition is evaluated to be true.

Or: returns the boolean value of true if any condition is true; otherwise false. For each two conditions combined using a logical OR, the second condition is evaluated only if the first condition is evaluated to be false.

Conditions

Click the plus button to add as many simple conditions as needed. Based on the logical operator selected, the conditions are evaluated one after the other in sequential order for each row. When evaluated, each condition returns the boolean value of true or false.

Input column: Select the column of the schema the function is to be operated on

Function: Select the function on the list

Operator: Select the operator to bind the input column with the value

Value: Type in the filtered value, between quotes if needed.

Use advanced mode

Select this check box when the operations you want to perform cannot be carried out through the standard functions offered, for example, different logical operations in the same component. In the text field, type in the regular expression as required.

If multiple advanced conditions are defined, use a logical operator between two conditions:

&& (logical AND): returns the boolean value of true if both conditions are true; otherwise false. The second condition is evaluated only if the first condition is evaluated to be true.

|| (logical OR): returns the boolean value of true if either condition is true; otherwise false. The second condition is evaluated only if the first condition is evaluated to be false.

Global Variables

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl + Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio User Guide.

Usage rule

In a Talend Map/Reduce Job, this component is used as an intermediate step and other components used along with it must be Map/Reduce components, too. They generate native Map/Reduce code that can be executed directly in Hadoop.

For further information about a Talend Map/Reduce Job, see the sections describing how to create, convert and configure a Talend Map/Reduce Job of the Talend Big Data Getting Started Guide .

Note that in this documentation, unless otherwise explicitly stated, a scenario presents only Standard Jobs, that is to say traditional Talend data integration Jobs, and non Map/Reduce Jobs.