# tHDFSInput MapReduce properties (deprecated)

Availability-note[Deprecated](https://help.talend.com/r/en-US/Cloud/labels-on-talend-help-center/availability-deprecated)

This content is deprecated.

These properties are used to configure tHDFSInput running in the MapReduce Job framework.

The MapReduce tHDFSInput component belongs to the MapReduce family.

The component in this framework is available in all Talend products with Big Data and Talend Data Fabric.

Availability-note[Deprecated](https://help.talend.com/r/en-US/Cloud/labels-on-talend-help-center/availability-deprecated)

This content is deprecated.

The MapReduce framework is deprecated from Talend 7.3 onwards. Use Talend Jobs for Apache Spark to accomplish your integration tasks.

## Basic settings

| Property type | Either Built-In or Repository.<br><br><br>Built-In: No property data stored centrally.<br><br><br>Repository: Select the repository file where the<br>properties are stored.<br><br>The properties are stored centrally under the Hadoop<br>Cluster node of the Repository<br>tree.<br><br>For further information about the Hadoop<br>Cluster node, see the Getting Started Guide. |
| --- | --- |
| Schema and Edit<br>Schema | A schema is a row description. It defines the number of fields<br>(columns) to be processed and passed on to the next component. When you create a Spark<br>Job, avoid the reserved word line when naming the<br>fields.<br><br>Click Edit<br>schema to make changes to the schema.<br><br>Information noteNote: If you<br>make changes, the schema automatically becomes built-in. |
|  | Built-In: You create and store the schema locally for this component<br>only. |
|  | Repository: You have already created the schema and stored it in the<br>Repository. You can reuse it in various projects and Job designs. |
| Folder/File | Browse to, or enter the path pointing to the data to be used in the file system.<br><br>If the path you set points to a folder, this component will read all of the files stored in that folder, for example,/user/talend/in; if sub-folders exist, the sub-folders are automatically ignored unless you define the property mapreduce.input.fileinputformat.input.dir.recursive to be true in the Hadoop properties table in the Hadoop configuration tab.<br><br>If you want to specify more than one files or directories in this<br>field, separate each path using a comma (,).<br><br>If the file to be read is a compressed one, enter the file name with<br>its extension; then tHDFSInput<br>automatically decompresses it at runtime. The supported compression<br>formats and their corresponding extensions are:<br><br><ul> <li> <p>DEFLATE: <em>*.deflate</em> </p> </li> <li> <p>gzip: <em>*.gz</em> </p> </li> <li> <p>bzip2: <em>*.bz2</em> </p> </li> <li> <p>LZO: <em>*.lzo</em> </p> </li> </ul><br><br>Note that you need<br>to ensure you have properly configured the connection to the Hadoop<br>distribution to be used in the Hadoop<br>configuration tab in the Run view. |
| Die on error | Select the check box to stop the execution of the Job when an error<br>occurs.<br><br>Clear the check box to skip any rows on error and complete the process for<br>error-free rows. When errors are skipped, you can collect the rows on error using a Row &gt; Reject link. |
| Type | Select the type of the file to be processed. The type of the file may be:<br><br><ul> <li> <p> <span>Text file</span>.</p> </li> <li> <p> <span>Sequence file</span>: a Hadoop sequence file                    consists of binary key/value pairs and is suitable for the Map/Reduce framework.                    For further information, see <a href="http://wiki.apache.org/hadoop/SequenceFile" target="_blank">http://wiki.apache.org/hadoop/SequenceFile</a>. </p> <p>Once you select the <span>Sequence file</span> format, the                        <span>Key column</span> list and the <span>Value column</span> list appear to allow you to select the                    keys and the values of that Sequence file to be processed.</p> </li> </ul> |
| Row separator | The separator used to identify the end of a row.<br><br>This field is not available for a Sequence file. |
| Field separator | Enter a character, a string, or a regular expression to separate<br>fields for the transferred data.<br><br>This field is not available for a Sequence file. |
| Header | Enter the number of rows to be skipped in the beginning of file.<br><br>For example, enter *0* to ignore no<br>rows for the data without header and set *1* for the data with header at the first row.<br><br>This field is not available for a Sequence file. |
| Custom Encoding | You may encounter encoding issues when you process the stored data. In that<br>situation, select this check box to display the Encoding list.<br><br>Then select the encoding to be used from the list or select Custom and define it manually.<br><br>This option is not available for a Sequence file. |

## Advanced settings

| Advanced separator (for number) | Select this check box to change the separator used for numbers. By default, the thousands separator is a comma (*,*) and the decimal separator is a period (*.*). |
| --- | --- |
| Trim all columns | Select this check box to remove the leading and trailing whitespaces from all<br>columns. When this check box is cleared, the Check column to<br>trim table is displayed, which lets you select particular columns to<br>trim. |
| Check column to trim | This table is filled automatically with the schema being used. Select the check<br>box(es) corresponding to the column(s) to be trimmed. |
| tStatCatcher Statistics | Select this check box to collect log data at the component<br>level. |

## Global Variables

| Global Variables | ERROR\_MESSAGE: the error message generated by the component when an<br>error occurs. This is an After variable and it returns a string. This variable functions<br>only if the Die on error check box<br>is cleared, if the component has this check<br>box.<br><br>A Flow variable functions during the execution of a component<br>while an After variable functions after the execution of the component.<br><br>To fill up a field or expression with a<br>variable, press Ctrl + Space to<br>access the variable list and choose the variable to use from it.<br><br>For further information about variables, see *Talend Studio*<br>*User Guide*. |
| --- | --- |

## Usage

| **Usage rule** | In a<br>Talend<br>Map/Reduce Job, it is used as a start component and requires<br>a transformation component as output link. The other components used along with it must be<br>Map/Reduce components, too. They generate native Map/Reduce code that can be executed<br>directly in Hadoop.<br><br>Once a Map/Reduce Job is opened in the workspace, tHDFSInput as well as the MapReduce family<br>appears in the Palette of the<br>Studio.<br><br>Note that in this documentation, unless otherwise<br>explicitly stated, a scenario presents only Standard Jobs,<br>that is to say traditional<br>Talend<br>data integration Jobs, and non Map/Reduce Jobs. |
| --- | --- |
| Hadoop Connection | You need to use the Hadoop Configuration tab in the<br>Run view to define the connection to a given Hadoop<br>distribution for the whole Job.<br><br>This connection is effective on a per-Job basis. |