# tHBaseInput properties for Apache Spark Batch

These properties are used to configure tHBaseInput running in the Spark Batch Job framework.

The Spark Batch tHBaseInput component belongs to the Databases family.

The component in this framework is available in all subscription-based Talend products with Big Data and Talend Data Fabric.

## Basic settings

| Properties | Description |
| --- | --- |
| Storage configuration | Select the tHBaseConfiguration component from which the<br>Spark system to be used reads the configuration information to connect to HBase. |
| Property type | Either Built-In or Repository.<br><br><br>Built-In: No property data stored centrally.<br><br><br>Repository: Select the repository file where the<br>properties are stored. |
| ![](https://help.qlik.com/talend/en-US/components/8.0/Resources/images/Save_Icon.png) | Click this icon to open a database connection wizard and store the<br>database connection parameters you set in the component Basic<br>settings view.<br><br>For more information about setting up and storing database connection<br>parameters, see [Centralizing database metadata](https://help.qlik.com/talend/r/en-US/8.0/studio-user-guide/centralizing-database-metadata). |
| Schema and Edit schema | <ul> <li> <p>A schema is a row description. It defines the number of fields            (columns) to be processed and passed on to the next component. When you create a Spark            Job, avoid the reserved word <kbd>line</kbd> when naming the            fields.</p> <p>Click <span>Edit        schema</span> to make changes to the schema. If the current schema is of the <span>Repository</span> type, three options are available:</p> <ul> <li> <p> <span>View schema</span>: choose this                option to view the schema only.</p> </li> <li> <p> <span>Change to built-in property</span>:                choose this option to change the schema to <span>Built-in</span> for local changes.</p> </li> <li> <p> <span>Update repository connection</span>:                choose this option to change the schema stored in the repository and decide whether                to propagate the changes to all the Jobs upon completion.</p> <p>If you just want to                propagate the changes to the current Job, you can select <span>No</span> upon completion and choose this schema metadata                again in the <span>Repository Content</span>                window.</p> </li> </ul> </li> <li> <p> <span>Built-In</span>: You create and store the schema locally for this component                only.</p> </li> <li> <p> <span>Repository</span>: You have already created the schema and stored it in the                Repository. You can reuse it in various projects and Job designs.</p> </li> </ul> |
| Table name | Type in the name of the table from which you need to extract columns. |
| Mapping | Complete this table to map the columns of the table to be used with the schema columns you<br>have defined for the data flow to be processed. |
| Is by filter | Select this check box to use filters to perform fine-grained data selection from your<br>database, such as selection of keys, or values, based on regular expressions.<br><br>Once selecting it, the Filter table that is used to<br>define filtering conditions becomes available.<br><br>This feature leverages filters provided by HBase and subject to constraints explained in<br>Apache HBase documentation. Therefore, advanced knowledge of HBase is required to make full<br>use of these filters. |
| Logical operation | Select the operator you need to use to define the logical relation between filters. This<br>available operators are:<br><br><ul> <li> <p> <span>And</span>: every defined filtering conditions must               be satisfied. It represents the relationship<span>                 FilterList.Operator.MUST_PASS_ALL</span> </p> </li> <li> <p> <span>Or</span>: at least one of the defined filtering               conditions must be satisfied. It represents the relationship:               <span>FilterList.Operator.MUST_PASS_ONE</span> </p> </li> </ul> |
| Filter | Click the button under this table to add as many rows as required, each row representing a<br>filter. The parameters you may need to set for a filter are:<br><br><ul> <li> <p> <span>Filter type</span>: the drop-down list presents               pre-existing filter types that are already defined by HBase. Select the type of               the filter you need to use. </p> </li> <li> <p> <span>Filter column</span>: enter the column qualifier on               which you need to apply the active filter. This parameter becomes mandatory               depending on the type of the filter and of the comparator you are using. For               example, it is not used by the <span>Row Filter</span> type               but is required by the <span>Single Column Value                 Filter</span> type.</p> </li> <li> <p> <span>Filter family</span>: enter the column family on               which you need to apply the active filter. This parameter becomes mandatory               depending on the type of the filter and of the comparator you are using. For               example, it is not used by the <span>Row Filter</span> type               but is required by the <span>Single Column Value                 Filter</span> type.</p> </li> <li> <p> <span>Filter operation</span>: select from the drop-down               list the operation to be used for the active filter.</p> </li> <li> <p> <span>Filter Value</span>: enter the value on which you               want to use the operator selected from the <span>Filter                 operation</span> drop-down list. </p> </li> <li> <p> <span>Filter comparator type</span>: select the type of               the comparator to be combined with the filter you are using.</p> </li> </ul><br><br><br>Depending on the Filter type you are using,<br>some or each of the parameters become mandatory. For further information, see [HBase filters](https://help.qlik.com/talend/en-US/components/8.0/hbase/thbaseinput-thbaseinput-hbase-filters-standard-component-bigdata-this) |
| Partition by table regions | Select this check box to read in parallel the data from an HBase table using<br>its number of regions. |
| Die on HBase error | Select the checkbox to stop the execution of the Job when an error<br>occurs.<br><br>Clear the checkbox to skip any rows on error and complete the process for<br>error-free rows. When errors are skipped, you can collect the rows on error using a Row &gt; Reject link. |

## Usage

| Usage guidance | Description |
| --- | --- |
| **Usage rule** | This component is used as a start component and requires an<br>output link.<br><br>This component uses a tHBaseConfiguration component present in the same Job to connect to<br>HBase.<br><br>This component, along with the Spark Batch component Palette it belongs to,<br>appears only when you are creating a Spark Batch Job.<br><br>Note that in this documentation, unless otherwise explicitly stated, a<br>scenario presents only Standard Jobs, that is to<br>say traditional<br>Talend<br>data integration Jobs. |
| Spark Connection | In the Spark<br>Configuration tab in the Run<br>view, define the connection to a given Spark cluster for the whole Job. In<br>addition, since the Job expects its dependent jar files for execution, you must<br>specify the directory in the file system to which these jar files are<br>transferred so that Spark can access these files:<br><br><ul> <li> <div> <span>Yarn mode</span> (Yarn client or Yarn cluster):<ul> <li> <p>When using Google Dataproc, specify a bucket in the                                            <span>Google Storage staging bucket</span>                                        field in the <span>Spark configuration</span>                                        tab.</p> </li> <li> <p>When using HDInsight, specify the blob to be used for Job                                        deployment in the <span>Windows Azure Storage                                            configuration</span> area in the <span>Spark                                            configuration</span> tab.</p> </li> <li>When using Altus, specify the S3 bucket or the Azure                                    Data Lake Storage for Job deployment in the <span>Spark                                        configuration</span> tab.</li> <li> <p>When using on-premises distributions, use                                        the configuration component corresponding to the file system                                        your cluster is using. Typically, this system is HDFS and so                                        use <a href="https://help.qlik.com/talend/r/en-US/8.0/components/hdfs/thdfsconfiguration">tHDFSConfiguration</a>.</p> </li> </ul> </div> </li> <li> <p> <span>Standalone mode</span>: use the                            configuration component corresponding to the file system your cluster is                            using, such as <a href="https://help.qlik.com/talend/r/en-US/8.0/components/hdfs/thdfsconfiguration-properties-for-apache-spark-batch">tHDFSConfiguration Apache Spark Batch</a> or <a href="https://help.qlik.com/talend/r/en-US/8.0/components/amazon-s3/ts3configuration-properties-for-apache-spark-batch">tS3Configuration Apache Spark Batch</a>.</p> <p>If you are using Databricks without any configuration component present                            in your Job, your business data is written directly in DBFS (Databricks                            Filesystem).</p> </li> </ul><br><br>This connection is effective on a per-Job basis. |