tImpalaLoad Standard properties

Property type

Either Built-in or Repository.

Built-in: No property data stored centrally.

Repository: Select the repository file in which the properties are stored. The fields that follow are completed automatically using the data retrieved.

Use an existing connection

Select this check box and in the Component List drop-down list, select the desired connection component to reuse the connection details you already defined.

Impala Driver

Select the driver you are using from the drop-down list.

Host

Database server IP address.

Port

Listening port number of DB server.

Database

Fill this field with the name of the database.

Additional JDBC Settings

Specify additional connection properties for the database connection you are creating.

This option is not available if you have selected the Use an existing connection check box in the Basic settings view.

Username and Password

Enter the database user authentication data to authenticate using LDAP.

To enter the password, click the […] button next to the password field, and then in the pop-up dialog box enter the password between double quotes and click OK to save the settings.

These parameters are not available when you select the Use kerberos authentication check box.

Use kerberos authentication

If you are accessing an Impala system running with Kerberos security, select this check box and then enter the Kerberos principal of this Impala system.

Load action

Select the action you need to carry for writing data into the specified destination.

• When you select LOAD, you are moving or copying data from a directory you specify.

  Information noteNote: With Cloudera Data Platform (CDP), if you load a table, the table must be non-ACID to work correctly.

• When you select INSERT, you are moving or copying data based on queries.

Target type

This drop-down list appears only when you have selected INSERT from the Load action list.

Select from this list the type of the location you need to write data in.

• If you select Table as destination, you can still choose to append data to or overwrite the contents in the specified table. This is the only option in the current release.

Action

Select whether you want to OVERWRITE the old data already existing in the destination or only APPEND the new data to the existing one.

Table name

Enter the name of the Hive table you need to write data in.

Note that with the INSERT action, this field is available only when you have selected Table from the Target type list.

File path

Enter the directory you need to read data from.

Query

This field appears when you have selected INSERT from the Load action list.

Enter the appropriate query for selecting the data to be exported to the specified Impala table or directory.

Select this check box to use the Impala Partition clause in loading or inserting data in a Impala table. You need to enter the partition keys and their values to be used in the field that appears.

For example, enter contry='US', state='CA'. This makes a partition clause reading Partition (contry='US', state='CA'), that is to say, a US and CA partition.

Also, it is recommended to select the Create partition if not exist check box that appears to ensure that you will not create a duplicate partition.

Die on error

Select this check box to kill the Job when an error occurs.

tStatCatcher Statistics

Select this check box to collect log data at the component level.

Global Variables

QUERY: the query statement being processed. This is a Flow variable and it returns a string.

ERROR_MESSAGE: the error message generated by the component when an error occurs. This is an After variable and it returns a string. This variable functions only if the Die on error check box is cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl+Space to access the variable list and choose the variable to use from it.

For more information about variables, see Using contexts and variables.

Usage rule

This component works standalone.