tDynamoDBConfiguration properties for Apache Spark Batch
These properties are used to configure tDynamoDBConfiguration running in the Spark Batch Job framework.
The Spark Batch tDynamoDBConfiguration component belongs to the Storage and the Databases families.
The component in this framework is available in all subscription-based Talend products with Big Data and Talend Data Fabric.
Basic settings
|
Inherit credentials from AWS role |
Select this check box to leverage the instance profile credentials. These credentials can be used on Amazon EC2 instances, and are delivered through the Amazon EC2 metadata service. To use this option, your Job must be running within Amazon EC2 or other services that can leverage IAM Roles for access to resources. For more information, see Using an IAM Role to Grant Permissions to Applications Running on Amazon EC2 Instances. |
|
Access key |
Enter the access key ID that uniquely identifies an AWS Account. For further information about how to get your Access Key and Secret Key, see Getting Your AWS Access Keys. Information noteNote: This option is available when Use an existing
connection and Inherit credentials from AWS
role are cleared.
|
|
Secret key |
Enter the secret access key, constituting the security credentials in combination with the access Key. To enter the secret key, click the [...] button next to the secret key field, and then in the pop-up dialog box enter the password between double quotes and click OK to save the settings. Information noteNote: This option is available when Use an existing
connection and Inherit credentials from AWS
role are cleared.
|
|
Region |
Specify the AWS region by selecting a region name from the list. For more information about the AWS Region, see Regions and Endpoints. |
|
Use End Point |
Select this check box and in the field displayed, specify the Web service URL of the DynamoDB database service. |
Usage
|
Usage rule |
This component is used with no need to be connected to other components. The configuration in a tDynamoDBConfiguration component applies only on the DynamoDB related components in the same Job. In other words, the DynamoDB components used in a child or a parent Job that is called via tRunJob cannot reuse this configuration. This component, along with the Spark Batch component Palette it belongs to, appears only when you are creating a Spark Batch Job. Note that in this documentation, unless otherwise explicitly stated, a scenario presents only Standard Jobs, that is to say traditional Talend data integration Jobs. |