tKinesisConfiguration
Last updated: 9/30/2026tKinesisConfiguration properties for Apache Spark Structured Streaming
Use these properties to configure tKinesisConfiguration running in the Spark Structured Streaming Job framework.
The Spark Structured Streaming tKinesisConfiguration component belongs to the Messaging family.
The streaming version of this component is available in Talend Real-Time Big Data Platform and in Talend Data Fabric.
Basic settings
| Properties | Description |
|---|---|
|
Property Type |
Select the way the connection details will be set.
|
| Inherit credentials |
Select this checkbox to leverage the instance profile credentials. These credentials can be used on Amazon EC2 instances, and are delivered through the Amazon EC2 metadata service. To use this option, your Job must be running within Amazon EC2 or other services that can leverage IAM Roles for access to resources. For more information, see Using an IAM Role to Grant Permissions to Applications Running on Amazon EC2 Instances. |
| Access Key ID |
Enter the access key ID that uniquely identifies an AWS Account. For further information about how to get your Access Key and Secret Key, see Getting Your AWS Access Keys. |
| Secret Access Key |
Enter the secret access key, constituting the security credentials in combination with the access Key. To enter the password, click the [...] button next to the password field, enter the password in double quotes in the pop-up dialog box, and click OK to save the settings. |
| Endpoint URL |
Enter the endpoint of the Kinesis service to be used. For example, https://kinesis.us-east-1.amazonaws.com. More valid Kinesis endpoint URLs can be found at http://docs.aws.amazon.com/general/latest/gr/rande.html#ak_region. |
Advanced settings
| Properties | Description |
|---|---|
| Add options |
Add additional Kinesis client configuration properties to this table. This property is optional. |
Usage
| Usage guidance | Description |
|---|---|
| Usage rule |
This component works standalone to provide the Amazon Kinesis connection configuration for the other Kinesis components in the Job. This component, along with the Spark Structured Streaming component Palette it belongs to, appears only when you are creating a Spark Structured Streaming Job. |
| Spark Connection |
You need to use the Structured Streaming Configuration tab in the Run view to define the connection to a Spark cluster for the whole Job. This connection is effective on a per-Job basis. |