Amazon Kinesis properties

Properties to configure to connect to an Amazon Kinesis stream.

Amazon Kinesis is unidirectional and can only be used as a source dataset in your pipeline.

Amazon Kinesis connection

Select Amazon Kinesis in the list and configure the connection.

Select your engine from the list and set the main and advanced settings.

Connection settings
Property	Configuration
Specify credentials	Toggle this option OFF if your authentication type does not require credentials. By default, the authentication with credentials is enabled.
AWS access key	Enter the Amazon Access Key ID that uniquely identifies your AWS Account. To know how to get your Access Key and Access Secret, read Getting Your AWS Access Keys.
AWS secret key	Enter the Secret Key that uniquely identifies your AWS Account. To know how to get your Access Key and Access Secret, read Getting Your AWS Access Keys.
Specify Kinesis endpoint	Toggle this option ON to enter the endpoint of the Kinesis service to be used. For example, `https://kinesis.us-east-1.amazonaws.com`. More valid Kinesis endpoint URLs can be found in the Amazon documentation.
Use STS	Toggle this option ON to enable the AWS Security Token Service and create a new assumed role session: In the ARN Role field, enter the Amazon Resource Name (ARN) of the role to assume. In the Role session name field, enter an identifier for the assumed role session. (Optional) Toggle the Specify STS endpoint ON to specify the AWS Security Token Service endpoint where the session credentials are retrieved from. (Optional) Toggle the Specify external role ID ON to enter the external ID of a third-party that will access your AWS resources. For more information, see the Amazon documentation.

After configuring the connection, give it a display name (mandatory) and a description (optional).

Dataset configuration
Property		Configuration
Dataset name		Enter a display name for the dataset. This name will be used as a unique identifier of the dataset in all Talend Cloud apps.
Connection		Select your connection in the list. If you are creating a dataset based on an existing connection, this field is read-only.

Dataset settings
Property	Configuration
AWS region	Select in the list an available AWS region.
Stream	Select or enter the name of the Kinesis stream you want to pull data from.
Value format	Select in the list the format of the data to be retrieved: Avro: If you select this format, you need to enter the schema of the Avro records to be retrieved. CSV: If you select this format, you need to indicate the type of field delimiter used in the file.

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!