Skip to main content Skip to complementary content

Kafka properties

Properties to configure to connect to a Kafka cluster. Supported Kafka versions are v0.10.0.x to v1.1.x.

Kafka connection

Select Kafka in the list and configure the connection.

Configuration

Select your engine from the list and set the main and advanced settings.

Connection settings
Property Configuration
Bootstrap servers Enter the addresses of the broker nodes of the Kafka cluster to be used.

Example: kafka1.example.com:9092

If you need to specify several addresses, separate them using a comma.
Use SSL Toggle this option ON to enable the SSL encrypted connection:
  • In the Truststore type list, select the Truststore type to be used.
  • In the Truststore path field, enter the path to the certificate TrustStore file (including file name) that contains the list of certificates that the client trusts.
  • In the Truststore password field, enter the password used to check the integrity of the TrustStore data.

By default, the Verify hostname toggle is ON.

(Optional) You can toggle the Need client auth ON to validate the customer data. To do so, fill the following parameters:
  • In the KeyStore type list; select the type of the keystore to be used. It may be PKCS 12 or JKS.
  • In the Keystore path field, enter the path to the certificate TrustStore file (including file name) that contains the keystore data.
  • In the Keystore password field, enter the password for this keystore.
Use SASL Toggle this option ON to enable the SASL encrypted connection.
  • In the JAAS config field, enter the Java Authentication and Authorization Service login module to be used.
  • In the SASL login class field (optional), enter the login class (for clients and brokers).
  • In the SASL login callback handler class field (optional), enter the login callback handler class (for clients and brokers).
  • In the SASL client callback handler class field (optional), enter the client callback handler class (for clients and brokers using SASL for inter-broker communication).
  • In the SASL type list, select the authentication mechanism to be used.

For more information, read the SASL configuration documentation.

After configuring the connection, give it a display name (mandatory) and a description (optional).

Kafka dataset

Property Configuration
Dataset name Enter a display name for the dataset. This name will be used as a unique identifier of the dataset in all Talend Cloud apps.
Connection Select your connection in the list. If you are creating a dataset based on an existing connection, this field is read-only.
Topic name Enter or select the name of the topic (file) to be retrieved.
Value format Select in the list the format of the data to be retrieved:
  • Avro: If you select this format, you need to enter the schema of the Avro records to be retrieved.
  • CSV: If you select this format, you need to indicate the type of field delimiter used in the file.
  • JSON: No specific parameters required for this format.

In this section

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here