Skip to main content Skip to complementary content
Qlik Resources
Loading SearchUnify's search If you need assistance with your product, please contact Qlik Support.
Qlik Customer Portal

Working with Avro schema (Confluent Registry)

Talend Data Mapper allows you to create a structure from an Avro schema stored in a Confluent Schema Registry.

Importing an Avro schema (Confluent Registry)

Before you begin

You have an Avro schema to import.

Procedure

  1. In the Data Mapper tab, expand the Hierarchical Mapper node and right-click Structures.
  2. Click New > Structure.
  3. In the wizard that opens, select Import a structure definition and click Next.
  4. Select the type of import, Avro schema (Confluent registry) in this example, and click Next.
  5. In the Host parameter, specify the URL of the Confluent Schema Registry host you want to access.
  6. If you are using the API key authentication, select API key authentication and specify your credentials in the Key and Secret parameters.
    Information noteNote: The API key is retained by Talend Studio so that it can be used automatically if you create a new structure from an Avro schema. The API secret is not retained by Talend Studio.
  7. If you are using the OAuth authentication, select OAuth authentication and specify your credentials in the Identity pool ID, Cluster ID, and Token parameters.
    Information noteNote: The Identity pool ID and cluster ID are retained by Talend Studio so that it can be used automatically if you create a new structure from an Avro schema. The token is not retained by Talend Studio.
  8. Click Next.
    All the Avro schemas are retrieved from Confluent Schema Registry.

Selecting the Avro schema to import

You can choose to import one or more schemas either by selecting them manually or by applying a filter. In the schema registry, schemas are identified by a subject and a version, and they each have a unique ID.

Procedure

  1. In the type filter text text box, type text to filter the schemas:
    • If you type only numeric characters, the filter works on the Version column
    • If you type alphanumeric characters, the filter works on the Subject column
  2. Optional: Click Preview to have a preview of the schema. It allows you to directly see the differences between two versions of a schema.
  3. Select the Show only latest versions parameter to filter out older versions of a schema.
  4. Select one or more schemas to import. You can also select Check/Uncheck all checkbox to perform the selection in one go.
  5. Click Next.
  6. Select a folder and enter a name for your structure, then click Next.
  7. Click Finish.
    The structures are created under a folder named after the subject and version of the corresponding schema. If the schema is namespaced, more folders are created to reproduce the namespace hierarchy.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here