Skip to main content Skip to complementary content

Defining a data model for the campaign

Create a data model to determine the structure of the data to be managed in the Reconciling client data campaign. This campaign helps data stewards to merge redundant client data coming from different systems.

Data Stewardship has data model awareness which makes syntactic and semantic validation of data possible. Therefore, a campaign relies on a data model to ensure that the data matches the expected structure and format.

About this task

Define the attributes in the data model and select their types out of a predefined standard or semantic types

Procedure

  1. Log in as a campaign owner.
    You can also create data models if the role assigned to you in Talend Management Console has permissions to add and manage data models.
  2. Select Data models > Add data model.
  3. Enter a name and a description for the new model in the Name and Description fields respectively. Optional fields are marked with * next to their names.
  4. In the Attributes section, define the columns you want to have in the data model as the following:
    1. In the Identifier field, enter the technical identifier for the first column.
    2. Enter a name and a description for the column in the corresponding fields, if needed.
      What you set in the Name field is the name displayed in the task list. If no name is set, the technical identifier will be displayed.
    3. From the attribute type list, select the type of the column.
      Column types in the attribute type list.

      Standard and semantic types are integrated in the application by default.

      • For the standard types, additional fields are displayed according to the type you select. These fields are optional and they enable you to define some constraints on the attribute you define such as defining a minimum and/or maximum length or defining a pattern against which to validate the attribute.

        To make sure the entire value matches your validation pattern, it is best practice to surround the validation pattern with ^ and $.

        Some examples:
        • [A-Z] matches A and ABC.
        • ^[A-Z]$ matches A but does not match ABC.

        For Date and Timestamp columns, you have access to a date and time picker which helps you set the date and time automatically in the right format.

      • For the semantic types, you can use the Talend Dictionary Service to manage the semantic types. However, the availability of this service depends on the license you have.
  5. Toggle the Define list of values option to display fields where you can set specific values for the attribute.
    Any values that are not in this list are marked as invalid in the task list.
  6. Optionally, toggle the Allow empty values option to disable the upload of empty fields. This option is enabled by default.
  7. Click Add attribute and repeat the above steps to create all the columns you need in the data model.
    Information noteTip: In the Rules tab, you can apply data quality rules. A data quality rule is a set of business requirements which helps you detect anomalies in campaigns. It defines the values your data must comply with. A condition can be added to make the data quality rule apply to some data only. For more information, see the Working with data quality rules.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here