Defining a data model for the campaign
Create a data model to determine the structure of the data to be managed in the Reconciling client data campaign. This campaign helps data stewards to merge redundant client data coming from different systems.
Data Stewardship has data model awareness which makes syntactic and semantic validation of data possible. Therefore, a campaign relies on a data model to ensure that the data matches the expected structure and format.
About this task
Procedure
-
In the Attributes
section, define the columns you want to have in the data model as the
following:
-
From the attribute type list, select the type of the
column.
Standard and semantic types are integrated in the application by default.
- For the standard types, additional fields are
displayed according to the type you select. These fields are
optional and they enable you to define some constraints on the
attribute you define such as defining a minimum and/or maximum
length or defining a pattern against which to validate the
attribute.
To make sure the entire value matches your validation pattern, it is best practice to surround the validation pattern with ^ and $.
Some examples:- [A-Z] matches A and ABC.
- ^[A-Z]$ matches A but does not match ABC.
For Date and Timestamp columns, you have access to a date and time picker which helps you set the date and time automatically in the right format.
- For the semantic types, you can use the Talend Dictionary Service to manage the semantic types. However, the availability of this service depends on the license you have.
- For the standard types, additional fields are
displayed according to the type you select. These fields are
optional and they enable you to define some constraints on the
attribute you define such as defining a minimum and/or maximum
length or defining a pattern against which to validate the
attribute.
-
From the attribute type list, select the type of the
column.