Generating the matching model

Procedure

Double-click tMatchModel to display the Basic settings view and define the component properties.
In the Matching Key table, click the [+] button to add rows in the table and select the columns on which you want to base the match computation.
The Original_Id column is ignored in the computation of the matching model.
Select the Save the model on file system check box and in the Folder field, set the path to the local folder where you want to generate the matching model file.
Select the Integration with Data Stewardship check box and set the connection parameters to the Talend Data Stewardship server.
1. In the URL field, enter the address of the application suffixed with /data-stewardship/, for example http://localhost:19999/data-stewardship/.
  
  If you are working with Talend Cloud Data Stewardship, use the URL for the corresponding data center suffixed with /data-stewardship/ to access the application, for example, https://tds.us.cloud.talend.com/data-stewardship for the AWS US data center.
  
  For the URLs of available data centers, see Talend Cloud regions and URLs.
2. Enter your login information to the server in the Username and Password fields.
  To enter your password, click ... next to the field, enter your password between double quotes in the dialog box that opens and click OK.
  If you are working with Talend Cloud Data Stewardship and if:
  - SSO is enabled, enter an access token in the field.
  - SSO is not enabled, enter either an access token or your password in the field.
3. Click Find a campaign to open a dialog box which lists the campaigns defined in Talend Data Stewardship and for which you are the owner or you have the access rights.
4. Select the campaign from which to read the grouping tasks, Sites deduplication in this example, and click OK.
Click Advanced settings and set the below parameters:
1. Set the maximum number of the tokens to be used in the phonetic comparison in the corresponding field.
2. In the Random Forest hyper parameters tuning, enter the ranges for the decision trees you want to build and their depth.
  These parameters are important for the accuracy of the model.
3. Leave the other by-default parameters unchanged.
In the Batch Size field, set the number of tasks you want to have in each commit.
There are no limits for the batch size in Talend Data Stewardship (on premises). However, do not exceed 200 tasks per commit in Talend Cloud Data Stewardship, otherwise the Job fails.
Press F6 to execute the Job and generate the matching model in the output folder.

Results

You can now use this model with the tMatchPredict component to label all the duplicates computed by tMatchPairing.

For further information, see Labeling suspect pairs with assigned labels.

For further information, see the online publication about labeling suspect pairs on Talend Help Center (https://help.talend.com).

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here