Adding a regular expression or an SQL pattern to a column analysis
You can add to any column analysis one or more regular expressions or SQL patterns against which you can match the content of the column to be analyzed.
If the database you are using does not support regular expressions or if the query template is not defined in Talend Studio, you need first to declare the user defined function and define the query template before being able to add any of the specified patterns to the column analysis.
For more information, see Managing User-Defined Functions in databases.
Before you begin
- You have selected the Profiling perspective.
- A column analysis is open in the analysis editor.
Procedure
-
In the Analyzed Columns section in the analysis editor,
click
next to the column name to which you want to add a regular expression
or an SQL pattern, the email column in this
example.
The Pattern Selector dialog box opens. -
Save the analysis and press F6 to execute it.
The editor switches to the Analysis result view. The results of the column analysis include those for pattern matching.
Results
If the regular expression you add to the column analysis is defined for a database, you will be able to generate ELT Jobs to recuperate valid and invalid rows.
If the regular expression you add to the column analysis is defined for the Java or the Default language, you will be able to generate an ETL Job to handle rows.