Incremental filter processor
Filters data incrementally to only load recent updates or additions using change detection.
The Incremental filter processor allows you to filter your columns on data changes using either the high watermark method or a time-based method in a transformation flow.
Filter properties
Properties to filter on data changes incrementally.
| Property | Configuration |
|---|---|
|
Change detection |
In the list, select the change detection method you want to use to filter on data changes. For more information, see Change detection. |
|
High watermark |
If you select this change detection method, select the Input column as well as the column to be compared with, the Target watermark column . |
|
Time-based |
If you select this change detection method, select the Input column and a specific timestamp in Last to detect changes made to this column since the selected time. |
To rename the processor, click the 
Edit icon that is displayed when hovering over the default name of the processor.
To edit its description, click the Edit icon that is displayed when hovering over Description.