Filtering and aggregating table columns directly on the DBMS
The following scenario creates a Job that opens a connection to a MySQL database and:
-
populates a database table with the input data,
-
creates the output table for the filtered data,
-
instantiates the schema from a database table in part (for column filtering),
-
filters two columns in the same table to get only the data that meets two filtering conditions,
-
collects data from the filtered column(s), grouped by specific value(s) and writes aggregated data in a target database table.