Record count is calculated for external entities (representation of external source Loads upon ingest) from load logs. Due to varying Total Counts resulting from whether Entity Type is Snapshot or Incremental, users are able to select Total Record Counts across all loads and Latest Record Counts for just most recent load. The metrics populate in source entity grids if they have been selected as visible columns in Profile then User Preferences.
Record count options for totals across all loads are: Total Record Count, Good Record Count, Bad Record Count, and Ugly Record Count.
Record count options for the latest load are: Latest Total Record Count, Latest Good Record Count, Latest Bad Record Count, and Latest Ugly Record Count.
These external entity counts are derived from load log record counts across all loads. They are calculated when data load yype is DATA, STATISTICS, STALE and the job status is FINISHED.
Note that record counts for data load type Append and Overwrite are not factored into the record counts because in these cases, the original data load log/record count is resolved with the Append (added) or Overwrite (replaced) records. Therefore, these counts are already represented in the total counts.
The purpose of offering
Note that internal entity counts (in discover module) will most always differ from those displaying in external entity (source) grids. This is because the counts for Internal Entities are calculated from metrics created at the time of data load— the counts displaying on Internal Entities are the net counts that users will see when they query hive (in contrast, external entity counts are derived from load logs). For more information on how record Counts for internal entities are derived, see Discover: Displaying Record Counts for Internal Entities.