Jobs
The Jobs section serves as a centralized activity log for all validation and comparison executions. It helps teams verify the success of data quality checks across different datasets and environments, whether those checks involve internal validations or cross-environment comparisons.
Comparison Jobs
Comparison jobs evaluate differences between two datasets—commonly between environments like prod vs dev or staging. They are essential for pre-deployment checks, regression detection, and cross-environment consistency validation.
Comparison Jobs Filters
The Filters panel allows users to narrow down and customize comparison jobs by their Status, which are: Revoked, Pending, Success, Running, Failure.
Additionally, users can use the time frame. The Timestamp filter allows users to select a specific date or date range to view audit logs generated during that time period. You can:
Choose predefined ranges such as: Today, Yesterday, Last Week, Last Month, Last Quarter. Or select a custom date range using the calendar view.
Use the Reset option to clear the filter.
Comparison Table:
| Column | Description |
|---|---|
| Run ID | Unique identifier for the comparison job run |
| Status | Result of the comparison job (SUCCESS, FAILURE, RUNNING) |
| ,Comparison Name | Custom name given to the comparison task |
| Source & Target Dataset | Name of the datasets being compared |
| Time Taken | Duration required to complete the comparison |
| Created At | Timestamp of when the job was triggered (formatted as MM/DD/YYYY) |
Users have the option to rerun the comparison. To do so, click the ellipsis (⋮) next to the relevant comparison and select Rerun. This will trigger the comparison to run again, and the status will be updated accordingly.
When a comparison or validation job fails, users can click the expand icon view a error message. This error message provides detailed insight into what failed
Validation Jobs
Validation jobs focus on verifying the quality of data within a single dataset. Each row in the job result captures a specific check and its outcome. This is useful for ensuring completeness, accuracy, and consistency in source datasets before they’re moved downstream.
Validation Jobs Filters
The Filters panel allows users to narrow down and customize comparison jobs by their Status, which are: Revoked, Pending, Success, Failure.
Validation Table:
| Column | Description |
|---|---|
| Run ID | Unique identifier for the validation job group |
| No of Validations | Total number of validations performed in the job |
| Status | Result of the validation job (SUCCESS, FAILURE, RUNNING) |
| Time Taken | Duration required to complete the validation process |
| Started At | Timestamp when the validation job was started. |
| Created At | Timestamp when the validation job was triggered (formatted as MM/DD/YYYY) |
Users have the option to revoke the validation. To do so, click the ellipsis (⋮) next to the relevant validation, select Revoke, and it will revoke the validation.
Updated 12 days ago