Jobs

The Jobs section serves as a centralized activity log for all validation and comparison executions. It helps teams verify the success of data quality checks across different datasets and environments, whether those checks involve internal validations or cross-environment comparisons.

Comparison Jobs

Comparison jobs evaluate differences between two datasets—commonly between environments like prod vs dev or staging. They are essential for pre-deployment checks, regression detection, and cross-environment consistency validation.

Comparison Jobs Filters

The Filters panel allows users to narrow down and customize comparison jobs by their Status, which are: Revoked, Pending, Success, Running, Failure.

Additionally, users can use the time frame. The Timestamp filter allows users to select a specific date or date range to view audit logs generated during that time period. You can:

Choose predefined ranges such as: Today, Yesterday, Last Week, Last Month, Last Quarter. Or select a custom date range using the calendar view.

Use the Reset option to clear the filter.


Comparison Table:

ColumnDescription
Run IDUnique identifier for the comparison job run
StatusResult of the comparison job (SUCCESS, FAILURE, RUNNING)
,Comparison NameCustom name given to the comparison task
Source & Target DatasetName of the datasets being compared
Time TakenDuration required to complete the comparison
Created AtTimestamp of when the job was triggered (formatted as MM/DD/YYYY)

Users have the option to rerun the comparison. To do so, click the ellipsis (⋮) next to the relevant comparison and select Rerun. This will trigger the comparison to run again, and the status will be updated accordingly.




💡

When a comparison or validation job fails, users can click the expand icon view a error message. This error message provides detailed insight into what failed




Validation Jobs

Validation jobs focus on verifying the quality of data within a single dataset. Each row in the job result captures a specific check and its outcome. This is useful for ensuring completeness, accuracy, and consistency in source datasets before they’re moved downstream.

Validation Jobs Filters

The Filters panel allows users to narrow down and customize comparison jobs by their Status, which are: Revoked, Pending, Success, Failure.


Validation Table:

ColumnDescription
Run IDUnique identifier for the validation job group
No of ValidationsTotal number of validations performed in the job
StatusResult of the validation job (SUCCESS, FAILURE, RUNNING)
Time TakenDuration required to complete the validation process
Started AtTimestamp when the validation job was started.
Created AtTimestamp when the validation job was triggered (formatted as MM/DD/YYYY)

Users have the option to revoke the validation. To do so, click the ellipsis (⋮) next to the relevant validation, select Revoke, and it will revoke the validation.