Validation
Overview of Validation
The last step of the process is to Validate (Audit) your Data Source to see if production patterns are still present (Indicating whether unmasked production data may still be present in the data or not). After successfully profiling the data a draft configuration file is automatically created for review prior to execution.
Validation Configuration
The rulesets and patterns scanned as part of the validation process are defined in Validation Configurations.
NOTE: Support for validation configuration will be discontinued in future releases. Users are highly encouraged to use masking configurations for performing validation scans.
For DCS version 3.5:
Navigate to Data Management Hub > Manage Configurations > Validation Configurations. Here you can Add, Edit, Clone or Delete a Validation Configuration.
For DCS versions 3.4 and earlier:
Navigate to Validation > Validate Configurations here you can Add, Edit, Clone or Delete a Validation Configuration.
Editing a Validation Configuration
As the masking process creates a draft Validation Configuration, click the Edit button on the validation configuration you want to edit. This will present the Validation Configuration form for editing the following information.
For DCS version 3.5:
For DCS versions 3.4 and earlier:
On the form you can edit the following configuration information.
| Type | Description |
|---|---|
| Configuration Name | The validation configuration name. |
| DB Source Connection | The data source the validation configuration is configured for. |
| Default Threshold | Percentage or threshold data must meet to be flagged as PII found. |
| Description | The validation configuration description or long name. |
| Notification | List of users who will be notified. |
| Status | Set the validation profile to Active for use or Draft/Inactive to hide it from the Execute Validation area. |
Add/Edit Field(s) section: -
| Type | Description |
|---|---|
| Category | The field masking category. (This filters the results visible in the Pattern drop list). |
| Table Name | The table the column/field is on for masking. |
| Column Name | The column/field for masking. |
| PII Level | For viewing/setting the masking pattern as Primary PII, Secondary PII, or Other. |
| Pattern | The pattern type (Masking function) as defined in the Data Library Administration area. |
| Parameter | Some pattern types/masking functions may allow a parameter to be provided to customize the masking behavior. |
Once complete, scroll to the bottom of the main window and click Save to Save the configuration or Close to Cancel out without saving.
Note: Please ensure the status is set to Active for the Mask Configuration to be selectable in the Execute Masking screen.
Adding a Validation Configuration
On the Validation Configurations screen, click the Add Validate Configuration button. This will present a new Validation Configuration form
Once complete, scroll to the bottom of the main window and click Save to Save the configuration or Close to Cancel out without saving.
Cloning a Validation Configuration
On the Validation Configurations screen, click the Clone button on the Validation Configuration you want to duplicate. This will present the Validation Configuration form with a duplication of all data for saving as a new Configuration.
Once complete, scroll to the bottom of the main window and click Save to Save the configuration or Close to Cancel out without saving.
Deleting a Validation Configuration
On the Validation Configurations screen, click the Delete button on the Validation Configuration you want to remove. This will present a confirmation window confirming that you want to delete the Configuration or not.
Comparing Validation Configurations
Tick on the check boxes in front of the two configurations which you want to compare and then press the Config Comparison button to view the comparison report. The text highlighted in red marks the differences in the two configurations.
Execute Validation
For DCS version 3.5:
To execute a new validation request, navigate to Data Management Hub > Execution Console.
Here, you can select your data source then press View. Scroll down to the Execution Details section, select Validation in the first dropdown menu, and your chosen validation/mask configuration in the second dropdown menu. The Execute button can be used to then run a validation scan or View Results to simply view the results from the previously ran validation jobs.
IMPORTANT: Validation scans can now be performed on file type data connections. However, file validation ONLY supports masking configs. Users are also highly encouraged to use masking configs for a validation execution. More information on masking configurations can be found in Masking.
For DCS versions 3.4 and earlier:
To Execute a new validation request, Navigate to Validation > Execute Validation
Here you can select a data source connection and validation Configuration for execution. Press Run button to run the selected validation configuration. On Run button press, the table list down will be refreshed with past executions and will also show the status of current execution request.
Validation Log
In the Details column, the Log button can be used to view logs for the execution.
Note: The Log window refreshes every 15 seconds if the validation is currently executing.
A currently executing validation scan can also be cancelled by clicking the Cancel button.
Validation Report
Successfully completed Validations will generate a Validation Report which can be viewed by clicking the Report button.
This can also be searched on or exported out to Excel or CSV.
