Skip to main content

TDM 3.3 Release Notes

· 3 min read
Jake Cave

3.3 Major Release Items​

What's New​

Fabrication - Profiling/Multi-table Output Support​

  • Users can now link and filter by data configuration using the associated profiling output/config.
  • Additionally, configurations can be directly generated from profiling results.
  • Multiple Tables and Files can now be generated.

TDM Overview Report Generator​

  • DCS now offers the capability to produce a summary report, covering profiling, masking, validation, and other scans tailored to a DB data connection.
  • The comprehensive report can help streamline analysis, decision-making, and communication for project stakeholders. For the time being, this feature is exclusively available via the API.

Validation - Dual Configuration Support​

  • The validation scan has been upgraded to support both the existing validation configuration and the new masking configuration.
  • Users now have the ability to choose the masking config instead of the validation config, in order to ensure that the right columns are effectively masked and checked.

API Endpoints​

  • Added database load and backup

Changed​

Custom Masking Functions​

  • Python scripts can now be deployed directly via the data library in Ecosystem UI.
  • Users can update/delete their custom function scripts.

Fabrication - Generate Schema Structure​

  • Added the ability to generate schema structures. With this update, a create schema field when checked, will automatically establish tables and their respective structures.

Pattern Finder​

  • Outliers have been excluded from the standard deviation calculation to enhance precision.
  • Additionally, any duplicate indexes identified have been systematically replaced with uniformly spaced values to ensure accuracy.

Fixed​

Task Manager​

  • Fixed an error that caused special characters for URL to be double encoded.

DB Masking​

Oracle

  • Fixed escaping backslash for UNISTR function.
  • Fixed an inconsistency with masking full names that began with spaces.

MySQL

  • Resolved an issue where the conditional masking configuration for the 'Address' column in the 'where' clause was ambiguous.

Teradata

  • Improved function definitions and calls for better consistency and reduced errors.

DB Validation​

  • Added support for TOP N function with DISTINCT in Teradata.

File Masking​

XML

  • Resolved an issue where the XML masking process completed successfully, but did not generate the corresponding masked file based on unique constraints.

API​

  • Fixed an error where File Profile report request could return a 400 error.

MSSQL - Performance Update​

  • The query responsible for retrieving tables and columns in MSSQL has been optimized. Users can now expect faster and more efficient performance.

Expanded Null Exclusion List​

  • The null exclusion list, previously exclusive to delimited file masking, has been expanded to all database types.

Mask Functions​

  • Fixed an error where the masked credit card number was being truncated to 5 digits.

Decommissioned​

Data Subsetting​

  • Data Subsetting has now been decommissioned.