Skip to main content

TDM 3.2 Release Notes

· 3 min read
Jake Cave

3.2 Major Release Items​

What's New​

Data Subsetting Module​

  • Data Subsetting streamlines data while upholding database rules. Therefore, removing unnecessary data whilst preserving the database integrity.

Profile Config - New "Scan by Column" Configuration Field​

  • DCS can now perform a deep scan of each non-null column instead of the whole table.

Wildcard Support​

  • Users now have the option to specify a wildcard file format (either as prefix or suffix) in data source connection.

Auto Retrieval of Date Format​

  • All DB types now automatically retrieve date format from the database. Also added default date format to auto-generated mask config.

JSON Schema Support​

  • Users can now specify a schema file for JSON files in data source connection to be used for profiling and masking.

Custom Functions​

  • Ecosystem generated custom functions have now been migrated to the DCS database. Now, users can easily access, edit, and update these functions through the Ecosystem UI in the data library.

Note: While you can create new custom functions, please keep in mind that editing or altering base functions is not supported.

Changed​

DCS API​

  • Added new endpoints to allow for backup and restoration of MongoDB data.

Enhanced Masking Logs​

  • Added "ERROR" prefix to previously unlabelled failed stages for increased clarity.

Data Subsetting​

  • Users can enable the “leave on failure” field which deletes the schema on any error.

Fixed​

Data Catalogue​

  • Resolved data catalogue error when scanning Teradata 17.20+.
  • Added error handling for unsupported file types.

DB Profiling​

  • Added bytes limit for DeepScan profiling.

DB Masking​

  • Added error handling for incorrect configs.
  • Added chunking to fixed value masking.

Teradata

  • Fixed issue of temp column not being deleted in version 17.0.
  • Improved error handling when collecting triggers.
  • Updated ODBC version to improve Linux compatibility.

Oracle

  • Now changing indexes to invisible instead of unusable prior to masking.

MySQL

  • Fixed defect where mask report was displaying incorrect pattern name.
  • Fixed defect regarding date formatting errors.
  • Fixed potential issue of special character replacement.

File Masking​

  • Updated partial masking to remove trailing spaces in source values for telephone numbers.
  • Fixed intermittent issue of error messages not showing up on XML/JSON mask report.

XML

  • Added specific error handling for missing masked files.

PostgreSQL

  • Added error messages for when no constraints are found in fixed value masking.

File Profiling​

JSON/XML

  • Fixed duplicated messages showing up in the log file.
  • Fixed percentage completed being reset for every new file.

Backend​

  • Added further error handling for running scans on unsupported data types.

Mask Functions​

  • Added further handling for scenarios where source value is the same as masked value.

Decommissioned​

  • Nothing has been decommissioned.