Skip to main content

TDM 3.8 Release Notes

· 3 min read
Jake Cave

3.8 Major Release Items

What's New

Introducing the Data Factory

Our Data Fabrication and Dataview modules are now unified under the new Data Factory.
This powerful upgrade automatically scans your custom queries to build data generation rules — using lookups, regex, and a new built-in Faker module to generate realistic test data automatically.
This enhancement makes it even easier to create rich, meaningful datasets for development and testing while protecting sensitive information.

Python 3.11 Support

TDM now runs on Python 3.11, bringing performance improvements, enhanced compatibility, and updated security patches that address known vulnerabilities in older versions.
This upgrade ensures a more secure and efficient runtime environment.

Masked File Directory

Users can now define the Masked File Directory field for masked files in file-based data connections — giving you more control over where your processed data lands.


Changes

OracleDB Driver Update

Replaced the legacy cx_Oracle module with the modern oracledb (v2.3.0), aligning with Oracle’s latest recommendations for improved compatibility, supportability, and future-proofing.

Default Post-Mask Validation

Set post-mask validation to default as True for all manually and auto-created masking configurations, ensuring consistency and helping catch issues early.


Fixed Issues

Reporting & Logging

  • Addressed an issue where report and log database sizes could grow disproportionately large relative to the number of scans executed.

File & XML Handling

  • Improved file masking logic to skip files with no active columns, avoiding unnecessary reads and improving performance.
  • XML Validation now correctly returns exceptions when renaming files, instead of failing the entire operation.

Byte Limit Optimisations

  • Optimised the byte limit when retrieving table data, preventing memory overflows during Database profiling.

DB2 Profiling String Handling

  • TDM now handles certain data attributes when profiling DB2 databases. Specifically, the type casting for TYPENAME and LENGTH fields is now correctly treated as strings.

Teradata Masking Resilience

  • Fixed masking failures on columns with char data types.
  • Enhanced session settings to use the UNICODE charset, resolving issues with untranslatable characters and improving support for multilingual data.

Deprecation Notice

Parameter Field in Pattern Configuration

We are deprecating the use of the Parameter field in the Pattern Configuration UI.
Starting from the next Major release (v3.9), configurations using this field will no longer be supported.
This change is part of a system-wide update to streamline and standardise masking logic via structured configuration options under Additional Configuration.

What You Need To Do

  • Migrate any masking logic or values currently set under the Parameter field into the appropriate fields, such as Fixed Value, Chunk Size, or other relevant options that were previously supported by the Parameter field.
  • Review your saved configurations and update them before the next release date to avoid any disruption.