Skip to main content

TDM 3.8 Release Notes

· 4 min read
Jake Cave

3.8 Major Release Items​

What's New​

Introducing the Data Factory​

Our Data Fabrication and Dataview modules are now unified under the new Data Factory.
This powerful upgrade automatically scans your custom queries to build data generation rules — using lookups, regex, and a new built-in Faker module to generate realistic test data automatically.
This enhancement makes it even easier to create rich, meaningful datasets for development and testing while protecting sensitive information.

Python 3.11 Support​

TDM now runs on Python 3.11, bringing performance improvements, enhanced compatibility, and updated security patches that address known vulnerabilities in older versions.
This upgrade ensures a more secure and efficient runtime environment.

Masked File Directory​

Users can now define the Masked File Directory field for masked files in file-based data connections — giving you more control over where your processed data lands.

Changes​

OracleDB Driver Update​

Replaced the legacy cx_Oracle module with the modern oracledb (v2.3.0), aligning with Oracle's latest recommendations for improved compatibility, supportability, and future-proofing.

Default Post-Mask Validation​

Set post-mask validation to default as True for all manually and auto-created masking configurations, ensuring consistency and helping catch issues early.

Fixed Issues​

Reporting & Logging​

  • Addressed an issue where report and log database sizes could grow disproportionately large relative to the number of scans executed.

File & XML Handling​

  • Improved file masking logic to skip files with no active columns, avoiding unnecessary reads and improving performance.
  • XML Validation now correctly returns exceptions when renaming files, instead of failing the entire operation.

Byte Limit Optimisations​

  • Optimised the byte limit when retrieving table data, preventing memory overflows during Database profiling.

DB2 Profiling String Handling​

  • TDM now handles certain data attributes when profiling DB2 databases. Specifically, the type casting for TYPENAME and LENGTH fields is now correctly treated as strings.

Teradata Masking Resilience​

  • Fixed masking failures on columns with char data types.
  • Enhanced session settings to use the UNICODE charset, resolving issues with untranslatable characters and improving support for multilingual data.

Deprecation Notice​

Parameter Field in Pattern Configuration​

We are deprecating the use of the Parameter field in the Pattern Configuration UI.
Starting from the next Major release (v3.9), configurations using this field will no longer be supported.
This change is part of a system-wide update to streamline and standardise masking logic via structured configuration options under Additional Configuration.

What You Need To Do​

  • Migrate any masking logic or values currently set under the Parameter field into the appropriate fields, such as Fixed Value, Chunk Size, or other relevant options that were previously supported by the Parameter field.
  • Review your saved configurations and update them before the next release date to avoid any disruption.

3.8.1​

Release Date: 30th July 2025

What's New​

Custom Fabrication Functions
You can now define custom Python functions within the Data Library's Fabrication module. This gives you full control over data generation, making it easier to produce complex or highly specific test data for your environment.

Changed​

Health Check API

  • Introduced the /api/health endpoint alias to simplify server readiness checks for external monitoring tools and integrations. See the TDM REST API documentation for detailed information about this endpoint.

Fixed​

Data Factory​

  • Resolved a failure when using the FULLNAME generator with a function-based fabrication type.
  • Generated CSV files now include the correct file extension by default.

DB2 Masking​

  • Masking now gracefully handles BIGINT failures and avoids silent crashes.
  • Fixed failures in conditional masking when using both LIKE and standard conditions.
  • Resolved issues with temp table creation for integer types.

Delimited Files​

  • Masking logs now correctly report inactive columns when present.

MySQL Profiling​

  • Certain unsupported data types are now correctly flagged and skipped.

DB2 Profiling​

  • Improved handling of TYPENAME and LENGTH casting.

Reporting & Validation​

  • Masking report logic now validates inactive columns before applying fail conditions.

3.8.2​

Release Date: 22nd August 2025

Fixed​

MSSQL Profiling​

  • Fixed MSSQL profiling connection issues on RHEL 8 when using Windows Authentication with Kerberos, improving reliability for domain-authenticated servers.

Teradata Connection​

  • Improved handling of special characters in credentials to ensure smoother and more reliable Teradata connections.

Fixed Value Masking​

  • Addressed issues with Other category pattern, specifically Replace_with_Null and Replace_with_empty.

Mask Config Import​

  • Improved handling of importing large masking configurations with over 1,000 patterns, optimizing memory usage to prevent page crashes and ensure smoother processing.