Skip to main content

TDM 3.6 Release Notes

· 3 min read
Jake Cave

3.6 Major Release Items​

What's New​

File Connection - Azure & S3 Support​

  • Users can now connect to and process files stored on both Amazon S3 and Azure.
  • Allows for profiling, masking, and validation directly from these cloud storage providers.

Profile Config - Multi-threading with Configurable Thread Count​

  • Multi-threading is now available in the profile configuration screen.
  • Users can set a thread count for faster profiling, provided the database supports it. This will significantly speed up the profiling process for large datasets.

Compliance Report Generator - Multiple Data Connections in One Report​

  • The TDM Report Generator has been enhanced to support multiple data connections within a single report.
  • Provides more comprehensive insights and flexibility in reporting.

Conditional Masking 'Like' Query​

  • New functionality allows users to apply conditional masking based on SQL 'LIKE' queries.
  • Enables the exclusion or inclusion of specific rows based on text patterns.

Group Feature for Data Connections​

  • Data connections can now be linked together into groups.
  • Allows users to perform group profiling, masking, validation, and reporting. This enables more efficient workflows for large-scale data management.
  • Enable the TDM Queue Manager to make use of this new feature!

Data Connection Bulk Upload/Update​

  • New feature allows users to upload or update multiple data connections in bulk.
  • Streamlines the management of large data environments.

New TDM API Endpoint - Get Logs and Reports​

  • A new API endpoint is available to retrieve the JSON version of logs and reports.
  • Allows users to programmatically access profile report data.

Changes​

Improved Performance for Masking Large Files​

  • Optimized chunk size for file masking, particularly for configurations exceeding 10,000 records.
  • Results in better performance and scalability for large file masking operations.

File Validation - Unsupported Pattern Handling​

  • A new validation mechanism compares the difference between the original and masked files when the pattern of the column is unsupported.
  • Ensures data integrity during masking.

Fixed Issues​

DOB Masking - ORACLE​

  • Addressed issues related to Date of Birth (DOB) masking.
  • Ensured more consistent and accurate masking results across various configurations.

Data Generator - Name Field Order​

  • Resolved an issue where the Data Generator was incorrectly ordering 'Full Name' with first and last names.

Masking Performance for Large Datasets​

  • Improved performance when masking datasets with over 40 million rows.
  • Reduced processing times and improved system scalability.

JSON Masking Performance​

  • Resolved an issue causing slower-than-expected performance and inconsistent results during the masking of JSON files.