Skip to main content

21 posts tagged with "changes"

View All Tags

· 3 min read
Rohit Gupta

What's New

Attachments

Users now have the ability to attach files to Projects, Bookings, Environment Events, and Service Requests via forms. The maximum file size allowed is 2 MB.

Blueprints

Introducing the ability to create environment blueprints and personalized environment process diagrams.

Pipeline

A new feature in DevOps Manager empowers users to create custom visual automation pipelines

DevOps Addons

Pre-built integration addons are now available to enhance your DevOps library.

Homepage Themes

Users can now personalize their homepage view by selecting from a variety of themes such as Classic, Release, and TDM

My Business Unit

This feature enables users to associate themselves with their respective business units, providing filter options on reports that allow viewing data specific to their business units.

Changes & Enhancements

Connectivity View

System Dependency view option has been added in this report to allow users to view system to system relationship.

Project Environment View

Project Filter has been added to provide more filter options.

Enhanced Reports

Several reports have been revamped with a fresh new look, including:

  • Manage WorkItems (Project Management >> Management)
  • Access Management (Configuration Management >> Add Data)
  • Booking Approval Queue (Booking Management >> Management)
  • Runsheet Activity (Event Management >> Reports)

Analytics Sub Module

A new submodule has been introduced in the Environment Management module, and the following reports have been moved to this module:

  • Deployed Versions
  • Environment Drift
  • Environment Cost (Renamed from IT Proliferation)
  • Tag Matrix

CSV View (Data Brick)

Support for column search has been added to the CSV View, enhancing the usability of this data brick.

Service Dashboard

The Service Dashboard has been enriched with new widgets and a date range capability.

Implementation Insight

This report has been moved to Implementation node

Report Renamed - The following reports has been renamed

  • Manage PI Plans -> Manage PI Milestones
  • Manage Project Plans -> Manage Project Milestones
  • Environment Insight -> Insight - Environment
  • System Insight -> Insight - System
  • Instance Insight -> Insight - Instance
  • Component Insight -> Insight - Component

Post Implementation Review

PIR Module has been redesigned for Release and Projects.

Table View in Gantt Reports

Gantt reports now include a table-style view option for the following reports :

  • PI Master Plan
  • Project Milestones
  • PI Bookings
  • Project Bookings
  • Environment Bookings
  • System Bookings -Component Bookings
  • Project Events

Column Selection

Various reports have been enhanced with the ability to select and hide columns, providing users with more flexibility in customizing the view. Reports with the column selection feature include:

  • Configure Environments
  • Manage Blue Prints
  • PI Activity
  • Manage Release Trains
  • Manage PI Milestones
  • Manage Release Implementation
  • Project Activity
  • WorkItem Insights
  • Manage Projects
  • Manage Project Milestones
  • Manage Project Implementation
  • Manage Workitems
  • Manage Project PIR
  • Booking Activity
  • Booking View
  • Manage Bookings
  • Booking Approval queue
  • Event Insights
  • Manage Events
  • Event Activity
  • Runsheet Activity
  • Service Activity
  • Service Request Insights
  • Manage Servie Requests
  • Access Management
  • Organisation Management
  • Location Management
  • CMDB Management
  • Lab Configuration
  • Information Template Management
  • Data Booking Insights
  • Profile Configuration
  • Mask Configurations
  • Validate Configurations
  • Data Generator
  • Data Source Management
  • Manage Scripts
  • Manage Pipeline

· 2 min read
Jake Cave

3.1 Major Release Items

What's New

Pause/Start/Cancel

  • Database Masking executions can now be paused, resumed, and cancelled.

Kerberos Implementation

  • Now supports Kerberos authentication for MSSQL.

New Classes

  • Now supports JSON profiling and masking.
  • Now supports Parquet profiling and masking.

Data Generator Regex Functions

  • Data can now be generated using user-generated regex functions.

Advanced REST API

  • New API to obtain data such as:
    • Logs
    • Reports/Outputs
    • Metrics
    • And more

Masking Function

  • New function to mask all strings in a fullname. For example, "James Bob Smith" → "Peter Thomas Jane".

Changed

File Masking

  • Mismatch in row count between input and output file will now be logged. Since row counts can differ due to bad lines, empty lines, etc.
  • Logs now use ASCII text to clearly display breaks such as pauses and restarts.

Database Masking

Oracle

  • Will now utilize a chunking feature to break data inserts into blocks of data to increase performance and reduce transaction log.

File Masking - Delimited

  • Enhanced performance when masking multiple large files, along with optimized memory usage.

Fixed

Database Masking

Redshift

  • Fixed issue where string values were being skipped if they included quotes.

Decommissioned

  • Nothing has been decommissioned.

· One min read
Rohit Gupta

What's New

Service Request Form (Notification List)*

With this new feature, users can now enable input for a notification list that will receive updates regarding any changes made to a ticket.

Booking Request Form (Booking Name)*

This feature allows user to provide their own booking name.

Changes & Enhancements

Project Request Form

The Business Unit field is now optional, and no longer mandatory.

Booking Request Form

The start date will now be automatically set to the current date when selecting a project, instead of a past date.

Configure Environments

Enabled Labels for System Interface Listing.

Package Deployment Tracker (Data Brick)

We have added support for the deployment of packages across multiple system instances of different systems.

Shared URL

Shared URLs for reports can now be bookmarked, and will no longer auto-resolve.

Project Plan

The issue with project creation for projects not linked to PI has been resolved.

Connectivity View (System View)

The incorrect version information has been fixed.

Environment Insight

The report was showing all events for the environment. It has now been fixed to show current events only.

· One min read
Jake Cave

2.9.3

Release Date: 1st April 2023

What's New

Masking Function

  • New function to mask all strings in a fullname. For example, "James Bob Smith" → "Peter Thomas Jane".

Changed

File Masking - Fixed Width

  • Fixed issue where malformed first rows were not being masked.
  • Fixed issue where unique ID masking was not working for all pattern types.

File Profiling - Fixed Width

  • Fixed format of output file to match other file types.

Masking - Lookup

  • Changes to obtain TFN lookup more effectively.

DataConnection - Redshift

  • When editing the connection, previously saved information was not being displayed or the save was corrupted.

Validation

  • Fixed issue where CSV export for validation reports was displaying 'undefined patterns' when not found.

· 2 min read
Rohit Gupta

What's New

Information Template

This feature allows you to design input forms to capture additional information as part of user requests.

DevOps Manager

  • GIT Integration- New Feature allowing you execute scripts directly from your GIT repository.
  • Folder Management - New Feature allowing you to create or manage folders and files within your scripts in file explorer.

Webhook DevOps Integration

This new feature allows you to call DevOps Script on a webhook call.

Project PI Planning

This feature allows projects to plan and track their activities for the release train.

Package Deployment Tracker

This new data brick allows you to keep track of all the package deployment status across your different environments.

Release Milestone Tracker

This new report will allow release manager to track how projects are progressing with their release activities.

Changes & Enhancements

Connectivity View

System view has been enhanced to use different symbols for systems, instances and components.

Enhanced Reports

These reports have been revamped to support new fresh look.

  • Configure Environments (Environment Management >> Management)
  • Environment Activity (Environment Management >> Management)
  • PI Activity (Release Train Management >> Reports)
  • Manage Release Trains (Release Train Management >> Management)
  • Manage PI Plans (Release Train Management >> Management)
  • Project Activity (Project Management >> Reports)
  • Project Demand (Project Management >> Reports)
  • Manage Projects (Project Management >> Management)
  • Booking Activity (Booking Management >> Reports)
  • Booking Queue (Booking Management >> Reports)
  • Manage Bookings (Booking Management >> Management)
  • Event Activity (Event Management >> Reports)
  • Manage Events (Event Management >> Management)
  • Service Activity (Service Management >> Reports)
  • Manage Service Requests (Service Management >> Management)

Booking Gantt Reports

Additional Filter to view data by System Instance Assigned To

User Groups

Ability to send emails to user group email address

Bulk Upload

Added feature to automatically remove unsupported characters from CSV

Deployed Version Dashboard

  • Ability to see multi instance details in the same environment on hover.
  • Added ability to view data by"Environment" & "Environment Type"

Environment Connectivity (System Instance View)

This view was showing decommissioned objects which has been fixed now.

Decommissioned

Release Train Management >> Management

  • PI Editor

Project Management >> Management

  • Project Editor

· 4 min read
Jake Cave

2.9 Major Release Items

What's New

Base DCS - Redshift Support

  • Added support for Redshift in Base DCS.

File Masking

  • Conditional masking has been added for all file types.
  • Optimizations made by using chunking when masking delimited files.

Data Compliance Insight

  • View your data operation execution reports across different data sources and types.

Data Connection Insight

  • Centralized view to monitor your data source status and execute different data operations from a single view.

REST API

  • Ecosystem API endpoints for DCS jobs.

Data Bricks

  • New data widgets in custom dashboards.

Changed

Data Source Management

  • The "Link with System Components" option has been removed and replaced with labels.

PII Splatter Board

  • The redesigned view allows users to search for PII compliance across different data sources.

Execution Queue

  • View the current status of all data operation executions.

Fixed

Global

  • Extended global timeout for database type Couchbase.

Database Masking

  • Fixed issue where Oracle tables might not be compressed correctly.
  • Altered Oracle queries used in masking to allow for larger DDL queries to be saved.
  • Resolved bug where masking an empty column did not display the correct error.

File Profiling

  • Log updates for delimited file type now work correctly in all scenarios.

File Masking

  • Fixed issue with delimited files where quotes were not retained if the value contained a comma (e.g., "hello, world").
  • Resolved bug where an incorrect engine was used to read delimited files.
  • Fixed issue where result count could be incorrect for delimited and fixed-width file types.
  • Added better handling for delimited file masking when dealing with bad inputs.

Decommissioned

  • Data Compliance
  • Compliance Dashboard
  • Profile Dashboard
  • Validate Dashboard
  • Masking Dashboard

2.9.1

Release Date: 1st October 2022

Changed

File Masking - Delimited

  • Enhanced progress updates for delimited file masking. The process now incorporates folders and the size of a file to report an accurate percentage of completion.

File Masking

  • Improved chunking algorithm to strengthen performance. Masking is now based on distinct values found: if greater than 1 million, masking is based on distinct values; otherwise, it is based on row count.

AWS Redshift

  • Reworked logic involving vacuums to maximize performance on masking.

Fixed

Database Masking

  • Performance improvements for databases with large counts of distinct values. The reworked algorithm constitutes improvements for the following database types:

    • MSSQL
    • MySQL
    • MariaDB
    • PostgreSQL
    • AWS Redshift
    • Teradata
  • Resolved a rare bug when masking full names where many-to-one masking returned an index error.

File Masking - XML

  • Improvement in the file gathering process when conducting a folder mask.
  • Revised algorithmic changes to update recursion when failing on edge cases.

File Masking - Delimited

  • Resolved issues related to breaking due to unique characters, such as certain Chinese characters.
  • Resolved a TFN masking bug on RedHat 8.1 systems.

Masking - Oracle

  • Improvements to masking diagnosis to resolve merging conflicts with special characters.
  • Enhanced trigger enabling/disabling when multiple correlated triggers are attached to one table.

Profiling - AWS Redshift

  • Now only retaining tables of the required "type" and excluding types such as views.

DCS Base

  • Fixed temporary table logging issues when failing in rare cases.

2.9.2

Release Date: 1st February 2023

Changed

File Masking - Delimited

  • Enhanced performance when masking multiple large files, along with optimized memory usage.
Database Masking - Oracle
  • Will now utilize a chunking feature to break data inserts into blocks of data to increase performance and reduce transaction log.

File Masking

  • Mismatch in row count between input and output file will now be logged. Since row counts can differ due to bad lines, empty lines, etc.

Fixed

Database Masking - Redshift

  • Fixed issue where string values were being skipped if they included quotes.

File Masking - Delimited

  • Fixed issue where empty space values were being masked.
  • Resolved issue where values starting with escape characters or empty space were being skipped.
  • Fixed reporting structure to accurately convey when a column is masked multiple times in one scan.

Profile Scanner - Oracle

  • Fixed wildcard functionality to incorporate rules to abide by include/exclude table functionality.

Decommissioned

  • Nothing has been decommissioned.

· One min read
Jake Cave

What's New

Insights

  • Addition of Data Bricks and Data Booking Insights views.

DataView

  • New Action forms for View Windows and View Configuration that allow bookings to be added and viewed.
  • Addition of Manage Data Booking view.

Queue Manager

  • All DCS scripts will now be placed in a queue if the queue manager is enabled.

Profiling, Masking, Validation, Data Fabrication

  • Config Comparison feature added.
  • Other minor UI adjustments.

Fixed

Masking

  • Resolved permission issues when accessing/creating folders for output and logging.
  • Fixed issue where masking could fail on compressed tables for database type Oracle.
  • Addressed issue when merging tables during masking for database type MySQL.
  • Fixed issue where masking could fail when using some functions for type File - Delimited.

Validation

  • Fixed issue where validation patterns could not be created due to incorrect date format.

Data Generator

  • Resolved issue when generating fake credit card numbers.

Exec Scan

  • Fixed script failure under certain conditions for database type Oracle.

· One min read
Jake Cave

What's New

Masking

  • Support for nullable CLOB and BLOB masking has been added for Oracle.
  • Added DCS widgets to custom dashboards.
  • Introduced a Meta-only scan, which is triggered if the configuration list is left empty.
  • The SQL Server 'Windows Authentication' login method is now available for Windows-hosted instances.
  • Data configurations can now be exported and imported as CSV files.

Fixed

Data Fabricator

  • Improved functions for generating random credit card numbers.

Profiling

  • Enhanced logging for errors, such as failed schema collection.
  • Resolved issue where profiling was attempted on 'unprofilable' columns (e.g., Raw and Long Raw types in Oracle).
  • Fixed issue where include/exclude rules failed due to mismatched letter cases.

Masking

  • Masking functions with large value lookups now dynamically trim values to fit the column definition.

· One min read
Jake Cave

What's New

Meta Scanning

  • Meta scanning now displays the matched category instead of "found."

Import/Export Configurations

  • Import and export of configurations are now available, facilitating faster bulk updates.

Reporting

  • Added filters to various reports.
  • Included row count in profile reports.

Fixed

MSSQL

  • Resolved issue with column collection when columns contained special characters (e.g., $ or [).

General

  • Fixed bug where values were not correctly replaced with NULL fields.
  • Corrected Teradata .csv report issue related to decimal data lengths.
  • Fixed issue where CLOB and NCLOB types could be profiled in Oracle.
  • Addressed bug where cancelling profiling did not stop the process under certain conditions.
  • Fixed issue where disabling triggers did not affect all existing triggers.

· 2 min read
Jake Cave

What's New

File Masking and Profiling

  • File masking and profiling now support multiple files and directories.

DCS Masking and Profiling

  • Can now handle multiple headers and footers in a single file.
  • Allows the choice of delimiter within quotes.

Memory Management

  • Added memory limit for obtained table data and the ability to skip large data types in profiling.

Database Triggers

  • Database triggers can now be disabled prior to masking.

Fixed

General

  • Large profiles could previously fail to generate a report.
  • Include/exclude rules could incorrectly read tables from other schemas if a table name was duplicated.

XML File Masking

  • Configurations could not be edited for XML file masking if the file path contained backslashes.

DCS Configuration

  • Fixed timeout issue within DCS configuration windows.

Teradata

  • Resolved minor defects in Teradata masking.

MongoDB

  • Profiling and validation could fail when MongoDB was used as the data source.

Data Sources

  • Corrected response issue with the Check Connection function for data sources.

Changed

Profile Execution Filter

  • The Profile Execution Filter has been changed from a dropdown menu to a calendar widget.

Empty Tables Reporting

  • When removing empty tables in profiling, the number of empty tables is now reported.

Pattern Search Status

  • The Execute Pattern Search Status now refreshes automatically.