Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Containers for Enhanced Data Governance and Regulatory Compliance

DZone's Guide to

Containers for Enhanced Data Governance and Regulatory Compliance

SQL Server and .NET containers on Windows 8, 10, Server 2012, R2, and 2016! Look over the community edition of Windocks to see if these containers work for you.

· Cloud Zone
Free Resource

Site24x7 - Full stack It Infrastructure Monitoring from the cloud. Sign up for free trial.

How can auditors assess the use of enterprise data given today's fragmented storage infrastructure? In short, with great difficulty!

Earlier this year, Windocks became the first container engine to incorporate database cloning. The combination of SQL Server containers with database cloning has been immediately popular for support of Dev/Test and reporting needs. A complex Terabyte class database can be delivered in seconds, and only requires an incremental 40 MB of storage. 

The combination of SQL Server containers and database clones is great for Dev/Test and reporting, but is also proving to be a huge step forward for Data Governance and Regulatory Compliance. In this article, we'll explore how this design delivers a versioned, auditable repository of enterprise data for Audit and Compliance purposes.

Data Imaging for Enterprise Data Environments

Data images are built using Full or Differential SQL Server backups, snapshots, and SQL Server incremental log shipping, and are combined with SQL Server scripts to implement data masking during the image build. The resulting image is a full byte copy of the data in the form of Virtual Disks that can span multiple physical (or virtual) disks and large data sets.

The Virtual Disk, in turn, supports the creation of Windows "differencing disks" which are writable clones. Clones are delivered in seconds, and only require 40 MB or less of storage.

Images are built with a Dockerfile that specifies the location of backups, snapshots, or log shipping updates, and SQL Server scripts. Windocks images support multiple databases, with source files located on the Windocks host or a network attached file. In the example below the Dockerfile specifies two databases, located on network attached file shares, and SQL Server scripts for data masking.

The resulting image is versioned and auditable and supports delivery of multi-terabyte environments in seconds for Development and Test, and for reporting and BI. These data environments can now be delivered automatically or provisioned by users, for use with any SQL Server container (both Windocks and Microsoft's), as well as with conventional SQL Server instances.

Data Imaging Enhances Data Governance and Compliance

The design as described was implemented to address the needs for delivery of data environments for Dev/Test and reporting needs, but the new Data Image repository is ideally suited for expanding data governance and regulatory compliance needs.

Privacy/Security: Security is improved with data delivered through a structured container process. Ad hoc access to enterprise data can be curtailed and approved and auditable images used to support dev and test, as well as reporting and BI needs. Privacy is enhanced as data masking that is implemented during the image build. National boundaries are respected with image registries hosted in the appropriate country, as the Windocks solution runs wherever Windows servers are supported (on-premise, private, or public cloud).

Quality: The container workflow enhances data quality and consistency by supporting the use of production databases as the authoritative source of data. The workflow outlined above will soon be enhanced with native Jenkins or Team City server support for Continuous Integration, making this approach unique as the first full-stack Jenkins Continuous Integration solution that incorporates production database support.

Access and Use: Docker containers are emerging as the defacto standard for software development and test. Containers play a prominent role in Microsoft's strategies for Windows Server 2016 and SQL Server 2017. The approach outlined here provides organizations with an on-ramp to Docker-based workflows on Windows Server 2012 and Server 2016, with support of all editions of SQL Server 2008 onward. Not only does this workflow improve access to data (on-demand and in seconds), with the latest preferred dev and test tooling, but it also is uniquely useful for SQL Server reporting and BI purposes. This workflow also integrates with existing backup and DR system infrastructure, making it uniquely easy to add to existing systems and infrastructure.

Open: As a result of customer feedback Windocks is also expanding support for delivery of data environments from any Storage Area Network (SAN), from NetApp, EqualLogic, and others. Copy Data Management systems will also be supported, such as from Cohesity and Rubrik. Finally, support for MySQL, DB2, and other environments will also be added as requested by customers.

Conclusions

Data governance should not be an afterthought for modern software development and delivery strategies. Windocks' combination of SQL Server containers with database cloning delivers benefits for development and test, reporting and BI, and enhances data governance and policy compliance. The solution installs with existing systems and delivers Terabyte-class data environments in seconds while creating immutable, versioned and auditable images that address many data governance needs.

Explore how Windocks can enhance your data governance and delivery with a free Windocks Community Edition. Download your free evaluation of Windocks here.

Site24x7 - Full stack It Infrastructure Monitoring from the cloud. Sign up for free trial.

Topics:
cloud ,docker containers ,sql server ,data governance ,compliance

Published at DZone with permission of Paul Stanton, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}