Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

News

5/16/2008
08:31 AM
George Crump
George Crump
Commentary
50%
50%

Optimizing Primary Storage

Data deduplication has done much to optimize disk backup storage, but can those same efforts be successful in primary storage? Primary storage is, of course, different than secondary storage. Any latency can cause problems with applications and users. Thin provisioning, which I wrote about last week, can help a great deal, but once the data is actually written, the space is allocated. How can you make primary storage take up less space?

Data deduplication has done much to optimize disk backup storage, but can those same efforts be successful in primary storage? Primary storage is, of course, different than secondary storage. Any latency can cause problems with applications and users. Thin provisioning, which I wrote about last week, can help a great deal, but once the data is actually written, the space is allocated. How can you make primary storage take up less space?Three of the approaches on the market today are in-line compression from companies such as Storwize or a post-process crawl approach performed by companies like Network Appliance, and the mixed-mode approach of companies like Ocarina Networks.

In-line compression is pretty straightforward; an appliance is put between you and the storage. Everything going through the box onto that storage is compressed; everything going through the box from storage is decompressed. The post-process crawl is also straightforward. During idle times on the system, files are scanned for duplicate blocks of data stored elsewhere in the array and are deduplicated.

We will explore the other methods in future entries, but today I wanted to focus in on the mixed-mode approach by Ocarina Networks. Its system does post-process crawling of data for deduplicated blocks and chooses the best compression method for the file. This crawling process gives Ocarina the time needed to be data-format aware. Decompression of data is done in-line, on access. This allows for control over what files are optimized for space savings and allows for the functionality to be carried across multiple platforms. You can set up the system, scan the file system, and only compress/deduplicate the files that have not been accessed in the last week, leaving the very active files unmodified. Files that have not been accessed in a week can then be space optimized. Different levels of optimization can be chosen based on file type or age, allowing you to decide between highly optimized access; the less compression, the less performance impact or highly optimized storage efficiencies. Since this decision can be made on a file-by-file basis, it gives you the freedom to "dial in" the correct level of optimization for each.

The Ocarina solution offers data movement as well. For example, you could have a rule any file that has not been accessed in six months will be space optimized to its highest level and then moved off of your expensive NAS to a disk-based archive that uses SATA drives. Because of Ocarina's mixed-mode architecture, spanning across different storage manufacturers' platforms is simple.

The challenge in offering data optimization solutions for primary storage is that it's so easy not to optimize it and just keep buying more shelves of drives. To be a compelling alternative, primary storage optimization suppliers need to do more than just offer 2:1 space savings, and they need to leverage their implementation to offer other capabilities, data movement being a good example.

For a detailed examination of Primary Storage Optimization, see our article on InformationWeek's sister site, Byte and Switch.

George Crump is founder of Storage Switzerland, an analyst firm focused on the virtualization and storage marketplaces. It provides strategic consulting and analysis to storage users, suppliers, and integrators. An industry veteran of more than 25 years, Crump has held engineering and sales positions at various IT industry manufacturers and integrators. Prior to Storage Switzerland, he was CTO at one of the nation's largest integrators.

 

Recommended Reading:

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
COVID-19: Latest Security News & Commentary
Dark Reading Staff 7/31/2020
'BootHole' Vulnerability Exposes Secure Boot Devices to Attack
Kelly Sheridan, Staff Editor, Dark Reading,  7/29/2020
Out-of-Date and Unsupported Cloud Workloads Continue as a Common Weakness
Robert Lemos, Contributing Writer,  7/28/2020
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
Special Report: Computing's New Normal, a Dark Reading Perspective
This special report examines how IT security organizations have adapted to the "new normal" of computing and what the long-term effects will be. Read it and get a unique set of perspectives on issues ranging from new threats & vulnerabilities as a result of remote working to how enterprise security strategy will be affected long term.
Flash Poll
The Threat from the Internetand What Your Organization Can Do About It
The Threat from the Internetand What Your Organization Can Do About It
This report describes some of the latest attacks and threats emanating from the Internet, as well as advice and tips on how your organization can mitigate those threats before they affect your business. Download it today!
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2020-14310
PUBLISHED: 2020-07-31
There is an issue on grub2 before version 2.06 at function read_section_as_string(). It expects a font name to be at max UINT32_MAX - 1 length in bytes but it doesn't verify it before proceed with buffer allocation to read the value from the font value. An attacker may leverage that by crafting a ma...
CVE-2020-14311
PUBLISHED: 2020-07-31
There is an issue with grub2 before version 2.06 while handling symlink on ext filesystems. A filesystem containing a symbolic link with an inode size of UINT32_MAX causes an arithmetic overflow leading to a zero-sized memory allocation with subsequent heap-based buffer overflow.
CVE-2020-5413
PUBLISHED: 2020-07-31
Spring Integration framework provides Kryo Codec implementations as an alternative for Java (de)serialization. When Kryo is configured with default options, all unregistered classes are resolved on demand. This leads to the "deserialization gadgets" exploit when provided data contains mali...
CVE-2020-5414
PUBLISHED: 2020-07-31
VMware Tanzu Application Service for VMs (2.7.x versions prior to 2.7.19, 2.8.x versions prior to 2.8.13, and 2.9.x versions prior to 2.9.7) contains an App Autoscaler that logs the UAA admin password. This credential is redacted on VMware Tanzu Operations Manager; however, the unredacted logs are a...
CVE-2019-11286
PUBLISHED: 2020-07-31
VMware GemFire versions prior to 9.10.0, 9.9.1, 9.8.5, and 9.7.5, and VMware Tanzu GemFire for VMs versions prior to 1.11.0, 1.10.1, 1.9.2, and 1.8.2, contain a JMX service available to the network which does not properly restrict input. A remote authenticated malicious user may request against the ...