|HOME||STORAGE VIRTUALIZATION||WHITE PAPERS||CONTACT|
MSA60 with 750GB SATA Drives
We will tier the storage, using a mix of 300 GB 15K RPM SAS and 750 GB SATA-II drives. The table below gives an example configuration, fully populating the server with shelves and drives. Each row represents an MSA60 shelf.
|MSA60 Capacity Scaling Example|
|P800||Port||MSA60||Spindle Type||Spindle Capacity||Qty||Total Qty||Capacity (GB)||Total Capacity (TB)|
You may recall that HP never stops asking "What if?" Well, what if we had populated all 7 PCIe x8 slots with those P800 cards and expanded out with another 16 MSA60 drive shelves full of 750GB SATA-II drives? We would have a total of 672 spindles, for 365.6 TB of raw capacity, leaving us 4 PCIe x4 slots for the FC ports. Just a tad bigger than the flagship EMC CX3-80, eh?
|MSA60 Capacity Scaling Example|
|P800||Port||MSA60||Spindle Type||Spindle Capacity||Qty||Total Qty||Capacity (GB)||Total Capacity (TB)|
Now let's turn our attention to the remaining PCIe slots and our SAN front-end ports. The HP FCA2242SR is a dual port 4Gb Fibre Channel HBA (an Emulex LPe-11002) available for the DL series. The cards are typically used as Fibre Channel "Initiators" for host operating systems such as Windows, Linux, VMWare, etc. Properly configured, they can also be driven as "Targets", allowing them to present LUNs, just like the CX3-80. Your application servers will access their logical disks over these Fibre Channel ports.
In our configuration, we've used five of the 11 PCIe slots for P800 cards, leaving us two PCIe x8 and four PCIe x4 slots. If we install all six remaining slots with the dual port FCA2242SR, we will have 12 4Gb Fibre Channel ports, four ports more than an SP on the CX3-80. For this example, I only plan to use 5 of the dual port HBA's, giving us 10 FC targets, leaving us with one available PCIe slot.
This ProLiant model comes with two integrated 1Gb Ethernet ports and an ILO (Integrated Lights Out) NIC to be used for remote management. We add a 360T dual port Gig-E NIC to our remaining PCIe slot, giving us a total of 4 Gig-E NICs which we can configure for use as iSCSI targets, for file sharing (NAS), or for Asynchronous Replication over IP. Thus our SAN will offer both native Fibre Channel (performance) and native iSCSI (economy) connections.
It is worth noting that the Broadcom NICs typically used with the DL series can be teamed; our iSCSI target drivers will attach to IP stacks, so you can use NIC teaming to maximize the iSCSI throughput.
Below is a schematic of the DL580 Storage Processor.
The following server was configured using HP's online store. Pricing is list; your HP reseller may be able to provide you with more attractive pricing. Date of this configuration: May 24, 2008.
-Configurable- HP ProLiant DL580 G5 Rack Server
HP ProLiant DL580 G5 Rack Server
Quad-Core Intel¨ Xeon¨ Processor E7320 (2.13GHz/2x2M 80W)
Quad-Core Intel¨ Xeon¨ Processor E7320 (2.13GHz/2x2M 80W)
HP 8GB Fully Buffered DIMM PC2-5300 8X1GB Memory
HP Smart Array P400i Controller
HP SA P400 256MB Cache Upgrade
Dual embedded NC371i Multi-function Gigabit Network Adapters
HP DL580G5 PCI-E I/O Option Kit
Two (2) HP 1200W 12V Hotplug AC Power Supplies
2 HP 1.83m 10A C13-UL US Power Cords
Integrated Lights Out 2 (iLO 2) Standard Management
3 years parts, labor and onsite service (3/3/3) standard warranty. Certain restrictions and exclusions apply.
|Microsoft® Windows® Server 2003 R2, Enterprise Edition + 25 CALS (Not Installed)||$3,199.00||1||$3,199.00|
|HP 72GB Hot Plug 2.5 SAS 10,000 rpm Hard Drive (For DL580 Internal Slots)||$259.00||2||$518.00|
|HP 146GB Hot Plug 2.5 SAS 10,000 rpm Hard Drive (For DL580 Internal Slots)||$329.00||6||$1,974.00|
|HP Smart Array P800 Controller||$949.00||5||$4,745.00|
|HP Fibre Channel 2242SR 4GB PCI-e HBA - Low Profile||$1,800.00||5||$9,000.00|
|HP NC360T PCI Express Dual Port Gigabit Server Adapter - Low Profile||$229.00||1||$229.00|
|HP StorageWorks 60 Modular Smart Array||$2999.00||40||$119,960.00|
|HP 300GB Hot Plug 3.5 SAS 15,000 rpm Hard Drive||$749.00||288||$215,712.00|
|HP 750GB SATA 3.5 1.5Gb 7,200 rpm Hard Drive||$499.00||192||$95,808.00|
|Total Hardware & 3 Years Support:||$459,923.00|
Of course, we'll want to rack the server and drive shelves. In the fully populated configuration proposed here, we can fit the DL580 and the 40 MSA60 shelves into two 46U racks, with 6U left over for FC switches.
Finally, we'll want to add a UPS behind the DL580 and drive shelves to assure continuity in case of loss of power. The SAN software package we will use is UPS-aware and will take the necessary steps to assure any cached data is flushed to disk on power failure.
Front and back diagrams of the fully populated DL580 Storage Array follow.
DL580 SAN STORAGE ARRAY FRONT VIEW
DL580 SAN STORAGE ARRAY BACK VIEW
SANsymphony 6.0 SAN STORAGE SOFTWARE
We have configured the SAN array hardware. What's missing is the intelligence to turn this ordinary high-power server with direct attached storage into a SAN: the volume provisioning, caching, and LUN masking management, as well as the drivers to run the Fibre Channel HBAs and NICs in "target" mode so they'll behave like a storage array's ports. For this functionality we will use a unique software package from DataCore Software Corporation called SANsymphony™. This software will turn the ProLiant into a storage array more powerful than HP's own EVA series and certainly deliver higher performance than the EMC CX3-80... but for a lot less money.
The flagship SANsymphony™ product was developed by DataCore in the late 1990s to address a fundamental limitation inherent in Storage Area Networks or SANs: true inter-operability between the disparate storage systems offered by the various vendors. Although storage arrays from IBM, EMC, HP, HDS, etc., can conceivably be connected through the same storage fabric, the vendors have never settled on a standard management system or protocols over which data could be moved from one platform to another in a transparent and seamless manner. Indeed, while such functionality would be of enormous benefit to IT departments and their storage admins, it would be counter-productive to the hardware vendors' sole objective: to generate revenue in this case, recurring revenue via customer retention. SANsymphony™ breaks the hardware vendor lock, providing customers with an open software platform that offers Tier-1 SAN functionality, virtualizing SAN storage and facilitating the migration or displacement of any SAN volume within the infrastructure.
DataCore has typically positioned and sold the SANsymphony™ product as a Storage Virtual platform for enterprise customers looking to address the handful of significant problems found in large datacenters, particularly where multiple tiers (e.g. DMX + CX + AX) and multiple vendors (e.g. HP + EMC + HDS + EqualLogic) are common:
SANsymphony™ runs on a standard x86 + Windows server platform, and acquires its storage resources through the device manager. Any disk devices presented through the device manager whether they be SCSI, Ultra 320, Fibre Channel, SATA, SAS, ATA (EIDE), iSCSI, FireWire, or USB2, or LUNs from other SAN devices are thus candidates for virtualization.
SANsymphony™ presents an abstraction layer that allows any underlying storage to be sliced, diced, pooled, and provisioned out as Fibre Channel and iSCSI LUNs to SAN clients. To SAN storage arrays, SANsymphony™ is just another application running on a Windows server. To your SAN clients or Application Servers, SANsymphony™ is a well-behaved SCSI3-based Fibre Channel / iSCSI SAN storage array.
The server's built-in Ethernet ports become "iSCSI" targets, allowing you to create an inexpensive SAN infrastructure using common IP switches and NICs. By adding in industry standard Fibre Channel HBAs, SANsymphony™ turns the PC server into a Fibre Channel SAN, thus offering both native FC and native iSCSI functionality.
SANsymphony™ uses the PC server's commodity RAM for its sophisticated caching engine, resulting in impressive "Tier-1" performance.
If you need to evolve beyond the DL580 G5 configuration we've presented here, multiple SANsymphony™ nodes can be loosely clustered into a "Storage Domain" and managed as an autonomous unit. The architecture is "N+1", so you can add as many SANsymphony™ nodes as required. What's more, as we've noted, SANsymphony™ is a storage virtualization platform, and can virtualize and manage any existing SAN storage you may already have.
SCALABILITY: UPWARD, OUTWARD, FORWARD
In the example configuration we have developed here, our SAN storage array is fully populated with target ports, storage controllers and disk shelves. Clearly, just as with a traditional SAN storage array, we aren't obliged to swallow the whole enchilada in one bite. We can build our SANsymphony™ storage array to measure, in line with our current business requirements. Maybe we start with only 50 TB of storage on a few shelves, with the reassurance that at any time we can add additional controllers, shelves and disks as our needs dictate. In other words, we can "scale up" within the box.
But as we've noted, SANsymphony™ is an "N+1" architecture, allowing us to loosely couple the SANsymphony™ storage controllers into a kind of storage cluster in which volumes can be mirrored and migrated between the nodes and all the storage managed as a whole entity. This flexibility goes well beyond the appliance approach of the SAN vendors. Add in the fact that SANsymphony™ can be used to virtualize any existing SAN storage array you have on the floor, and you can see how SANsymphony™ truly "scales out", allowing you to treat all your storage current and future as a pool of commodity devices.
Finally, as a software package running on the ubiquitous Windows server platform, the SANsymphony™ license you buy today can take advantage of the technologies the industry offers tomorrow.
Case in point: When SANsymphony™ shipped in 2000, Fibre Channel was the only game in town and the costs associated with the fabric limited the reach of shared storage in the datacenter. But all that changed in early 2003 when the iSCSI recommendation was ratified and DataCore shipped version 5.2 of SANsymphony™. Our existing customer base was able to immediately take advantage of iSCSI by installing the free PSP2 service pack and using the common, low-cost NICs to tier and extend their SAN.
Case in point 2: Qlogic recently announced their 8Gb Fibre Channel products... and DataCore immediately offered a free download for SANsymphony™ that enables using those 8Gb cards *today* to implement your 8Gb SAN storage array. If you are an existing SANsymphony™ customer using 4Gb FC cards, you can simply replace your 4Gb HBA's with the QLE2562 dual port cards and enjoy 8Gb SAN performance now. And comparative to 4Gb FC technology, the cards are affordable; a few weeks ago I received a quote of less than $1400 for the dual port 8Gb QLE2562 card.
Of course, if you aren't a SANsymphony™ customer, you can always wait another 6 to 24 months for the traditional SAN vendors to catch up you'll probably need to forklift out the old array, bring in the new box and hope your vendor has a good data migration story!
When you add it up, SANsymphony™ really does represent the quintessential definition of scalability for SAN storage: upward, outward, and forward.
THE MANAGEMENT INTERFACE
SANsymphony™ storage controllers are managed and monitored from a simple Windows drag-and-drop style application. The SANcentral window displays status information about the SAN, whereas the SANmanager window is used to perform the common provisioning and LUN masking operations.
From the SANmanager tabs, the storage admin can manage Storage Pools, create Virtual Volumes, assign them to Application Servers, manage Quality of Service, Synchronous Mirroring, Asynchronous Replication, Data Migration, Snapshots and Volume Clones.
SANsymphony™ Storage Domains use standard Windows user accounts to control access to SAN management allowing you to, for example, separate Linux and Windows storage management.
The SANsymphony™ GUI is rich and provides management tools such as reporting and real-time performance monitoring.
THIN PROVISIONING A DATACORE FIRST
DataCore's NMV (Network Managed Volume) feature is a unique concept that combines Storage Pooling with the advanced features of Thin Provisioning and Over Subscription.
The concept is based on the complete abstraction of back-end physical storage and front-end virtual storage. With Network Managed Volumes, physical storage resources (whether they be actual physical disks or LUNs from a RAID controller or back-end SAN storage array) are placed in NMV "Storage Pools".
Virtual Volumes are created as logical entities whose physical representation is based on storage allocated dynamically from the associated NMV storage pool. The storage administrator no longer needs to be concerned with the geometry of partitions on the RAID groups new Virtual Volumes are created with a simple right-click menu selection over a storage pool.
When an NMV volume is first created, it is logically-sized by default to its maximum of 2TB. The storage administrator can then resize the volume to a smaller value as desired. Although the volume's geometry begins at 2TB, no physical storage has yet been allocated.
The pool's physical storage is allocated to the volume on a demand basis. Only when data is written to the volume will "storage allocation units" be assigned from the pool to hold the data. This concept is known as "Thin Provisioning" and allows several volumes to share the Storage Pool's physical space, thus maximizing the utilization of physical storage resources and eliminating waste.
With Thin Provisioning, it is possible to over-allocate space to the virtual volumes. For instance, given the example of a 1TB pool, we could easily create several 2TB LUNs and assign each to different servers (our MS-SQL, Exchange and File Servers, for instance). The NMV Pool manager will notify us as the physical storage in the pool depletes. An adjustable "Low Water Mark" is set to warn when additional storage needs to be added to the pool. The additional storage can be added without interruption to the production environment indeed, our databases, mail servers and file servers continue to run with their large LUNs even as we feed the pool.
This concept, referred to as "Over Subscription", facilitates capacity planning and reduces or eliminates the need for downtime to "resize" volumes or add storage to the SAN. I like to think of it as a "storage credit card".
SNAPSHOTS AND VOLUME CLONING
SANsymphony's Snapshot feature can be used to generate point-in-time copies of production volumes, which can then be used for backups or for dev/test environments. The snapshot volumes can be used as Read-Only or Read-Write, depending on your needs. They can also be "pointer-based" or complete image copies (clones or "Disk-To-Disk Backups) of the source volumes. Based on "Copy On Write" technology, a newly-enabled snapshot is immediately usable. Snapshot disk usage was the impetus for the development of DataCore's Thin Provisioning invention; pointer-based snapshot volumes require only the space necessary to hold the original blocks of any changed data on a source volume. Snapshots won't eat up all your disk space.
All Snapshot features can be driven entirely from SANsymphony's intuitive GUI or scripted using the CLI interface ideal for automating backups. They are also compatible with DataCore's VSS (Microsoft Volume Shadow Service) provider.
ASSURING BUSINESS CONTINUITY
The key to implementing Business Continuance is High-Availability through total redundancy. In the traditional SAN model HBA's, cables, switches, and storage array components are made redundant with automatic failover capabilities.
SANsymphony™ takes this model one step further, allowing for physical isolation of the storage processors and their associated disk resources. In the DataCore model, two or more active SANsymphony™ servers provide complete redundancy and implement synchronous data mirroring with automatic failover and fail-back. The mirroring is, in effect, a RAID-1 implementation of the virtual volumes. A mirrored volume is comprised of a Primary and a Secondary mirror part, each associated with a SANsymphony™ server.
This unique capability keeps your data available even in the event of a complete storage system failure.
Here's how it works. When a server writes data to a volume, it writes to the volume's primary node. This node caches the write and immediately copies it to the partner node containing the secondary part. Once the secondary node has the write in cache, the write acknowledgement is returned. This feature is commonly called "Mirrored Write Cache". If a failure occurs that renders one of the nodes inaccessible, steps are taken to assure no data is lost: write cache is flushed to disk and the node places the volume into "Cache Write-Through" mode.
The system includes a logging mechanism to facilitate rapid recoveries: only those blocks which have gone out of synch will be resynchronized once the failed or stopped node is brought back online.
Finally, the system is designed to allow not only for automatic failover, but for automatic fail-back, as well... no scripting required, no user intervention required.
Given the autonomous nature of the SANsymphony™ storage servers, DataCore's Business Continuity implementation provides an elegant solution for eliminating downtime associated with scheduled routine facility or storage maintenance. Just as XenMotion or VMotion are employed in Server Virtualizaton systems to keep your application servers available, DataCore's Auto-Failover and Failback functionality can be used to keep the data 100% available.
SANsymphony™ mirroring has been implemented to allow for active-active writes on volumes, and supports clustering and third party failover agents such as Microsoft's MPIO, Veritas DMP, or native systems such as VMWare ESX multipathing and VMotion, XenServer's multipathing and XenMotion, or Virtual Iron's LiveMigrate.
The SANsymphony™ mirroring system is based on common foundations such as Fibre Channel and iSCSI, making it ideal for "stretch" clusters where application servers and storage are geographically separated.
When combined with Thin Provisioning, Synchronous Data Mirroring provides the maximum in availability without unnecessarily wasting disk space: the mirrored volumes only occupy that space in their associated pools necessary to hold the actual data.
The SANsymphony™ storage solution we propose here is "Business Continuity Ready" just add another SANsymphony™ storage array, hardware + software license. There are no additional "feature" or "capacity" licenses or hidden costs.
ASYNCHRONOUS REPLICATION DR READY
DataCore offers a unique long-distance replication feature ideally suited for a DR project. AIM or "Asynchronous IP Mirroring" uses standard IP protocols to replicate volumes between DataCore-based storage products such as SANsymphony™ and SANmelody™.
AIM can be used over any of the server's network connections to implement replication over an existing network or VPN. No special Protocol Converters or hardware is required.
Any or all of the SANsymphony™ virtual volumes can be replicated between sites, including those volumes based on LUNs from any back-end SAN arrays virtualized by DataCore. You can replicate your EMC, HP, IBM, HDS storage to a SANsymphony or SANmelody server running at your DR site! That's virtualization.
AIM is a byte-level replication engine, live-replicating the data written to AIM source LUNs once the mirror is established only the "deltas" are written.
AIM is designed to allow flexibility in the use of the inter-site IP link. It can withstand link downtime and allows for scheduling of replication and bandwidth throttling.
AIM offers in-band snapshot and custom marker mechanisms to create checkpoints and automate processes on the replicated data at the DR site. AIM snapshot markers are integrated with SANsymphony's Snapshot manager and can be driven by GUI, by script, or by the DataCore VSS package.
The setup and management of AIM is intuitive and DataCore and its partners can provide best practices, tools and Professional Services to plan and facilitate the deployment.
The SANsymphony™ storage solution we are proposing here is "Disaster Recovery Plan Ready". The AIM feature is included in the license just add a SANsymphony™ or SANmelody™ storage array at the DR site. Again, there are no additional "feature" or "capacity" licenses or hidden costs.
"KISS" SOFTWARE LICENSING
Speaking of software licensing and costs, let's talk about how SANsymphony™ is sold. DataCore offers a simple bundled pricing model that includes all features (snapshots, volume clones, synchronous mirroring, asynchronous replication, storage pooling, thin provisioning, storage virtualization) with unlimited capacity. Like I said, "No hidden costs."
Let's add it up:
Total price of this solution, fully configured hardware and software with 10 FC ports, 480 drives and 225 TB of capacity, based on list pricing? Well, I'm not authorized to publish DataCore's prices, so you'll need to contact DataCore or one of their Authorized Resellers for more information. Let's just say the total cost will be a small fraction of the cost associated with a similarly configured box from EMC, NetApp, HP, etc.
SANsymphony™ is sold uniquely through DataCore's network of Value Added Resellers. For more information on the SANsymphony™ product and to find an authorized reseller in your area, please visit the DataCore website at www.datacore.com.
Time: 09/26/2008 02:00 PM EDT
Duration: 1 Hour(s)
Want to see a live of demo of SANsymphony presented by the author of this paper? Just register for TGIF - The Friday Technical Deep Dive, a webinar presented on Fridays to highlight advanced topics of Storage Virtualization. Tim periodically gives an overview of SANsymphony, DataCore's Storage Virtualization platform, showing many of the advanced features including Synchronous Mirroring, Asynchronous Replication, Data Migration, etc. The presentation is intended for a technical audience with a cursory knowledge of SAN storage concepts. Following the demo, the presenter will entertain questions from any of the attendees. [Register...]