Las Solanas Consulting

Storage Virtualization | FAQs & Discussions

Build a Business Continuity iSCSI Scalable SAN Solution with Tiered Storage using two HP DL180G6 Servers

Author: Tim Warden

Date: October 8, 2009

BUILDING A SANmelody™ SAN

In this cookbook, we will use two HP DL180 G6 Windows 2008 server to build a highly available, flexible and scalable iSCSI SAN Storage Appliance. The servers will run DataCore's SANmelody software package, which will turn them into dedicated storage controllers. SANmelody implements a rich feature set, including both iSCSI and Fibre Channel targets, Read/Write Caching, Thin Provisioning, Snapshots, Active/Active Synchronous Mirroring for Business Continuity, and Asynchronous Replication for Disaster Recovery.

SANmelody can be installed on any Windows 2003 or 2008 server platform, regardless of vendor, model, CPU architecture, whether rackmount, blade or VM. If Windows runs on the platform, SANmelody can run on the platform. The choice of the HP DL180 G6 server in this cookbook is somewhat arbitrary. We could just as easily build this solution with a DL380, or a Dell R710 or an IBM System x3650.

I've chosen the DL180 G6 used in this example for a variety of reasons... the DL180 can be configured with several internal drive chassis, one of which is a 25 disk chassis for SFF (Small Form Factor) disks. Combined with its 4 PCI Express slots, the DL180 G6 is ideal for building an enclosed SAN appliance all the while giving us PCI slots for expansion as our needs evolve.

We'll build the server with a single Quad-Core CPU — we won't trouble ourselves too much with CPU performance. A 2GHz processor will be perfectly suitable for our purposes — after all, storage control is not a compute-intensive exercise.

As for RAM, 4GB would be just fine, but I've built this server with 16GB to underscore the fact that SANmelody implements a best-of-breed cache engine and will allocate up to 80% of the available memory for caching I/Os.

The DL180 G6 comes with 2 embedded 1Gb NICs. I've opted to add a quad-port NIC card, giving me 6 NICs total. I can dedicate the NICs as iSCSI Targets, iSCSI Initiators, Synchronous Mirroring channels, NAS, management, or Asynchronous Replication. I also opted for HP's ILO, allowing total control of the server (hardware and software) via web browser.

As for disks, I've chosen HP's 25 drive SFF chassis. I've put in a mix of HP's SAS Enterprise and Midline drives to give me a few tiers of storage — performance and capacity. Adding it up, there's about 7.5TB of raw capacity in those 25 slots.

The disks attach to an HP P212 RAID controller, which also includes an external SAS connector for attaching external MSA shelves when we need to expand storage. The card can control up to 54 disks and has been configured here to support BBWC and RAID 1, 1+0, 5 and 50.

Two additional PCI Express slots remain, which can be used for adding additional RAID controllers, such as the high-performance P411. The P411 has two external SAS ports and each card can control up to 100 spindles — ideal for attaching additional MSA shelves to further expand our storage. The card can be optionally added at any time.

Redundant 750W power supplies will feed all those spindles and the redundant fan kit will keep everything cool.

A UPS can be added to assure that power failures don't result in loss of cached writes, allowing the UPS-aware SANmelody software to flush cache and shutdown properly.

HP DL180 G6 SERVER HARDWARE

HP DL180 G6 25-bay SFF

QTYDESCRIPTION
1HP ProLiant DL180 G6 Rack-Mountable Server
- includes HP Embedded SATA Controller
- includes HP Embedded HP NC362i Integrated Dual Port Gigabit Server Adapter
1Quad-Core Intel® Xeon® Processor E5504 (2.00GHz, 4M Cache, 80 Watts, 800MHz)
1HP 16GB 4Rx4 PC3-8500R-7 Kit
1HP 3 PCI-E x8 Full Height Riser Card
1HP NC364T PCI Express Quad Port Gigabit Server Adapter — Low Profile
1HP P212/256 FIO SA Cntrlr w/Battery
1HP 25-Bay Small Form Factor Drive Cage
2HP 146GB 6G Hot Plug 2.5 SAS Dual Port 10,000 rpm Enterprise Hard Drive
10HP 300GB 6G Hot Plug 2.5 SAS Dual Port 10,000 rpm Enterprise Hard Drive
6HP 146GB 3G Hot Plug 2.5 SAS Dual Port 15,000 rpm Enterprise Hard Drive
7HP 500GB 6G Hot Plug 2.5 SAS 7,200 rpm MDL Hard Drive 1-year warranty
2HP 750W HE Hot Plug Power Supplies
2HP 1.83m 10A C13-UL US Power Cords
1HP Redundant Fan Kit
1HP Lights-Out 100i Remote Management
1HP Dedicated Management Port
1Microsoft® Windows® 2008 Server, Standard Edition 5 CALs
1Protected by HP Services, 3-Year Next Day Part Replacement, 0-Year Labor, 0-Year Onsite support with next business day response.
1HP Care Pack, 3 Years, 4 Hours, 13x5, Hardware, DL18x

DON'T LIKE MY CHOICE OF DISKS?

Then change it. That's the beauty of a software SAN solution... like they say at Burger King, "Have it your way..." HP has an impressive list of drives available for the DL180 G6, including high-speed Solid State Drives. And although these drives are manufactured on the same assembly lines as the so-called "Tier 1 Enterprise" drives sold by the traditional SAN vendors, as you know they are far more economical.

SAS Hot Plug SFF Enterprise (ENT) Drives
HP 300GB 6G SAS 10K SFF DP ENT HDD
HP 300GB 3G SAS 10K SFF DP ENT HDD
HP 146GB 6G SAS 15K SFF DP ENT HDD
HP 146GB 3G SAS 15K SFF DP ENT HDD
HP 146GB 6G SAS 10K SFF DP ENT HDD
HP 146GB 3G SAS 10K SFF DP ENT HDD
HP 72GB 6G SAS 15K SFF DP ENT HDD
HP 72GB 3G SAS 15K SFF DP ENT HDD
HP 72GB 3G SAS 10K SFF DP ENT HDD
Hot Plug Midline (MDL) Drives
HP 500GB 6G SAS 7.2K SFF DP MDL HDD
HP 500GB 3G SATA 7.2K 2.5in MDL HDD
HP 160GB 3G SATA 7.2K 2.5in MDL HDD
HP 60GB 3G SATA 2.5in MDL 1y Wty SSD (SOLID STATE)
HP 120GB 3G SATA 2.5in MDL 1y Wty SSD (SOLID STATE)

In my configuration, I chose to use SFF (Small Form Factor) 2.5" drives to increase spindle density for achieving the highest performance. If you prefer the 3.5" Large Form Factor drives, again you have many choices...

SAS Hot Plug 3.5" Enterprise (ENT) Drives
HP 600GB 6G SAS 15K 3.5" DP ENT HDD
HP 450GB 6G SAS 15K 3.5" DP ENT HDD
HP 450GB 3G 15K 3.5" DP SAS ENT HDD
HP 300GB 6G SAS 15K 3.5" DP ENT HDD
HP 300GB 3G SAS 15K 3.5" DP HDD
HP 146GB 3G SAS 15K 3.5" DP HDD
Hot Plug Midline (MDL) Drives
HP 1TB 3G SAS 7.2K 3.5" DP MDL HDD
HP 750GB 3G SAS 7.2K 3.5" DP MDL HDD
HP 1TB 3G SATA 7.2K 3.5" MDL HDD
HP 750GB 3G SATA 7.2K 3.5" MDL HDD
HP 500GB 3G SATA 7.2K 3.5" MDL HDD
HP 250GB 3G SATA 7.2K 3.5" MDL HDD
HP 60GB 3G SATA 3.5in MDL 1y Wty SSD (SOLID STATE)
HP 120GB 3G SATA 3.5in MDL 1y Wty SSD (SOLID STATE)

The most important point to keep in mind is that SANmelody can use _any_ MBR disk you can see in the Windows Device Manager. That means SATA, SAS, SDD, FC, iSCSI, SCSI, you name it!

Yes, you can even attach an older SAN appliance to your SANmelody storage server and virtualize it... give it an advanced feature set its manufacturer never intended. Use it for your disk-to-disk backups or use it at your DR facility to hold the SANmelody replicated volumes. Try doing that with a traditional SAN storage array!

WANT FC WITH THAT? BIGGIE-SIZE IT WITH 10Gb?

Again, the software approach to SAN design gives you the greatest flexibility. You choose the options you want. DataCore's SANmelody software supports any IP stack the Windows Device Manager presents, whether 1Gb or 10Gb. The software includes an FC option with Target/Initiator drivers that supports most QLogic and Emulex Fibre Channel HBA's (Including the HP-rebranded models). In fact, SANmelody customers know that DataCore was the first on the block with an 8Gb Fibre Channel SAN — and they were able to take advantage of the capability by downloading the free Product Service Pack DataCore made available shortly after those first 8Gb cards hit the market.

DataCore has recently announced support for FCoE as well, and again, our customers will be able to leverage advances in technology via the power of architecting their SAN around portable software.

COST-EFFECTIVE STORAGE EXPANSION

Once you've made the initial investment in your SAN, it's just a matter of time before you'll need to add additional storage. And adding storage with the DataCore approach is as easy as adding shelves of low-cost disks attached to a RAID controller.

We've already configured the DL180 G6 with a P212 RAID Controller card, which includes an external SAS port for attaching additional MSA shelves. We can easily add an MSA70 which has the same form factor as the DL180 and also accepts 25 SFF disks.

If you prefer the Large Form Factor drives, again HP offers their MSA60 which will hold 12 of the same LFF disks we listed in the tables above.

It's a far more cost effective approach to storage expansion than, say, "adding another node", as some of the appliance vendors would recommend.

BUSINESS CONTINUITY

In these days of twits and twitter, blokes that blog and virtual attention spans, 24/7 is the norm and it's a catastrophe if your Blackberry server is down for an hour. Small shops have the same business imperatives as their Goliath enterprise counterparts and everything depends on the datacenter. Keeping your job means keeping the datacenter running.

Most IT professionals have a fundamental understanding of availability when it comes to servers: if it's a critical application, put it in a cluster. This is particularly evidenced with virtual server hosts — If a single ESX or XenServer goes down, all of its VMs and their applications will go down with it. The common practice is thus to use two or more virtualization hosts in a cluster and use advanced features such as VMware HA, XenMotion, etc., to keep the applications available.

And as your cluster servers depend intrinsically on the underlying SAN infrastructure, we'd better make sure it is also highly available. The astute reader has already figured out that the DL180 G6 server we have built here is a single point of failure. Even with its redundant power supplies and fans, and its battery-backed RAID controllers, an environmental issue can take the SAN out.

The traditional SAN vendors address High Availability via redundancy: dual storage controllers dual-porting the same disks, dual power, redundant cooling... all in a Highly-Available 19"-rackable chassis that is in and of itself a Single Point of Failure.

Perhaps we'd be better off taking the same approach to our storage that we take with our virtual server hosts: true redundancy — physically autonomous controllers, each with their own disks implementing an active-active network RAID1.

Active-Active Business Continuity

And that's just what DataCore's synchronous mirroring feature does. Two SANmelody servers are put into a "partnership". They share a common configuration and each actively presents and mirrors the SAN volumes. The mirroring takes place between the two SANmelody controllers over iSCSI or Fibre Channel. The SANmelody administrator has complete control over which volumes are to be mirrored, and whether the volumes will be simple mirrors or active/active multipath mirrors. A multipath mirror is actively presented by both controllers and provides the highest level of availability possible: true business continuity.

And because we're taking advantage of lower cost server drives and SANmelody's Thin Provisioning pools, we've made this redundancy an affordable reality — a mere fraction of what we would pay for similar (but non-active/active) functionality from one of the traditional storage vendors.

SANmelody™ — POWERFUL, FLEXIBLE, FEATURE RICH

DataCore SANmelody

Now let's add the software to turn these two HP DL180 G6 servers into a high-performance, feature rich SAN: let's add the SANmelody software.

Each of these servers has 2.4TB of raw storage, and depending on how we create our RAID stripes, we'll have at most about 2TB of usable space left. SANmelody is sold as feature-packed bundles, based on capacity. The VMS bundle will manage up to 2TB of usable capacity — we'll need two licenses, one for each server.

QTYSKUDESCRIPTION
2VMS-ESR-200-BSVDataCore VMS Feature Packed 2TB License for 1 Node
2VMS-EWR-GLD-BSVAnnual Maintenance & Support

These feature pack licenses include iSCSI, Storage Pools with RAID Striping, Thin Provisioning, Snapshots, Active-Active Synchronous Network Mirroring with Auto Failover and Failback, Asynchronous IP Mirroring, and Volume Migration. Fibre Channel is available as an option.

SOFTWARE... A BYTE OF PHILOSOPHY

At first, the idea of implementing a SAN using software running on standard x86/x64 servers may seem a bit unorthodox to the reader. In reality, it's just the natural evolution of the storage industry — one the traditional storage vendors are understandably reluctant to embrace.

If you think back throughout the history of IT, you'll realize that many of the technologies we commonly use began as closed, hardware-based appliances... and then evolved into software running on common computing devices. Whether we're talking copy machines, old fashioned telephones, stereos, VCRs... or proprietary databases on proprietary minicomputers or mainframes, the world accepted that was how it was done.

But with each of these technologies, at some point in time a brilliant engineer — maybe a college student working on a term project — wrote an "emulator" on a computer. Nifty idea, but nothing to be taken seriously, right? Right?

Ah, but someone — a visionary, if you will — would see the potential in that nifty idea and the engineering team would keep working at it until the emulator had a richer feature set than the thing it was emulating. Oh, and by the way, it was running on a hardware platform destined to follow Moore's law, getting faster and faster with each generation.

From 8086's to today's multi-core Gigahertz processors, we've come a long way. Memory speeds, and peripheral busses... PCI, PCI-X, PCI Express, PCIe 2.0. Let's face it: the closed appliance approach can never keep up with software leveraging the incessant advances in open server architectures. And so eventually the traditional, closed architecture appliance goes the way of the dinosaur.

Think about it — no one considers Microsoft Word to be a typewriter emulator, but isn't that effectively what word processors are? And VoIP? Telephone emulation, implemented as software running on common servers?

And as much as VMware insists that ESX is not an emulator... well, just what is a hypervisor? It's an emulator, emulating physical server hardware, and doing a darned good job of it, I might add... with a powerful feature set you just can't find on a physical server. And it's software. (Amusing that it was a college project... Stanford University. The visionary? Mendel, right? Doing for x86 servers what IBM did back in the 60s with their VM operating system...)

Funny how the SAN storage industry has been the last bastion of closed, proprietary hardware products. Particularly funny, because if you "look under the hood" of the vast majority of those traditional hardware SANs and storage arrays, you'll find server boards and software. Indeed, the EMC CX, which boasts a very large installed base, is built on Dell motherboards running Windows. Their CX3 is based on Microsoft Windows XP-Embedded, the newer CX4 is running Windows 2003 Storage Server edition — you can even see the Microsoft license holograms on the back of the chassis. And most of the iSCSI appliances sold today? Usually just hacked Linux systems, many based on CentOS.

So what is DataCore doing so different? Simple. DataCore has broken with tradition and offers SAN storage control as a software package that you can install on your favorite server platform... even if that server is a virtual machine. And is it fast? Better fasten your seatbelts.

NEXT STEPS TO STORAGE FREEDOM

Whether you're in the market for a low-cost iSCSI SAN appliance or a tier-one high-performance SAN, you should investigate the DataCore offering. DataCore's approach to the storage industry is truly unique, from their software-only solutions to their "Carry Forward Value Protection Program".

SANmelody is packaged as feature-rich, usable-capacity-based bundles. Capacity can be expanded and additional features turned on by simple and cost-effective license upgrades with no "upgrade penalties".

DataCore resells SANmelody through their network of authorized resellers who are trained and certified to architect and deploy complete DataCore SAN solutions using industry standard servers such as the DL180 G6 we've discussed here.

For more information or to download a 30-day evaluation of SANmelody, visit www.datacore.com.