Rethinking the Data Center
An infrastructure optimization project saves time, money and energy at Queensborough Community College.

When the servers in Queensborough Community College’s data center began to show their considerable age, the college decided it was time to take a comprehensive look at how the entire data center operated, says Bryan Farr, IT senior associate at the Bayside Queens, N.Y., educational institution. “When Y2K was coming down we went to a client-server architecture, so every application had its own physical server,” says Farr, who manages the hardware in the QCC data center. “That was in the late 1990s or early 2000. In the past few years, as equipment wore out and we started to have to replace a lot of servers individually, we realized that we had to optimize. We needed something better for management, cost savings and power — all the main drivers.” In order to meet those needs, QCC has implemented an optimization strategy that includes server virtualization and consolidation, storage virtualization, and substantial upgrades to the power protection and management systems in the data center. Key elements of the revamped IT infrastructure are an IBM BladeCenter chassis with 14 IBM HS21 blade servers, VMware vSphere Enterprise virtualization software, an HP LeftHand SAN and an APC Symmetra power management system.

The Benefits of Going Green
Reducing energy usage and saving taxpayer money were other important reasons for the optimization, says George Sherman, QCC’s CIO. “The green aspect was important. Mayor [Michael] Bloomberg wants all city institutions to reduce their carbon footprints,” Sherman says. “But in the process of cutting power consumption, we’re also improving our computing capabilities. We’re consolidating server resources and making them more quickly available, as well as creating automatic redundancy.” QCC, a campus of the City University of New York, has about 15,000 students and 1,400 faculty and staff members. In addition to maintaining network resources for traditional classrooms as well as business and administrative offices, the IT and Academic Computing Center staff supports the wide range of online and hybrid courses offered by QCC. The rapidly changing needs of the academic computing environment provided an extra push toward optimizing the IT infrastructure, says Farr. “The academic world right now changes a lot with initiatives based on grant-funding cycles,” he explains. “There’s always a new project coming up.” Farr and Raj Vaswani, a senior IT associate for the QCC Academic Computing Center, had been exploring the possibilities of virtualization since 2006. But the first long stride toward optimization came the following year when QCC deployed an IBM BladeCenter as a platform for server consolidation. As with all the hardware purchased for the data center, primary selection criteria were vendor support and durability, says Farr. “We asked every manufacturer that came in, ‘What is the life expectancy of that product line?’” he says. “You have to make sure that something you buy is going to be around and sustainable for a while. One main reason we chose the IBM BladeCenter was that the model we bought was second generation, but it fits first-generation blades and now third generation. That continuity was important to us.”

Synergy: Blades and Virtualization
Switching to blade servers saved space and power, but using the blades in conjunction with VMware is the heart of the optimization, says Vaswani. Virtualization allows five or six virtual servers to run on a single physical blade, and vSphere Enterprise provides a complete management platform for the virtual environment.


as well as to roll back entire volumes of backup files. says Farr. “It was scary before we got the APC system. but the QCC staff was initially having trouble recovering snapshots of individual VMs at specific points in time from the SAN. Farr says. Farr says. a modular system that allows for easy scaling as data center needs grow. along with other standard servers.” The Symmetra system also acts as a power filter and transformer. “Our power here had been a nightmare for a couple of years.” he says. if not more. but they’re just servers. and do it at substantial savings over a Fibre Channel SAN. every time we had a problem. The power management system protects the blades.” says Vaswani. “VMware with the BladeCenter is the driving force that made the optimization successful. however. we take care of just about everything ourselves. while the other was hooked up to a backup generator circuit. we just converted them to virtual machines. including everything going down on campus.” 2 . Backing up the virtual server environment was. Backup and disaster recovery are simplified by features that allow administrators to access snapshots of virtual machines for a single point in time. The HP LeftHand SAN offers storage clustering capabilities that make it easier to increase capacity.” QCC already owned an HP LeftHand SAN. were perfect right away using the VMware on the blades. however. Without VMware the blades are very good servers. “We also didn’t have to pay for Fibre Channel switches and a dedicated fibre network for storage. Vaswani says. QCC ran two stand-alone UPS units to power the IBM BladeCenter. “And the converter was huge.” Powering Up Initially. says Farr.“As great as the blades are by themselves. “With iSCSI. which was well suited to meet increased high-availability storage needs for the virtualized environment. says Farr. It was especially great for old servers with configurations we hadn’t touched in so long we could hardly remember them. Thin provisioning features allocate space as data is stored rather than requiring that storage be allocated in advance. We didn’t have to rebuild servers. “On the other hand. It was so complicated we couldn’t maintain it without a lot of help. One of the UPS units was connected to the electrical grid normally servicing the building. the college implemented APC Symmetra power protection.” Vaswani continues. “Using the two technologies together meant that we could just wipe out all our dying servers and move them onto the BladeCenter. a major challenge. remarkably easy due in large part to VMware Converter. eight of which are used to support a total of 60 virtual servers. The difficulty was resolved with the help of ESX Ranger. The HP LeftHand SAN has also decreased maintenance hassles and increased ease of use as compared to a fibrebased storage area network previously used at QCC. In late 2009. the real power comes in running them with VMware. and we were able to put that money toward actual storage. backup software designed to be used with VMware. “Nineteen out of 20 applications. the SAN and all the hardware appliances in the data center. using the BladeCenter really maximizes VMware features like VMotion [which enables the live migration of virtual machines]. But the SAN performed so well that the IT staff realized it could do much more. which protects and extends the life of the hardware. which contains 14 IBM HS21 blade servers.” QCC is now using 17 terabytes out of the SAN’s 30TB storage capacity. which duplicates physical server configurations on virtual servers. “That was a big cost savings. The college initially bought the iSCSI-based SAN to provide storage and backup for an e-mail server. We’ve had transformers blow and major power outages time and time again. Implementation of the technology involved in the data center optimization project took place in steps over a 2. There was no problem backing up data from the virtual machines. ensuring that the data center only gets “clean” power.5-year period and went relatively smoothly. Minor integration issues with some applications in the virtual environment (most notably with Microsoft SharePoint) as they were moved to virtual servers were resolved by tweaking VMware settings.” says Vaswani.” he says. The transition was. we had to call support and wait. “With the Fibre Channel system.” he says.

along with having a strategy for planned growth. “That will mean that we’re actually using our hardware to something close to capacity. “The trick with VMware. on a physical server. we can usually solve it in a couple of hours. Maximum Capacity Operating close to capacity — configuring the data center to make the maximum efficient use of space as well as computing and power resources — is key to data center optimization. ‘Is there a better way to run things?’ It involves fundamental infrastructure design. comments Cappuccio. So virtualize and put a few images.” he says. “The main return on investment we see is in management time. We can be much more responsive to administrators. in part because so much of the infrastructure was at the end of its life.” Using SANs. If there is a problem.000 in the technology and support services necessary for the QCC data center optimization (covering the BladeCenter with eight blade servers. laying things out and running them logically and efficiently. but the same principles can be applied to optimizing an existing data center. Our workload has increased because of it. “In the old data center. “We can get things done a lot faster. Farr says.” QCC now does all of its application testing and troubleshooting on virtual machines at substantial time savings. virtualizing storage and deduplicating the data going into the repository are all ways to increase efficiency and decrease wasted space and energy in the data center. says Tony Hong. “One calculation I did recently with a client was. including energy. says Farr. but we know how much better our data center works.” he says. explains Cappuccio. Time and Reliability QCC has invested a total of approximately $300.” 3 .” which focuses on rack space rather than floor space. is not just to run it for its convenience but to look at optimal performance levels of the hardware and run it as close to that as you can. when something didn’t come up. “You have to ask.ROI: Productivity. “Infrastructure optimization is usually people taking a look at things and deciding to do what they should have done all along.” he says. Because we’re a college we don’t really do ROI metrics. we started praying. or 30 images if that works. with increased rack density and virtualization. for example. an analyst for Gartner. New data centers should be designed for “vertical scalability. That represents the optimization of all resources.” Farr says. making it difficult to use baseline figures for comparisons. or all virtualization. “The average x86 server in the United States runs at between 10 and 12 percent [capacity].” Increased reliability and a decreased chance of catastrophic failures are also part of the return on the retooled data center. “It’s more difficult. but that means we’re doing more for more people. an IT senior associate at the Office of Information Technology. and emphasizes building the IT infrastructure for maximum density and efficiency. QCC is “headed in the right direction” to maximize performance. says Dave Cappuccio.” “First I ask. And he would get that increase with just a 29 percent boost in power consumption. there’s less worry that systems won’t come up.” By looking at all major aspects of the IT infrastructure.” he says. “With the new system. but the optimal level may be more like 60 to 65 percent. Hard numbers for return on investment are difficult to calculate. He jokes that the VMs are so useful that he looks forward to dealing with virtual server sprawl. which is increasingly a big deal. HP LeftHand SAN and APC Symmetra). VMware with Virtual Center. ‘How efficient is the space you have?’” Cappuccio continues. Cappuccio says. he could increase the computing power in his data center by 350 percent.

” says Cappuccio. once you reach higher densities you can fry an egg on the top of one of your racks. which ultimately makes optimization possible and saves energy. “We’ve finally come to the realization that we have to pay more attention to the energy we consume in IT. often with virtualization on blades. “We needed to find alternative solutions if we wanted to do more things. an IT senior associate at QCC’s Office of Information Technology. the college was making sure it could continue to upgrade its infrastructure.” Power and cooling are at the top of the list of issues addressed in any infrastructure optimization. Power management systems protect that optimized infrastructure and make it possible. “The trouble is.808.” says Tony Hong. and we had maxed out our power resources. as well as ensuring that the data center is up and running. 030310 4 .” Cappuccio says. “We can do things a lot better. So when QCC installed an APC Symmetra power management system in its data center last September. even 30 percent of energy costs just by reconfiguring data centers. it was doing more than safeguarding operations continuity. “We had to find a way to consolidate the servers so we would have less power usage. because they’re running out of power in their current configurations. but QCC (like many other organizations) actually had few alternatives. That’s why people bring in APC or one of the other power management systems to get that under control. an analyst for Gartner. “Organizations consolidate their servers.” CALL 800.” Power management systems can provide granular protection and control for various pieces and groupings of hardware. and you need more power for cooling. We can save 15. says Dave Cappuccio. 20.Powering the Upgrade The benefits of IT infrastructure optimization might have been enough alone to pull Queensborough Community College into the process of upgrading its data center. We couldn’t expand our data center.4239 to talk to a specialist today.

Sign up to vote on this title
UsefulNot useful