Follow Us

We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message

Case Study: Keeping AOL's files in order

IBRIX clustered file storage does the business for AOL

Article comments

Dan Pollack of AOL had a big data problem -- 8 petabytes of unstructured data to be exact -- data that his clients had to access and manage, and he had to make sure was always available.

Pollack, operations architect for the Internet service provider in Dulles, Va., manages a traditional storage-area network (SAN), which has about 3,000 connected servers and uses 10,000 Fibre Channel storage ports, to store the transactional data generated by line-of-business applications. But it was the 8 petabytes of unstructured data stored on 1,000 file servers across his enterprise that was causing him fits.

Client applications need to access this data continually, whether it is for archival or sharing purposes. It was necessary for Pollack to have some way to manage the data and ensure its accessibility during upgrades, patches and maintenance activity. He also wanted to maintain this data on lower-cost storage than his SAN, because while it is important data, it doesn’t have the business-criticality of data stored on the SAN.

“While we found that [a SAN] is good for a lot of critical applications, there's another class of applications that require very high capacity but very low-cost storage in order to not go broke trying to provide services to your customers,” Pollack says.

Pollack started to investigate storage systems that would give him high capacity, less-expensive storage and the uptime he required. He found a number of cluster-based network-attached storage (NAS) systems from companies the likes of Panasas, Isilon, PolyServe (now HP) and IBRIX. After careful consideration, Pollack chose IBRIX’s Fusion.

“One of the things we liked about IBRIX over those other options is that they've re-implemented the interface as a file system as opposed to levering a traditional NAS protocol like NFS [the Network File System], CIFS [the Common Internet File System] or iSCSI,” Pollack says. “What that does is makes it extremely understandable for our clients and easy to access.”

He also chose IBRIX over NAS systems because he considered it to be more available.

“The large-scale NAS deployments are not as available as they ought to be,” Pollack says. “We have a long, checkered experience with large NAS deployments and very large systems that support customer-facing applications.”

“In order to avoid this availability problem, we wanted to go with something that was cluster-based and non-coupled,” he says.

IBRIX’s Fusion is a software-only system, which installs on each of the 1,000 file servers in Pollack’s cluster. With Fusion, Pollack can use any storage media he wants, unlike packages such as Panasas, which require use of their own storage.

“With IBRIX we can select our own hardware at the lowest cost possible,” says Pollack, who is using direct-attached storage consisting of 12 700GB ATA drives per server.

As for uptime, when Pollack wants to do upgrades or maintenance, he can take down a single server in the cluster, perform the upgrade and then bring the node back up without disrupting the operations of the rest of the cluster.

“There may be a minimal data unavailability on whatever is offline but every other server is available,” Pollack says. “Any unavailability is a small part of the total complex and it doesn't affect the actual behavior of the rest of the complex.”

When Pollack’s cluster grows, he can add new nodes in without taking down the cluster. Data is balanced across the cluster as it is added.

However, there is one thing missing though from Pollack’s wish list: the ability for the cluster to automatically redistribute data to other nodes in the cluster when a failure occurs.

“It's a requirement we gave to the IBRIX guys that they should have delivered in the next couple of months,” Pollack says.


More from Techworld

More relevant IT news


Send to a friend

Email this article to a friend or colleague:

PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Choose – and Choose Wisely – the Right MSP for Your SMB

End users need a technology partner that provides transparency, enables productivity, delivers...

Download Whitepaper

10 Effective Habits of Indispensable IT Departments

It’s no secret that responsibilities are growing while budgets continue to shrink. Download this...

Download Whitepaper

Gartner Magic Quadrant for Enterprise Information Archiving

Enterprise information archiving is contributing to organisational needs for e-discovery and...

Download Whitepaper

Advancing the state of virtualised backups

Dell Software’s vRanger is a veteran of the virtualisation specific backup market. It was the...

Download Whitepaper

Techworld UK - Technology - Business

Innovation, productivity, agility and profit

Watch this on demand webinar which explores IT innovation, managed print services and business agility.

Techworld Mobile Site

Access Techworld's content on the move

Get the latest news, product reviews and downloads on your mobile device with Techworld's mobile site.

Find out more...

From Wow to How : Making mobile and cloud work for you

On demand Biztech Briefing - Learn how to effectively deliver mobile work styles and cloud services together.

Watch now...

Site Map

* *