Free Trial

Safari Books Online is a digital library providing on-demand subscription access to thousands of learning resources.

Share this Page URL

Chapter 7: Infrastructure Simplification... > Unified solution: N Series System St... - Pg. 132

7.1 Challenge: Expanding Linux workload: Wild server crashes Over a three year period, lab data volumes grew from under 1 TB to 18 TB and the commodity hardware Linux cluster topped the 200-node mark. Customer N was bursting at the seams in terms of Linux file server capacity. "Sequencing production processes generate tens of millions of files, in fact, a single volume can contain nearly 30 million files. They had absolutely reached the performance and manageability limits of the existing file server structure. A number of disruptive file server crashes further emphasized the urgency of finding a more robust solution. System reliability is a principal concern in sequencing processes, one production stop can jeopardize several hundred thousands of dollars' worth of data moving through the lab." Solution cost and complexity are important considerations for a lab funded largely through grant awards. "As is the case at most research organizations, it's easier to find budget for science than budget to run an IT group." With limited headcount to support our infrastructure, we always strive to deploy highly flexible and easily manageable technologies. 7.2 Unified solution: N Series System Storage Today the bulk of Customer N's data resides on an N Series fabric-attached System Storage with 14 TB capacity. The types of data include: Production pipelines for genome mapping and DNA sequencing