Storage Resource Managers Recent International Experience on Requirements And Multiple Co-Operating Implementations

K Devi

Abstract


Storage management is one of the most important enabling technologies for large-scale scientific investigations.  Having to deal with multiple heterogeneous storage and file systems is one of the major bottlenecks in managing, replicating, and accessing files in distributed environments.  Storage Resource Managers (SRMs), named after their web services control protocol, provide the technology needed to manage the rapidly growing distributed data volumes, as a result of faster and larger computational facilities.  SRMs are Grid storage services providing interfaces to storage resources, as well as advanced functionality such as dynamic space allocation and file management on shared storage systems.  They call on transport services to bring files into their space transparently and provide effective sharing of files. SRMs are based on a common specification that emerged over time and evolved into an international collaboration.  This approach of an open specification that can be used by various institutions to adapt to their own storage systems has proven to be a remarkable success – the challenge has been to provide a consistent homogeneous interface to the Grid, while allowing sites to have diverse infrastructures.  In particular, supporting optional features while preserving interoperability is one of the main challenges we describe in this paper.  We also describe using SRM in a large international High Energy Physics collaboration, called WLCG, to prepare to handle the large volume of data expected when the Large Hadron Collider (LHC) goes online.  This intense collaboration led to refinements and additional functionality in the SRM specification, and the development of multiple interoperating implementations of SRM for various complex multi-component storage systems.

Keywords


SRM-Storage Resource Manager, HEP-High Energy Physics, NP-Nuclear Physics.

References


O. Bärring, R. Garcia Rioja, G. Lo Presti, S. Ponce, G. Taurelli, D. Waldron, CASTOR2: design and development of a scalable architecture for a hierarchical storage system at CERN, CHEP, 2007.

http://castor.web.cern.ch/castor/

Corso, E. and Cozzini, S. and Donno, F. and Ghiselli, A. and Magnoni,, L. and Mazzucato, M. and Murri, R. and Ricci, P.P. and Stockinger, H. and Terpin, A. and Vagnoni, V. and Zappi, R., “StoRM, an SRM Implementation for LHC Analysis Farms Computing in High Energy Physics”, CHEP’06, Feb. 13-17, 2006, Mumbai, India,http://indico.cern.ch/contributionDisplay.py?contribId=373&sessionId=13&confId=048.

http://www.cs.wisc.edu/condor/

http://www.dcache.org/

A. Domenici, F. Donno, A Model for the Storage Resource Manager, Int. Symposium on Grid Computing 2007, 26-29 March 2007, Academia Sinica, Taiwan

http://www-ccf.fnal.gov/enstore/

http://www.hpss-collaboration.org/hpss/index.jsp

J. Mencak, F. Donno, The S2 testing suite, http://s-2.sourceforge.net

G. J. Myers, C. Sandler (Revised by), T. Badgett (Revised by), T. M. Thomas (Revised by) The ART of SOFTWARE TESTING 2 edition, December 2004.

http://www.sdsc.edu/srb/index.php/Main_Page

SRM Storage Tests and Monitoring, http://datagrid.lbl.gov/

http://sdm.lbl.gov/srm-wg

The Storage Resource Manager Interface Specification, Version 2.2, April 2007, http://sdm.lbl.gov/srm-wg/doc/SRM.v2.2.html


Full Text: PDF

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

.......................................................................................................................................................................................................................

ISSN  2279 – 0381 |  IST HOMEJOURNAL HOME | Copyright IST 2012-13

.......................................................................................................................................................................................................................