bwGRID

|
 
 

Karlsruhe Storage

Karlsruhe Institute of Technology (KIT)

General Information

Within the framework of the D-Grid Project, funded by the Federal Ministry of Education and Research, the Steinbuch Centre for Computing (SCC) of the Karlsruhe Institute of Technology provides virtual organisations with the opportunity to use computing time on different cluster systems and to use storage space. The SCC operates a cluster and the central storage system exclusively for the bwGRiD.

Information on the resources

The central storage system for the bwGRiD was procured using funds from the state of Baden-Württemberg and the Federal Government in accordance with article 91b of the German Constitution. Hardware and software were supplied by HP. The HP SFS G3 software based on the parallel cluster file system Lustre is used. The hardware consists of the following components:

  • Hard disks: 768 1TB SATA and 48 146 GB SAS
  • Storage systems: 18 HP MSA2212fc and 50 MSA2000 JBODs
  • Storage networks: 8 16-Port FibreChannel switches
  • Server systems: 12 HP DL380G5 with FibreChannel and InfiniBand adapters
  • Communication network: 1 24-Port InfiniBand DDR switch
  • Middleware systems or client systems: 6 HP DL380G5 with InfiniBand und 10 GE adapters

This resource is exclusively available to users of the Virtual Organsiation bwgrid. The storage space is divided between two file systems: 

  • Backup (/bwfs/backup), 128 TB (with backup)
  • Work (/bwfs/work), 256 TB (without backup)

If you require a restore of data from the file system backup, please contact the D-Grid user support (see below).

Access is available through the following middleware systems:

  • GridFTP: bwgrid-se.scc.kit.edu
  • GSI-SSH: bwgrid-se.scc.kit.edu

 

Examples:

$ globus-url-copy -r -cd -rp file://$HOME/Test/ gsiftp://bwgrid-se.scc.kit.edu:2811/Test/ 
 $ globus-url-copy gsiftp://bwgrid-se.scc.kit.edu:2811/~/test.tgz gsiftp://sccbwgrid1.fzk.de:2811/~/ 
 $ globus-url-copy -r -cd gsiftp://bwgrid-se.scc.kit.edu:2811/~/ file://`pwd`/bwgrid/ 
 $ globus-url-copy file://`pwd`/test.tgz gsiftp://bwgrid-se.scc.kit.edu:2811/~/
  • Interactive access with uberFTP:
$ uberftp bwgrid-se.scc.kit.edu 
 220 bwgrid-se4 GridFTP Server 3.15 (gcc64dbgpthr, 1222656151-78) [Globus Toolkit 4.2.1] ready. 
 230 User dgbw0011 logged in. UberFTP(BETA2)> help
  • Job description (RSL) for a job with input data and output data in the central storage (Staging):
<job> 
  <executable>bwtest.sh</executable> 
  <stdout>${GLOBUS_USER_HOME}/bwtest.out</stdout> 
  <maxTime>5</maxTime> 
  <jobType>single</jobType> 
  <fileStageIn>
  <transfer>
  <sourceUrl>
  gsiftp://bwgrid-se.scc.kit.edu:2811/bwfs/backup/bwgrid/users/dgbw0011/bwtest.sh
  </sourceUrl>
  <destinationUrl>
  file:///${GLOBUS_USER_HOME}/bwtest.sh
  </destinationUrl>
  </transfer>
  </fileStageIn>
  <fileStageOut>
  <transfer>
  <sourceUrl>
  file:///${GLOBUS_USER_HOME}/bwtest.out
  </sourceUrl>
  <destinationUrl>
  gsiftp://bwgrid-se.scc.kit.edu:2811/bwfs/backup/bwgrid/users/dgbw0011/bwtest.out
  </destinationUrl>
  </transfer>
  </fileStageOut>
  </job>
  • Copy data with GSI-SSH (scp):
$ gsiscp test.tar bwgrid-se.scc.kit.edu:~/work
  test.tar                                      100%  222KB 221.9KB/s   00:00
  • Interactive access with GSI-SSH:
$ gsissh -x bwgrid-se.scc.kit.edu
  Last login: Wed Dec 23 11:38:23 2009 from iwrcgui.fzk.de
  HPC SFS G3.0-0
  [dgbw0011@bwgrid-se1 ~]$ ls work/
  test.tar

For all questions regarding support please contact the D-Grid user support.

Links