Configuration of the VSC-2

  • 1314 compute nodes
    • chassis: SlashFive (from Megware),
    • CPU: 2 x AMD Opteron Magny Cours 6132HE (8 Cores, 2.2 GHz)
    • RAM: 8 x 4 GB ECC DDR3
    • HD: 16 GB SSD
    • Network:
      • 2 x Gigabit Ethernet LAN
      • 1 x Infiniband QDR
  • Total number of available processor cores: 21024
  • Maximum available memory: 42.0 TB
  • Power consumption (maximum load): 420 kW
  • R_max: 135.6 TFlops
  • R_peak: 185.0 TFlops
  • Three login servers, two master nodes
    • chassis Megware Saxonide 6100 Dual Opteron
    • CPU: 2 x AMD Opteron Magny Cours 6132HE (8 Cores, 2,2 GHz)
    • RAM: 8 x 4 GB ECC DDR3
    • HD:  RAID 1 Verbund mit 300 GB
    • Netzwork:
      • 2 x Gigabit Ethernet LAN
      • 1 x Infiniband-QDR
    • redundant power supply
  • High Performance Infiniband QDR Netzwerk
    • 80 Switches Voltaire Grid Director 4036
    • 36 ports per Switch
    • Fat-tree topology, two sub networks
    • 8 root switches (see diagram)
    • 12 spine switches in each sub network
    • 672 ports in each sub network, 1344 in total
    • possibility of extension by a third subnetwork with 672 ports
    • Diagram of the IB network structure
  • two Gbit networks.
  • Parallel file system (Fraunhofer FHGFS):
    • temporary file space for running jobs,
    • 12 storage servers with 12x2 TB file space each
    • 6000 MB/s for i/o operations.
  • Operating System: Linux (Scientific Linux 6.0)
  • Management software:
    • Oracle Grid Engine
    • ClustWare-Appliance (from Megware)
  • Cooling: Knürr CoolTherm® – Water cooled server rack with 17 kW cooling power each

Documentation

  • White Paper: Megware SlashFive server system(183KB)
  • White Paper: ASUS KGMH-D16 QDR (7.3 MB)
  • Data Sheet: Voltaire® Grid Director™ 4036 (208KB)
  • Data Sheet: Knürr CoolTherm® – Water Cooled Server Rack – 4 to 35 kW (675KB)