Advanced Computing Research Lab
Documentation news.php News Media About Us Projects
png diagram of system

The machine consists of:

  • One user gateway (Panopticon)
  • Four compile nodes (Fawlty, Fawlty2, Makalu and Bender)
  • One server for system functions and scheduling (Echelon01)
  • One backup server for system functions (Echelon02)
  • 256 Apple XServe G5 nodes that run either Linux or Mac OSX depending on queue demand
  • 20 x86_64 (AMD Opteron) nodes that run Linux
  • One The SGI Altix 3700 BX2 with 64 Itanium2 processors
  • SGI Infinite Storage RAID NAS
  • Ethernet and Myrinet networks

Echelon01 provides system services,
Echelon02 provides redundancy

Functions

  • Standard network services: dhcp, name service, authentication
  • Queues: scheduler and server
  • NOTP: node provisioning (OS selection)

Hardware

  • Echelon01
    • Apple XServe G5
    • Dual 2.3GHz G5 Processors
    • 4 GB ECC SDRAM
    • Gigabit Ethernet
    • 1U Rackmount chassis
  • Echelon02
    • Microway custom build
    • Dual 1.0GHz PIII Processors
    • 1 GB SDRAM
    • Gigabit Ethernet

Software

  • Gentoo Linux 2009.0
  • dhcp3,bind9,ldap

Fawlty is the Linux PPC-64 compile node.

  • Compile code for Linux PPC-64
  • Submit jobs to queue
  • Edit user files

Hardware

  • Apple XServe G5
  • Dual 2.3GHz G5 Processors
  • 4 GB DDR400 ECC SDRAM 8x512
  • Gigabit Ethernet
  • 1U Rackmount chassis

Software

  • Gentoo Linux 64 bit
  • Gnu Compiler suite (gcc 4.1.1, gfortran 4.1.1)
  • Linux 2.6.16 kernel

Bender is the OS-X compile node.

Function:

  • Compile code for OS-X
  • Submit jobs to queue
  • Edit user files

Hardware:

  • Apple XServe G5
  • Dual Power PC 2.3Ghz G5 processor
  • 4 GB DDR400 ECC SDRAM 8x512
  • 240 GB hot-pluggable Serial ATA
  • 1U Rackmount chassis

Software:

  • OS X Tiger 10.4.6
  • Darwin 8.6.0
  • IBM XLC and XLF compilers
  • gnu C compilers

Makalu is the Linux x86-64 compile node.

  • Compile code for Linux x86-64 (Opteron)
  • Submit jobs to queue
  • Edit user files

Hardware

  • Advanced Clustering custom build
  • Dual AMD Opteron(tm) Processor 250
  • 4 GB RAM
  • Gig Ethernet
  • 4U chassis

Software

  • Gentoo 2009.0
  • Gnu Compiler suite (gcc 4.3.2, gfortran )
  • Linux 2.6.25 kernel

204 of the PPC-64 nodes are connected by a Myrinet 2000 optical network.

http://www.myri.com/

These are the PPC compute nodes:

Hardware

  • Apple XServe G5
  • Dual 2.0GHz G5 Processors
  • 2 GB DDR400 ECC SDRAM 8x512
  • Gigabit Ethernet
  • 1U Rackmount chassis

Software

  • Gentoo Linux 64 bit 2008.0
  • Gentoo Linux 64 bit 2009.0
  • Debian Linux multilib bit lenny
  • OS-X
  • The nodes automatically boot into the correct OS on user-queue demand

These are the 20 x86-64 nodes.

Hardware

  • Advanced Clustering custom build
  • Dual x86_64 AMD Opteron(tm) Processor 246
  • 1 GB SDRAM
  • Gigabit Ethernet
  • Midtower chassis

Available OS Images:

  • Gentoo 2009.0 Linux 2.6.25 kernel
  • Fedora 9 Linux 2.6.25 kernel

The SGI Altix 3700 BX2

Hardware

  • 64 Intel IA-64 Itanium 2 1.6 GHz Processors
  • 256 GB SDRAM
  • 10 Gigabit Ethernet

Software

  • SuSE Linux 10.2
  • 2.6.16 kernel

User files are stored on an SGI Infinite Store 4000

  • 4 1.6GHz Dual-Core Intel Itanium 2 9030 Processors
  • 48 GB SDRAM
  • 10 Gigabit Ethernet
  • 99TB user storage

Software

  • SLES 10.2 Linux
  • Linux 2.6.16 kernel
All equipment is connected with Gigabit or 10 Gigabit Ethernet
Hardware
  • Core: HP Procurve 5412zl with 10G module for the Altix and SGI fileserver
  • Edge switches: HP Procurve 2824
  • All PPC and x86-64 compute nodes are connected 20 per edge switch

Panopticon is the user gateway. It has an automatic fail-over spare for redundancy.

Hardware

  • Dual 2.0GHz Intel Xeon Processors
  • 2 GB SDRAM
  • Gigabit Ethernet
  • 1U Rackmount chassis

Software

  • Gentoo Linux

Nagios is used to monitor the health of the system.

  • Monitors the batch queuing system
  • Controls the fail-over of the user gateway (Panopticon)

Hardware

  • Microway custom build
  • Dual PIII Processors
  • Gig Ethernet
  • 4U chassis