General information
Summary
Arina has 3.728 cores distributed in 3.664 xeon cores, and 64 Itanium2 cores with RAM memory ranging from 16 to 512 GB per node. Four of the xeon nodes have 2 Nvidia Tesla cards each, another node with two Nvidia Kepler 20, and another one with 2 Nvidia Kepler 40 . There are 3 high performance file systems based on Lustre, one with 4.2 TB for the Itanium2 and Opteron nodes and other 2 with 22 and 40 TB for the Xeon nodes. All the nodes are connected with a high bandwidth and low latency Infiniband network.
Other resources
Arina has 3 servers, arina (Itanium2), katramila and guinness (Xeon) where researches can use to access the cluster. This servers work as connection, visualization, compilation and test servers. All the servers mount the same /home file system using NFS. Every night the/home is backed up. When a computing node writes in /home the data is sent using the NFS protocol using an ethernet slow connection. We strongly recommend to use during the calculations the the local /scratch or the shared /gscratch filesystems to storage temporary data.
Features of the Xeon nodes
- BullX cluster with Red Hat Linux AS, AS6 and AS7 operative system.
- 464 Xeon 5420 at 2.3 GHz cores, 648 5645 cores at 2.4 GHz, 630 Xeon 2680v2 at 2.8 GHz cores and 32 Xeon 4620v2 at 2.6 GHz cores in the shared memory node (512 GB).
- 1.876 Xeon 2680v4 cores 2.8GHz.
- RAM memory which ranges from 24 to 512 GB of RAM per node.
- 40 Gb/s QDR and 56 Gb/s FDR High bandwidth and low latency Infiniband network.
- Main server for compile Guinness and Katramila.
Nodes with GPGPUs
They are similar to the previous ones:
- Two nodes with Nvidia Tesla 20 C2050 cards, Xeon 5420 at 2.3 GHz processor, 24 GB RAM and two QDR infiniband network cards.
- Two nodes with Nvidia Tesla 20 C2070 cards, Xeon 5420 at 2.3 GHz processor, 24 GB RAM and two QDR infiniband network cards.
- One node with Nvidia Tesla 20 cards, Xeon 2680v2 at 2.8 GHz GHz processor, 128 GB RAM and FDR infiniband network card.
- One node with Nvidia Tesla 40 cards, Xeon 2680v4 at 2.4 GHz GHz processor, 128 GB RAM and FDR infiniband network card.
Specific features of the nodes:
| Amount | Name | Type | Proc | Cores | Speed | RAM (GB) | Disk (GB) | Label |
| 1 | Guinness | Server | 2 | 8 | 2.3 GHz | 12 | — | — |
| 1 | Katramila | Server | 2 | 8 | 2.6 GHz | 128 | — | — |
| 1 | cn3 | Node | 2 | 8 | 2.3 GHz | 96 | 250 | xeon,xeon8 |
| 17 | cn4-20 | Node | 2 | 8 | 2.3 GHz | 24 | 250 | xeon,xeon8 |
| 36 | cn21-56 | Node | 2 | 8 | 2.3 GHz | 48 | 250 | xeon,xeon8 |
| 4 | cn57-60 | GPU node | 2 | 8 | 2.3 GHz | 24 | 250 | xeon,xeon8,gpu |
| 18 | cn61-78 | Node | 2 | 12 | 2.4 GHz | 48 | 250 | xeon,xeon12 |
| 1 | cn79 | Node | 2 | 12 | 2.4 GHz | 96 | 250 | xeon,xeon12 |
| 35 | cn80-cn114 | Node | 2 | 12 | 2.4 GHz | 24 | 250 | xeon,xeon12 |
| 30 | nb1-nb30 | Node | 2 | 20 | 2.8 GHz | 128 | 128 | xeon,xeon20 |
| 1 | nb31 | Node | 2 | 32 | 2.6 GHz | 512 | 1000 | xeon,xeon20 |
| 1 | nb32 | GPU node | 2 | 20 | 2.8 GHz | 128 | 128 | xeon,xeon20,gpu,rh7 |
| 66 | nd1-nd14,nd16-nd67 | Node | 2 | 28 | 2.4 GHz | 128 | 128 | xeon,xeon28,rh7 |
| 1 | nd15 | GPU Node | 2 | 28 | 2.4 GHz | 128 | 128 | xeon,xeon28,rh7,gpu |
The labels are used to select specific computing nodes.
Features of the Itanium2 nodes
- HP Integrity Server cluster with Red Hat Linux AS 4 operative system.
- 128 Itanium2 cores at 1.3 y 1.6 GHz.
- Between 4 and 128 GB of RAM per node.
- 10 Gb/s and 20 Gb/s high bandwith and low latency Infiniband SDR and DDR network.
- Main server to compile arina.
Specific features of the nodes:
| Amount | Name | Type | Proc | Cores | Speed | RAM (GB) | Disk (GB) | Label |
| 1 | Arina | Server | 2 | 4 | 1.6 GHz | 8 | — | — |
| 1 | Arinaz | Server | 2 | 2 | 1.3 GHz | 2 | — | — |
| 4 | cndXX | Node | 4 | 8 | 1.6 GHz | 16 | 550 | itaniumb |
| 10 | cndXX | Node | 4 | 8 | 1.6 GHz | 32 | 550 | itaniumb |
| 1 | cnd43 | Node | 4 | 8 | 1.6 GHz | 64 | 550 | itaniumb |
All the Itanium2 computing nodes have the itanium label. The labels are used to select specific computing nodes.
High performance filesystems
In addition to the local file systems (/scratch) nodes there are three shared file systems.
- HP-SFS with 4.7 TB, parallel write/read in disk using Lustre technology. It can write at 400MB/s and read at 600MB/s ( a normal disk can do it at about 40-60 MB/s) for Itanium2 and Opteron nodes.
- Lustre with 22 TB for Xeon (xeon8 and xeon12) nodes.
- Lustre with 40 TB, 6.9 GB/s write speed and 5.1 GB/s read speed for Xeon (xeon20) nodes.