TSUBAME2 Hardware Architecture

TSUBAME2 consists of more than 1400 compute nodes interconnected by high-bandwidth full bisection-bandwidth Infiniband networks. There are three node types: Thin, Medium, and Fat nodes, which differ in their equipped memory capacity among others. All compute nodes share scalable storage systems that provide 7PB of capacity.

TSUBAME2 system overview

Compute Nodes

Node Name Purpose # Node Product Name CPU GPU Memory Local Storage (SSD) Network
Thin Node For jobs needing less than 54GB 1408 HP Proliant SL390s G7 Intel Xeon X5670 2.93 GHz (6 cores) x 2 (Hyperthreading enabled) NVIDIA Tesla K20X x 3 PC3-10600
54GB (partly 96GB)
120GB[HP 572071-B21×2] (partly 240GB[HP 572073-B21×2]) QDR InfiniBand x 2 (80Gbps)
[HP 592520-B21]
[HP 614841-B21]
Medium Node For jobs requiring up to 128GB 24 HP Proliant DL580 G7 Intel Xeon X7550 2.0 GHz (8 cores) x 4 (Hyperthreading enabled)

NVIDIA Tesla S1070

Tesla S2070

PC3-10600
128GB
480GB [HP 572073-B21×4] QDR InfiniBand x 1 (40Gbps)
[HP 592520-B21]
Fat Node For jobs using more than 128GB and up to 256/512GB 10 HP Proliant DL580 G7 Intel Xeon X7550 2.0 GHz (8 cores) x 4 (Hyperthreading enabled) NVIDIA Tesla S1070 PC3-10600
256GB/512GB
480GB [HP 572073-B21×5] QDR InfiniBand x 1 (40Gbps)
[HP 592520-B21]