{"id":5649,"date":"2012-01-09T14:10:41","date_gmt":"2012-01-09T12:10:41","guid":{"rendered":"http:\/\/www.ehu.es\/sgi\/?p=5649"},"modified":"2023-09-15T13:32:39","modified_gmt":"2023-09-15T11:32:39","slug":"arina-cluster-3","status":"publish","type":"post","link":"https:\/\/www.ehu.eus\/sgi\/arina_en\/computational-resources\/arina-cluster-3","title":{"rendered":"Arina Cluster"},"content":{"rendered":"<h2>General information<\/h2>\n<h3>Summary<\/h3>\n<p>Arina has <strong>3.728\u00a0cores<\/strong> distributed in 3.664\u00a0xeon cores, and 64\u00a0Itanium2 cores with RAM memory ranging from 16 to 512 GB per node. Four of the xeon nodes have 2 Nvidia Tesla cards each, another node with \u00a0two Nvidia Kepler 20, and another one with 2 Nvidia Kepler 40 . There are 3 high performance file systems based on Lustre, one with 4.2 TB for the Itanium2 and Opteron nodes and other 2 with 22 and 40 TB for the Xeon nodes. All the nodes are connected with a high bandwidth and low latency Infiniband network.<\/p>\n<h3>Other resources<\/h3>\n<p>Arina has 3 servers, <strong>arina<\/strong> (Itanium2), <strong>katramila<\/strong> and <strong>guinness<\/strong> (Xeon) where researches can use to access the cluster. This servers work as connection, visualization, compilation and test servers. All the servers mount the same <code>\/home<\/code> file system using NFS. Every night the<code>\/home is backed up. <\/code> When a computing node writes in <code>\/home<\/code> the data is sent using the NFS protocol using an ethernet \u00a0slow connection. We strongly recommend to use during the calculations the \u00a0the local <code>\/scratch<\/code> or the shared <code>\/gscratch<\/code> filesystems to storage temporary data.<\/p>\n<p><code><\/code><\/p>\n<h2>Features of the Xeon nodes<\/h2>\n<ul>\n<li>BullX cluster with Red Hat Linux AS, AS6 and AS7 operative system.<\/li>\n<li>464 Xeon 5420 at 2.3 GHz cores, 648 5645 cores at 2.4 GHz, 630 Xeon 2680v2 at 2.8 GHz cores and 32 Xeon 4620v2 at 2.6 GHz cores in the shared memory node (512 GB).<\/li>\n<li>1.876 Xeon 2680v4 \u00a0cores 2.8GHz.<\/li>\n<li>RAM memory which ranges from 24 to 512 GB of RAM per node.<\/li>\n<li>40 Gb\/s QDR and 56 Gb\/s FDR High bandwidth and low latency Infiniband network.<\/li>\n<li>Main server for compile Guinness and Katramila.<\/li>\n<\/ul>\n<h3>Nodes with GPGPUs<\/h3>\n<p>They are similar to the previous ones:<\/p>\n<ul>\n<li>Two nodes with Nvidia Tesla 20 C2050 cards, Xeon 5420 at 2.3 GHz processor, 24 GB RAM and two QDR infiniband network cards.<\/li>\n<li>Two nodes with Nvidia Tesla 20 C2070 cards, Xeon 5420 at 2.3 GHz processor, 24 GB RAM and two QDR infiniband network cards.<\/li>\n<li>One node with Nvidia Tesla 20 cards, Xeon\u00a02680v2 at 2.8 GHz GHz processor, 128 GB RAM and FDR infiniband network card.<\/li>\n<li>One node with Nvidia Tesla 40 cards, Xeon\u00a02680v4 at 2.4 GHz GHz processor, 128 GB RAM and FDR infiniband network card.<\/li>\n<\/ul>\n<p>Specific features of the nodes:<\/p>\n<table border=\"1\" cellpadding=\"3\">\n<tbody>\n<tr>\n<td align=\"LEFT\">Amount<\/td>\n<td align=\"LEFT\">Name<\/td>\n<td align=\"LEFT\">Type<\/td>\n<td align=\"RIGHT\">Proc<\/td>\n<td align=\"RIGHT\">Cores<\/td>\n<td align=\"RIGHT\">Speed<\/td>\n<td align=\"RIGHT\">RAM (GB)<\/td>\n<td align=\"RIGHT\">Disk (GB)<\/td>\n<td align=\"RIGHT\">Label<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">Guinness<\/td>\n<td align=\"LEFT\">Server<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">8<\/td>\n<td align=\"RIGHT\">2.3 GHz<\/td>\n<td align=\"RIGHT\">12<\/td>\n<td align=\"RIGHT\">&#8212;<\/td>\n<td align=\"RIGHT\">&#8212;<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">Katramila<\/td>\n<td align=\"LEFT\">Server<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">8<\/td>\n<td align=\"RIGHT\">2.6 GHz<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">&#8212;<\/td>\n<td align=\"RIGHT\">&#8212;<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">cn3<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">8<\/td>\n<td align=\"RIGHT\">2.3 GHz<\/td>\n<td align=\"RIGHT\">96<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon8<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">17<\/td>\n<td align=\"LEFT\">cn4-20<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">8<\/td>\n<td align=\"RIGHT\">2.3 GHz<\/td>\n<td align=\"RIGHT\">24<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon8<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">36<\/td>\n<td align=\"LEFT\">cn21-56<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">8<\/td>\n<td align=\"RIGHT\">2.3 GHz<\/td>\n<td align=\"RIGHT\">48<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon8<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">4<\/td>\n<td align=\"LEFT\">cn57-60<\/td>\n<td align=\"LEFT\">GPU node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">8<\/td>\n<td align=\"RIGHT\">2.3 GHz<\/td>\n<td align=\"RIGHT\">24<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon8,gpu<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">18<\/td>\n<td align=\"LEFT\">cn61-78<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">12<\/td>\n<td align=\"RIGHT\">2.4 GHz<\/td>\n<td align=\"RIGHT\">48<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon12<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">cn79<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">12<\/td>\n<td align=\"RIGHT\">2.4 GHz<\/td>\n<td align=\"RIGHT\">96<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon12<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">35<\/td>\n<td align=\"LEFT\">cn80-cn114<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">12<\/td>\n<td align=\"RIGHT\">2.4 GHz<\/td>\n<td align=\"RIGHT\">24<\/td>\n<td align=\"RIGHT\">250<\/td>\n<td align=\"RIGHT\">xeon,xeon12<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">30<\/td>\n<td align=\"LEFT\">nb1-nb30<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">20<\/td>\n<td align=\"RIGHT\">2.8 GHz<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">xeon,xeon20<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">nb31<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">32<\/td>\n<td align=\"RIGHT\">2.6 GHz<\/td>\n<td align=\"RIGHT\">512<\/td>\n<td align=\"RIGHT\">1000<\/td>\n<td align=\"RIGHT\">xeon,xeon20<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">nb32<\/td>\n<td align=\"LEFT\">GPU node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">20<\/td>\n<td align=\"RIGHT\">2.8 GHz<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">xeon,xeon20,gpu,rh7<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">66<\/td>\n<td align=\"LEFT\">nd1-nd14,nd16-nd67<\/td>\n<td align=\"LEFT\">Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">28<\/td>\n<td align=\"RIGHT\">2.4 GHz<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">xeon,xeon28,rh7<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\">1<\/td>\n<td align=\"LEFT\">nd15<\/td>\n<td align=\"LEFT\">GPU Node<\/td>\n<td align=\"RIGHT\">2<\/td>\n<td align=\"RIGHT\">28<\/td>\n<td align=\"RIGHT\">2.4 GHz<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">128<\/td>\n<td align=\"RIGHT\">xeon,xeon28,rh7,gpu<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>The labels are used to select specific computing nodes.<\/p>\n<h2>Features of the Itanium2 nodes<\/h2>\n<ul>\n<li>HP Integrity Server cluster with Red Hat Linux AS 4 operative system.<\/li>\n<li>128 Itanium2 cores at 1.3 y 1.6 GHz.<\/li>\n<li>Between 4 and 128 GB of RAM per node.<\/li>\n<li>10 Gb\/s and 20 Gb\/s high bandwith and low latency Infiniband SDR and DDR network.<\/li>\n<li>Main server to compile arina.<\/li>\n<\/ul>\n<p>Specific features of the nodes:<\/p>\n<table border=\"1\" cellpadding=\"3\">\n<tbody>\n<tr>\n<td align=\"LEFT\">Amount<\/td>\n<td align=\"LEFT\">Name<\/td>\n<td align=\"LEFT\">Type<\/td>\n<td align=\"RIGHT\">Proc<\/td>\n<td align=\"RIGHT\">Cores<\/td>\n<td align=\"RIGHT\">Speed<\/td>\n<td align=\"RIGHT\">RAM (GB)<\/td>\n<td align=\"RIGHT\">Disk (GB)<\/td>\n<td align=\"RIGHT\">Label<\/td>\n<\/tr>\n<tr>\n<td align=\"left\">1<\/td>\n<td align=\"left\">Arina<\/td>\n<td align=\"left\">Server<\/td>\n<td align=\"right\">2<\/td>\n<td align=\"right\">4<\/td>\n<td align=\"right\">1.6 GHz<\/td>\n<td align=\"right\">8<\/td>\n<td align=\"right\">&#8212;<\/td>\n<td align=\"right\">&#8212;<\/td>\n<\/tr>\n<tr>\n<td align=\"left\">1<\/td>\n<td align=\"left\">Arinaz<\/td>\n<td align=\"left\">Server<\/td>\n<td align=\"right\">2<\/td>\n<td align=\"right\">2<\/td>\n<td align=\"right\">1.3 GHz<\/td>\n<td align=\"right\">2<\/td>\n<td align=\"right\">&#8212;<\/td>\n<td align=\"right\">&#8212;<\/td>\n<\/tr>\n<tr>\n<td align=\"left\">4<\/td>\n<td align=\"left\">cndXX<\/td>\n<td align=\"left\">Node<\/td>\n<td align=\"right\">4<\/td>\n<td align=\"right\">8<\/td>\n<td align=\"right\">1.6 GHz<\/td>\n<td align=\"right\">16<\/td>\n<td align=\"right\">550<\/td>\n<td align=\"right\">itaniumb<\/td>\n<\/tr>\n<tr>\n<td align=\"left\">10<\/td>\n<td align=\"left\">cndXX<\/td>\n<td align=\"left\">Node<\/td>\n<td align=\"right\">4<\/td>\n<td align=\"right\">8<\/td>\n<td align=\"right\">1.6 GHz<\/td>\n<td align=\"right\">32<\/td>\n<td align=\"right\">550<\/td>\n<td align=\"right\">itaniumb<\/td>\n<\/tr>\n<tr>\n<td align=\"left\">1<\/td>\n<td align=\"left\">cnd43<\/td>\n<td align=\"left\">Node<\/td>\n<td align=\"right\">4<\/td>\n<td align=\"right\">8<\/td>\n<td align=\"right\">1.6 GHz<\/td>\n<td align=\"right\">64<\/td>\n<td align=\"right\">550<\/td>\n<td align=\"right\">itaniumb<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>All the Itanium2 computing nodes have the <em>itanium<\/em> label. The labels are used to select specific computing nodes.<\/p>\n<h2><\/h2>\n<h2 id=\"sfs\">High performance filesystems<\/h2>\n<p>In addition to the local file systems (<tt>\/scratch<\/tt>) nodes there are three shared file systems.<\/p>\n<ul>\n<li>HP-SFS with 4.7 TB, parallel write\/read in disk using Lustre technology. It can write at 400MB\/s and read at 600MB\/s ( a normal disk can do it at about 40-60 MB\/s) for Itanium2 and Opteron nodes.<\/li>\n<li>Lustre with 22 TB for Xeon (xeon8 and xeon12) nodes.<\/li>\n<li>Lustre with 40 TB,\u00a0 6.9 GB\/s write speed and 5.1 GB\/s read speed for Xeon (xeon20) nodes.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>General information Summary Arina has 3.728\u00a0cores distributed in 3.664\u00a0xeon cores, and 64\u00a0Itanium2 cores with RAM memory ranging from 16 to 512 GB per node. Four of the xeon nodes have 2 Nvidia Tesla cards each, another node with \u00a0two Nvidia Kepler 20, and another one with 2 Nvidia Kepler 40 . There are 3 high &hellip; <a href=\"https:\/\/www.ehu.eus\/sgi\/arina_en\/computational-resources\/arina-cluster-3\" class=\"more-link\">Seguir leyendo <span class=\"screen-reader-text\">Arina Cluster<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_links_to":"","_links_to_target":""},"categories":[237],"tags":[],"_links":{"self":[{"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/posts\/5649"}],"collection":[{"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/comments?post=5649"}],"version-history":[{"count":18,"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/posts\/5649\/revisions"}],"predecessor-version":[{"id":9204,"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/posts\/5649\/revisions\/9204"}],"wp:attachment":[{"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/media?parent=5649"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/categories?post=5649"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ehu.eus\/sgi\/wp-json\/wp\/v2\/tags?post=5649"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}