Re: Budget Linux cluster suggestions?

> >

> > My design should be around 500, right out of my hat. > > > This is a 32 cores (16x2) solution. > > Mount 4 boards of 4 dual core atoms on a thin rack. > > Run it up to 5m away, not that you have to. > > PCIe signals run between 2.5Gb/s and 80 Gb/s. > > Latency is less than a microsecond. > > > =A0 =A0+-------+ =A0 =A0 =A0 =A0 +-----+ =A0 =A0| > > =A0 =A0| =A0CPU =A0|---PCI---| MEM | =A0 =A0| > > =A0 =A0+-------+ =A0 =A0 =A0 =A0 +-----+ =A0 =A0| > > =A0 =A0 =A0 =A0| =A0 =A0 =A0----+ =A0 =A0 =A0 =A0 =A0 =A0 |-----+ > > =A0 =A0 =A0 PCI =A0 =A0 | =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 | uSD | > > =A0 =A0 =A0 =A0| =A0 =A0 =A0CI =A0 =A0 =A0 =A0----+ =A0 |-----+ > > =A0 =A0+--------+ | =A0 =A0 =A0 =A0 | =A0 =A0 =A0 | > > =A0 =A0| Bridge | ----+ =A0 =A0 CI =A0 =A0 =A0| > > =A0 =A0+--------+ dge | =A0 =A0 | =A0 =A0 =A0 | > > =A0 =A0 =A0 =A0| =A0 =A0 =A0----+ ... ----+ =A0 | > > =A0 =A0 =A0 PCIe =A0 =A0| =A0 =A0 =A0 =A0 dge | =A0 | > > =A0 =A0 =A0 =A0#1 =A0 =A0PCIe =A0 =A0 =A0 ----+ =A0 | > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 #2 =A0 =A0 =A0 =A0| =A0 =A0 =A0 |=3D=3D=3D=

=3D=3D=3D

> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0PCIe =A0 =A0 |=3D=3D=3D=

=3D||

> =A0 1/4 of 1/2U rack =A0 =A0 =A0#4 =A0 =A0 =A0| =A0|||| > > --------------------------------+ =A0|||| > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=

||||

> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 5M PCIe cab=

le

> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=

||||

> --------------------------------+ =A0|||| > > =A0 =A0 =A0 1U PCIe cable adapter =A0 =A0 |=3D=3D=3D=3D|| > > -------------------------+ =A0 =A0 =A0|=3D=3D=3D=3D=3D=3D > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0+------+ > > > CPU: Intel Atom N270 $44 > > =A0 =A0 =A0or ARM A9 > > Bridge: Pericom PI7C9X130DNDE $28 > > MEM: Micron MT46H64M32L2JG $27 > > uSD: Sandisk 1G MicroSD boot drive $5 > > > PCIe PCB (x4) > > =A0 =A0CPU (x4) =A0 =A0 =A0 =A0 176 > > =A0 =A0PCIe to PCI (x4) 112 > > =A0 =A02G DRAM (x4) =A0 =A0 108 > > =A0 =A0Misc =A0 =A0 =A0 =A0 =A0 =A0 100 > > =A0 =A0PCIe adapter =A0 =A0 =A040 > > =A0 =A0-------------------- > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 500 > > ------------------------ > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A02000 > > PCIe is 2.5Gb lane, your bridge is 4 lanes so after data stream encoding > and packet over head will give about 800MB usable bandwidth per Atom. > This rate will only be with large transfer sizes and higher latency. > Smaller transfer sizes will give better latency but lower bandwidth.

Yes, no reason not to go with 16 lanes and 2.5Gb per CPU.

> Your memory is listed as samples at Micron and is not ECC. For large > memory and critical applications ECC it a must along with error rate > feedback. Does Atom even support this?

Probabbly not ECC, but error detection at least.

One of the major parts of HPC > bring up is memory burn in and getting rid of bad memory. You need not > only detection but bad sim callout for replacement. > > Running PCIe over a cable requires expensive connectors and cable - I > didn't see this in your pricing.

But only one off.

> There will be a bunch of special bios/firmware/device drivers needed for > the PCIe connection. Is this covered in your NRE along with board design?

Yes, only need modified network driver to emulate ethernet over PCIe.

Reply to
linnix
Loading thread data ...

ElectronDepot website is not affiliated with any of the manufacturers or service providers discussed here. All logos and trade names are the property of their respective owners.