HighDots.NET Computer Hardware Forums  

Building a Distributed Supercomputer

Homebuilt Computer Hardware Discussion of homebuilt computer hardware (alt.comp.hardware.homebuilt). Postings may deal with real hardware, or absract concepts, and are not restricted to any specific cpu or architecture. Topics may also include homebuilt peripherals added to existing off the shelf systems, or hardware hacks to existing systems/accessories.


Discuss Building a Distributed Supercomputer in the Homebuilt Computer Hardware forum.



Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old   
Gavin Brewer
 
Posts: n/a

Default Building a Distributed Supercomputer - 11-24-2006 , 10:34 AM






Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.

Physically constructing such a system is a straightforward enough
exercise, but finding and configuring a truly distributed OS (like
AMOEBA or some such) is a rather daunting prospect.

I suppose creating a Linux Beowulf cluster is one option, but I would
really like to hear some sound alternatives.

Thanks guys,
Gavin Brewer.

Reply With Quote
  #2  
Old   
Paul
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-24-2006 , 01:08 PM






Gavin Brewer wrote:
Quote:
Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.

Physically constructing such a system is a straightforward enough
exercise, but finding and configuring a truly distributed OS (like
AMOEBA or some such) is a rather daunting prospect.

I suppose creating a Linux Beowulf cluster is one option, but I would
really like to hear some sound alternatives.

Thanks guys,
Gavin Brewer.
Some background here:

http://en.wikipedia.org/wiki/Cluster_computing
http://en.wikipedia.org/wiki/Beowulf_%28computing%29

Paul


Reply With Quote
  #3  
Old   
Brendan Gillatt
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-26-2006 , 02:17 PM



On Fri, 24 Nov 2006 15:34:23 +0000, Gavin Brewer <gb (AT) axicon (DOT) com>
wrote:

Quote:
Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.

Physically constructing such a system is a straightforward enough
exercise, but finding and configuring a truly distributed OS (like
AMOEBA or some such) is a rather daunting prospect.

I suppose creating a Linux Beowulf cluster is one option, but I would
really like to hear some sound alternatives.

Thanks guys,
Gavin Brewer.
Have a look here: http://www.shadowflux.com/xbox.html - Xbox 1s are
real cheap at the moment - must have cost him a fortune at that time.



Reply With Quote
  #4  
Old   
philo
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-27-2006 , 04:32 PM




"Gavin Brewer" <gb (AT) axicon (DOT) com> wrote

Quote:
Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.


Nope, not worth it...
if you use a bunch of *free* machines...

vs just one very high end such as a dual core...

the energy they will take will make the whole project un-feasible




Reply With Quote
  #5  
Old   
kony
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-27-2006 , 04:51 PM



On Mon, 27 Nov 2006 15:32:45 -0600, "philo"
<philo (AT) privacy (DOT) net> wrote:

Quote:
"Gavin Brewer" <gb (AT) axicon (DOT) com> wrote in message
news:1164382467.17061.0 (AT) proxy01 (DOT) news.clara.net...
Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.



Nope, not worth it...
if you use a bunch of *free* machines...

vs just one very high end such as a dual core...

the energy they will take will make the whole project un-feasible


Depends on how much processing power is needed, as well as
memory bandwidth, etc. I don't recall seeing any "low cost
single-board computers" though, they tend to cost quite a
bit for what they are though the lower volume sales might
easily account for that.


Reply With Quote
  #6  
Old   
philo
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-27-2006 , 06:40 PM



<snip>
Quote:
Depends on how much processing power is needed, as well as
memory bandwidth, etc. I don't recall seeing any "low cost
single-board computers" though, they tend to cost quite a
bit for what they are though the lower volume sales might
easily account for that.
Well when the X2's first came out...I waited a while and built a machine
as soon as the first price break came...
but now an X2-3800 is dirt cheap ...

Even though the electric bill to run a computer is not terribly high...
If one ran a dozen or so lower end machines...the cost of electricity would
make
the project a bit unattractive.




Reply With Quote
  #7  
Old   
SteveSch
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-28-2006 , 07:02 PM



On Fri, 24 Nov 2006 15:34:23 +0000, Gavin Brewer wrote:

Quote:
Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.
Have you seen:

http://www.mini-itx.com/projects/cluster/

Good luck,
Steve


Reply With Quote
  #8  
Old   
Andrew Smallshaw
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-29-2006 , 06:00 PM



On 2006-11-29, SteveSch <THISEMAIL (AT) IS_FAKE (DOT) COM> wrote:
12 nodes? That's a slightly generous definition of massively
parallel...

I have quite a bit of experience with the VIA EPIA boards, and
generally rate them, but I wouldn't consider them for performance.
Added to that, if you don't need everything (video, audio etc) on
board each system, a standard mid-range ATX mobo and chip will be
both cheaper and faster.

--
Andrew Smallshaw
andrews (AT) sdf (DOT) lonestar.org


Reply With Quote
  #9  
Old   
philo
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 11-29-2006 , 06:43 PM




"SteveSch" <THISEMAIL (AT) IS_FAKE (DOT) COM> wrote

Quote:
On Fri, 24 Nov 2006 15:34:23 +0000, Gavin Brewer wrote:

Folks,

I am considering the feasability of building a distributed system out of
a network of low-cost single-board computers.

Have you seen:

http://www.mini-itx.com/projects/cluster/

Good luck,
Steve

That was a good article and I'm sure it must have been a lot of fun building
the machine.
It almost seemed like a worthwhile project until I read the "maintenance"
section and saw that it is *typical* to
have two nodes down (and I quote ):
"Plan on having about ten percent of the cluster failed or failing at any
given time. If you need a machine with 10 nodes operational, you had best
plan on having 12 nodes, and some spare parts. The larger the cluster is,
the more failed hardware you can expect. Really large clusters have hardware
failures on a more or less continuous basis. Alternatively, you can just
build a lot of extra nodes and take bad nodes offline as the cluster "burns
in" (this seems expensive and wasteful to me). Run the cluster on a good
UPS. It is not an option. You need clean power to get good hardware life,
and with this many computers the investment in a UPS will pay off in terms
of longer hardware life."



That's *totally* unacceptable. On my own machines I'd consider two failures
a year to be excessive!@!!






Reply With Quote
  #10  
Old   
Bob Fry
 
Posts: n/a

Default Re: Building a Distributed Supercomputer - 12-28-2006 , 09:59 PM



Quote:
"GB" == Gavin Brewer <gb (AT) axicon (DOT) com> writes:
GB> Folks, I am considering the feasability of building a
GB> distributed system out of a network of low-cost single-board
GB> computers.

What is the intended use or purpose of this network?
- Best MFLOPS/$ ?
- Fault tolerant computing?
- Experimentation?


--
Politics doesn't make strange bedfellows, marriage does.
Groucho Marx


Reply With Quote
Reply




Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.