[lnkForumImage]
TotalShareware - Download Free Software
Confronta i prezzi di migliaia di prodotti.
Asp Forum
 Home | Login | Register | Search 


 

Forums >

comp.lang.ruby

Grid computing with Ruby?

Alexander Staubo

2/8/2005 12:19:00 AM

I have an interest in distributed computing and so-called grid
computing. Has anyone here done, or know of, any grid processing with Ruby?

Alexander.
10 Answers

Dave Burt

2/8/2005 1:27:00 AM

0

"Alexander Staubo" <alex@byzantine.no> wrote:
>I have an interest in distributed computing and so-called grid computing.
>Has anyone here done, or know of, any grid processing with Ruby?

There is rq (ruby queue) by Ara. T. Howard:

http://raa.ruby-lang.org/p...

rq is a tool used to build instant linux clusters
ruby queue (rq) is a tool used to create instant linux clusters by managing
sqlite databases as nfs mounted priority work queues. multiple instances of
rq running from multiples hosts can work from these queues to distribute
processing load to n nodes - bringing many dozens of otherwise powerful cpus
to their knees with a single blow. clearly this software should be kept out
of the hands of free radicals, seti enthusiasts, and j. safran.

the central concept of rq is that n nodes work in isolation to pull jobs
from an central nfs mounted priority work queue in a synchronized fashion.
the nodes have absolutely no knowledge of each other and all communication
if done via the queue meaning that, so long as the queue is available via
nfs and a single node is running jobs from it, the system will continue to
process jobs. there is no centralized process whatsoever - all nodes work to
take jobs from the queue and run them as fast as possible. this creates a
system which load balances automatically and is robust in face of node
failures.

Alexander Staubo

2/8/2005 2:45:00 AM

0

Interesting. Unfortunately, the dependency on a central NFS mount rules
out rq for my purposes.

Alexander.

Dave Burt wrote:
> "Alexander Staubo" <alex@byzantine.no> wrote:
>
>>I have an interest in distributed computing and so-called grid computing.
>>Has anyone here done, or know of, any grid processing with Ruby?
>
>
> There is rq (ruby queue) by Ara. T. Howard:
>
> http://raa.ruby-lang.org/p...
>
> rq is a tool used to build instant linux clusters
> ruby queue (rq) is a tool used to create instant linux clusters by managing
> sqlite databases as nfs mounted priority work queues. multiple instances of
> rq running from multiples hosts can work from these queues to distribute
> processing load to n nodes - bringing many dozens of otherwise powerful cpus
> to their knees with a single blow. clearly this software should be kept out
> of the hands of free radicals, seti enthusiasts, and j. safran.
>
> the central concept of rq is that n nodes work in isolation to pull jobs
> from an central nfs mounted priority work queue in a synchronized fashion.
> the nodes have absolutely no knowledge of each other and all communication
> if done via the queue meaning that, so long as the queue is available via
> nfs and a single node is running jobs from it, the system will continue to
> process jobs. there is no centralized process whatsoever - all nodes work to
> take jobs from the queue and run them as fast as possible. this creates a
> system which load balances automatically and is robust in face of node
> failures.
>
>
>
>
>



Ralf Müller

2/8/2005 8:09:00 AM

0

On Tue, 8 Feb 2005 09:18:55 +0900
Alexander Staubo <alex@byzantine.no> wrote:

> I have an interest in distributed computing and so-called grid
> computing. Has anyone here done, or know of, any grid processing with Ruby?
>
> Alexander.
>

Maybe it's not what you meant, but there is a MPI-API in Ruby.
You can find it under http://www-unix.mcs.anl.gov/mpi....

regards
ralf

ptkwt

2/8/2005 9:41:00 AM

0

In article <4208277B.1030605@byzantine.no>,
Alexander Staubo <alex@byzantine.no> wrote:
>Interesting. Unfortunately, the dependency on a central NFS mount rules
>out rq for my purposes.
>


There's also TaskMaster (I think it's still on the RAA), but I haven't
updated it in ages. I was going to try to take it in a more P2P
direction.

TaskMaster distributes task objects via drb. As long as you define a
'run' method on your class it can be distributed.

I would tend to think that TaskMaster doesn't work with 1.8.x, but you
could probably get it running without too many changes... Also, there was
a Dr. Dobb's article on it 2 or 3 years ago. If you're interested I can
try to dig up the links.



Phil

Jim Freeze

2/8/2005 2:27:00 PM

0

* Ralf Müller <r_mueller@imp-ag.de> [2005-02-08 17:08:56 +0900]:

> Maybe it's not what you meant, but there is a MPI-API in Ruby.
> You can find it under http://www-unix.mcs.anl.gov/mpi....

Hmm, there is MPIRuby that was presented at the very first
Ruby conference by Emil Ong.
I found it in the RAA:
http://raa.ruby-lang.org/search.rhtml?sear...

Is this what you are looking for?
--
Jim Freeze
Code Red. Code Ruby

Ralf Müller

2/8/2005 2:41:00 PM

0

On Tue, 8 Feb 2005 23:26:41 +0900
jim@freeze.org wrote:

> * Ralf Müller <r_mueller@imp-ag.de> [2005-02-08 17:08:56 +0900]:
>
> > Maybe it's not what you meant, but there is a MPI-API in Ruby.
> > You can find it under http://www-unix.mcs.anl.gov/mpi....
>
> Hmm, there is MPIRuby that was presented at the very first
> Ruby conference by Emil Ong.
> I found it in the RAA:
> http://raa.ruby-lang.org/search.rhtml?sear...
>
> Is this what you are looking for?
> --
> Jim Freeze
> Code Red. Code Ruby
>
I read about Emil's mpiruby in a book from 2002, found the given url still active and nothing under rubyforge. i posted the url for Alex.
Didn't search raa ;)

but the homepage (http://mpiruby.sourc...) of the raa-project seems to be almost a copy of http://www-unix.mcs.anl.gov/mp....



Cameron McBride

2/8/2005 5:15:00 PM

0

> but the homepage (http://mpiruby.sourc...) of the raa-project seems to be almost a copy of http://www-unix.mcs.anl.gov/mp....

an updated copy it appears.

Cameron

Alexander Staubo

2/8/2005 10:07:00 PM

0

Ralf Müller wrote:
> Maybe it's not what you meant, but there is a MPI-API in Ruby.
> You can find it under http://www-unix.mcs.anl.gov/mpi....

I'm not familiar enough with MPI to say whether it suits my purpose;
however, I do know it's only useful insofar as there are free
P2P/socket-based implementations available. I'll take a look.

Alexander.

Booker C. Bense

2/8/2005 10:30:00 PM

0

-----BEGIN PGP SIGNED MESSAGE-----

In article <4208055D.9070806@byzantine.no>,
Alexander Staubo <alex@byzantine.no> wrote:
>I have an interest in distributed computing and so-called grid
>computing. Has anyone here done, or know of, any grid processing with Ruby?
>

_ If by "grid" you mean Globus, then I don't think there are any
Ruby interfaces. However, since Globus toolkit 4 is pretty much
just web services with some state, grid computing is getting
much closer to Ruby every day.

_ Most GT4 stuff is being implemented in Java.

_ Booker C. Bense


-----BEGIN PGP SIGNATURE-----
Version: 2.6.2

iQCVAwUBQgk9amTWTAjn5N/lAQEtwQP/W52aKGL/I5u5SEG/pv8Lp2XOYt2vAura
ryXg+FbFGwd7aqxDRyhWYEn/7jfTfDLPok6RykA6dsePVp7OZifvp/IT5IQKZbMu
lx+ZAgEsuw7V4QUvDldC8V2+sM5+VnMPHzLaptD16SwRPNSqoPBwSgt2SJzjuw/o
1drRnNQZjG4=
=12Tv
-----END PGP SIGNATURE-----

Ralf Müller

2/9/2005 7:30:00 AM

0

On Wed, 9 Feb 2005 07:06:39 +0900
Alexander Staubo <alex@byzantine.no> wrote:

> Ralf Müller wrote:
> > Maybe it's not what you meant, but there is a MPI-API in Ruby.
> > You can find it under http://www-unix.mcs.anl.gov/mpi....
>
> I'm not familiar enough with MPI to say whether it suits my purpose;
> however, I do know it's only useful insofar as there are free
> P2P/socket-based implementations available. I'll take a look.
>
> Alexander.
>
Take a look at LAM = Local Area Multicomputer, its a full implementation of MPI (http://www.l...). I used it to test geophysical simulation (in C ,about 5 years ago) and was very satisfied.
But i did not test the mpiruby package.

regards
ralf