Re: distributed make within torque

For the record:

I found "pvmgmake" at http://pvmgmake.sourceforge.net/ . It seems to
work admirably for my purposes.  It's based on GNU make 3.80 and has PVM
job dispatch in the "customs" code.

The sole issue is that there seems to be some delays during the "make".
However, this is pretty minor (especially with a job we anticipate
running for days).

Thanks again

Michael


On Tue, 2007-07-24 at 11:09 -0700, Michael Gutteridge wrote:
> Actually, it's not building software, rather using "make" logic to sort
> out dependencies and work-flow.  A primitive job array?
> 
> Anyway, without a drop-in "make" replacement I'm likely going to just
> modify the pipeline I was given.  The other option would be running sge
> in conjunction with Torque, but that's messier than I'd like it to be.
> I was really hoping for a "tmake" to parallel SGE's "qmake".
> 
> Thanks to all..
> 
> Michael
> 
> On Fri, 2007-07-20 at 16:01 +0000, Joshua Bernstein wrote:
> > Michael,
> > 
> > > I haven't ever seen a distributed make for Torque- theoretically one
> > > could be developed, but I don't know if that's within my skill set or if
> > > it's worth the effort.
> > 
> > Have you ever looked at using distCC? It also GCC and consequenly make 
> > to be distributed across multiple machines. I've used several times. Its 
> > easily implemented into your current make system with something like:
> > 
> > make CC=distcc
> > 
> > -Joshua Bernstein
> > Software Engineer
> > Penguin Computing