Subject: Re: Non-fatal disconnects? - msg#00064

Previous Message by Date: click to view message preview

Re: Questions on basic BuildBot configuration

Perhaps your the relay param to the email notifier is bad?  Can you telnet to the host you gave the email notifier's constructor on the smtp port from the master?_MarkOn Feb 15, 2007, at 12:46 PM, Mary Fernandez wrote:Hi Mark,Thanks for your reply.  Yes, the ports matchand are both 9989. The second problem is definitely a firewall issue: our firewall simply won't permit traffic out on that port.  I will move the master to 80 and see what happens.But I think the first problem is different: I'm guessing it's the interface between the Twistedmail.smtp library and sendmail.  Or am I missingsomething?Thanks! MaryOn Thu, 2007-02-15 at 13:41, Mark Pauley wrote:So you can see the master on port 25... can you telnet onto the masteron port 9989 (or whatever port the master is running with)?Double check the master.cfg file and make sure the address and portare correct on both sides.  Also make sure you don't have a peskyfirewall, or you'll need to run the master on port 80 or somethinglike that._Mark On Feb 14, 2007, at 7:12 PM, Mary Fernandez wrote:Greetings,I have two very basic questions about BuildBotconfiguration problems that hopefully someone can answer easily.Thanks for any help in advance!-MaryGeneral config info:buildbot 0.7.5Twisted 2.0.1   CVSToys 1.0.10(CVSToys did not compile against Twisted 2.5, so I backedup to 2.0, which was in the same era as the CVSToys release)Problem #1: SMTP error when using mail.mailNotifier~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Configuration: FreshCVS, a buildbot master, anda buildbot slave are all running on the same machine.What happens: On a commit, FreshCVS sends mail to me (successfully) and also triggers a PBService event, which in turn, triggers the build master, which contactsthe slave.  The slave runs the job, returns the result to the buildmaster, which attempts to send a mail notification. Results in following error in twistd.log:[Uninitialized] SMTP Client retrying server. Retry: 1[Uninitialized] Unhandled error in Deferred:[Uninitialized] Traceback (most recent call last):   Failure: twisted.internet.error.ConnectionRefusedError:       Connection was refused by other side: 111: Connectionrefused.I was surprised, because FreshCVS's email succeededso I expected BuildBot's to as well.The difference is that FreshCVS's mail notifier invokes /usr/bin/sendmail explicitly as a shell command,whereas BuildBot uses the twisted.mail.smtp object.I'm guessing that sendmail on this machine is configuredin some way that ends up refusing connections from Twisted.Has anyone ever seen this before?  Any suggestions?Problem #2: Slave inside firewall cannot connect to master~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Configuration: FreshCVS and buildbot master are on machineoutside firewall.  buildbot slave is on machine insidefirewall (behind NAT)What happens: I can SSH from slave machine to mastermachine, check out source, and build successfully on theslave.   But when I try to start the slave daemon, it neverconnects to the master:[Uninitialized] <twisted.internet.tcp.Connector instance at0xb7b3e18c>will retry in 2 secondsRunning buildbot debugclient gives a bit more info:   [Failure instance: Traceback (failure with no frames): twisted.internet.error.ConnectError: An error occurred while    connecting: 113: No route to host.I'm guessing that this is the error when the daemon starts up.There's obviously a route to the host, because SSH works.Could this be due to incorrect address translation from the master back to the slave?  Any ideas are greatly appreciated.-- Mary Fernandez <mff-7WuBAv+fczCkVZkbZjKZZw@xxxxxxxxxxxxxxxx>AT&T Labs - Research-------------------------------------------------------------------------Take Surveys. Earn Cash. Influence the Future of ITJoin SourceForge.net's Techsay panel and you'll get the chance toshare youropinions on IT & business topics through brief surveys-and earn cashhttp://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________Buildbot-devel mailing listBuildbot-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxxhttps://lists.sourceforge.net/lists/listinfo/buildbot-devel-- Mary Fernandez <mff-7WuBAv+fczCkVZkbZjKZZw@xxxxxxxxxxxxxxxx>AT&T Labs - Research-------------------------------------------------------------------------Take Surveys. Earn Cash. Influence the Future of ITJoin SourceForge.net's Techsay panel and you'll get the chance to share youropinions on IT & business topics through brief surveys-and earn cashhttp://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________Buildbot-devel mailing listBuildbot-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxxhttps://lists.sourceforge.net/lists/listinfo/buildbot-devel------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________ Buildbot-devel mailing list Buildbot-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx https://lists.sourceforge.net/lists/listinfo/buildbot-devel

Next Message by Date: click to view message preview

Re: Non-fatal disconnects?

Could it be possible to use a utility like screen http://www.howtoforge.com/linux_screen to be able to re-attach to a lost process. This would be helpful for those people that have firewall/drop connections issues. Any thoughts... Thanks, Minesh buildbot-devel-request-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx wrote: Send Buildbot-devel mailing list submissions to buildbot-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/buildbot-devel or, via email, send a message with subject or body 'help' to buildbot-devel-request-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx You can reach the person managing the list at buildbot-devel-owner-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx When replying, please edit your Subject line so it is more specific than "Re: Contents of Buildbot-devel digest..." Today's Topics: 1. Re: Non-fatal disconnects? (Benoit Sigoure) 2. build log files (Bailey, Darragh) 3. Adding log files (Rafael Sanz) 4. Re: Questions on basic BuildBot configuration (Mark Pauley) ---------------------------------------------------------------------- Message: 1 Date: Fri, 16 Feb 2007 09:25:46 +0100 From: Benoit Sigoure <tsuna-+R3Ik2xuP/1XyE3A67eCUw@xxxxxxxxxxxxxxxx> Subject: Re: [Buildbot-devel] Non-fatal disconnects? To: Simon Marlow <simonmarhaskell-Re5JQEeQqe8AvxtiuMwx3w@xxxxxxxxxxxxxxxx> Cc: buildbot-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx Message-ID: <20070216092546.wroypm4qm08ocwgk-2RFepEojUI1w+PH6qX40TA@xxxxxxxxxxxxxxxx> Content-Type: text/plain; charset=ISO-8859-1; format="flowed" Quoting Simon Marlow <simonmarhaskell-Re5JQEeQqe8AvxtiuMwx3w@xxxxxxxxxxxxxxxx>: Hi there, The GHC project has just set up a buildbot: http://darcs.haskell.org/buildbot/all/. The single biggest problem we have is that some of our clients get accidentally disconnected during a build, probably the main reason being flaky firewall setups. There's not a lot we can do about this, unfortunately. Builds take several hours, making it all the more likely that a disconnect occurs during a build. I wonder if it would be possible to make transient disconnections non-fatal, such that a disconnection wouldn't interrupt an ongoing build, as long as the connection was restored within a suitably short time period? I think this would be our #1 feature request as far as improving our buildbot experience goes. Cheers, Simon Hello Simon, I would also love to have this feature in BuildBot, but in the mean time, you can still connect your buildslaves to their buildmaster through a SSH tunnel (SSH is quite good at keeping connections open). ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________ Buildbot-devel mailing list Buildbot-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@xxxxxxxxxxxxxxxx https://lists.sourceforge.net/lists/listinfo/buildbot-devel

Previous Message by Thread: click to view message preview

Re: Non-fatal disconnects?

Quoting Simon Marlow <simonmarhaskell-Re5JQEeQqe8AvxtiuMwx3w@xxxxxxxxxxxxxxxx>: > Hi there, > > The GHC project has just set up a buildbot: > http://darcs.haskell.org/buildbot/all/. The single biggest problem > we have is > that some of our clients get accidentally disconnected during a > build, probably > the main reason being flaky firewall setups. There's not a lot we > can do about > this, unfortunately. Builds take several hours, making it all the > more likely > that a disconnect occurs during a build. > > I wonder if it would be possible to make transient disconnections non-fatal, > such that a disconnection wouldn't interrupt an ongoing build, as long as the > connection was restored within a suitably short time period? I think > this would > be our #1 feature request as far as improving our buildbot experience goes. > > Cheers, > Simon > Hello Simon, I would also love to have this feature in BuildBot, but in the mean time, you can still connect your buildslaves to their buildmaster through a SSH tunnel (SSH is quite good at keeping connections open). -- SIGOURE Benoit aka Tsuna _____ /EPITA\ Promo 2008, LRDE ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV

Next Message by Thread: click to view message preview

Re: Non-fatal disconnects?

Mark Pauley wrote: > Can I take this opportunity to complain about how long it takes to build > GHC? > > Is this unavoidable? It takes less time to build gcc on os x :( > I've seen my ghc builds run so long that I thought they were hung... > what gives? [ off-topic, so Reply-To set to glasgow-haskell-users-HC+Z4NTRIlBAfugRpC6u6w@xxxxxxxxxxxxxxxx ] Our default setup gives you a slow build for a few reasons: optimisation is set high, compiling via C is the default, GHC itself has to be built twice, and we ship a lot of extra libraries. However, many of these things can be tweaked, and it has been reported that you can get a GHC build down to under 8 minutes on a dual-core, if you're prepared to sacrifice optimisation and extra libraries. However, you can speed up the build a *lot* just by using the native code generator instead of compiling via C: gcc has been getting quite a bit slower recently. Full details on how to tweak the GHC build are here: http://hackage.haskell.org/trac/ghc/wiki/Building/Hacking Cheers, Simon ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV