#apache #archlinux #asterisk #centos #debian #gentoo #haskell #kde #kubuntu #lisp #math #mysql #perl #python #ruby-lang #rubyonrails #suse #ubuntu #vim #wikipedia 0 1 2 3 4 5 6 7 8 9 10
Top Prev 2415 2416 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 Next
#gentoo
<testleper> endra: try netstat... it will tell you what the network activity for distcc is.
<testleper> netstat -taupe try
<endra> You see, instead of monitor whats being sent, monitor whats being received on the other end.. I think they should add it up
<endra> But hey, beggers can't be choosers
<endra> All is great so far.
<endra> Thanks a bunch! Now to verify all my GCC match lol
<pekster> endra: It's less useful, because only the box driving the compile job can see all the hosts in the cluster
<pekster> endra: But, feel free to submit a feature request, or better yet, a patch to do it :D
<endra> pekster: yes, that is true if you look at it that way :-)
<endra> pekster: I might just do that when I have time :)
<pekster> USE="client-monitor" distcc ;)
<pekster> errr, emerge in there too
<endra> well, would be server monitor but yea :P
<romanos> oh by the way, is gentoo supports my wireless card? i have an ipw3945
<endra> distcc is a great tool.
<pekster> endra: Well, distcc is a bit backwards, because the distcc server is really acting as a clieint to the machine telling it what to compile :P
<pekster> endra: Don't think too hard about that one ;)
<endra> Why hasn't anyone made a public network of distcc hosts to compile stuff for you? Like bit torrent :P
<pekster> endra: Compiling over Internet is slow. I set up a distcc over OpenVPN link using 2 residential cable uplinks, and there was little to no speed improvement, and it used a lot of bandwidth
<pekster> And that's with only -j1 on the box on the VPN link
<endra> Yes but with ccache and using over 200 clients, you could compile KDE in a very short while
<pekster> You have to be joking
<endra> No :-/
<endra> I just started using this.. I see no idea why people would not want to do that lol
<pekster> 200 * 4 = 800 processes ( distcc's default is /4 for each client in hosts file) and there's no way anything but a DS3 could handle that bandwidth
<pekster> As I said, just 1 (one process, not 800) used about 70% of my 360 kbps uplink line between 2 networks
<pekster> I did see about a 10-15% speed improvement, but it's not worth the hastle of the wasted bandwidth and setup
<endra> Yes, but what if it could be cached on the other end? Simply sending the package name and file to compile and the network will find a few people who already have that package, and they simply send you back its output
<endra> so its really your downstream in that case
<pekster> endra: It's the sending process that's the slow part
<pekster> endra: THe source is many times bigger than the object code received back
<britishseapower> err i pressed the "pause break" key by mistake and my screen blanked in make menuconfig, how do i retrun ?
<endra> Of course, but I am telling you what if we didnt have to send source
<pekster> endra: And most residential connections have a crappy upload speed (240 to 512 kbps is common)
<onewheelskyward> endra: If you did cache the libraries required, and communicated that to distcc, it could be quick. But I don't think distcc knows how to send that type of partial package.
<endra> What if we simply sent a hash code and it would already know what source file you are talking about
<rabidfurby> endra: there are also frightening security implications to implementing that on a large scale
<pekster> endra: How on earth could distcc not send source? "give me a compiled copy for kdelibs-1.2.4, patched for gentoo with patches #1, 3, 55, and 77 with the A B and C USE flags"
<pekster> That's impossible
<endra> Well yes, security is quite a problem
<testleper> pekster: I guess like bittorrent, the more popular variations would be more highly available
<pekster> testleper: Starting to sound like a binary distro ;)
<onewheelskyward> pekster: It's not necessarily impossible, it just takes time and storage to create it.
<endra> pekster: just like testleper said, but if someone else out there has already done it, he can HELP, after all they arent doing it for you, they are helping
<endra> pekster: gentoo, in the end, is a binary distro lol
<endra> Whether you compile it or someone elses computer, its all the same in the end
<testleper> pekster: :) you caught my drift... essentially that is what it would be, but the purveyor of binaries would be a distributed network, instead of a single monolithic package/distributor
<britishseapower> err i pressed the "pause break" key by mistake and my screen blanked in make menuconfig, how do i retrun ? any ideas what i did, i'm ssh'd in via putty?
<testleper> britishseapower: type fg <enter>
<testleper> pekster: which could have its advantages :)
Previous Page Next Page