Обсуждение: mirroring problem (www.postgresql.org)
Hi, seems something wrong with rsync mirroring. I use rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/ and it does well but no images from /images directory are copied. So my mirror http://www.sai.msu.su:8000/ looks corrupt Regards, Oleg _____________________________________________________________ Oleg Bartunov, sci.researcher, hostmaster of AstroNet, Sternberg Astronomical Institute, Moscow University (Russia) Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(095)939-16-83, +007(095)939-23-83
On Thu, 17 Jun 1999, Oleg Bartunov wrote: > Hi, > > seems something wrong with rsync mirroring. > I use > rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/ > and it does well but no images from /images directory are copied. > So my mirror http://www.sai.msu.su:8000/ looks corrupt Are you on the mirrors mailing list? We're trying to get all of the mirror admins on it to contact them easier. Anyway, I dropped your site from automatic redirect while we figure out what happened. There are two other directories that also don't appear to be transferring: css and js. I've already asked Marc to look into it - dunno if he came up with anything yet. It also appears to only be happening to the sites that have an extra directory in their URL; eg: Vince. -- ========================================================================== Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null # include <std/disclaimers.h> TEAM-OS2 Online Campground Directory http://www.camping-usa.com Online Giftshop Superstore http://www.cloudninegifts.com ==========================================================================
On Thu, 17 Jun 1999, Vince Vielhaber wrote: > On Thu, 17 Jun 1999, Oleg Bartunov wrote: > > > Hi, > > > > seems something wrong with rsync mirroring. > > I use > > rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/ > > and it does well but no images from /images directory are copied. > > So my mirror http://www.sai.msu.su:8000/ looks corrupt > > Are you on the mirrors mailing list? We're trying to get all of the > mirror admins on it to contact them easier. Anyway, I dropped your > site from automatic redirect while we figure out what happened. There > are two other directories that also don't appear to be transferring: > css and js. I've already asked Marc to look into it - dunno if he > came up with anything yet. It also appears to only be happening to > the sites that have an extra directory in their URL; eg: Just tested things out here, and it created the images directory and all...is rsync generating any error messages? *raised eyebrow* There is nothing configured on hub.org to exclude the images directory... Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy Systems Administrator @ hub.org primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org
> There is nothing configured on hub.org to exclude the
> images directory...
Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...
- Thomas
--
Thomas Lockhart lockhart@alumni.caltech.edu
South Pasadena, California
On Thu, 17 Jun 1999, Thomas Lockhart wrote:
> > There is nothing configured on hub.org to exclude the
> > images directory...
>
> Sorry in advance for the re/misdirection, but would CVSup be a
> suitable alternative for this task? It is working *great* for me to
> replicate the CVS tree, but it also handles normal directory trees. It
> includes lots of compression optimizations and so is very fast...
What was used before rsync that was the bandwidth hog? Wasn't cvs, was
it?
Vince.
--
==========================================================================
Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null # include <std/disclaimers.h>
TEAM-OS2 Online Campground Directory http://www.camping-usa.com Online Giftshop Superstore
http://www.cloudninegifts.com
==========================================================================
On Thu, Jun 17, 1999 at 01:54:33PM +0000, Thomas Lockhart wrote: > > There is nothing configured on hub.org to exclude the > > images directory... > > Sorry in advance for the re/misdirection, but would CVSup be a > suitable alternative for this task? It is working *great* for me to > replicate the CVS tree, but it also handles normal directory trees. It > includes lots of compression optimizations and so is very fast... Please don;t force us to use CVSup - you have to have Modula-3 to compile it, and some organisations (mine mostly included) has to start from source for all this stuff... Regards, -- Peter Galbavy Knowledge Matters Ltd http://www.knowledge.com/
> > Sorry in advance for the re/misdirection, but would CVSup be a
> > suitable alternative for this task? It is working *great* for me to
> > replicate the CVS tree, but it also handles normal directory trees. It
> > includes lots of compression optimizations and so is very fast...
> Please don;t force us to use CVSup - you have to have Modula-3 to
> compile it, and some organisations (mine mostly included) has to start
> from source for all this stuff...
Another enthusiast... ;)
I'm not sure what platform you are on, but there is a *very* nice
Modula-3 rpm package from Polytechnic University in Montreal for
linux.
Anyway, for some mirrors CVSup might be a good alternative since Marc
is already running a server. Also, CVSup has a "mirror sync" mode
which makes it even faster; if the mirror is run as a slave server
then the server leaves all of the sync info in cache and does not need
to traverse the directory tree to deduce what should be updated.
- Thomas
--
Thomas Lockhart lockhart@alumni.caltech.edu
South Pasadena, California
Vince, I found the problem and fixed it. The problem was because I have alias /images in my main site and it propagates to virtual site. btw, http://www.postgresql.org redirected to http://www.postgresql.org/postgresql.wplus.net This happens with NS 4.05, win95 Regards, Oleg On Thu, 17 Jun 1999, Vince Vielhaber wrote: > Date: Thu, 17 Jun 1999 06:57:37 -0400 (EDT) > From: Vince Vielhaber <vev@michvhf.com> > To: Oleg Bartunov <oleg@sai.msu.su> > Cc: pgsql-hackers@hub.org > Subject: Re: [HACKERS] mirroring problem (www.postgresql.org) > > On Thu, 17 Jun 1999, Oleg Bartunov wrote: > > > Hi, > > > > seems something wrong with rsync mirroring. > > I use > > rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/ > > and it does well but no images from /images directory are copied. > > So my mirror http://www.sai.msu.su:8000/ looks corrupt > > Are you on the mirrors mailing list? We're trying to get all of the > mirror admins on it to contact them easier. Anyway, I dropped your > site from automatic redirect while we figure out what happened. There > are two other directories that also don't appear to be transferring: > css and js. I've already asked Marc to look into it - dunno if he > came up with anything yet. It also appears to only be happening to > the sites that have an extra directory in their URL; eg: > > Vince. > -- > ========================================================================== > Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null > # include <std/disclaimers.h> TEAM-OS2 > Online Campground Directory http://www.camping-usa.com > Online Giftshop Superstore http://www.cloudninegifts.com > ========================================================================== > > > > _____________________________________________________________ Oleg Bartunov, sci.researcher, hostmaster of AstroNet, Sternberg Astronomical Institute, Moscow University (Russia) Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(095)939-16-83, +007(095)939-23-83
On Thu, 17 Jun 1999, Oleg Bartunov wrote: > Vince, > > I found the problem and fixed it. The problem was because I have > alias /images in my main site and it propagates to virtual site. > > btw, http://www.postgresql.org redirected to > http://www.postgresql.org/postgresql.wplus.net > This happens with NS 4.05, win95 Should be back in business now. msu.su has been added back into the mirror list and the above was a typo that's been corrected. Thanks! Vince. -- ========================================================================== Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null # include <std/disclaimers.h> TEAM-OS2 Online Campground Directory http://www.camping-usa.com Online Giftshop Superstore http://www.cloudninegifts.com ==========================================================================
On Thu, 17 Jun 1999, Thomas Lockhart wrote:
> > There is nothing configured on hub.org to exclude the
> > images directory...
>
> Sorry in advance for the re/misdirection, but would CVSup be a
> suitable alternative for this task? It is working *great* for me to
> replicate the CVS tree, but it also handles normal directory trees. It
> includes lots of compression optimizations and so is very fast...
Rsync basically does the same thing, but cleaner...and doesn't require
Modula-3 to install.
Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org
On Thu, 17 Jun 1999, Vince Vielhaber wrote:
> On Thu, 17 Jun 1999, Thomas Lockhart wrote:
>
> > > There is nothing configured on hub.org to exclude the
> > > images directory...
> >
> > Sorry in advance for the re/misdirection, but would CVSup be a
> > suitable alternative for this task? It is working *great* for me to
> > replicate the CVS tree, but it also handles normal directory trees. It
> > includes lots of compression optimizations and so is very fast...
>
> What was used before rsync that was the bandwidth hog? Wasn't cvs, was
> it?
Nope, ftp/mirror, except that ftp/mirror requires the client to do their
configuration cleanly, whereas with rsync I can setup our end to exclude
stuff (ie. ht/Dig databases)
Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org