Обсуждение: mirroring problem (www.postgresql.org)

Поиск
Список
Период
Сортировка

mirroring problem (www.postgresql.org)

От
Oleg Bartunov
Дата:
Hi,

seems something wrong with rsync mirroring.
I use 
rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
and it does well but no images from /images directory are copied.
So my mirror http://www.sai.msu.su:8000/ looks corrupt
Regards,
    Oleg


_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83



Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Vince Vielhaber
Дата:
On Thu, 17 Jun 1999, Oleg Bartunov wrote:

> Hi,
> 
> seems something wrong with rsync mirroring.
> I use 
> rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
> and it does well but no images from /images directory are copied.
> So my mirror http://www.sai.msu.su:8000/ looks corrupt

Are you on the mirrors mailing list?  We're trying to get all of the
mirror admins on it to contact them easier.   Anyway, I dropped your
site from automatic redirect while we figure out what happened.  There
are two other directories that also don't appear to be transferring:
css and js.  I've already asked Marc to look into it - dunno if he
came up with anything yet.  It also appears to only be happening to
the sites that have an extra directory in their URL; eg:

Vince.
-- 
==========================================================================
Vince Vielhaber -- KA8CSH   email: vev@michvhf.com   flame-mail: /dev/null      # include <std/disclaimers.h>
       TEAM-OS2       Online Campground Directory    http://www.camping-usa.com      Online Giftshop Superstore
http://www.cloudninegifts.com
==========================================================================





Re: [HACKERS] mirroring problem (www.postgresql.org)

От
The Hermit Hacker
Дата:
On Thu, 17 Jun 1999, Vince Vielhaber wrote:

> On Thu, 17 Jun 1999, Oleg Bartunov wrote:
> 
> > Hi,
> > 
> > seems something wrong with rsync mirroring.
> > I use 
> > rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
> > and it does well but no images from /images directory are copied.
> > So my mirror http://www.sai.msu.su:8000/ looks corrupt
> 
> Are you on the mirrors mailing list?  We're trying to get all of the
> mirror admins on it to contact them easier.   Anyway, I dropped your
> site from automatic redirect while we figure out what happened.  There
> are two other directories that also don't appear to be transferring:
> css and js.  I've already asked Marc to look into it - dunno if he
> came up with anything yet.  It also appears to only be happening to
> the sites that have an extra directory in their URL; eg:

Just tested things out here, and it created the images directory and
all...is rsync generating any error messages? *raised eyebrow*

There is nothing configured on hub.org to exclude the images directory...

Marc G. Fournier                   ICQ#7615664               IRC Nick: Scrappy
Systems Administrator @ hub.org 
primary: scrappy@hub.org           secondary: scrappy@{freebsd|postgresql}.org 



Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Thomas Lockhart
Дата:
> There is nothing configured on hub.org to exclude the 
> images directory...

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...
                 - Thomas

-- 
Thomas Lockhart                lockhart@alumni.caltech.edu
South Pasadena, California


Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Vince Vielhaber
Дата:
On Thu, 17 Jun 1999, Thomas Lockhart wrote:

> > There is nothing configured on hub.org to exclude the 
> > images directory...
> 
> Sorry in advance for the re/misdirection, but would CVSup be a
> suitable alternative for this task? It is working *great* for me to
> replicate the CVS tree, but it also handles normal directory trees. It
> includes lots of compression optimizations and so is very fast...

What was used before rsync that was the bandwidth hog?  Wasn't cvs, was
it?

Vince.
-- 
==========================================================================
Vince Vielhaber -- KA8CSH   email: vev@michvhf.com   flame-mail: /dev/null      # include <std/disclaimers.h>
       TEAM-OS2       Online Campground Directory    http://www.camping-usa.com      Online Giftshop Superstore
http://www.cloudninegifts.com
==========================================================================





Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Peter Galbavy
Дата:
On Thu, Jun 17, 1999 at 01:54:33PM +0000, Thomas Lockhart wrote:
> > There is nothing configured on hub.org to exclude the 
> > images directory...
> 
> Sorry in advance for the re/misdirection, but would CVSup be a
> suitable alternative for this task? It is working *great* for me to
> replicate the CVS tree, but it also handles normal directory trees. It
> includes lots of compression optimizations and so is very fast...

Please don;t force us to use CVSup - you have to have Modula-3 to
compile it, and some organisations (mine mostly included) has to start
from source for all this stuff...

Regards,
-- 
Peter Galbavy
Knowledge Matters Ltd
http://www.knowledge.com/


Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Thomas Lockhart
Дата:
> > Sorry in advance for the re/misdirection, but would CVSup be a
> > suitable alternative for this task? It is working *great* for me to
> > replicate the CVS tree, but it also handles normal directory trees. It
> > includes lots of compression optimizations and so is very fast...
> Please don;t force us to use CVSup - you have to have Modula-3 to
> compile it, and some organisations (mine mostly included) has to start
> from source for all this stuff...

Another enthusiast... ;)

I'm not sure what platform you are on, but there is a *very* nice
Modula-3 rpm package from Polytechnic University in Montreal for
linux.

Anyway, for some mirrors CVSup might be a good alternative since Marc
is already running a server. Also, CVSup has a "mirror sync" mode
which makes it even faster; if the mirror is run as a slave server
then the server leaves all of the sync info in cache and does not need
to traverse the directory tree to deduce what should be updated.
                   - Thomas

-- 
Thomas Lockhart                lockhart@alumni.caltech.edu
South Pasadena, California


SOLVED: Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Oleg Bartunov
Дата:
Vince,

I found the problem and fixed it. The problem was because I have
alias /images in my main site and it propagates to  virtual  site.

btw, http://www.postgresql.org redirected to 
http://www.postgresql.org/postgresql.wplus.net
This happens with NS 4.05, win95
Regards,
    Oleg
On Thu, 17 Jun 1999, Vince Vielhaber wrote:

> Date: Thu, 17 Jun 1999 06:57:37 -0400 (EDT)
> From: Vince Vielhaber <vev@michvhf.com>
> To: Oleg Bartunov <oleg@sai.msu.su>
> Cc: pgsql-hackers@hub.org
> Subject: Re: [HACKERS] mirroring problem (www.postgresql.org)
> 
> On Thu, 17 Jun 1999, Oleg Bartunov wrote:
> 
> > Hi,
> > 
> > seems something wrong with rsync mirroring.
> > I use 
> > rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
> > and it does well but no images from /images directory are copied.
> > So my mirror http://www.sai.msu.su:8000/ looks corrupt
> 
> Are you on the mirrors mailing list?  We're trying to get all of the
> mirror admins on it to contact them easier.   Anyway, I dropped your
> site from automatic redirect while we figure out what happened.  There
> are two other directories that also don't appear to be transferring:
> css and js.  I've already asked Marc to look into it - dunno if he
> came up with anything yet.  It also appears to only be happening to
> the sites that have an extra directory in their URL; eg:
> 
> Vince.
> -- 
> ==========================================================================
> Vince Vielhaber -- KA8CSH   email: vev@michvhf.com   flame-mail: /dev/null
>        # include <std/disclaimers.h>                   TEAM-OS2
>         Online Campground Directory    http://www.camping-usa.com
>        Online Giftshop Superstore    http://www.cloudninegifts.com
> ==========================================================================
> 
> 
> 
> 

_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83



Re: SOLVED: Re: [HACKERS] mirroring problem (www.postgresql.org)

От
Vince Vielhaber
Дата:
On Thu, 17 Jun 1999, Oleg Bartunov wrote:

> Vince,
> 
> I found the problem and fixed it. The problem was because I have
> alias /images in my main site and it propagates to  virtual  site.
> 
> btw, http://www.postgresql.org redirected to 
> http://www.postgresql.org/postgresql.wplus.net
> This happens with NS 4.05, win95

Should be back in business now.  msu.su has been added back into the
mirror list and the above was a typo that's been corrected.

Thanks!

Vince.
-- 
==========================================================================
Vince Vielhaber -- KA8CSH   email: vev@michvhf.com   flame-mail: /dev/null      # include <std/disclaimers.h>
       TEAM-OS2       Online Campground Directory    http://www.camping-usa.com      Online Giftshop Superstore
http://www.cloudninegifts.com
==========================================================================





Re: [HACKERS] mirroring problem (www.postgresql.org)

От
The Hermit Hacker
Дата:
On Thu, 17 Jun 1999, Thomas Lockhart wrote:

> > There is nothing configured on hub.org to exclude the 
> > images directory...
> 
> Sorry in advance for the re/misdirection, but would CVSup be a
> suitable alternative for this task? It is working *great* for me to
> replicate the CVS tree, but it also handles normal directory trees. It
> includes lots of compression optimizations and so is very fast...

Rsync basically does the same thing, but cleaner...and doesn't require
Modula-3 to install.  

Marc G. Fournier                   ICQ#7615664               IRC Nick: Scrappy
Systems Administrator @ hub.org 
primary: scrappy@hub.org           secondary: scrappy@{freebsd|postgresql}.org 



Re: [HACKERS] mirroring problem (www.postgresql.org)

От
The Hermit Hacker
Дата:
On Thu, 17 Jun 1999, Vince Vielhaber wrote:

> On Thu, 17 Jun 1999, Thomas Lockhart wrote:
> 
> > > There is nothing configured on hub.org to exclude the 
> > > images directory...
> > 
> > Sorry in advance for the re/misdirection, but would CVSup be a
> > suitable alternative for this task? It is working *great* for me to
> > replicate the CVS tree, but it also handles normal directory trees. It
> > includes lots of compression optimizations and so is very fast...
> 
> What was used before rsync that was the bandwidth hog?  Wasn't cvs, was
> it?

Nope, ftp/mirror, except that ftp/mirror requires the client to do their
configuration cleanly, whereas with rsync I can setup our end to exclude
stuff (ie. ht/Dig databases)

Marc G. Fournier                   ICQ#7615664               IRC Nick: Scrappy
Systems Administrator @ hub.org 
primary: scrappy@hub.org           secondary: scrappy@{freebsd|postgresql}.org