update-website.mk and mirroring issue
matthew at linuxfromscratch.org
Sun Nov 21 10:22:26 PST 2004
Anderson Lizardo wrote:
> But then I ask: what's the real purpose of the "timestamp" file? I know it
> allows the mirrors to only run rsync if this file is changed, but does rsync
> not do this check already?
My understanding of rsync is that it will only sync *changed* files. So
there should be no need for us to keep our own housekeeping information
for this purpose. If our site changes, the mirrors' rsync process will
spot them the next time they run. If the site hasn't changed next time
they rsync, then nothing gets transferred.
> Another thing: with the current
> http://linuxfromscratch.org/~gerard/lfs-rsync.sh script used by all mirrors,
> the ".svn" dir (along with other files, like news-YYYY.txt, templates) are
> rsync'ed even though they are not necessary on the "final" website. This is
> avoidable by using the --exclude-from rsync option (see update-website.mk's
> "run-rsync" rule), and saves some MB of bandwidth (aprox. 12MB of .svn dirs).
OK, this suggests that they're mirroring a working copy of the SVN
repos. I don't like that idea much. This issue appears on the
svn-users list every now and again, as people seem to insist on having
their live site as simply a working copy of the repository. Why can't
we use 'svn export' here to get a clean, unversioned, copy of a
particular revision of the repository? This would negate having to have
a .htaccess that has to ignore .svn directories, and the corresponding
flag to rsync.
More information about the website