[lfs-support] Howto keep track....
Frans de Boer
frans at fransdb.nl
Sun Oct 20 09:33:53 PDT 2013
On 10/20/2013 04:43 PM, Bruce Dubbs wrote:
> Frans de Boer wrote:
>> ...of changed/new files on http only sites like sourceforge.net?
>> Keeping track of changed and new files on FTP sites is relative easy.
>> However, HTTP sites is differently and made complicated because no page
>> is the same and directory listings are not easy. In fact, I do not
>> remember anymore how to get directory listings from HTTP servers. If
>> that is possible and if it works mostly the same on every HTTP server, I
>> can make a script to get it done.
>> Since authors on LFS are probably using such a tool, what tool or
>> mechanism I can try?
> It's not easy. I have custom scripts that basically address each
> package. Sometimes upstream blocks directory listings completely.
> Sometimes you get into a situation where odd releases are stable and
> even development or vice versa. You can look at
> http://anduin.linuxfromscratch.org/~bdubbs/lfs-latest-files.phps but
> that is just an example and slightly out of date.
> -- Bruce
Like I said no page is the same and I noticed that you handle every site
in a different way using customized regex's. That is exactly the thing I
try to avoid, but given the nature of things I assume that would be hard
to accomplished using HTTP.
I stay on the lookout of a more generic tool and am happy that my
scripts can handle normal FTP transfers. I augmented the tables in my
scripts to handle also the LFS site, since that can be reached by FTP too.
More information about the lfs-support