[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Reminder
Spent far too long trying to figure out how to properly manage the LDP
docs (mirroring, conversion, indexing, etc) But I did figure it out!
I hereby mandate a new directory structure for "external links" which will
be mirrored and in our database: /home/content/
/home/mirrors/
will be where we mirror entire web sites etc for people to browse
/home/content/
will be where we actually store content for the DB which we mirror. I've
configured htdig not to index /home/mirrors/. I've also done a sweet
little hack to download.pm which will translate /mirrors/ URL's into
/content/ URL's on the fly. We will avoid duplicating content via
symlinks. This will have a dramatic impact on the htdig database size and
hence performance.
One current issue, is that there are some really LARGE documents > 500K.
It might be worthwhile adding some intelligence to download.pm which will
detect the size and offer up the broken up version to web clients (not
htdig) in those cases. Easy to do, not very important.
Other than that, I also spent a bunch of time doing sysadmin things,
including researching our 6.x upgrade of Vodka and Yukon. I also spent a
few hours analyzing the CmdSchedule project from which I generated a list
of things I need done before I proceed. I'm also working on the next
devball version which fixes compatibility with the new CVS tree for htdig.
Not really important for most developers.
Anyone know where Micah is?
On Tue, 29 Feb 2000, Jason Pincin wrote:
> Status Reports. Just a reminder. Mine will be coming soon.
>
> --
> Jason Pincin
> Linux Knowledge Base Project Leader (http://www.linuxkb.org/)
> http://vodka.linuxkb.org/~chardros/
>