I posted to delicious.com

How we funneled searchers from Google to our collections by catering to Web crawlers -- Breeding, Marshall [Library Technology Guides]

http://www.librarytechnology.org/ltg-displaytext.pl?RC=12049

I developed a Perl script that systematically extracts records from the database to generate the Web pages. The script takes only a couple of hours to process the entire database. We refresh the pages every week

Your favourite external commenting service goes here! I recommend http://www.disqus.com