Showing posts with label indexing. Show all posts
Showing posts with label indexing. Show all posts

Thursday, July 22, 2010

Indexing of gallery re-enabled

At the just-finished Whitman camp (our annual planning meeting), Travis argued compellingly for allowing search engines to index the photographs. As there were no objections, I've edited the robots.txt file to do this.

~ Brett

Friday, July 18, 2008

Links to past versions of the Archive

To the "About the Archive" page, under "Project and Staff Information," I've added a link to a page that offers the complete contents of two earlier states of the WWA: the "brown" site and the "blue bulge" site—both in their last incarnations.

At camp a few years ago, we decided to make the brown version available but to password protect it so that search engines wouldn't index it (and send users to outdated content). This time around, Zach suggested that we should not password protect the archived versions but instead add to the "robots.txt" file instructions for the spiders not to crawl them. So that's what we've done.

~ Brett