At the just-finished Whitman camp (our annual planning meeting), Travis argued compellingly for allowing search engines to index the photographs. As there were no objections, I've edited the robots.txt file to do this.
~ Brett
Showing posts with label indexing. Show all posts
Showing posts with label indexing. Show all posts
Thursday, July 22, 2010
Friday, July 18, 2008
Links to past versions of the Archive
To the "About the Archive" page, under "Project and Staff Information," I've added a link to a page that offers the complete contents of two earlier states of the WWA: the "brown" site and the "blue bulge" site—both in their last incarnations.
At camp a few years ago, we decided to make the brown version available but to password protect it so that search engines wouldn't index it (and send users to outdated content). This time around, Zach suggested that we should not password protect the archived versions but instead add to the "robots.txt" file instructions for the spiders not to crawl them. So that's what we've done.
~ Brett
Labels:
About the Archive,
blue bulge site,
brown site,
indexing,
old versions
Subscribe to:
Posts (Atom)