At camp a few years ago, we decided to make the brown version available but to password protect it so that search engines wouldn't index it (and send users to outdated content). This time around, Zach suggested that we should not password protect the archived versions but instead add to the "robots.txt" file instructions for the spiders not to crawl them. So that's what we've done.
~ Brett
Friday, July 18, 2008
Links to past versions of the Archive
To the "About the Archive" page, under "Project and Staff Information," I've added a link to a page that offers the complete contents of two earlier states of the WWA: the "brown" site and the "blue bulge" site—both in their last incarnations.
Labels:
About the Archive,
blue bulge site,
brown site,
indexing,
old versions
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment