|Home||donate | Forums | FAQs | Contributions | Terms, Privacy, & Copyright | Contact | Volunteer Positions | Jobs | Bios|
|Anonymous User (login or join us)|
|Why Bitcoiners Believe In The Digital Currency|
|Living On Bitcoin For A Week: Bitcoin Is The Internet Applied To Money (And I Survived It)|
|You Didn’t Ask For it: Trademark Owner Tries to Invade Public Domain|
|Bay Area bitcoin users intrigued, but cautious|
|Nonprofit Pays Staff in Bitcoin|
|Brewster Kahle: Preserving All the World's Knowlege|
|Brewster's trillions: Internet Archive strives to keep web history alive|
|Jason Scott's Archive Team Is Saving The Web From Itself|
|Down the digital rabbit hole|
|Bitcoin is the coolest thing you’ve never heard of|
The Internet Archive is not interested in offering access to web sites or other Internet documents whose authors do not want their materials in the collection. To remove your site from the Wayback Machine, place a robots.txt file at the top level of your site (e.g. www.yourdomain.com/robots.txt).
The robots.txt file will do two things:
To exclude the Internet Archives crawler (and remove documents from the Wayback Machine) while allowing all other robots to crawl your site, your robots.txt file should say:
Robots.txt can be used to block access to the whole domain, or any file or directory within. There are a large number of resources for webmasters and site owners describing this method and how to use it, including http://www.robotstxt.org/.