## robots.txt for http://www.w3.org/ ## $Id: robots.txt,v 1.17 1998/10/25 02:37:04 renaudb Exp $ ## For use by search.w3.org User-agent: W3Crobot/1 Disallow: /Out-Of-Date # AltaVista Search User-agent: AltaVista Intranet V2.0 W3C Webreq Disallow: /Out-Of-Date User-agent: * Disallow: /Member/ # This is restricted to W3C Members only Disallow: /member/ # This is restricted to W3C Members only Disallow: /team/ # This is restricted to W3C Team only Disallow: /TandS/Member # This is restricted to W3C Members only Disallow: /TandS/Team # This is restricted to W3C Team only Disallow: /team_england_shop Disallow: /images Disallow: /js-css Disallow: /cgi-bin Disallow: /admin Disallow: /webalizer Disallow: /modlogan