# Robots.txt file created by http://www.webtoolcentral.com # For domain: http://www.westierehoming.me.uk/index.htm # All robots will spider the domain User-agent: * User-agent: rhino Disallow: User-agent: searchpreview Disallow: / User-agent: * Disallow: /*.PDF$ Disallow: /*.DOC$ Disallow: /*.TXT$ Disallow: /*.RDF$ User-agent: ia_archiver Disallow: / User-agent: AboutUsBot Disallow: / # Specifically, regarding Internet Archive: The web page http://www.westierehoming.me.uk/index.htm is protected by copyright for the current year, and no records should be kept by anyone other than the site owner for previous years