# Robots.txt file # For domain: http://www.wvi.com/~odonnell/ # All robots will spider the domain User-agent: * Disallow: / User-agent: ia_archiver Disalow: /