# robots.txt for http://www.antoniociccone.com/ # modified 01 December 2006 User-agent: * Disallow: /development/ Disallow: /concepts/ Disallow: /css/ Disallow: /webstat/ Disallow: /plesk-stat/ # User-agent: * wild card, specifies ALL robots # Disallow: /directoryname/ disallows entire directory # Disallow: /*string* disallows all URLs CONTAINING string # Disallow: /*string$ disallows URLs ENDING with the string # IMPORTANT: Agent-specific instructions must appear ABOVE any * wild card instruction