# PhpDig is allowed and disallowed as needed for this site. # # All user-agents are disallowed from crawling standard, # non-informational links. These links do not contain secret # goodies, but rather they are disallowed to save on bandwidth. User-agent: * Disallow: /scripts Disallow: /styles Disallow: /images