All robots will spider the domain
User-agent: *
Disallow: 



User-agent: *
Disallow: /gfx/
Disallow: /cgi-bin/
Disallow: /_private/
Disallow: /photos/
Disallow: /newsletter/
Disallow: /buttons/
Disallow: /_notes/
Disallow: /images/
Disallow: /sfvsf pdf files/