User-agent: * # By directory Disallow: /a/ Disallow: /embed/ Disallow: /featured/ Disallow: /library/ Disallow: /old/ Disallow: /pledges/ Disallow: /private/ Disallow: /scripts/ Disallow: /static/ Disallow: /upload/ # By Page Disallow: /thankyou.html Disallow: /featured # By extension disallow: /*.php$ disallow: /*.gif$ disallow: /*.jpg$ disallow: /*.jpeg$ disallow: /*.bmp$ disallow: /*.ico$ disallow: /*.err$ disallow: /*.txt$ disallow: /*.mp3$