User-agent: *
Allow: /
Disallow: /log/
Disallow: /logs/
Disallow: /junk-files/