User-agent: *      
Disallow: /logs/  
Disallow: /flash/
Disallow: /pdf/
Disallow: /generated items/