User-agent: * 
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /test/
User-agent: e-SocietyRobot
Disallow: /
User-agent: Perl LWP
Disallow: /