# WWW Robots (also called wanderers or spiders) are programs that traverse # many pages in the World Wide Web by recursively retrieving linked pages. # This file prevents them from accessing your data. User-agent: * Disallow: /bt/ Disallow: /cs/ Disallow: /download/ Disallow: /Gallery/ Disallow: /Gallery2/ Disallow: /hd/ Disallow: /KUKA/ Disallow: /log/ Disallow: /Misc/ Disallow: /Vc/ Disallow: /webcat/ Disallow: /test_cat/ Disallow: /CDROM/