# allow all robots, exclude all directories User-agent: * Disallow: about.htm Disallow: defaultold.htm Disallow: test.txt Disallow: /aspnet_client/ Disallow: /auction/ Disallow: /class/ Disallow: /classifieds/ Disallow: /database/ Disallow: /documentation/ Disallow: /images/ Disallow: /listings/ Disallow: /log/ Disallow: /membership/ Disallow: /scripts/ Disallow: /upload/