# # Robots.txt for domain: http://www.cpc.unc.edu # # All robots will spider the domain User-agent: * # Disallow some access-controlled areas Disallow: /cgi-bin/ Disallow: /mirrors/ Disallow: /projects/nangrong/old_site/ Disallow: /nangrong/old_site/ Disallow: /dataarch Disallow: /dataarch/ Disallow: /intranet Disallow: /intranet/ Disallow: /workgroups Disallow: /workgroups/ Disallow: /Plone Disallow: /Plone/ Disallow: /*?* #Disallow: /*.php$