# robots.txt file for www.NationalChildrensStudy.gov User-Agent: * Disallow: /_layouts/ Dissalow: /Documents/Forms/ Dissalow: /Pages/Forms/ Dissalow: /ReusableContent/ Dissalow: /Reports%20List/ Disallow: /Search/ Dissalow: /SiteCollectionDocuments/ Dissalow: /SiteCollectionImages/ Dissalow: /WorkflowTasks/ Dissalow: /Search.aspx Dissalow: /search.aspx Dissalow: Search.aspx Dissalow: search.aspx # adding new 2008 wild card syntax (see http://www.searchtools.com/robots/robots-txt-elements.html#wildcards) Disallow: */_layouts/ Dissalow: */Documents/Forms/ Dissalow: */Pages/Forms/ Dissalow: */ReusableContent/ Dissalow: */Reports%20List/ Disallow: */Search/ Dissalow: */SiteCollectionDocuments/ Dissalow: */SiteCollectionImages/ Dissalow: */WorkflowTasks/ # page-level exclusion Dissalow: *WebFldr.aspx$ Dissalow: *Upload.aspx$ Dissalow: *EditForm.aspx$ Dissalow: *external.aspx$ Dissalow: *search.aspx$ Dissalow: *Search.aspx Dissalow: *search.aspx