> Retrieving Robots.txt file from bbc.co.uk/robots.txt
> Retrieval Complete
> bbc.co.uk responded with HTTP status code 200 OK

It Depends... :-/


The robots.txt file contains "Disallow" instructions. Whether or not you can crawl this site depends on who you are and what folders you want to crawl.



We've broken out the individual declarations from the robots.txt file below. Hover any section for more detail about what the declaration means. We've also hyperlinked any URL's and paths that were included in the file for your convenience.

**Please read our disclaimer to learn about other considerations before crawling a website.**
  1. # v.4.6.1
    ⇧ This row is a comment only, and does not contain actionable instructions - only notes from the site publisher.
    # www.bbc.co.uk
    ⇧ This row is a comment only, and does not contain actionable instructions - only notes from the site publisher.
  2. User-agent: Googlebot
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
  3. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    Disallow: /_programmes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /606/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /afrique/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/cbbc
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/flash
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ide
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ids
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ifl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/nr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/query
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/t
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /arabic/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /azeri/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bengali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /burmese/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cbbc/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perlx
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-store
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cwynion/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/dev
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/nav
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /eoltools/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /films/gateways
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/binder/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/recipes/search*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /furniture
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gahuza/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hausa/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hindi/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /includes/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /kyrgyz/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mediaselector
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /messageboards/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mundo/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /music/language/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nav/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /navigation
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nepali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /partners/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pashto/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /persian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /print/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/aod/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/player
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /russian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /safety/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search$
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sinhala/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /somali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /survey/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /swahili/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tamil/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /turkce/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /urdu/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /uzbek/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /weather/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /scotland$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /scotland/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    User-Agent: bingbot
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
  4. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    Disallow: /_programmes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /606/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /afrique/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/cbbc
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/flash
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ide
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ids
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ifl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/nr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/query
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/t
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /arabic/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /azeri/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bengali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /burmese/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cbbc/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perlx
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-store
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cwynion/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/dev
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/nav
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /eoltools/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /films/gateways
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/binder/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/recipes/search*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /furniture
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gahuza/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hausa/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hindi/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /includes/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /kyrgyz/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mediaselector
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /messageboards/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mundo/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /music/language/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nav/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /navigation
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nepali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /partners/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pashto/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /persian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /print/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/aod/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/player
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /russian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /safety/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search$
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sinhala/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /somali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /survey/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /swahili/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tamil/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /turkce/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /urdu/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /uzbek/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /weather/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /scotland$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /scotland/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    User-agent: Googlebot-Mobile
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
  5. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    Disallow: /_programmes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /606/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /afrique/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/cbbc
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/flash
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ide
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ids
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ifl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/nr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/query
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/t
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /arabic/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /azeri/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bengali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /burmese/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cbbc/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perlx
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-store
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cwynion/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/dev
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/nav
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /eoltools/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /films/gateways
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/binder/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/recipes/search*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /furniture
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gahuza/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hausa/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hindi/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /includes/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /kyrgyz/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mediaselector
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /messageboards/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mundo/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /music/language/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nav/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /navigation
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nepali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /partners/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pashto/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /persian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /print/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/aod/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/player
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /russian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /safety/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search$
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sinhala/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /somali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /survey/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /swahili/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tamil/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /turkce/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /urdu/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /uzbek/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /weather/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /scotland$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /scotland/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    User-agent: QuerySeekerSpider
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: /
    ⇧ This row declares that the specified user agents are disallowed access to the site's root (a.k.a. "/")
    User-agent: *
    ⇧ This row specifies that all user agents (a.k.a. "*") should obey the instructions on the following rows.
  6. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    Disallow: /_programmes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /606/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /afrique/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/cbbc
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/flash
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ide
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ids
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/ifl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/nr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/query
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /apps/t
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /arabic/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /azeri/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bengali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /burmese/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cbbc/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cbbc/search$
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perl
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-perlx
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-store
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cwynion/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/dev
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /education/nav
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /eoltools/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /films/gateways
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/binder/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /food/recipes/search*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /furniture
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gahuza/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hausa/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hindi/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /includes/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /kyrgyz/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mediaselector
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /messageboards/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mundo/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /music/language/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nav/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /navigation
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nepali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /partners/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pashto/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /persian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /print/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/aod/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /radio/player
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /russian/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /safety/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search$
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sinhala/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /somali/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /survey/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /swahili/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tamil/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /turkce/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /urdu/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /uzbek/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /weather/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /ideas$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /ideas/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cbbc$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cbbc/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cbeebies$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cbeebies/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /scotland$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /scotland/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /wales/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /alba/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cymru/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
# v.4.6.1
# www.bbc.co.uk
User-agent: Googlebot
Sitemap: http://www.bbc.co.uk/sitemaps/index-uk-archive.xml
Sitemap: http://www.bbc.co.uk/sitemaps/index-uk-news.xml
Sitemap: http://www.bbc.co.uk/video_sitemap.xml
Sitemap: http://www.bbc.co.uk/sitemap.xml
Disallow: /_programmes
Disallow: /606/
Disallow: /aboutthebbc/insidethebbc/search
Disallow: /academy/chinese-trad/search
Disallow: /afrique/search
Disallow: /apps/cbbc
Disallow: /apps/flash
Disallow: /apps/ide
Disallow: /apps/ids
Disallow: /apps/ifl
Disallow: /apps/nr
Disallow: /apps/query
Disallow: /apps/t
Disallow: /arabic/search
Disallow: /arts/yourpaintings/artdetective/
Disallow: /arts/yourpaintings/feedback/sent/
Disallow: /arts/yourpaintings/images/guidedtours/
Disallow: /arts/yourpaintings/newsletter/error/
Disallow: /arts/yourpaintings/newsletter/success/
Disallow: /arts/yourpaintings/newsletter/unsubscribe/
Disallow: /arts/yourpaintings/paintings/search
Disallow: /azeri/search
Disallow: /bbctrust/search
Disallow: /bengali/search
Disallow: /burmese/search
Disallow: /cbbc/search
Disallow: /cbeebies/search
Disallow: /cgi-bin
Disallow: /cgi-perl
Disallow: /cgi-perlx
Disallow: /cgi-store
Disallow: /corporate2/bbctrust/search
Disallow: /corporate2/insidethebbc/search
Disallow: /corporate2/mediacentre/proginfo/search
Disallow: /corporate2/mediacentre/search
Disallow: /corporate2/safety/search
Disallow: /cwynion/
Disallow: /eastenders/updates/
Disallow: /education/bitesize
Disallow: /education/dev
Disallow: /education/images
Disallow: /education/nav
Disallow: /education/navigation
Disallow: /education/ximages
Disallow: /eoltools/
Disallow: /films/gateways
Disallow: /food/binder/
Disallow: /food/recipes/search*?*
Disallow: /frameworks/fig/
Disallow: /furniture
Disallow: /gahuza/search
Disallow: /h2g2/servers/narthur8
Disallow: /hausa/search
Disallow: /hindi/search
Disallow: /history/domesday/search
Disallow: /includes/
Disallow: /indonesia/search
Disallow: /kyrgyz/search
Disallow: /learningzone/clips/search
Disallow: /mediacentre/proginfo/search
Disallow: /mediacentre/search
Disallow: /mediaselector
Disallow: /messageboards/
Disallow: /modules/musicnav/language/
Disallow: /mundo/search
Disallow: /music/language/*
Disallow: /music/releases/
Disallow: /nav/
Disallow: /navigation
Disallow: /nepali/search
Disallow: /news/uk-30888157
Disallow: /news/uk-england-suffolk-20780472
Disallow: /partners/
Disallow: /pashto/search
Disallow: /persian/search
Disallow: /portuguese/search
Disallow: /pressoffice/plots/
Disallow: /print/
Disallow: /programmes/articles/1jJwRxT3X9s0QlBsCMhvv7D/2013-fundraising-packs
Disallow: /programmes/articles/1nSkm7VR3fypxqB16dDtVwk/how-to-get-sponsored
Disallow: /programmes/articles/1RjY5ZcmdvRKPvbS662Jv9C/welsh-downloads-2013
Disallow: /programmes/articles/25h23bXRXFlGdVQ86hNFVkT/secondary-schools-fundraising
Disallow: /programmes/articles/2S6fTlHnqvdHGswDJ9yLs6r/early-years-fundraising
Disallow: /programmes/articles/35Cb1BsKBWZNfhVDp07K1y1/students
Disallow: /programmes/articles/4P9FhkRwqvYHVXmX6c13Bfd/downloads-page
Disallow: /programmes/articles/4qd5GpykkdkGZtYrRR5h073/ideas-and-downloads
Disallow: /programmes/articles/4zNrFLZXqfGcBFRHzLnkxqw/primary-schools-fundraising
Disallow: /programmes/articles/4zplPWW97l5Yk1BhTY4p3rz/tell-us-what-youre-doing
Disallow: /programmes/articles/5kgXgM40wp1JM9lSB1f18Yd/fundraising
Disallow: /programmes/articles/91J9cY9hzMLrsCmM7tX113/cerries-jump-up-and-dance-competition
Disallow: /programmes/articles/psvxkB6QDMK63pgHmP5RJF/who-you-help
Disallow: /programmes/articles/RRWbSk1mCZngypVngyZYJ0/get-your-money-to-us
Disallow: /programmes/articles/v8qTSbm89w6DnfgxFL5GBk/fundraising-at-school
Disallow: /programmes/articles/ZY66x6RD4jg5kqv8t7vn56/lets-go-shopping
Disallow: /programmes/b008dk4b
Disallow: /programmes/profiles/1YyY0F36ppV3DmnSkNTrRxZ/downloads-for-primary-schools
Disallow: /programmes/profiles/2dgMD54k88Lz77lYcy7mRhc/secondary-school-fundraising-ideas
Disallow: /programmes/profiles/2x87wV7KW01sgY0dl7qBnT6/recipes
Disallow: /programmes/profiles/33x1x5jLwh1MbhpFXhlxq37/posters-stickers-and-games
Disallow: /programmes/profiles/3yvcq7cxMmNLCzSzDCWsPyM/primary-school-fundraising-ideas
Disallow: /programmes/profiles/49qkZq0Pmmh4flWgYSPhgPj/fundraising-ideas-at-work
Disallow: /programmes/profiles/49QnjFZ5T6f6sdQY399HNzf/primary-teacher-resources
Disallow: /programmes/profiles/4KFFdqWQZ9lSPl1qHnRPbNV/be-a-hero
Disallow: /programmes/profiles/4yn6kWyMJZLgPZj4100SSkh/early-years-teacher-resources
Disallow: /programmes/profiles/54k8kVKM9gTzVL4zvDJ1BzN/secondary-teacher-resources
Disallow: /programmes/profiles/581RcyV6nP3Jtxk9Vcy9Hnq/downloads-for-early-years
Disallow: /programmes/profiles/5wdxQwnlLHJNY9y2Nxm1RkQ/fundraising-ideas
Disallow: /programmes/profiles/cGJ1RZ5pHG0Jl65YSN0YYc/downloads-for-secondary-schools
Disallow: /programmes/profiles/qWq8hB1135cdgj2cqNXyWB/early-years-fundraising-ideas
Disallow: /radio/aod/
Disallow: /radio/player
Disallow: /russian/search
Disallow: /safety/search
Disallow: /schools/typing/about/
Disallow: /schools/typing/flash/
Disallow: /schools/typing/generic/
Disallow: /schools/typing/levels/
Disallow: /search/
Disallow: /search$
Disallow: /sinhala/search
Disallow: /skillswise/quickfind/search
Disallow: /somali/search
Disallow: /survey/
Disallow: /swahili/search
Disallow: /syndication/html/
Disallow: /tamil/search
Disallow: /turkce/search
Disallow: /ukchina/simp/search
Disallow: /ukchina/trad/search
Disallow: /ukrainian/search
Disallow: /urdu/search
Disallow: /uzbek/search
Disallow: /vietnamese/search
Disallow: /weather/broadband/
Disallow: /weather/search
Disallow: /worldservice/images/
Disallow: /worldservice/psims/
Disallow: /worldservice/ssi/
Disallow: /worldservice/survey/
Disallow: /zhongwen/simp/search
Disallow: /zhongwen/trad/search
Disallow: /indepthtoolkit/smallprox$
Disallow: /indepthtoolkit/smallprox/
Allow: /scotland$
Allow: /scotland/
Allow: /wales$
Allow: /wales/
Allow: /northernireland$
Allow: /northernireland/
Allow: /alba$
Allow: /alba/
Allow: /cymru$
Allow: /cymru/
Allow: /newsround/amp$
Allow: /newsround/amp/

User-Agent: bingbot
Sitemap: http://www.bbc.co.uk/sitemap.xml
Disallow: /_programmes
Disallow: /606/
Disallow: /aboutthebbc/insidethebbc/search
Disallow: /academy/chinese-trad/search
Disallow: /afrique/search
Disallow: /apps/cbbc
Disallow: /apps/flash
Disallow: /apps/ide
Disallow: /apps/ids
Disallow: /apps/ifl
Disallow: /apps/nr
Disallow: /apps/query
Disallow: /apps/t
Disallow: /arabic/search
Disallow: /arts/yourpaintings/artdetective/
Disallow: /arts/yourpaintings/feedback/sent/
Disallow: /arts/yourpaintings/images/guidedtours/
Disallow: /arts/yourpaintings/newsletter/error/
Disallow: /arts/yourpaintings/newsletter/success/
Disallow: /arts/yourpaintings/newsletter/unsubscribe/
Disallow: /arts/yourpaintings/paintings/search
Disallow: /azeri/search
Disallow: /bbctrust/search
Disallow: /bengali/search
Disallow: /burmese/search
Disallow: /cbbc/search
Disallow: /cbeebies/search
Disallow: /cgi-bin
Disallow: /cgi-perl
Disallow: /cgi-perlx
Disallow: /cgi-store
Disallow: /corporate2/bbctrust/search
Disallow: /corporate2/insidethebbc/search
Disallow: /corporate2/mediacentre/proginfo/search
Disallow: /corporate2/mediacentre/search
Disallow: /corporate2/safety/search
Disallow: /cwynion/
Disallow: /eastenders/updates/
Disallow: /education/bitesize
Disallow: /education/dev
Disallow: /education/images
Disallow: /education/nav
Disallow: /education/navigation
Disallow: /education/ximages
Disallow: /eoltools/
Disallow: /films/gateways
Disallow: /food/binder/
Disallow: /food/recipes/search*?*
Disallow: /frameworks/fig/
Disallow: /furniture
Disallow: /gahuza/search
Disallow: /h2g2/servers/narthur8
Disallow: /hausa/search
Disallow: /hindi/search
Disallow: /history/domesday/search
Disallow: /includes/
Disallow: /indonesia/search
Disallow: /kyrgyz/search
Disallow: /learningzone/clips/search
Disallow: /mediacentre/proginfo/search
Disallow: /mediacentre/search
Disallow: /mediaselector
Disallow: /messageboards/
Disallow: /modules/musicnav/language/
Disallow: /mundo/search
Disallow: /music/language/*
Disallow: /music/releases/
Disallow: /nav/
Disallow: /navigation
Disallow: /nepali/search
Disallow: /news/uk-30888157
Disallow: /news/uk-england-suffolk-20780472
Disallow: /partners/
Disallow: /pashto/search
Disallow: /persian/search
Disallow: /portuguese/search
Disallow: /pressoffice/plots/
Disallow: /print/
Disallow: /programmes/articles/1jJwRxT3X9s0QlBsCMhvv7D/2013-fundraising-packs
Disallow: /programmes/articles/1nSkm7VR3fypxqB16dDtVwk/how-to-get-sponsored
Disallow: /programmes/articles/1RjY5ZcmdvRKPvbS662Jv9C/welsh-downloads-2013
Disallow: /programmes/articles/25h23bXRXFlGdVQ86hNFVkT/secondary-schools-fundraising
Disallow: /programmes/articles/2S6fTlHnqvdHGswDJ9yLs6r/early-years-fundraising
Disallow: /programmes/articles/35Cb1BsKBWZNfhVDp07K1y1/students
Disallow: /programmes/articles/4P9FhkRwqvYHVXmX6c13Bfd/downloads-page
Disallow: /programmes/articles/4qd5GpykkdkGZtYrRR5h073/ideas-and-downloads
Disallow: /programmes/articles/4zNrFLZXqfGcBFRHzLnkxqw/primary-schools-fundraising
Disallow: /programmes/articles/4zplPWW97l5Yk1BhTY4p3rz/tell-us-what-youre-doing
Disallow: /programmes/articles/5kgXgM40wp1JM9lSB1f18Yd/fundraising
Disallow: /programmes/articles/91J9cY9hzMLrsCmM7tX113/cerries-jump-up-and-dance-competition
Disallow: /programmes/articles/psvxkB6QDMK63pgHmP5RJF/who-you-help
Disallow: /programmes/articles/RRWbSk1mCZngypVngyZYJ0/get-your-money-to-us
Disallow: /programmes/articles/v8qTSbm89w6DnfgxFL5GBk/fundraising-at-school
Disallow: /programmes/articles/ZY66x6RD4jg5kqv8t7vn56/lets-go-shopping
Disallow: /programmes/b008dk4b
Disallow: /programmes/profiles/1YyY0F36ppV3DmnSkNTrRxZ/downloads-for-primary-schools
Disallow: /programmes/profiles/2dgMD54k88Lz77lYcy7mRhc/secondary-school-fundraising-ideas
Disallow: /programmes/profiles/2x87wV7KW01sgY0dl7qBnT6/recipes
Disallow: /programmes/profiles/33x1x5jLwh1MbhpFXhlxq37/posters-stickers-and-games
Disallow: /programmes/profiles/3yvcq7cxMmNLCzSzDCWsPyM/primary-school-fundraising-ideas
Disallow: /programmes/profiles/49qkZq0Pmmh4flWgYSPhgPj/fundraising-ideas-at-work
Disallow: /programmes/profiles/49QnjFZ5T6f6sdQY399HNzf/primary-teacher-resources
Disallow: /programmes/profiles/4KFFdqWQZ9lSPl1qHnRPbNV/be-a-hero
Disallow: /programmes/profiles/4yn6kWyMJZLgPZj4100SSkh/early-years-teacher-resources
Disallow: /programmes/profiles/54k8kVKM9gTzVL4zvDJ1BzN/secondary-teacher-resources
Disallow: /programmes/profiles/581RcyV6nP3Jtxk9Vcy9Hnq/downloads-for-early-years
Disallow: /programmes/profiles/5wdxQwnlLHJNY9y2Nxm1RkQ/fundraising-ideas
Disallow: /programmes/profiles/cGJ1RZ5pHG0Jl65YSN0YYc/downloads-for-secondary-schools
Disallow: /programmes/profiles/qWq8hB1135cdgj2cqNXyWB/early-years-fundraising-ideas
Disallow: /radio/aod/
Disallow: /radio/player
Disallow: /russian/search
Disallow: /safety/search
Disallow: /schools/typing/about/
Disallow: /schools/typing/flash/
Disallow: /schools/typing/generic/
Disallow: /schools/typing/levels/
Disallow: /search/
Disallow: /search$
Disallow: /sinhala/search
Disallow: /skillswise/quickfind/search
Disallow: /somali/search
Disallow: /survey/
Disallow: /swahili/search
Disallow: /syndication/html/
Disallow: /tamil/search
Disallow: /turkce/search
Disallow: /ukchina/simp/search
Disallow: /ukchina/trad/search
Disallow: /ukrainian/search
Disallow: /urdu/search
Disallow: /uzbek/search
Disallow: /vietnamese/search
Disallow: /weather/broadband/
Disallow: /weather/search
Disallow: /worldservice/images/
Disallow: /worldservice/psims/
Disallow: /worldservice/ssi/
Disallow: /worldservice/survey/
Disallow: /zhongwen/simp/search
Disallow: /zhongwen/trad/search
Disallow: /indepthtoolkit/smallprox$
Disallow: /indepthtoolkit/smallprox/
Allow: /scotland$
Allow: /scotland/
Allow: /wales$
Allow: /wales/
Allow: /northernireland$
Allow: /northernireland/
Allow: /alba$
Allow: /alba/
Allow: /cymru$
Allow: /cymru/
Allow: /newsround/amp$
Allow: /newsround/amp/


User-agent: Googlebot-Mobile
Sitemap: http://www.bbc.co.uk/mobile_sitemap.xml
Disallow: /_programmes
Disallow: /606/
Disallow: /aboutthebbc/insidethebbc/search
Disallow: /academy/chinese-trad/search
Disallow: /afrique/search
Disallow: /apps/cbbc
Disallow: /apps/flash
Disallow: /apps/ide
Disallow: /apps/ids
Disallow: /apps/ifl
Disallow: /apps/nr
Disallow: /apps/query
Disallow: /apps/t
Disallow: /arabic/search
Disallow: /arts/yourpaintings/artdetective/
Disallow: /arts/yourpaintings/feedback/sent/
Disallow: /arts/yourpaintings/images/guidedtours/
Disallow: /arts/yourpaintings/newsletter/error/
Disallow: /arts/yourpaintings/newsletter/success/
Disallow: /arts/yourpaintings/newsletter/unsubscribe/
Disallow: /arts/yourpaintings/paintings/search
Disallow: /azeri/search
Disallow: /bbctrust/search
Disallow: /bengali/search
Disallow: /burmese/search
Disallow: /cbbc/search
Disallow: /cbeebies/search
Disallow: /cgi-bin
Disallow: /cgi-perl
Disallow: /cgi-perlx
Disallow: /cgi-store
Disallow: /corporate2/bbctrust/search
Disallow: /corporate2/insidethebbc/search
Disallow: /corporate2/mediacentre/proginfo/search
Disallow: /corporate2/mediacentre/search
Disallow: /corporate2/safety/search
Disallow: /cwynion/
Disallow: /eastenders/updates/
Disallow: /education/bitesize
Disallow: /education/dev
Disallow: /education/images
Disallow: /education/nav
Disallow: /education/navigation
Disallow: /education/ximages
Disallow: /eoltools/
Disallow: /films/gateways
Disallow: /food/binder/
Disallow: /food/recipes/search*?*
Disallow: /frameworks/fig/
Disallow: /furniture
Disallow: /gahuza/search
Disallow: /h2g2/servers/narthur8
Disallow: /hausa/search
Disallow: /hindi/search
Disallow: /history/domesday/search
Disallow: /includes/
Disallow: /indonesia/search
Disallow: /kyrgyz/search
Disallow: /learningzone/clips/search
Disallow: /mediacentre/proginfo/search
Disallow: /mediacentre/search
Disallow: /mediaselector
Disallow: /messageboards/
Disallow: /modules/musicnav/language/
Disallow: /mundo/search
Disallow: /music/language/*
Disallow: /music/releases/
Disallow: /nav/
Disallow: /navigation
Disallow: /nepali/search
Disallow: /news/uk-30888157
Disallow: /news/uk-england-suffolk-20780472
Disallow: /partners/
Disallow: /pashto/search
Disallow: /persian/search
Disallow: /portuguese/search
Disallow: /pressoffice/plots/
Disallow: /print/
Disallow: /programmes/articles/1jJwRxT3X9s0QlBsCMhvv7D/2013-fundraising-packs
Disallow: /programmes/articles/1nSkm7VR3fypxqB16dDtVwk/how-to-get-sponsored
Disallow: /programmes/articles/1RjY5ZcmdvRKPvbS662Jv9C/welsh-downloads-2013
Disallow: /programmes/articles/25h23bXRXFlGdVQ86hNFVkT/secondary-schools-fundraising
Disallow: /programmes/articles/2S6fTlHnqvdHGswDJ9yLs6r/early-years-fundraising
Disallow: /programmes/articles/35Cb1BsKBWZNfhVDp07K1y1/students
Disallow: /programmes/articles/4P9FhkRwqvYHVXmX6c13Bfd/downloads-page
Disallow: /programmes/articles/4qd5GpykkdkGZtYrRR5h073/ideas-and-downloads
Disallow: /programmes/articles/4zNrFLZXqfGcBFRHzLnkxqw/primary-schools-fundraising
Disallow: /programmes/articles/4zplPWW97l5Yk1BhTY4p3rz/tell-us-what-youre-doing
Disallow: /programmes/articles/5kgXgM40wp1JM9lSB1f18Yd/fundraising
Disallow: /programmes/articles/91J9cY9hzMLrsCmM7tX113/cerries-jump-up-and-dance-competition
Disallow: /programmes/articles/psvxkB6QDMK63pgHmP5RJF/who-you-help
Disallow: /programmes/articles/RRWbSk1mCZngypVngyZYJ0/get-your-money-to-us
Disallow: /programmes/articles/v8qTSbm89w6DnfgxFL5GBk/fundraising-at-school
Disallow: /programmes/articles/ZY66x6RD4jg5kqv8t7vn56/lets-go-shopping
Disallow: /programmes/b008dk4b
Disallow: /programmes/profiles/1YyY0F36ppV3DmnSkNTrRxZ/downloads-for-primary-schools
Disallow: /programmes/profiles/2dgMD54k88Lz77lYcy7mRhc/secondary-school-fundraising-ideas
Disallow: /programmes/profiles/2x87wV7KW01sgY0dl7qBnT6/recipes
Disallow: /programmes/profiles/33x1x5jLwh1MbhpFXhlxq37/posters-stickers-and-games
Disallow: /programmes/profiles/3yvcq7cxMmNLCzSzDCWsPyM/primary-school-fundraising-ideas
Disallow: /programmes/profiles/49qkZq0Pmmh4flWgYSPhgPj/fundraising-ideas-at-work
Disallow: /programmes/profiles/49QnjFZ5T6f6sdQY399HNzf/primary-teacher-resources
Disallow: /programmes/profiles/4KFFdqWQZ9lSPl1qHnRPbNV/be-a-hero
Disallow: /programmes/profiles/4yn6kWyMJZLgPZj4100SSkh/early-years-teacher-resources
Disallow: /programmes/profiles/54k8kVKM9gTzVL4zvDJ1BzN/secondary-teacher-resources
Disallow: /programmes/profiles/581RcyV6nP3Jtxk9Vcy9Hnq/downloads-for-early-years
Disallow: /programmes/profiles/5wdxQwnlLHJNY9y2Nxm1RkQ/fundraising-ideas
Disallow: /programmes/profiles/cGJ1RZ5pHG0Jl65YSN0YYc/downloads-for-secondary-schools
Disallow: /programmes/profiles/qWq8hB1135cdgj2cqNXyWB/early-years-fundraising-ideas
Disallow: /radio/aod/
Disallow: /radio/player
Disallow: /russian/search
Disallow: /safety/search
Disallow: /schools/typing/about/
Disallow: /schools/typing/flash/
Disallow: /schools/typing/generic/
Disallow: /schools/typing/levels/
Disallow: /search/
Disallow: /search$
Disallow: /sinhala/search
Disallow: /skillswise/quickfind/search
Disallow: /somali/search
Disallow: /survey/
Disallow: /swahili/search
Disallow: /syndication/html/
Disallow: /tamil/search
Disallow: /turkce/search
Disallow: /ukchina/simp/search
Disallow: /ukchina/trad/search
Disallow: /ukrainian/search
Disallow: /urdu/search
Disallow: /uzbek/search
Disallow: /vietnamese/search
Disallow: /weather/broadband/
Disallow: /weather/search
Disallow: /worldservice/images/
Disallow: /worldservice/psims/
Disallow: /worldservice/ssi/
Disallow: /worldservice/survey/
Disallow: /zhongwen/simp/search
Disallow: /zhongwen/trad/search
Disallow: /indepthtoolkit/smallprox$
Disallow: /indepthtoolkit/smallprox/
Allow: /scotland$
Allow: /scotland/
Allow: /wales$
Allow: /wales/
Allow: /northernireland$
Allow: /northernireland/
Allow: /alba$
Allow: /alba/
Allow: /cymru$
Allow: /cymru/
Allow: /newsround/amp$
Allow: /newsround/amp/


User-agent: QuerySeekerSpider
Disallow: /


User-agent: *
Sitemap: http://www.bbc.co.uk/sitemap.xml
Disallow: /_programmes
Disallow: /606/
Disallow: /aboutthebbc/insidethebbc/search
Disallow: /academy/chinese-trad/search
Disallow: /afrique/search
Disallow: /apps/cbbc
Disallow: /apps/flash
Disallow: /apps/ide
Disallow: /apps/ids
Disallow: /apps/ifl
Disallow: /apps/nr
Disallow: /apps/query
Disallow: /apps/t
Disallow: /arabic/search
Disallow: /arts/yourpaintings/artdetective/
Disallow: /arts/yourpaintings/feedback/sent/
Disallow: /arts/yourpaintings/images/guidedtours/
Disallow: /arts/yourpaintings/newsletter/error/
Disallow: /arts/yourpaintings/newsletter/success/
Disallow: /arts/yourpaintings/newsletter/unsubscribe/
Disallow: /arts/yourpaintings/paintings/search
Disallow: /azeri/search
Disallow: /bbctrust/search
Disallow: /bengali/search
Disallow: /burmese/search

Disallow: /cbbc/search
Disallow: /cbbc/search$
Disallow: /cbeebies/search
Disallow: /cbeebies/search$
Disallow: /cgi-bin
Disallow: /cgi-perl
Disallow: /cgi-perlx
Disallow: /cgi-store
Disallow: /corporate2/bbctrust/search
Disallow: /corporate2/insidethebbc/search
Disallow: /corporate2/mediacentre/proginfo/search
Disallow: /corporate2/mediacentre/search
Disallow: /corporate2/safety/search
Disallow: /cwynion/
Disallow: /eastenders/updates/
Disallow: /education/bitesize
Disallow: /education/dev
Disallow: /education/images
Disallow: /education/nav
Disallow: /education/navigation
Disallow: /education/ximages
Disallow: /eoltools/
Disallow: /films/gateways
Disallow: /food/binder/
Disallow: /food/recipes/search*?*
Disallow: /frameworks/fig/
Disallow: /furniture
Disallow: /gahuza/search
Disallow: /h2g2/servers/narthur8
Disallow: /hausa/search
Disallow: /hindi/search
Disallow: /history/domesday/search
Disallow: /includes/
Disallow: /indonesia/search
Disallow: /kyrgyz/search
Disallow: /learningzone/clips/search
Disallow: /mediacentre/proginfo/search
Disallow: /mediacentre/search
Disallow: /mediaselector
Disallow: /messageboards/
Disallow: /modules/musicnav/language/
Disallow: /mundo/search
Disallow: /music/language/*
Disallow: /music/releases/
Disallow: /nav/
Disallow: /navigation
Disallow: /nepali/search
Disallow: /news/uk-30888157
Disallow: /news/uk-england-suffolk-20780472
Disallow: /partners/
Disallow: /pashto/search
Disallow: /persian/search
Disallow: /portuguese/search
Disallow: /pressoffice/plots/
Disallow: /print/
Disallow: /programmes/articles/1jJwRxT3X9s0QlBsCMhvv7D/2013-fundraising-packs
Disallow: /programmes/articles/1nSkm7VR3fypxqB16dDtVwk/how-to-get-sponsored
Disallow: /programmes/articles/1RjY5ZcmdvRKPvbS662Jv9C/welsh-downloads-2013
Disallow: /programmes/articles/25h23bXRXFlGdVQ86hNFVkT/secondary-schools-fundraising
Disallow: /programmes/articles/2S6fTlHnqvdHGswDJ9yLs6r/early-years-fundraising
Disallow: /programmes/articles/35Cb1BsKBWZNfhVDp07K1y1/students
Disallow: /programmes/articles/4P9FhkRwqvYHVXmX6c13Bfd/downloads-page
Disallow: /programmes/articles/4qd5GpykkdkGZtYrRR5h073/ideas-and-downloads
Disallow: /programmes/articles/4zNrFLZXqfGcBFRHzLnkxqw/primary-schools-fundraising
Disallow: /programmes/articles/4zplPWW97l5Yk1BhTY4p3rz/tell-us-what-youre-doing
Disallow: /programmes/articles/5kgXgM40wp1JM9lSB1f18Yd/fundraising
Disallow: /programmes/articles/91J9cY9hzMLrsCmM7tX113/cerries-jump-up-and-dance-competition
Disallow: /programmes/articles/psvxkB6QDMK63pgHmP5RJF/who-you-help
Disallow: /programmes/articles/RRWbSk1mCZngypVngyZYJ0/get-your-money-to-us
Disallow: /programmes/articles/v8qTSbm89w6DnfgxFL5GBk/fundraising-at-school
Disallow: /programmes/articles/ZY66x6RD4jg5kqv8t7vn56/lets-go-shopping
Disallow: /programmes/b008dk4b
Disallow: /programmes/profiles/1YyY0F36ppV3DmnSkNTrRxZ/downloads-for-primary-schools
Disallow: /programmes/profiles/2dgMD54k88Lz77lYcy7mRhc/secondary-school-fundraising-ideas
Disallow: /programmes/profiles/2x87wV7KW01sgY0dl7qBnT6/recipes
Disallow: /programmes/profiles/33x1x5jLwh1MbhpFXhlxq37/posters-stickers-and-games
Disallow: /programmes/profiles/3yvcq7cxMmNLCzSzDCWsPyM/primary-school-fundraising-ideas
Disallow: /programmes/profiles/49qkZq0Pmmh4flWgYSPhgPj/fundraising-ideas-at-work
Disallow: /programmes/profiles/49QnjFZ5T6f6sdQY399HNzf/primary-teacher-resources
Disallow: /programmes/profiles/4KFFdqWQZ9lSPl1qHnRPbNV/be-a-hero
Disallow: /programmes/profiles/4yn6kWyMJZLgPZj4100SSkh/early-years-teacher-resources
Disallow: /programmes/profiles/54k8kVKM9gTzVL4zvDJ1BzN/secondary-teacher-resources
Disallow: /programmes/profiles/581RcyV6nP3Jtxk9Vcy9Hnq/downloads-for-early-years
Disallow: /programmes/profiles/5wdxQwnlLHJNY9y2Nxm1RkQ/fundraising-ideas
Disallow: /programmes/profiles/cGJ1RZ5pHG0Jl65YSN0YYc/downloads-for-secondary-schools
Disallow: /programmes/profiles/qWq8hB1135cdgj2cqNXyWB/early-years-fundraising-ideas
Disallow: /radio/aod/
Disallow: /radio/player
Disallow: /russian/search
Disallow: /safety/search
Disallow: /schools/typing/about/
Disallow: /schools/typing/flash/
Disallow: /schools/typing/generic/
Disallow: /schools/typing/levels/
Disallow: /search/
Disallow: /search$
Disallow: /sinhala/search
Disallow: /skillswise/quickfind/search
Disallow: /somali/search
Disallow: /survey/
Disallow: /swahili/search
Disallow: /syndication/html/
Disallow: /tamil/search
Disallow: /turkce/search
Disallow: /ukchina/simp/search
Disallow: /ukchina/trad/search
Disallow: /ukrainian/search
Disallow: /urdu/search
Disallow: /uzbek/search
Disallow: /vietnamese/search
Disallow: /weather/broadband/
Disallow: /weather/search
Disallow: /worldservice/images/
Disallow: /worldservice/psims/
Disallow: /worldservice/ssi/
Disallow: /worldservice/survey/
Disallow: /zhongwen/simp/search
Disallow: /zhongwen/trad/search
Disallow: /indepthtoolkit/smallprox$
Disallow: /indepthtoolkit/smallprox/
Allow: /ideas$
Allow: /ideas/
Allow: /cbbc$
Allow: /cbbc/
Allow: /cbeebies$
Allow: /cbeebies/
Allow: /scotland$
Allow: /scotland/
Allow: /wales$
Allow: /wales/
Allow: /northernireland$
Allow: /northernireland/
Allow: /alba$
Allow: /alba/
Allow: /cymru$
Allow: /cymru/
Allow: /newsround/amp$
Allow: /newsround/amp/