> Retrieving Robots.txt file from yandex.ru/robots.txt
> Retrieval Complete
> yandex.ru responded with HTTP status code 200 OK

It Depends... :-/


The robots.txt file contains "Disallow" instructions. Whether or not you can crawl this site depends on who you are and what folders you want to crawl.



We've broken out the individual declarations from the robots.txt file below. Hover any section for more detail about what the declaration means. We've also hyperlinked any URL's and paths that were included in the file for your convenience.

**Please read our disclaimer to learn about other considerations before crawling a website.**
  1. # yandex.ru
    ⇧ This row is a comment only, and does not contain actionable instructions - only notes from the site publisher.
  2. User-agent: *
    ⇧ This row specifies that all user agents (a.k.a. "*") should obey the instructions on the following rows.
    Disallow: /?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /403.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /404.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /500.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /about.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /adddata
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /advertising
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /articles
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*?text=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*?tag=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*/*/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blogs*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /blogs$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /blogs/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /bus/orders*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bus/api/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /catalog/?text=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /chisla.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /clck
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cy
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cycounter
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /dzen
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/ping
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/tasks
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/teachers
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/test
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /formfeedback
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /goto_issue/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /goto_rubric/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /i/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images-data
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /images/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /index_m
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /infected
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /logotypes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /more_samples
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /msearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /msearchpart
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /map-constructor/loader*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /maps/*?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /maps/*?lang=ru$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /maps/*?lang=uk$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /norobot
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /opensearch.xml
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /padsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /people/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /people$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /people/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /person
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/404
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/*?*lat=*&*lon=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/*?*lon=*&*lat=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /polling
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/launcher/mgoodbye/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/skype*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/skype/*/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/*welcome*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/yobject/changelog*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/chrome/ext-install/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/chrome/searchline-install/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/mac/uninstall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/win/uninstall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*welcome*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/win/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /quotes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /redir
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /region_map
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /regions.html?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /rubric2sport
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /s/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /save
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /setup
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /showcaptcha
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sitesearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /skazki
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sl/*.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sportagent
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /storeclick
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /storerequest
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /support/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/distr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/dsp
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/*zout_
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /telsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /themes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /touchsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /versions
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/*filmId=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /video/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /video/?
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /xmlsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /yaca/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/m/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/m/yca/cat/*/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/*.xml$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/cat/*/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/tungrp/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/time/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/geo/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/cat/*/geo/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/synt2/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yandsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yca/cy
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /yac2014
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/launcher/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /opera/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /firefox/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/bm/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/browsers/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ie/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /element/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /element/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /adult
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Clean-Param: ncrnd&redircnt&clid&_&win /
    ⇧ This directive contains invalid syntax according to the robots.txt specification. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    User-Agent: Twitterbot
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Allow: /images
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /gorsel
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /video
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /adult
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
  3. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    User-agent: Applebot
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: /?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /403.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /404.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /500.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /about.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /adddata
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /advertising
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /articles
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*?text=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*?tag=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*/*/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blogs*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /blogs$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /blogs/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /bus/orders*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bus/api/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /catalog/?text=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /chisla.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /clck
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cy
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cycounter
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /dzen
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/ping
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/tasks
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/teachers
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/test
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /formfeedback
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /goto_issue/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /goto_rubric/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /i/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images-data
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /images/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /index_m
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /infected
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /logotypes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /map-constructor/loader*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /more_samples
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /msearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /msearchpart
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /norobot
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /opensearch.xml
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /padsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /people/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /people$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /people/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /person
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/404
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/*?*lat=*&*lon=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/*?*lon=*&*lat=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /polling
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/launcher/mgoodbye/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/skype*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/skype/*/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/*welcome*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/yobject/changelog*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/chrome/ext-install/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/chrome/searchline-install/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/mac/uninstall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/win/uninstall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*welcome*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/win/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /quotes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /redir
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /region_map
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /regions.html?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /rubric2sport
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /s/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /save
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /set/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /setup
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /showcaptcha
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sitesearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /skazki
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sl/*.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sportagent
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /storeclick
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /storerequest
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /support/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/distr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/dsp
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/*zout_
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /telsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /themes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /touchsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /versions
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/*filmId=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /video/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /video/?
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /xmlsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /yaca/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/m/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/m/yca/cat/*/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/*.xml$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/cat/*/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/tungrp/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/time/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/geo/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/cat/*/geo/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/synt2/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yandsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yca/cy
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /yac2014
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/launcher/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /opera/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /firefox/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/bm/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/browsers/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ie/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /element/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /element/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /adult
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Clean-Param: ncrnd&redircnt&clid&_&win /
    ⇧ This directive contains invalid syntax according to the robots.txt specification. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
    User-agent: Yandex
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: /?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /403.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /404.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /500.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /about.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /adddata
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /advertising
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /articles
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*?text=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*?tag=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blog/*/*/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /blogs*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /blogs$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /blogs/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /bus/orders*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bus/api/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /catalog/?text=
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi-bin/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cgi/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /chisla.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /clck
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cy
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cycounter
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /dzen
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/ping
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/tasks
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/teachers
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /edu/test
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /formfeedback
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /goto_issue/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /goto_rubric/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /i/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images-data
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /images/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /images/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /index_m
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /infected
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /logotypes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /more_samples
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /msearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /msearchpart
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /map-constructor/loader*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /maps/*?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /maps/*?lang=ru$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /maps/*?lang=uk$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /norobot
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /opensearch.xml
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /padsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /people/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /people$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /people/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /person
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/404
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/*?*lat=*&*lon=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pogoda/*?*lon=*&*lat=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /polling
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/launcher/mgoodbye/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/skype*?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/skype/*/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/*welcome*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/yobject/changelog*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/chrome/ext-install/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/chrome/searchline-install/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/mac/uninstall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/win/uninstall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*welcome*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/win/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /quotes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /redir
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /region_map
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /regions.html?
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /rubric2sport
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /s/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /save
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /search
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /setup
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /showcaptcha
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sitesearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /skazki
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sl/*.html
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sportagent
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /storeclick
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /storerequest
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /support/
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/distr
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/dsp
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /support/*zout_
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /telsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /themes
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /touchsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /versions
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/*filmId=*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /video/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /video/?
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Disallow: /xmlsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /yaca/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/m/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/m/yca/cat/*/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/*.xml$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /yaca/cat/*/$
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/tungrp/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/time/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/geo/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/cat/*/geo/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yaca/*/synt2/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yandsearch
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /yca/cy
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /yac2014
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /promo/launcher/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /opera/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /firefox/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/bm/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/browsers/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/punto/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ie/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /element/?*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /element/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /soft/*goodbye*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /adult
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Clean-Param: ncrnd&redircnt&clid&_&win /
    ⇧ This directive contains invalid syntax according to the robots.txt specification.
# yandex.ru
User-agent: *
Disallow: /?
Disallow: /403.html
Disallow: /404.html
Disallow: /500.html
Disallow: /about.html
Disallow: /adddata
Disallow: /adresa-segmentator
Disallow: /advanced_engl.html
Disallow: /advertising
Disallow: /all-supported-params
Disallow: /articles
Disallow: /blog/*?text=
Disallow: /blog/*?tag=
Disallow: /blog/*/*/*
Disallow: /blogs*
Allow: /blogs$
Allow: /blogs/$
Allow: /blogs/pad/$
Allow: /blogs/pad$

Disallow: /bus/orders*
Disallow: /bus/api/*

Disallow: /catalog/?text=
Disallow: /cgi-bin/
Disallow: /cgi/
Disallow: /chisla.html
Disallow: /clck
Disallow: /cy
Disallow: /cycounter
Disallow: /dzen
Disallow: /edu/ping
Disallow: /edu/tasks
Disallow: /edu/teachers
Disallow: /edu/test
Disallow: /experiments.xml
Disallow: /formfeedback
Disallow: /goto_issue/
Disallow: /goto_rubric/
Disallow: /i/
Disallow: /images-data
Disallow: /images.html
Disallow: /images/*
Allow: /images/$
Allow: /images/smart/$
Allow: /images/touch/$
Allow: /images/touch/?
Disallow: /index_m
Disallow: /infected
Disallow: /keyboard_qwerty.html
Disallow: /logotypes
Disallow: /more_samples
Disallow: /msearch
Disallow: /msearchpart
Disallow: /map-constructor/loader*
Disallow: /maps/*?
Allow: /maps/*?lang=ru$
Allow: /maps/*?lang=uk$
Disallow: /norobot
Disallow: /opensearch.xml
Disallow: /padsearch
Disallow: /people/*
Allow: /people$
Allow: /people/$
Allow: /people/pad/$
Allow: /people/pad$
Disallow: /person
Disallow: /podpiska/login.pl
Disallow: /pogoda/search
Disallow: /pogoda/404
Disallow: /pogoda/*?*lat=*&*lon=*
Disallow: /pogoda/*?*lon=*&*lat=*

Disallow: /polling
Disallow: /promo/*goodbye*
Disallow: /promo/diskelement
Disallow: /promo/launcher/mgoodbye/*
Disallow: /promo/skype*?*
Disallow: /promo/skype/*/*
Disallow: /promo/*welcome*
Disallow: /promo/yobject/changelog*
Disallow: /soft/bm/goodbye
Disallow: /soft/chrome/ext-install/*
Disallow: /soft/chrome/searchline-install/*
Disallow: /soft/*goodbye*
Disallow: /soft/punto/mac/uninstall/*
Disallow: /soft/punto/win/uninstall/*
Disallow: /soft/*welcome*
Disallow: /soft/win/?*
Disallow: /quotes
Disallow: /redir
Disallow: /region_map
Disallow: /regions_list.xml
Disallow: /regions.html?
Disallow: /rubric2sport
Disallow: /s/
Disallow: /save
Disallow: /search
Allow: /search/advanced
Disallow: /setup
Disallow: /showcaptcha
Disallow: /sitesearch
Disallow: /skazki
Disallow: /sl/*.html
Disallow: /soft/extensions/goodbye
Disallow: /sportagent
Disallow: /storeclick
Disallow: /storerequest
Disallow: /subscribe/confirm.pl
Disallow: /subscribe/view.pl

Allow: /support/
Disallow: /support/direct-images
Disallow: /support/direct-tooltips
Disallow: /support/distr
Disallow: /support/dsp
Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
Disallow: /support/maps-beta
Disallow: /support/market-images
Disallow: /support/security
Disallow: /support/webmaster-images
Disallow: /support/*zout_
Disallow: /support/search-results/

Disallow: /telsearch
Disallow: /themes
Disallow: /toggle-experiment
Disallow: /touchsearch
Disallow: /versions
Disallow: /video/*
Disallow: /video/*filmId=*
Allow: /video/$
Allow: /video/?
Allow: /video/sitemap
Allow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/
Allow: /video/dizi-izle/
Allow: /video/dizi-izle/?
Allow: /video/yerli-dizi-izle/
Allow: /video/yabanci-dizi-izle/
Allow: /video/touch/
Allow: /video/pad/
Disallow: /xmlsearch

Disallow: /yaca
Allow: /yaca/$
Allow: /yaca/m/$
Allow: /yaca/m/yca/cat/*/$
Allow: /yaca/*.xml$
Allow: /yaca/cat/*/$
Disallow: /yaca/result.xml
Disallow: /yaca/*/tungrp/
Disallow: /yaca/*/time/
Disallow: /yaca/*/geo/
Disallow: /yaca/cat/*/geo/*
Disallow: /yaca/*/synt2/
Disallow: /yandsearch
Disallow: /yca/cy

Allow: /yac2014
Disallow: /soft/distribution
Disallow: /soft/?*
Disallow: /promo/launcher/?*
Disallow: /opera/?*
Disallow: /firefox/?*
Disallow: /soft/bm/?*
Disallow: /soft/browsers/?*
Disallow: /soft/punto/?*
Disallow: /ie/?*
Disallow: /element/?*
Disallow: /element/*goodbye*
Disallow: /soft/*goodbye*
Disallow: /adult

Clean-Param: ncrnd&redircnt&clid&_&win /

Sitemap: https://yandex.ru/pogoda/sitemap_index.xml
Sitemap: https://yandex.ru/support/sitemap.xml
Sitemap: https://yandex.ru/blog/sitemap.xml

User-Agent: Twitterbot
Allow: /images
Allow: /gorsel
Allow: /video
Disallow: /adult
Sitemap: https://yandex.ru/pogoda/sitemap_index.xml
Sitemap: https://yandex.ru/support/sitemap.xml
Sitemap: https://yandex.ru/blog/sitemap.xml

User-agent: Applebot
Disallow: /?
Disallow: /403.html
Disallow: /404.html
Disallow: /500.html
Disallow: /about.html
Disallow: /adddata
Disallow: /adresa-segmentator
Disallow: /advanced_engl.html
Disallow: /advertising
Disallow: /all-supported-params
Disallow: /articles
Disallow: /blog/*?text=
Disallow: /blog/*?tag=
Disallow: /blog/*/*/*
Disallow: /blogs*
Allow: /blogs$
Allow: /blogs/$
Allow: /blogs/pad/$
Allow: /blogs/pad$

Disallow: /bus/orders*
Disallow: /bus/api/*

Disallow: /catalog/?text=
Disallow: /cgi-bin/
Disallow: /cgi/
Disallow: /chisla.html
Disallow: /clck
Disallow: /cy
Disallow: /cycounter
Disallow: /dzen
Disallow: /edu/ping
Disallow: /edu/tasks
Disallow: /edu/teachers
Disallow: /edu/test
Disallow: /experiments.xml
Disallow: /formfeedback
Disallow: /goto_issue/
Disallow: /goto_rubric/
Disallow: /i/
Disallow: /images-data
Disallow: /images.html
Disallow: /images/*
Allow: /images/$
Allow: /images/smart/$
Allow: /images/touch/$
Allow: /images/touch/?
Disallow: /index_m
Disallow: /infected
Disallow: /keyboard_qwerty.html
Disallow: /logotypes
Disallow: /map-constructor/loader*
Disallow: /more_samples
Disallow: /msearch
Disallow: /msearchpart
Disallow: /norobot
Disallow: /opensearch.xml
Disallow: /padsearch
Disallow: /people/*
Allow: /people$
Allow: /people/$
Allow: /people/pad/$
Allow: /people/pad$
Disallow: /person
Disallow: /podpiska/login.pl
Disallow: /pogoda/search
Disallow: /pogoda/404
Disallow: /pogoda/*?*lat=*&*lon=*
Disallow: /pogoda/*?*lon=*&*lat=*

Disallow: /polling
Disallow: /promo/*goodbye*
Disallow: /promo/diskelement
Disallow: /promo/launcher/mgoodbye/*
Disallow: /promo/skype*?*
Disallow: /promo/skype/*/*
Disallow: /promo/*welcome*
Disallow: /promo/yobject/changelog*
Disallow: /soft/bm/goodbye
Disallow: /soft/chrome/ext-install/*
Disallow: /soft/chrome/searchline-install/*
Disallow: /soft/*goodbye*
Disallow: /soft/punto/mac/uninstall/*
Disallow: /soft/punto/win/uninstall/*
Disallow: /soft/*welcome*
Disallow: /soft/win/?*
Disallow: /quotes
Disallow: /redir
Disallow: /region_map
Disallow: /regions_list.xml
Disallow: /regions.html?
Disallow: /rubric2sport
Disallow: /s/
Disallow: /save
Disallow: /search
Allow: /search/advanced
Disallow: /set/
Disallow: /setup
Disallow: /showcaptcha
Disallow: /sitesearch
Disallow: /skazki
Disallow: /sl/*.html
Disallow: /soft/extensions/goodbye
Disallow: /sportagent
Disallow: /storeclick
Disallow: /storerequest
Disallow: /subscribe/confirm.pl
Disallow: /subscribe/view.pl

Allow: /support/
Disallow: /support/direct-images
Disallow: /support/direct-tooltips
Disallow: /support/distr
Disallow: /support/dsp
Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
Disallow: /support/maps-beta
Disallow: /support/market-images
Disallow: /support/security
Disallow: /support/webmaster-images
Disallow: /support/*zout_
Disallow: /support/search-results/

Disallow: /telsearch
Disallow: /themes
Disallow: /toggle-experiment
Disallow: /touchsearch
Disallow: /versions
Disallow: /video/*
Disallow: /video/*filmId=*
Allow: /video/$
Allow: /video/?
Allow: /video/sitemap
Allow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/
Allow: /video/dizi-izle/
Allow: /video/dizi-izle/?
Allow: /video/yerli-dizi-izle/
Allow: /video/yabanci-dizi-izle/
Allow: /video/touch/
Allow: /video/pad/
Disallow: /xmlsearch

Disallow: /yaca
Allow: /yaca/$
Allow: /yaca/m/$
Allow: /yaca/m/yca/cat/*/$
Allow: /yaca/*.xml$
Allow: /yaca/cat/*/$
Disallow: /yaca/result.xml
Disallow: /yaca/*/tungrp/
Disallow: /yaca/*/time/
Disallow: /yaca/*/geo/
Disallow: /yaca/cat/*/geo/*
Disallow: /yaca/*/synt2/
Disallow: /yandsearch
Disallow: /yca/cy

Allow: /yac2014
Disallow: /soft/distribution
Disallow: /soft/?*
Disallow: /promo/launcher/?*
Disallow: /opera/?*
Disallow: /firefox/?*
Disallow: /soft/bm/?*
Disallow: /soft/browsers/?*
Disallow: /soft/punto/?*
Disallow: /ie/?*
Disallow: /element/?*
Disallow: /element/*goodbye*
Disallow: /soft/*goodbye*
Disallow: /adult

Clean-Param: ncrnd&redircnt&clid&_&win /

Sitemap: https://yandex.ru/pogoda/sitemap_index.xml
Sitemap: https://yandex.ru/support/sitemap.xml
Sitemap: https://yandex.ru/blog/sitemap.xml

User-agent: Yandex
Disallow: /?
Disallow: /403.html
Disallow: /404.html
Disallow: /500.html
Disallow: /about.html
Disallow: /adddata
Disallow: /adresa-segmentator
Disallow: /advanced_engl.html
Disallow: /advertising
Disallow: /all-supported-params
Disallow: /articles
Disallow: /blog/*?text=
Disallow: /blog/*?tag=
Disallow: /blog/*/*/*
Disallow: /blogs*
Allow: /blogs$
Allow: /blogs/$
Allow: /blogs/pad/$
Allow: /blogs/pad$

Disallow: /bus/orders*
Disallow: /bus/api/*

Disallow: /catalog/?text=
Disallow: /cgi-bin/
Disallow: /cgi/
Disallow: /chisla.html
Disallow: /clck
Disallow: /cy
Disallow: /cycounter
Disallow: /dzen
Disallow: /edu/ping
Disallow: /edu/tasks
Disallow: /edu/teachers
Disallow: /edu/test
Disallow: /experiments.xml
Disallow: /formfeedback
Disallow: /goto_issue/
Disallow: /goto_rubric/
Disallow: /i/
Disallow: /images-data
Disallow: /images.html
Disallow: /images/*
Allow: /images/$
Allow: /images/smart/$
Allow: /images/touch/$
Allow: /images/touch/?
Disallow: /index_m
Disallow: /infected
Disallow: /keyboard_qwerty.html
Disallow: /logotypes
Disallow: /more_samples
Disallow: /msearch
Disallow: /msearchpart
Disallow: /map-constructor/loader*
Disallow: /maps/*?
Allow: /maps/*?lang=ru$
Allow: /maps/*?lang=uk$
Disallow: /norobot
Disallow: /opensearch.xml
Disallow: /padsearch
Disallow: /people/*
Allow: /people$
Allow: /people/$
Allow: /people/pad/$
Allow: /people/pad$
Disallow: /person
Disallow: /podpiska/login.pl
Disallow: /pogoda/search
Disallow: /pogoda/404
Disallow: /pogoda/*?*lat=*&*lon=*
Disallow: /pogoda/*?*lon=*&*lat=*

Disallow: /polling
Disallow: /promo/*goodbye*
Disallow: /promo/diskelement
Disallow: /promo/launcher/mgoodbye/*
Disallow: /promo/skype*?*
Disallow: /promo/skype/*/*
Disallow: /promo/*welcome*
Disallow: /promo/yobject/changelog*
Disallow: /soft/bm/goodbye
Disallow: /soft/chrome/ext-install/*
Disallow: /soft/chrome/searchline-install/*
Disallow: /soft/*goodbye*
Disallow: /soft/punto/mac/uninstall/*
Disallow: /soft/punto/win/uninstall/*
Disallow: /soft/*welcome*
Disallow: /soft/win/?*
Disallow: /quotes
Disallow: /redir
Disallow: /region_map
Disallow: /regions_list.xml
Disallow: /regions.html?
Disallow: /rubric2sport
Disallow: /s/
Disallow: /save
Disallow: /search
Allow: /search/advanced
Disallow: /setup
Disallow: /showcaptcha
Disallow: /sitesearch
Disallow: /skazki
Disallow: /sl/*.html
Disallow: /soft/extensions/goodbye
Disallow: /sportagent
Disallow: /storeclick
Disallow: /storerequest
Disallow: /subscribe/confirm.pl
Disallow: /subscribe/view.pl

Allow: /support/
Disallow: /support/direct-images
Disallow: /support/direct-tooltips
Disallow: /support/distr
Disallow: /support/dsp
Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
Disallow: /support/maps-beta
Disallow: /support/market-images
Disallow: /support/security
Disallow: /support/webmaster-images
Disallow: /support/*zout_
Disallow: /support/search-results/

Disallow: /telsearch
Disallow: /themes
Disallow: /toggle-experiment
Disallow: /touchsearch
Disallow: /versions
Disallow: /video/*
Disallow: /video/*filmId=*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/*
Allow: /video/$
Allow: /video/?
Allow: /video/sitemap
Allow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/
Allow: /video/dizi-izle/
Allow: /video/dizi-izle/?
Allow: /video/yerli-dizi-izle/
Allow: /video/yabanci-dizi-izle/
Allow: /video/touch/
Allow: /video/pad/
Disallow: /xmlsearch

Disallow: /yaca
Allow: /yaca/$
Allow: /yaca/m/$
Allow: /yaca/m/yca/cat/*/$
Allow: /yaca/*.xml$
Allow: /yaca/cat/*/$
Disallow: /yaca/result.xml
Disallow: /yaca/*/tungrp/
Disallow: /yaca/*/time/
Disallow: /yaca/*/geo/
Disallow: /yaca/cat/*/geo/*
Disallow: /yaca/*/synt2/
Disallow: /yandsearch
Disallow: /yca/cy

Allow: /yac2014
Disallow: /soft/distribution
Disallow: /soft/?*
Disallow: /promo/launcher/?*
Disallow: /opera/?*
Disallow: /firefox/?*
Disallow: /soft/bm/?*
Disallow: /soft/browsers/?*
Disallow: /soft/punto/?*
Disallow: /ie/?*
Disallow: /element/?*
Disallow: /element/*goodbye*
Disallow: /soft/*goodbye*
Disallow: /adult

Clean-Param: ncrnd&redircnt&clid&_&win /