> Retrieving Robots.txt file from apple.com/robots.txt
> Retrieval Complete
> apple.com responded with HTTP status code 200 OK

It Depends... :-/


The robots.txt file contains "Disallow" instructions. Whether or not you can crawl this site depends on who you are and what folders you want to crawl.



We've broken out the individual declarations from the robots.txt file below. Hover any section for more detail about what the declaration means. We've also hyperlinked any URL's and paths that were included in the file for your convenience.

**Please read our disclaimer to learn about other considerations before crawling a website.**
  1. # robots.txt for http://www.apple.com/
    ⇧ This row is a comment only, and does not contain actionable instructions - only notes from the site publisher.
    User-agent: *
    ⇧ This row specifies that all user agents (a.k.a. "*") should obey the instructions on the following rows.
    Disallow: /*/includes/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*retail/availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*retail/availabilitySearch*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*retail/pickupEligibility*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/signed_in_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/sign_out*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/*WebObjects/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/1-800-MY-APPLE/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/answer/vote*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/bag*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/browse/overlay/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/browse/ribbon/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/browse/campaigns/mobile_overlay*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/button_availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/favorites*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/iphone/payments/overlay/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/mobile/olss_error*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/mobilex/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/order*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/giftorguestorder*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/order/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/question/answer/report*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/question/subscribe*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/question/unsubscribe/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/review/vote*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/reviews/report*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/rs-mvt/rel/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/sentry*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/socialsharing/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/store/feeds/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/variationSelection
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_adc_*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_aoc_*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_enterprise*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_internal-epp-discounted*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_k12nonbts*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_kiosk*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_nonbts*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_qpromo*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_refurb-discounted*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn/*/aow/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /go/awards/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /newsroom/notifications/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /shop/search/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tmall*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /ac/globalnav/2.0/*/images/ac-globalnav/globalnav/search/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    User-agent: Baiduspider
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: */product-red/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: */product-red*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/retail/availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/retail/availabilitySearch*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/retail/pickupEligibility*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/*WebObjects/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/1-800-MY-APPLE/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/2322-consumer*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/account/setup*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/answer/vote*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/browse/campaigns/mobile_overlay*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/browse/overlay*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/button_availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/bag*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/change_password*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/checkout*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/create_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/favorites*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/identify_user*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/mobile/checkout/start*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/mobilex/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/order*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/giftorguestorder*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/question/answer/report*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/question/subscribe*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/question/unsubscribe/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/review/vote*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/reviews/report*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/rs-mvt/rel/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentry*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/change_password*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/create_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/create_account_confirm*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/identify_user*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/signed_in_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sign_out*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/socialsharing/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/storeConfig*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/vieworder*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /today*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/variationSelection*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ae/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /am/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /asia/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /at/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /au/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /befr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /benl/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bg/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bh/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /br/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /bw/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ca/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ca/fr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cf/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /chde/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /chfr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ci/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cl/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cm/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn/*/aow/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_cmb/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_abc/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_icbc/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_ccb_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_cmb_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_abc_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_icbc_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_ccb_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*_kiosk*/shop/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /co/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cz/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /de/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /dk/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ee/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /eg/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /es/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /fi/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /fr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gn/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gq/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /go/awards/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /gw/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hk/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hk/en/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hk-zh/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /hu/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /id/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ie/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /il/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /in/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /it/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /jo/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /jp/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ke/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /kr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /kw/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /la/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /lae/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /li/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /lt/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /lu/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /lv/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ma/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /md/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /me/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mg/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mk/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ml/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mo/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mt/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mu/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mx/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /my/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /mz/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ne/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /newsroom*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ng/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nl/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /no/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /nz/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /om/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ph/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pl/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /pt/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /qa/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /retail/availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /retail/availabilitySearch*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /retail/pickupEligibility*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ro/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ru/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sa/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /se/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sg/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /shop/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /si/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sk/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /sn/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /today*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /th/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /th-en/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tmall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tn/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tr/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tw/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /ug/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /uk/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /vn/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /za/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    User-agent: HaoSouSpider
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: */product-red/
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/retail/availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/retail/availabilitySearch*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/retail/pickupEligibility*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/*WebObjects/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/1-800-MY-APPLE/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/2322-consumer*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/account/setup*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/answer/vote*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/browse/campaigns/mobile_overlay*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/button_availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/bag*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/change_password*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/checkout*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/create_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/favorites*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/identify_user*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/mobile/checkout/start*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/mobilex/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/order*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/giftorguestorder*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*shop/np/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/question/answer/report*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/question/subscribe*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/question/unsubscribe/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/review/vote*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/reviews/report*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/rs-mvt/rel/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentry*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/change_password*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/create_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/create_account_confirm*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/identify_user*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sentryx/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/signed_in_account*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sign_in*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/sign_out*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/socialsharing/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/storeConfig*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/variationSelection*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /*/shop/vieworder*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above. ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn/*/aow/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /newsroom/notifications/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /retail/availability*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /retail/availabilitySearch*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /retail/pickupEligibility*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /shop/bag*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /shop/search/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /tmall/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_cmb/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_abc/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_icbc/*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_ccb_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_cmb_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_abc_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_icbc_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Disallow: /cn_ccb_*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    User-agent: Sogou web spider
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: /*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /cn/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cn-k12/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    User-agent: Sogou inst spider
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: /*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /cn/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cn-k12/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    User-agent: Sogou spider2
    ⇧ This row specifies a user agent pattern. Any robots or browsers that match this pattern should obey the instructions on the following rows.
    Disallow: /*
    ⇧ This row contains instructions to disallow robot access to a particular folder on the site for user agents specified above.
    Allow: /cn/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above.
    Allow: /cn-k12/*
    ⇧ This row contains instructions for folders that are allowed access to the user agents specified above. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable. ⇧ This row contains a path to a sitemap file that contains URLs that are crawlable.
# robots.txt for http://www.apple.com/

User-agent: *
Disallow: /*/includes/*
Disallow: /*retail/availability*
Disallow: /*retail/availabilitySearch*
Disallow: /*retail/pickupEligibility*
Disallow: /*shop/signed_in_account*
Disallow: /*shop/sign_in*
Disallow: /*shop/sign_out*
Disallow: /*shop/*WebObjects/*
Disallow: /*shop/1-800-MY-APPLE/*
Disallow: /*shop/answer/vote*
Disallow: /*shop/bag*
Disallow: /*shop/browse/overlay/*
Disallow: /*shop/browse/ribbon/*
Disallow: /*shop/browse/campaigns/mobile_overlay*
Disallow: /*shop/button_availability*
Disallow: /*shop/favorites*
Disallow: /*shop/iphone/payments/overlay/*
Disallow: /*shop/mobile/olss_error*
Disallow: /*shop/mobilex/*
Disallow: /*shop/np/order*
Disallow: /*shop/np/giftorguestorder*
Disallow: /*shop/np/sign_in*
Disallow: /*shop/order/*
Disallow: /*shop/question/answer/report*
Disallow: /*shop/question/subscribe*
Disallow: /*shop/question/unsubscribe/
Disallow: /*shop/review/vote*
Disallow: /*shop/reviews/report*
Disallow: /*shop/rs-mvt/rel/*
Disallow: /*shop/sentry*
Disallow: /*shop/socialsharing/*
Disallow: /*shop/store/feeds/*
Disallow: /*shop/variationSelection
Disallow: /*_adc_*/shop/
Disallow: /*_aoc_*/shop/
Disallow: /*_enterprise*/shop/
Disallow: /*_internal-epp-discounted*/shop/
Disallow: /*_k12nonbts*/shop/
Disallow: /*_kiosk*/shop/
Disallow: /*_nonbts*/shop/
Disallow: /*_qpromo*/shop/
Disallow: /*_refurb-discounted*/shop/
Disallow: /cn/*/aow/*
Disallow: /go/awards/*
Disallow: /newsroom/notifications/*
Disallow: /shop/search/*
Disallow: /tmall*
Allow: /ac/globalnav/2.0/*/images/ac-globalnav/globalnav/search/*

User-agent: Baiduspider
Disallow: */product-red/
Disallow: */product-red*
Disallow: /*/retail/availability*
Disallow: /*/retail/availabilitySearch*
Disallow: /*/retail/pickupEligibility*
Disallow: /*/shop/*WebObjects/*
Disallow: /*/shop/1-800-MY-APPLE/*
Disallow: /*/shop/2322-consumer*
Disallow: /*/shop/account/setup*
Disallow: /*/shop/answer/vote*
Disallow: /*/shop/browse/campaigns/mobile_overlay*
Disallow: /*/shop/browse/overlay*
Disallow: /*/shop/button_availability*
Disallow: /*/shop/bag*
Disallow: /*/shop/change_password*
Disallow: /*/shop/checkout*
Disallow: /*/shop/create_account*
Disallow: /*/shop/favorites*
Disallow: /*/shop/identify_user*
Disallow: /*/shop/mobile/checkout/start*
Disallow: /*/shop/mobilex/*
Disallow: /*shop/np/order*
Disallow: /*shop/np/giftorguestorder*
Disallow: /*shop/np/sign_in*
Disallow: /*/shop/question/answer/report*
Disallow: /*/shop/question/subscribe*
Disallow: /*/shop/question/unsubscribe/*
Disallow: /*/shop/review/vote*
Disallow: /*/shop/reviews/report*
Disallow: /*/shop/rs-mvt/rel/*
Disallow: /*/shop/sentry*
Disallow: /*/shop/sentryx/change_password*
Disallow: /*/shop/sentryx/create_account*
Disallow: /*/shop/sentryx/create_account_confirm*
Disallow: /*/shop/sentryx/identify_user*
Disallow: /*/shop/sentryx/sign_in*
Disallow: /*/shop/signed_in_account*
Disallow: /*/shop/sign_in*
Disallow: /*/shop/sign_out*
Disallow: /*/shop/socialsharing/*
Disallow: /*/shop/storeConfig*
Disallow: /*/shop/vieworder*
Disallow: /today*
Disallow: /*/variationSelection*
Disallow: /ae/*
Disallow: /am/*
Disallow: /apple-watch-nike/
Disallow: /apple-watch-hermes/
Disallow: /asia/*
Disallow: /at/*
Disallow: /au/*
Disallow: /befr/*
Disallow: /benl/*
Disallow: /bg/*
Disallow: /bh/*
Disallow: /br/*
Disallow: /bw/*
Disallow: /ca/*
Disallow: /ca/fr/*
Disallow: /cf/*
Disallow: /chde/*
Disallow: /chfr/*
Disallow: /ci/*
Disallow: /cl/*
Disallow: /cm/*
Disallow: /cn/*/aow/*
Disallow: /cn_cmb/*
Disallow: /cn_abc/*
Disallow: /cn_icbc/*
Disallow: /cn_ccb_*
Disallow: /cn_cmb_*
Disallow: /cn_abc_*
Disallow: /cn_icbc_*
Disallow: /cn_ccb_*
Disallow: /*_kiosk*/shop/
Disallow: /co/*
Disallow: /cz/*
Disallow: /de/*
Disallow: /dk/*
Disallow: /ee/*
Disallow: /eg/*
Disallow: /es/*
Disallow: /fi/*
Disallow: /fr/*
Disallow: /gn/*
Disallow: /gq/*
Disallow: /go/awards/*
Disallow: /gr/*
Disallow: /gw/*
Disallow: /hk/*
Disallow: /hk/en/*
Disallow: /hk-zh/*
Disallow: /hr/*
Disallow: /hu/*
Disallow: /id/*
Disallow: /ie/*
Disallow: /il/*
Disallow: /in/*
Disallow: /it/*
Disallow: /jo/*
Disallow: /jp/*
Disallow: /ke/*
Disallow: /kr/*
Disallow: /kw/*
Disallow: /la/*
Disallow: /lae/*
Disallow: /li/*
Disallow: /lt/*
Disallow: /lu/*
Disallow: /lv/*
Disallow: /ma/*
Disallow: /md/*
Disallow: /me/*
Disallow: /mg/*
Disallow: /mk/*
Disallow: /ml/*
Disallow: /mo/*
Disallow: /mt/*
Disallow: /mu/*
Disallow: /mx/*
Disallow: /my/*
Disallow: /mz/*
Disallow: /ne/*
Disallow: /newsroom*
Disallow: /ng/*
Disallow: /nl/*
Disallow: /no/*
Disallow: /nz/*
Disallow: /om/*
Disallow: /ph/*
Disallow: /pl/*
Disallow: /pt/*
Disallow: /qa/*
Disallow: /retail/availability*
Disallow: /retail/availabilitySearch*
Disallow: /retail/pickupEligibility*
Disallow: /ro/*
Disallow: /ru/*
Disallow: /sa/*
Disallow: /se/*
Disallow: /sg/*
Disallow: /shop/*
Disallow: /si/*
Disallow: /sk/*
Disallow: /sn/*
Disallow: /today*
Disallow: /th/*
Disallow: /th-en/*
Disallow: /tmall/*
Disallow: /tn/*
Disallow: /tr/*
Disallow: /tw/*
Disallow: /ug/*
Disallow: /uk/*
Disallow: /vn/*
Disallow: /za/*

User-agent: HaoSouSpider
Disallow: */product-red/
Disallow: /*/retail/availability*
Disallow: /*/retail/availabilitySearch*
Disallow: /*/retail/pickupEligibility*
Disallow: /*/shop/*WebObjects/*
Disallow: /*/shop/1-800-MY-APPLE/*
Disallow: /*/shop/2322-consumer*
Disallow: /*/shop/account/setup*
Disallow: /*/shop/answer/vote*
Disallow: /*/shop/browse/campaigns/mobile_overlay*
Disallow: /*/shop/button_availability*
Disallow: /*/shop/bag*
Disallow: /*/shop/change_password*
Disallow: /*/shop/checkout*
Disallow: /*/shop/create_account*
Disallow: /*/shop/favorites*
Disallow: /*/shop/identify_user*
Disallow: /*/shop/mobile/checkout/start*
Disallow: /*/shop/mobilex/*
Disallow: /*shop/np/order*
Disallow: /*shop/np/giftorguestorder*
Disallow: /*shop/np/sign_in*
Disallow: /*/shop/question/answer/report*
Disallow: /*/shop/question/subscribe*
Disallow: /*/shop/question/unsubscribe/*
Disallow: /*/shop/review/vote*
Disallow: /*/shop/reviews/report*
Disallow: /*/shop/rs-mvt/rel/*
Disallow: /*/shop/sentry*
Disallow: /*/shop/sentryx/change_password*
Disallow: /*/shop/sentryx/create_account*
Disallow: /*/shop/sentryx/create_account_confirm*
Disallow: /*/shop/sentryx/identify_user*
Disallow: /*/shop/sentryx/sign_in*
Disallow: /*/shop/signed_in_account*
Disallow: /*/shop/sign_in*
Disallow: /*/shop/sign_out*
Disallow: /*/shop/socialsharing/*
Disallow: /*/shop/storeConfig*
Disallow: /*/shop/variationSelection*
Disallow: /*/shop/vieworder*
Disallow: /apple-watch-nike/
Disallow: /apple-watch-hermes/
Disallow: /cn/*/aow/*
Disallow: /newsroom/notifications/*
Disallow: /retail/availability*
Disallow: /retail/availabilitySearch*
Disallow: /retail/pickupEligibility*
Disallow: /shop/bag*
Disallow: /shop/search/*
Disallow: /tmall/*
Disallow: /cn_cmb/*
Disallow: /cn_abc/*
Disallow: /cn_icbc/*
Disallow: /cn_ccb_*
Disallow: /cn_cmb_*
Disallow: /cn_abc_*
Disallow: /cn_icbc_*
Disallow: /cn_ccb_*

User-agent: Sogou web spider
Disallow: /*
Allow: /cn/*
Allow: /cn-k12/*

User-agent: Sogou inst spider
Disallow: /*
Allow: /cn/*
Allow: /cn-k12/*

User-agent: Sogou spider2
Disallow: /*
Allow: /cn/*
Allow: /cn-k12/*

Sitemap: https://www.apple.com/shop/sitemap.xml
Sitemap: https://www.apple.com/sitemap.xml
Sitemap: https://www.apple.com/newsroom/sitemap.xml
Sitemap: https://www.apple.com/retail/sitemap/sitemap.xml
Sitemap: https://www.apple.com/today/sitemap.xml