# InoxTV Website - robots.txt # https://inoxtv.com/robots.txt # # Canonical host is the apex domain (see CNAME). The www subdomain is not # configured, so every absolute URL here must stay non-www or crawlers get # an unresolvable host. User-agent: * Allow: / # Local contact sheet for the diagram SVGs. Nothing on the site links to it and # it is not a page a visitor should land on from a search result. Disallow: /images/diagrams/preview.html # The advertising and measurement crawlers need every page that carries ads - # the help-centre pages, not the policy pages and not the search results page, # which carry no ad script at all. Spelled out rather than left to the wildcard # above: a named agent ignores the * block entirely, so if a Disallow is ever # added up there for an unrelated reason, ad serving does not quietly break with # it. The Allow stays site-wide on purpose - it is not a claim that every page # shows ads, only that nothing here is closed to these crawlers. User-agent: Mediapartners-Google Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / Sitemap: https://inoxtv.com/sitemap.xml