1 2 3 4 5 6 7 8 9 10 11 12 13 14
User-agent: Mediapartners-Google* Disallow: / User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: * Disallow: /