# A product URL with a vehicle in the query (/products/.html?type=...) renders per request and is never cached. # The plain /products/.html stays open. A bot that matches a named group ignores the * group, so every group # repeats the rule, ahead of its Allow line for crawlers that take the first matching line. User-agent: * Disallow: /api Disallow: /products/*?type= User-agent: GPTBot Disallow: /products/*?type= Allow: / User-agent: ChatGPT-User Disallow: /products/*?type= Allow: / User-agent: OAI-SearchBot Disallow: /products/*?type= Allow: / User-agent: ClaudeBot Disallow: /products/*?type= Allow: / User-agent: PerplexityBot Disallow: /products/*?type= Allow: / Sitemap: https://www.carcovers.com/sitemap.xml