User-agent: Baiduspider User-agent: 360Spider User-agent: Yisouspider User-agent: PetalBot User-agent: Bytespider User-agent: Sogou web spider User-agent: Sogou inst spider User-agent: SemrushBot User-agent: GPTBot Disallow: / User-agent: SurdotlyBot Disallow: / User-agent: GeedoBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: MojeekBot Disallow: / User-agent: Mail.RU Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: SurdotlyBot Disallow: / User-agent: AwarioBot Disallow: / User-agent: coccocbot-web Disallow: / User-agent: DuckDuckGo-Favicons-Bot Disallow: / User-agent: YandexBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: WellKnownBot Disallow: / User-agent: SemanticScholarBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Baiduspider Disallow: / #Yandex User-agent: Yandex Disallow: / User-Agent: trendictionbot Disallow: / User-Agent: ia_archiver Disallow: / User-agent: SemrushBot Disallow: / User-agent: GPTBot Disallow: / User-agent: * Crawl-delay: 30 Disallow: /*.php