Twitter/X

@shiri_shh: Cloudflare is already testing this: - Allow - Block - Charge AI crawler requests your page. serve...

Cloudflare is already testing this:

  • Allow
  • Block
  • Charge

AI crawler requests your page.

server returns HTTP 402.

bot pays or leaves.

Marc Lou (@marclou)

Meta is scraping like crazy.

AI training crawls last 3 days on TrustMRR:

  • OpenAI: 409
  • Anthropic: 721
  • Meta: 67,390

— https://nitter.net/marclou/status/2073788753810972911#m