Capture AI crawlers on Cloudflare.

Install Virent AI crawler analytics on example.com with a Cloudflare Worker.

Site ID: <your-site-id>
Use the full Virent server secret from the Connect dialog. Do not use the masked preview "vha_sk_••••" as the real value.

Steps:
1. Create a Worker in the Cloudflare dashboard.
2. Replace the starter code with:

```javascript
const SITE_ID = "<your-site-id>"
const INGEST = "https://stage.virent.app/v1/ingest/bot"

// Send eligible requests for classification by Virent.
const ASSET = /\.(?!(?:html?|txt|md|xml|json|pdf)$)[a-z0-9]+$/i

export default {
  async fetch(request, env, ctx) {
    const response = await fetch(request)
    ctx.waitUntil(report(request, response, env.VIRENT_INGEST_SECRET).catch(() => {}))
    return response
  },
}

async function report(request, response, secret) {
  if (request.method !== "GET") return

  const url = new URL(request.url)
  const userAgent = request.headers.get("user-agent") || ""
  if (ASSET.test(url.pathname)) return

  const cf = request.cf || {}

  await fetch(INGEST, {
    method: "POST",
    headers: {
      "content-type": "application/json",
      "x-api-key": secret,
    },
    body: JSON.stringify({
      siteId: SITE_ID,
      url: url.origin + url.pathname,
      host: url.host,
      path: url.pathname,
      query: {},
      method: request.method,
      statusCode: response.status,
      userAgent,
      accept: request.headers.get("accept"),
      acceptLanguage: request.headers.get("accept-language"),
      referer: null,
      country: cf.country || null,
      requestId: request.headers.get("cf-ray") || crypto.randomUUID(),
      timestamp: new Date().toISOString(),
    }),
  })
}
```

3. Add a route of *example.com/* on the zone serving the site.
4. Under DNS → Records, keep the site A, AAAA, or CNAME record proxied (orange cloud).

Reporting must run in ctx.waitUntil. Do not hard-code the secret in a committed repo if you can use Worker secrets instead.

Configure Cloudflare Logpush so example.com sends HTTP request logs to Virent AI crawler analytics.

Site ID: <your-site-id>
Use the full Virent server secret from the Connect dialog. Do not use the masked preview "vha_sk_••••" as the real value.

Steps:
1. In the example.com zone, create a Logpush job with HTTP destination https://stage.virent.app/api/ingest/cloudflare-logpush?header_x-api-key=%3Cpaste-your-server-secret%3E.
2. Dataset: HTTP requests.
3. Job name: Virent Crawler Logs.
4. Fields: ClientRequestHost, ClientRequestMethod, ClientRequestURI, EdgeResponseStatus, EdgeStartTimestamp, RayID, ClientRequestUserAgent, ClientRequestReferer, ClientIP, ClientCountry, WorkerSubrequest.
5. Keep DNS proxied (orange cloud).

WorkerSubrequest lets Virent ignore the site's own Worker subrequests. Do not commit the server secret.