# aicodingpricing Cloudflare crawlability fix — 2026-05-26T14:07:20Z

Verdict: PASS — required URL/UA checks return 200 and no cf-mitigated challenge.

## Cloudflare changes

- bot_management: {"surface": "bot_management", "before": {"fight_mode": true, "enable_js": true}, "after": {"fight_mode": false, "enable_js": false}}
- zone_setting.browser_check: {"surface": "zone_setting.browser_check", "before": "on", "after": "off"}
- zone_setting.security_level: {"surface": "zone_setting.security_level", "before": "medium", "after": "medium", "note": "temporarily tested essentially_off, then restored to medium after scoped checks passed"}
- ruleset.http_request_firewall_custom: {"surface": "ruleset.http_request_firewall_custom", "id": "5e42aba0bff741d382df20044ac362dc", "rule": "skip bic/securityLevel/uaBlock for public SEO paths and static assets"}
- ruleset.http_request_transform: {"surface": "ruleset.http_request_transform", "id": "d4251fda87214b1e84c216e5ae5af6ec", "rule": "rewrite /ai-coding-pricing-calculator[/] to /claude-code-cost at origin"}

## Required URL checks

### https://aicodingpricing.com/
- default: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/
- browser: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/
- googlebot_desktop: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/
- googlebot_smartphone: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/
- bingbot: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/

### https://aicodingpricing.com/sitemap.xml
- default: HTTP 200, cf-mitigated=None, content-type=application/xml, effective=https://aicodingpricing.com/sitemap.xml
- browser: HTTP 200, cf-mitigated=None, content-type=application/xml, effective=https://aicodingpricing.com/sitemap.xml
- googlebot_desktop: HTTP 200, cf-mitigated=None, content-type=application/xml, effective=https://aicodingpricing.com/sitemap.xml
- googlebot_smartphone: HTTP 200, cf-mitigated=None, content-type=application/xml, effective=https://aicodingpricing.com/sitemap.xml
- bingbot: HTTP 200, cf-mitigated=None, content-type=application/xml, effective=https://aicodingpricing.com/sitemap.xml

### https://aicodingpricing.com/robots.txt
- default: HTTP 200, cf-mitigated=None, content-type=text/plain; charset=utf-8, effective=https://aicodingpricing.com/robots.txt
- browser: HTTP 200, cf-mitigated=None, content-type=text/plain; charset=utf-8, effective=https://aicodingpricing.com/robots.txt
- googlebot_desktop: HTTP 200, cf-mitigated=None, content-type=text/plain; charset=utf-8, effective=https://aicodingpricing.com/robots.txt
- googlebot_smartphone: HTTP 200, cf-mitigated=None, content-type=text/plain; charset=utf-8, effective=https://aicodingpricing.com/robots.txt
- bingbot: HTTP 200, cf-mitigated=None, content-type=text/plain; charset=utf-8, effective=https://aicodingpricing.com/robots.txt

### https://aicodingpricing.com/ai-coding-pricing-calculator/
- default: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/ai-coding-pricing-calculator/
- browser: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/ai-coding-pricing-calculator/
- googlebot_desktop: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/ai-coding-pricing-calculator/
- googlebot_smartphone: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/ai-coding-pricing-calculator/
- bingbot: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/ai-coding-pricing-calculator/

### https://aicodingpricing.com/claude-code-vs-cursor/
- default: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/claude-code-vs-cursor
- browser: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/claude-code-vs-cursor
- googlebot_desktop: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/claude-code-vs-cursor
- googlebot_smartphone: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/claude-code-vs-cursor
- bingbot: HTTP 200, cf-mitigated=None, content-type=text/html; charset=utf-8, effective=https://aicodingpricing.com/claude-code-vs-cursor

## Static asset sample

- https://aicodingpricing.com/_next/static/media/03fc1b4a8d284b5e-s.p.09.f.n_ccld80.woff2: HTTP 200, cf-mitigated=None, content-type=font/woff2
- https://aicodingpricing.com/_next/static/media/0c89a48fa5027cee-s.p.0rd3rjvnnhw7n.woff2: HTTP 200, cf-mitigated=None, content-type=font/woff2
- https://aicodingpricing.com/_next/static/chunks/0kg9yiupg44_p.css: HTTP 200, cf-mitigated=None, content-type=text/css; charset=utf-8
- https://aicodingpricing.com/_next/static/chunks/0yu3k-pmkudgf.js: HTTP 200, cf-mitigated=None, content-type=application/javascript
- https://aicodingpricing.com/_next/static/chunks/0dgq26a5_oy.a.js: HTTP 200, cf-mitigated=None, content-type=application/javascript
- https://aicodingpricing.com/_next/static/chunks/0m_p1bxtorv5i.js: HTTP 200, cf-mitigated=None, content-type=application/javascript
- https://aicodingpricing.com/_next/static/chunks/146c.gwdhdag4.js: HTTP 200, cf-mitigated=None, content-type=application/javascript
- https://aicodingpricing.com/_next/static/chunks/turbopack-0rlekk4iywkwe.js: HTTP 200, cf-mitigated=None, content-type=application/javascript
- https://aicodingpricing.com/_next/static/chunks/0g65zv~fun4x7.js: HTTP 200, cf-mitigated=None, content-type=application/javascript
- https://aicodingpricing.com/_next/static/chunks/0d3shmwh5_nmn.js: HTTP 200, cf-mitigated=None, content-type=application/javascript

## Verification command

Run this matrix for each required URL (`/`, `/sitemap.xml`, `/robots.txt`, `/ai-coding-pricing-calculator/`, `/claude-code-vs-cursor/`) and UA (`default`, browser Chrome UA, Googlebot desktop, Googlebot smartphone, Bingbot):

```bash
curl -sS -L --max-time 30 -D - -o /tmp/aicp_body -w '\nHTTP:%{http_code} EFFECTIVE:%{url_effective}\n' 'https://aicodingpricing.com/sitemap.xml'
curl -sS -L --max-time 30 -A 'Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)' -D - -o /tmp/aicp_body -w '\nHTTP:%{http_code} EFFECTIVE:%{url_effective}\n' 'https://aicodingpricing.com/'
```

The full executed curl UA matrix and headers are captured in JSON evidence: `/mnt/HC_Volume_105300089/projects/aicodingpricing/reports/site-review/site-review-20260526/aicodingpricing-cf-crawlability-fix-evidence.json`