Robots.txt Change Log

Updated 25 October 2025
Explore AI Tools Back to Landing

Robots.txt Change Log

Record each robots.txt update to maintain compliance and audit readiness.

Date Environment Summary Stakeholder Approvals Notes
2025-10-15 Production Allowed /beta/ preview paths SEO, Legal Temporary change for launch week
2025-10-22 Staging Added Disallow for /drafts SEO Keeps staging drafts private

Attach crawl tester screenshots or exports to the related ticket for full traceability.