SEO audit fixes: schema, content, technical and AI readiness

- Remove restricted FAQPage schema and duplicate Organization schema
- Remove incomplete LocalBusiness schema
- Fix Organization: founder Peter Foster, foundingDate 2015
- Rewrite H1 to include target keywords
- Fix BreadcrumbList with correct page URLs
- Remove SearchAction pointing to 404 endpoint
- Simplify verbose content across 13 key paragraphs
- Promote service card headings from H3 to H2 with keyword-rich names
- Add width/height attributes to all images (CLS fix)
- Create 1200x630 OG social card image
- Update og:image, og:image:width, og:image:height meta tags
- Fix broken LinkedIn (www prefix) and Twitter (x.com) social links
- Add Free Tools footer section linking to individual tools
- Remove google-oauth-callback and /index URLs from sitemap.xml
- Add AI crawler rules to robots.txt (GPTBot, ClaudeBot, Perplexity, etc.)
- Add Disallow for oauth callback endpoints in robots.txt
- Create llms.txt for AI search engine readiness
This commit is contained in:
Peter Foster
2026-03-06 06:42:24 +00:00
parent 66a02fcafb
commit 624a3aa282
6 changed files with 147 additions and 192 deletions

View File

@@ -14,6 +14,9 @@ Disallow: /config/
Disallow: /database/
Disallow: /docker/
Disallow: /redis/
Disallow: /google-oauth-callback
Disallow: /google-oauth-callback.php
Disallow: /oauth-callback.php
# Block configuration and handler files
Disallow: /*-handler.php
@@ -42,6 +45,7 @@ Sitemap: https://ukdataservices.co.uk/sitemap.xml
Sitemap: https://ukdataservices.co.uk/sitemap-index.xml
Sitemap: https://ukdataservices.co.uk/sitemap-blog.xml
Sitemap: https://ukdataservices.co.uk/sitemap-services.xml
Sitemap: https://ukdataservices.co.uk/sitemap-tools.xml
# Crawl-delay for respectful crawling
Crawl-delay: 1
@@ -58,4 +62,37 @@ Crawl-delay: 1
User-agent: Slurp
Allow: /
Crawl-delay: 2
Sitemap: https://ukdataservices.co.uk/sitemap-tools.xml
# AI crawlers - explicitly allowed for citation
User-agent: GPTBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: anthropic-ai
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Google-Extended
Allow: /
User-agent: Applebot-Extended
Allow: /
User-agent: Bytespider
Allow: /
User-agent: CCBot
Allow: /
User-agent: FacebookBot
Allow: /
User-agent: Amazonbot
Allow: /