Fix all UKDS SEO cross-contamination risks

- Remove old sitemaps pointing to ukdataservices.co.uk URLs
- Delete llms.txt/llms-full.txt (had ukdataservices references)
- Replace all web scraping text in PHP files with AI automation equivalents
- Add noindex to legal boilerplate pages (privacy, terms, cookie, GDPR) to prevent duplicate content penalty
- Fix OG/Twitter social card images from ukds-* filenames to ukaiautomation-*
- Fix lead-capture.php to write logs to ukaiautomation directory
- Fix sitemap.php, quote-handler, canonical.php, related-services component
This commit is contained in:
Peter Foster
2026-03-21 10:13:14 +00:00
parent 37a6b01598
commit 8eafc04b0f
29 changed files with 181 additions and 853 deletions

View File

@@ -110,7 +110,6 @@ echo '<?xml version="1.0" encoding="UTF-8"?>';
<!-- Blog Categories -->
<url>
<loc>https://ukaiautomation.co.uk/blog/categories/web-scraping</loc>
<lastmod><?php echo date('Y-m-d'); ?></lastmod>
<changefreq>weekly</changefreq>
<priority>0.7</priority>