Fix all UKDS SEO cross-contamination risks

- Remove old sitemaps pointing to ukdataservices.co.uk URLs
- Delete llms.txt/llms-full.txt (had ukdataservices references)
- Replace all web scraping text in PHP files with AI automation equivalents
- Add noindex to legal boilerplate pages (privacy, terms, cookie, GDPR) to prevent duplicate content penalty
- Fix OG/Twitter social card images from ukds-* filenames to ukaiautomation-*
- Fix lead-capture.php to write logs to ukaiautomation directory
- Fix sitemap.php, quote-handler, canonical.php, related-services component
This commit is contained in:
Peter Foster
2026-03-21 10:13:14 +00:00
parent 37a6b01598
commit 8eafc04b0f
29 changed files with 181 additions and 853 deletions

View File

@@ -45,23 +45,23 @@ $related_articles = [
'read_time' => '15 min read'
]
],
'Web Scraping' => [
'AI Automation' => [
[
'title' => 'Web Scraping Compliance UK Guide',
'slug' => 'web-scraping-compliance-uk-guide',
'category' => 'Web Scraping',
'title' => 'AI Automation Compliance UK Guide',
'slug' => 'web-Automation-compliance-uk-guide',
'category' => 'AI Automation',
'read_time' => '10 min read'
],
[
'title' => 'Handling CAPTCHAs in Web Scraping',
'slug' => 'handling-captchas-scraping',
'category' => 'Web Scraping',
'title' => 'Handling CAPTCHAs in AI Automation',
'slug' => 'handling-captchas-Automation',
'category' => 'AI Automation',
'read_time' => '7 min read'
],
[
'title' => 'JavaScript Heavy Sites Scraping',
'slug' => 'javascript-heavy-sites-scraping',
'category' => 'Web Scraping',
'title' => 'JavaScript Heavy Sites Automation',
'slug' => 'javascript-heavy-sites-Automation',
'category' => 'AI Automation',
'read_time' => '9 min read'
]
],
@@ -103,11 +103,11 @@ $display_articles = array_slice($filtered_articles, 0, 3);
<div class="cta-inner">
<div class="cta-text">
<h3>Need data for your business?</h3>
<p>UK AI Automation delivers GDPR-compliant web scraping, data extraction, and analytics — tailored to your industry. 99.8% accuracy, fast turnaround, no long-term contracts.</p>
<p>UK AI Automation delivers GDPR-compliant AI Automation, data extraction, and analytics — tailored to your industry. 99.8% accuracy, fast turnaround, no long-term contracts.</p>
</div>
<div class="cta-actions">
<a href="/quote" class="cta-btn cta-btn-primary">Get a Free Quote</a>
<a href="/services/web-scraping" class="cta-btn cta-btn-outline">See Our Services</a>
<a href="/services/web-Automation" class="cta-btn cta-btn-outline">See Our Services</a>
</div>
</div>
</section>