peter/ukaiautomation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Fix all UKDS SEO cross-contamination risks

Browse Source 
- Remove old sitemaps pointing to ukdataservices.co.uk URLs
- Delete llms.txt/llms-full.txt (had ukdataservices references)
- Replace all web scraping text in PHP files with AI automation equivalents
- Add noindex to legal boilerplate pages (privacy, terms, cookie, GDPR) to prevent duplicate content penalty
- Fix OG/Twitter social card images from ukds-* filenames to ukaiautomation-*
- Fix lead-capture.php to write logs to ukaiautomation directory
- Fix sitemap.php, quote-handler, canonical.php, related-services component
This commit is contained in:
Peter Foster
2026-03-21 10:13:14 +00:00
parent 37a6b01598
commit 8eafc04b0f
29 changed files with 181 additions and 853 deletions
Download Patch File Download Diff File Expand all files Collapse all files

20
faq.php
View File

@@ -19,7 +19,7 @@ $breadcrumbs = [
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title><?php echo htmlspecialchars($page_title); ?></title>
<meta name="description" content="<?php echo htmlspecialchars($page_description); ?>">
<meta name="keywords" content="web scraping FAQ, data extraction questions, business intelligence help, UK data services support">
<meta name="keywords" content="AI Automation FAQ, data extraction questions, business intelligence help, UK data services support">
<meta name="author" content="UK AI Automation">
<meta name="robots" content="index, follow">
<link rel="canonical" href="<?php echo htmlspecialchars($canonical_url); ?>">
@@ -29,7 +29,7 @@ $breadcrumbs = [
<meta property="og:url" content="<?php echo htmlspecialchars($canonical_url); ?>">
<meta property="og:title" content="<?php echo htmlspecialchars($page_title); ?>">
<meta property="og:description" content="<?php echo htmlspecialchars($page_description); ?>">
<meta property="og:image" content="https://ukaiautomation.co.uk/assets/images/ukds-main-logo.png">
<meta property="og:image" content="https://ukaiautomation.co.uk/assets/images/ukaiautomation-logo.svg">
<meta property="og:locale" content="en_GB">
<!-- Twitter Card -->
@@ -37,7 +37,7 @@ $breadcrumbs = [
<meta name="twitter:url" content="<?php echo htmlspecialchars($canonical_url); ?>">
<meta name="twitter:title" content="<?php echo htmlspecialchars($page_title); ?>">
<meta name="twitter:description" content="<?php echo htmlspecialchars($page_description); ?>">
<meta name="twitter:image" content="https://ukaiautomation.co.uk/assets/images/ukds-main-logo.png">
<meta name="twitter:image" content="https://ukaiautomation.co.uk/assets/images/ukaiautomation-logo.svg">
<!-- Favicon -->
<link rel="icon" type="image/svg+xml" href="assets/images/favicon.svg">
@@ -52,8 +52,8 @@ $breadcrumbs = [
"@context": "https://schema.org",
"@type": "WebPage",
"@id": "https://ukaiautomation.co.uk/faq#faqpage",
"name": "UK AI Automation FAQ - Web Scraping & Data Analytics",
"description": "Comprehensive answers to frequently asked questions about web scraping, data extraction, pricing, legal compliance, and our services."}
"name": "UK AI Automation FAQ - AI Automation & Data Analytics",
"description": "Comprehensive answers to frequently asked questions about AI Automation, data extraction, pricing, legal compliance, and our services."}
</script>
<style>
@@ -187,11 +187,11 @@ $breadcrumbs = [
<div class="faq-item">
<button class="faq-question">
What is web scraping and how can it benefit my business?
What is AI Automation and how can it benefit my business?
<span class="faq-icon">▼</span>
</button>
<div class="faq-answer">
<p>Web scraping is the automated process of extracting data from websites and converting it into structured, usable formats. It can benefit your business by:</p>
<p>AI Automation is the automated process of extracting data from websites and converting it into structured, usable formats. It can benefit your business by:</p>
<ul>
<li>Providing competitive intelligence and market analysis</li>
<li>Automating data collection to save time and resources</li>
@@ -247,11 +247,11 @@ $breadcrumbs = [
<div class="faq-item">
<button class="faq-question">
Is web scraping legal in the UK?
Is AI Automation legal in the UK?
<span class="faq-icon">▼</span>
</button>
<div class="faq-answer">
<p>Yes, web scraping is legal in the UK when conducted properly. We ensure all our activities comply with:</p>
<p>Yes, AI Automation is legal in the UK when conducted properly. We ensure all our activities comply with:</p>
<ul>
<li>UK Data Protection Act 2018 and GDPR</li>
<li>Website terms of service and robots.txt files</li>
@@ -284,7 +284,7 @@ $breadcrumbs = [
<div class="faq-item">
<button class="faq-question">
What if a website's terms prohibit scraping?
What if a website's terms prohibit Automation?
<span class="faq-icon">▼</span>
</button>
<div class="faq-answer">