peter/ukaiautomation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Fix all UKDS SEO cross-contamination risks

Browse Source 
- Remove old sitemaps pointing to ukdataservices.co.uk URLs
- Delete llms.txt/llms-full.txt (had ukdataservices references)
- Replace all web scraping text in PHP files with AI automation equivalents
- Add noindex to legal boilerplate pages (privacy, terms, cookie, GDPR) to prevent duplicate content penalty
- Fix OG/Twitter social card images from ukds-* filenames to ukaiautomation-*
- Fix lead-capture.php to write logs to ukaiautomation directory
- Fix sitemap.php, quote-handler, canonical.php, related-services component
This commit is contained in:
Peter Foster
2026-03-21 10:13:14 +00:00
parent 37a6b01598
commit 8eafc04b0f
29 changed files with 181 additions and 853 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
includes/schema/faq-schema.php
View File

@@ -5,7 +5,7 @@
*
* Usage:
* $faqs = [
* ['question' => 'What is web scraping?', 'answer' => 'Web scraping is...'],
* ['question' => 'What is AI Automation?', 'answer' => 'AI Automation is...'],
* ['question' => 'How much does it cost?', 'answer' => 'Pricing varies...']
* ];
* include($_SERVER['DOCUMENT_ROOT'] . '/includes/schema/faq-schema.php');
@@ -63,12 +63,12 @@ function generateFAQSchema($faqs, $pageUrl = null, $pageName = null) {
$commonFAQs = [
'general' => [
[
'question' => 'What is web scraping and how can it benefit my business?',
'answer' => 'Web scraping is the automated process of extracting data from websites. It benefits businesses by providing competitive intelligence, automating data collection, enabling real-time price monitoring, and supporting strategic decision-making with accurate market data.'
'question' => 'What is AI Automation and how can it benefit my business?',
'answer' => 'AI Automation is the automated process of extracting data from websites. It benefits businesses by providing competitive intelligence, automating data collection, enabling real-time price monitoring, and supporting strategic decision-making with accurate market data.'
],
[
'question' => 'Is web scraping legal in the UK?',
'answer' => 'Yes, web scraping is legal in the UK when conducted properly. We ensure full compliance with UK Data Protection Act 2018, GDPR, website terms of service, and industry best practices. We only collect publicly available data and respect robots.txt directives.'
'question' => 'Is AI Automation legal in the UK?',
'answer' => 'Yes, AI Automation is legal in the UK when conducted properly. We ensure full compliance with UK Data Protection Act 2018, GDPR, website terms of service, and industry best practices. We only collect publicly available data and respect robots.txt directives.'
],
[
'question' => 'How do you ensure data accuracy?',
@@ -85,7 +85,7 @@ $commonFAQs = [
],
'pricing' => [
[
'question' => 'What factors affect the cost of web scraping services?',
'question' => 'What factors affect the cost of AI Automation Services?',
'answer' => 'Costs depend on several factors: the number and complexity of target websites, data volume required, frequency of updates, anti-bot measures to navigate, data cleaning requirements, and delivery format preferences.'
],
[