peter/ukaiautomation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Security hardening + new tools deployment

Browse Source 
- Hide Apache version (ServerTokens Prod)
- Add Permissions-Policy header
- Remove deprecated X-XSS-Protection
- Consolidate security headers to .htaccess only (remove duplicates from PHP)
- Deploy free tools: robots-analyzer, data-converter
- Deploy tools announcement blog post
- Update sitemap with new tools and blog post
This commit is contained in:
root
2026-02-05 04:11:15 +00:00
parent 3a0d8034c7
commit b6e39fe0c2
89 changed files with 4866 additions and 1932 deletions
Download Patch File Download Diff File Expand all files Collapse all files

193
blog/articles/free-web-scraping-tools-launch.php Normal file
View File

@@ -0,0 +1,193 @@
<?php
$page_title = "Introducing Our Free Web Scraping Tools | UK Data Services";
$page_description = "We've launched four free tools to help you plan web scraping projects: Cost Calculator, Scrapeability Checker, Robots.txt Analyzer, and Data Format Converter.";
$canonical_url = "https://ukdataservices.co.uk/blog/articles/free-web-scraping-tools-launch";
$publish_date = "2026-02-04";
$author = "UK Data Services Team";
?>
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title><?php echo htmlspecialchars($page_title); ?></title>
<meta name="description" content="<?php echo htmlspecialchars($page_description); ?>">
<link rel="canonical" href="<?php echo htmlspecialchars($canonical_url); ?>">
<meta property="og:title" content="<?php echo htmlspecialchars($page_title); ?>">
<meta property="og:description" content="<?php echo htmlspecialchars($page_description); ?>">
<meta property="og:type" content="article">
<meta property="article:published_time" content="<?php echo $publish_date; ?>">
<link rel="stylesheet" href="../../assets/css/main.css">
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "BlogPosting",
"headline": "Introducing Our Free Web Scraping Tools",
"description": "<?php echo htmlspecialchars($page_description); ?>",
"datePublished": "<?php echo $publish_date; ?>",
"dateModified": "<?php echo $publish_date; ?>",
"author": {
"@type": "Organization",
"name": "UK Data Services"
},
"publisher": {
"@type": "Organization",
"name": "UK Data Services",
"logo": {
"@type": "ImageObject",
"url": "https://ukdataservices.co.uk/assets/images/ukds-main-logo.png"
}
},
"mainEntityOfPage": {
"@type": "WebPage",
"@id": "<?php echo $canonical_url; ?>"
}
}
</script>
<style>
.article-container { max-width: 800px; margin: 0 auto; padding: 40px 20px; }
.article-header { margin-bottom: 40px; }
.article-header h1 { font-size: 2.4em; color: #1a1a2e; line-height: 1.3; margin-bottom: 20px; }
.article-meta { color: #666; font-size: 0.95em; display: flex; gap: 20px; flex-wrap: wrap; }
.article-meta span { display: flex; align-items: center; gap: 6px; }
.article-content { line-height: 1.8; color: #444; }
.article-content h2 { color: #1a1a2e; margin: 40px 0 20px; font-size: 1.6em; }
.article-content h3 { color: #1a1a2e; margin: 30px 0 15px; font-size: 1.3em; }
.article-content p { margin-bottom: 20px; }
.article-content ul, .article-content ol { margin-bottom: 20px; padding-left: 25px; }
.article-content li { margin-bottom: 10px; }
.tool-card { background: linear-gradient(135deg, #f8f9fa 0%, #fff 100%); border: 1px solid #e0e0e0; border-radius: 12px; padding: 25px; margin: 25px 0; }
.tool-card h3 { margin-top: 0; color: #144784; }
.tool-card .btn { display: inline-block; background: #179e83; color: white; padding: 12px 24px; border-radius: 6px; text-decoration: none; font-weight: 600; margin-top: 15px; }
.tool-card .btn:hover { background: #148a72; }
.highlight-box { background: #e8f5e9; border-left: 4px solid #179e83; padding: 20px; margin: 25px 0; border-radius: 0 8px 8px 0; }
.breadcrumb { padding: 15px 20px; background: #f5f5f5; font-size: 0.9em; }
.breadcrumb a { color: #144784; text-decoration: none; }
.breadcrumb span { color: #888; margin: 0 8px; }
.share-box { background: #f8f9fa; padding: 25px; border-radius: 8px; margin-top: 40px; text-align: center; }
.share-box h4 { margin-bottom: 15px; color: #1a1a2e; }
.share-links { display: flex; justify-content: center; gap: 15px; }
.share-links a { padding: 10px 20px; background: #144784; color: white; border-radius: 6px; text-decoration: none; font-weight: 500; }
.share-links a:hover { background: #0d3a6e; }
</style>
</head>
<body>
<?php include '../../includes/navbar.php'; ?>
<nav class="breadcrumb">
<a href="/">Home</a> <span>›</span> <a href="/blog/">Blog</a> <span>›</span> Free Web Scraping Tools Launch
</nav>
<article class="article-container">
<header class="article-header">
<h1>🚀 Introducing Our Free Web Scraping Tools</h1>
<div class="article-meta">
<span>📅 <?php echo date('j F Y', strtotime($publish_date)); ?></span>
<span>👤 <?php echo $author; ?></span>
<span>⏱️ 4 min read</span>
</div>
</header>
<div class="article-content">
<p>
Today we're excited to announce the launch of <strong>four free tools</strong> designed to help UK businesses plan and execute web scraping projects more effectively. Whether you're exploring data extraction for the first time or you're a seasoned professional, these tools will save you time and help you make better decisions.
</p>
<div class="highlight-box">
<strong>🎉 All tools are completely free</strong> — no signup required, no limits, no catches. Your data stays in your browser.
</div>
<h2>The Tools</h2>
<div class="tool-card">
<h3>💰 Web Scraping Cost Calculator</h3>
<p>Get an instant estimate for your web scraping project. Simply enter your requirements — data volume, complexity, delivery format — and receive transparent pricing guidance based on real project data.</p>
<p><strong>Perfect for:</strong> Budgeting, procurement proposals, comparing build vs. buy decisions.</p>
<a href="/tools/cost-calculator" class="btn">Try the Calculator →</a>
</div>
<div class="tool-card">
<h3>🔍 Website Scrapeability Checker</h3>
<p>Enter any URL and get an instant assessment of how complex it would be to scrape. Our tool analyzes JavaScript requirements, anti-bot protection, rate limiting, and more.</p>
<p><strong>Perfect for:</strong> Feasibility assessments, technical planning, setting expectations.</p>
<a href="/tools/scrapeability-checker" class="btn">Check a Website →</a>
</div>
<div class="tool-card">
<h3>🤖 Robots.txt Analyzer</h3>
<p>Analyze any website's robots.txt file to understand crawling rules and permissions. See blocked paths, allowed paths, sitemaps, and crawl delays at a glance.</p>
<p><strong>Perfect for:</strong> Compliance checking, understanding site policies, planning respectful scraping.</p>
<a href="/tools/robots-analyzer" class="btn">Analyze Robots.txt →</a>
</div>
<div class="tool-card">
<h3>🔄 Data Format Converter</h3>
<p>Convert between JSON, CSV, and XML formats instantly in your browser. Perfect for transforming scraped data into the format your systems need.</p>
<p><strong>Perfect for:</strong> Data transformation, Excel imports, API preparation.</p>
<a href="/tools/data-converter" class="btn">Convert Data →</a>
</div>
<h2>Why We Built These</h2>
<p>
After completing over 500 web scraping projects for UK businesses, we noticed a pattern: many potential clients spent weeks researching and planning before reaching out. They had questions like:
</p>
<ul>
<li>How much will this cost?</li>
<li>Is it even possible to scrape this website?</li>
<li>Is it legal and compliant?</li>
<li>How do I work with the data once I have it?</li>
</ul>
<p>
These tools answer those questions instantly. They're the same questions we ask ourselves at the start of every project — now you can get those answers before even speaking to us.
</p>
<h2>Privacy First</h2>
<p>
All our tools run entirely in your browser. The data you enter never leaves your device — we don't store it, we don't see it, and we certainly don't sell it. This is particularly important for the data converter, where you might be working with sensitive business information.
</p>
<h2>What's Next?</h2>
<p>We're planning to add more tools based on user feedback:</p>
<ul>
<li><strong>Selector Tester</strong> — Test CSS selectors and XPath expressions against live pages</li>
<li><strong>Rate Limit Calculator</strong> — Calculate optimal request rates for your scraping projects</li>
<li><strong>Data Quality Checker</strong> — Validate scraped data for completeness and accuracy</li>
</ul>
<p>
Have a suggestion? We'd love to hear it. <a href="/contact">Get in touch</a> and let us know what would help you most.
</p>
<h2>Ready to Start Your Project?</h2>
<p>
These tools are designed to help you plan, but when you're ready to execute, we're here to help. Our team has delivered reliable, GDPR-compliant web scraping solutions for businesses across the UK.
</p>
<p>
<a href="/quote" style="display: inline-block; background: #144784; color: white; padding: 14px 28px; border-radius: 8px; text-decoration: none; font-weight: 600;">Request a Free Quote →</a>
</p>
</div>
<div class="share-box">
<h4>Found this useful? Share it!</h4>
<div class="share-links">
<a href="https://twitter.com/intent/tweet?url=https://ukdataservices.co.uk/blog/articles/free-web-scraping-tools-launch&text=Free web scraping tools from UK Data Services" target="_blank">Twitter</a>
<a href="https://www.linkedin.com/shareArticle?mini=true&url=https://ukdataservices.co.uk/blog/articles/free-web-scraping-tools-launch" target="_blank">LinkedIn</a>
</div>
</div>
</article>
<?php include '../../includes/footer.php'; ?>
</body>
</html>