Peter Foster 73dcf9367b Fix text_id to use date+name instead of PDF filename ...

Early OFAC years use batch PDFs where one document covers many penalty
cases (e.g. 56 rows sharing the same PDF in 2003). Deriving text_id from
the PDF filename caused all rows sharing a document to overwrite each other
in the DB, reducing 1061 rows to 348.

Fix: text_id = yyyyMMdd_{slugified_name}, which is unique per table row.
Also add ofac-scrape-only command for fast table-only scraping without PDF downloads.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-09 16:14:52 +01:00

src/OFACScraper

Fix text_id to use date+name instead of PDF filename

2026-04-09 16:14:52 +01:00

.gitignore

Fix .gitignore: exclude bin/, obj/, logs/, data/

2026-04-09 15:29:17 +01:00

Description

OFAC Civil Penalties scraper

13 MiB

Languages

C# 100%