Dieter Schlüter 9801ce6fc4 feat: sitemap seeding — discover orphan pages not reachable via links ... Reads robots.txt Sitemap directive and fetches sitemap.xml / sitemap_index.xml before crawling. All listed URLs are added to the crawl queue so pages without any inbound links are still scanned. Configurable via crawl.sitemap. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>		2026-06-12 17:58:52 +02:00
..
__init__.py	feat: initial implementation of website integrity scanner	2026-06-12 00:51:41 +02:00
__main__.py	feat: single-line progress indicator during crawl and ext-link check	2026-06-12 17:17:37 +02:00
alerter.py	feat: Laientauglichkeit — Auto-Modus, Klartext-Ausgabe, einfachere Doku	2026-06-12 11:14:05 +02:00
baseline.py	feat: Laientauglichkeit — Auto-Modus, Klartext-Ausgabe, einfachere Doku	2026-06-12 11:14:05 +02:00
checker.py	feat: single-line progress indicator during crawl and ext-link check	2026-06-12 17:17:37 +02:00
config.py	feat: sitemap seeding — discover orphan pages not reachable via links	2026-06-12 17:58:52 +02:00
crawler.py	feat: sitemap seeding — discover orphan pages not reachable via links	2026-06-12 17:58:52 +02:00
differ.py	feat: exclude_paths — skip dynamic areas (RSS feeds, news archives) from scan	2026-06-12 13:14:06 +02:00
extractor.py	fix: Bugfixes, toten Code entfernt, Cache-Normalisierung & Session	2026-06-12 03:20:32 +02:00
plain.py	fix: always report broken internal links + show source pages	2026-06-12 12:18:38 +02:00