feat: Cloaking-Erkennung per Doppel-Crawl (Browser-UA vs. Googlebot-UA)

Neuer Befehl `python -m scanner cloak-check`:
- Crawlt die Website zweimal: einmal mit Browser-UA, einmal als Googlebot
- Vergleicht Text, Links und Response-Header (Vary: User-Agent)
- Scoring: Bot-Only-Link 60 Pkt (RED), extra Text >100 Zeichen 40 Pkt,
  Vary: User-Agent ohne Inhaltsdiff 25 Pkt
- Eigener Report unter reports/<ts>_cloak/

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Your Name 2026-06-12 04:02:24 +02:00
commit 0302d469b1
5 changed files with 336 additions and 1 deletions

View file

@ -33,6 +33,9 @@ DEFAULT_CONFIG: dict = {
"comment_links": 25,
"new_broken_link": 20,
"suspicious_filename": 60,
"cloaking_extra_link": 60,
"cloaking_extra_text": 40,
"cloaking_vary_ua": 25,
},
"thresholds": {
"yellow": 20,