Skip to content

Fix development cache key auth context#312

Open
3em0 wants to merge 1 commit into
D4Vinci:mainfrom
3em0:fix/development-cache-auth-context
Open

Fix development cache key auth context#312
3em0 wants to merge 1 commit into
D4Vinci:mainfrom
3em0:fix/development-cache-auth-context

Conversation

@3em0
Copy link
Copy Markdown

@3em0 3em0 commented May 31, 2026

Summary

  • add a separate SHA-256 development-cache fingerprint with a schema version
  • include request headers/kwargs plus session cache context such as default headers and cookies in the cache key
  • keep scheduler deduplication fingerprints unchanged while preventing auth/cookie cache reuse
  • update development-cache docs and add regression tests

Fixes #311

Tests

  • /tmp/scrapling-agent-verify-venv/bin/python -m pytest tests/spiders -q
  • /tmp/scrapling-agent-verify-venv/bin/python -m ruff check scrapling/spiders/request.py scrapling/spiders/session.py scrapling/spiders/engine.py tests/spiders/test_cache.py tests/spiders/test_session.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Cache Poisoning via Partial-Object Hashing in Spider Development Response Cache

1 participant