Scout (Second-Brain)

wiki/decisions/0004-human-assisted-acquisition.md

ADR-0004: Human-Assisted Acquisition for Behavioral Walls

Date: 2026-06-17 Status: LOCKED Decision: Human-assisted rung is the priority for behavioral walls. Unattended crawling of Zillow/LinkedIn-class sites is not achievable by anyone.

Context

PerimeterX, DataDome, and similar behavioral anti-bot systems require real human interaction (press-and-hold, puzzle solve). No amount of stealth or proxy rotation defeats behavioral authentication.

Key Findings

  • 2026-06-17 (Zillow): scout unblock opened real Chrome → Arijit solved press-and-hold → Scout captured 615 real Roswell rentals. First live proof.
  • 2026-06-18 (embedded canvas): Forwarded press-and-hold on the CDP canvas gets the tick but PerimeterX rejects it (CDP input lacks real-OS fidelity). Native-window solve REQUIRED.
  • 2026-06-17 (crawl-from-here): Auto-nav to detail pages RE-CHALLENGES. PerimeterX scores behavior per-page. Human must navigate each page (browse-and-harvest pattern).

Decision

  • Embedded pane = viewing + normal/easy sites.
  • Native-window solve REQUIRED for PerimeterX/DataDome press-and-hold.
  • Block detector matches the CHALLENGE text, not the vendor SDK (SDK persists on cleared pages → false positive; fix c7c8fbb).
  • For multi-page detail extraction: human must navigate (browse-and-harvest), not automated goto.