Algolia-Central2

wiki/dev-log.md

Algolia-Central2 — Dev Log

2026-06-14 — Harness reliability hardening + reliability SOP

Status: Done What happened: The autocorrect optimization loop crashed twice and ran ~4h before fixes. Root-caused a single failure class (unreliable batch-LLM / agent-orchestration code) and fixed it: parallelized the judge + run-tests (mapWithConcurrency, ~5–10× faster), cached the fixed floor across rounds, guarded the propose seam + raised its token budget (was crashing on Gemini MAX_TOKENS empty), and widened the Gemini retry set to {429,500,502,503,504} + network throws. Added the previously-missing tests for the live adapters. Also fixed a UX issue (fabricated mock judge scores on idle launch → call-to-action). Key decisions: Encoded as a reusable SOP/runbook — **llm-harness-reliability** (canonical: repo docs/sop/llm-harness-reliability.md). Tests written: mapWithConcurrency (4), applyFloorCache (3), gemini retry (4) → lab/server 18 tests; judge 64, autocorrect 22, web 37 — all green; tsc clean. Next: Implement observability (timestamps/heartbeat/summary, std S8); commit the session batch; apply the staged typo-tolerance reformulation fix post-run.

2026-07-10 — Content Engagement strategic pivot named; vision + data-gathering opened

Status: Vision + data-gathering stage only. No code touched. What happened: Arijit framed a new strategic direction for Algolia-Central2: move Algolia from "search/discovery for ecommerce & product" to ContentSearch → Content Engagement — chat that doesn't just answer but discovers, understands, and actively engages a visitor like a human companion, driving them toward a journey outcome (book a call, start building, convert). First POC target: embed this content-engagement behavior across several algolia.com journeys in parallel — case study pages, pricing, and the homepage/landing page — with context/page-awareness driving personalized engagement. Backend = Algolia; delivery = Agent Studio agents. Deployment for the POC is a standalone demo environment simulating those pages, not an injection into live algolia.com. Success criteria = broad market/product-market validation (not one exec or one customer). Full synthesis: **content-engagement-vision**. Key decisions: None locked yet — this is pre-decision. Explicitly left open: whether this extends the existing live 3-agent build (General/Developer/Marketer on app 0EXRPAXB56, see SESSION.md session 7) or runs as a separate/parallel initiative. Arijit's call: "not sure yet — that's part of what we're figuring out." Data-gathering opened in parallel (tactical, not yet executed this entry): 1. Analytics API — full breadth/depth of real user queries against ALGOLIA_WWW_PROD_V2. 2. Insights API — click/conversion signal detail for the same index. 3. Index x-ray of ALGOLIA_WWW_PROD_V2 — data shape, richness gaps, enrichment targets (precedent: enrichment already done on AC2's own index, see session 5-6 enrichment A/B). 4. Screenshot sweep of representative algolia.com pages (case study / pricing / home) to ground a UI/UX brainstorm on where engagement should surface. 5. GA behavioral data — Arijit is pulling a Looker Studio export (datastudio.google.com/.../b05b44b9-.../Cr7KB); confirmed NOT fetchable via plain WebFetch (redirects to Google login) — needs either an authenticated browser session or a manual CSV/Sheets export from Arijit. Grounding correction made this session: ALGOLIA_WWW_PROD_V2 does not live in the AC2 build app — it lives in the VISIBILITY app 1QDAWL72TQ, documented in this project's own CLAUDE.md as Algolia's live keyword incumbent, read-only, benchmark target. Resolved without needing to ask Arijit, by reading CLAUDE.md rather than guessing. Next: Run the Analytics/Insights/index-x-ray pulls against 1QDAWL72TQ / ALGOLIA_WWW_PROD_V2; capture findings in a data-shape synthesis; then a joint UI/UX brainstorm (screenshots + query data + GA data together) on where engagement surfaces.

2026-07-10 (later same day) — Analytics + index x-ray pulled (raw data relocated)

Status: Data-gathering executed. Raw findings intentionally NOT kept here — Arijit called this out: analytics numbers and record dumps are transactional data, not knowledge, and pollute the wiki. Relocated to repo docs/algolia-data/analytics.md and docs/algolia-data/content.md (Algolia-Central2 repo, not the vault). What happened: Pulled Analytics API + full index content via direct REST (Arijit rejected the Algolia MCP tool — use the real keys already in .env, not MCP). Root-caused a region-host bug along the way (see memory feedback-algolia-analytics-region-host). Key decision that DOES belong here: raw analytics/content-shape numbers live in repo docs, not the vault. Vault holds the vision, the open questions, and the synthesized implications — not the transactional evidence itself. Next: Screenshot sweep of case study/pricing/homepage; GA Looker Studio export; joint UI/UX brainstorm once both data threads (Algolia Insights = what people search, GA/Looker = where traffic is) are in.

2026-07-12 — Five founding decisions resolved; full data-health audit run on both copies; merged into vault as single source of truth

Status: Done. What happened: Five open questions from the vision doc were answered directly (timeline, audience, success criteria, official naming, AC2 relationship) — see **2026-07-12-content-engagement-motion-decisions**. In parallel, ran the same full, unsampled field-health + analytics audit on both the current production index (ALGOLIA_WWW_PROD_V2, 17,138 records) and AC2's enriched copy (AC2_WWW_MULTI_NEURAL, 8,353 records) — see **data-health-current-production**, **data-health-enriched-copy**, and the composite-scored comparison in **data-health-final-verdict**. Headline: the two are statistically even (63.4 vs 62.6/100), but the enriched copy's edge comes entirely from deduplication — on content quality alone the unenriched baseline is ahead by 4.1 points. Key decisions: Content Engagement is the AC2 work (not parallel) — decision 5 above. An interactive companion site was also built (bible.chowmes.com/ac2/, source repo RAG/Algolia-Central2/algolia-content-engagement/) with the same findings presented with real record examples, a bang-for-buck action-item ranking, and a build log. This vault folder is the single source of truth — the interactive site is a presentation layer over the same facts, not a second place where the facts live. A separate, portfolio-wide live-render system was discovered running at bible.chowmes.com root (reads this exact vault folder on every request, no build step) — this project's vault content is already visible there automatically; only the ADR and data-health syntheses added today needed to be written into the vault explicitly, since they didn't exist as markdown before now. Next: Resolve the scope-vs-deadline tension (full 3-journey POC vs one journey, by Tuesday) — tracked in **open-questions**. Screenshot sweep, GA data pull, and Agent Studio build remain not started.