Brain Source Fabric

Give every source—from a saved post to a paper, repository, conversation, screenshot, skill, meeting, or live system event—one inspectable path from raw evidence to changed knowledge, workflow behavior, retrieval, and later correction.

The harness should not equate captured, indexed, understood, believed, routed, and adopted. Those are separate states. A source may be preserved without shaping the brain; it may shape a project without becoming global guidance; it may challenge a belief without immediately replacing it; or it may become a first-class workflow fixture only after proof. Source: User request, 2026-07-15

This page is the source-layer companion to Harness and Brain Workflow Refactor Plan. The master plan owns workflow execution. This page owns how evidence enters, acquires meaning, changes the compiled brain, and remains auditable.

Full Corpus Workflow and Capability Program owns the exhaustive census across the source fabric: the review-closure test for each artifact class, workflow extraction, capability identity, independent install/config/auth/health/binding states, the normalized workflow universe, and the conditions required before “every source was reviewed” is defensible.

Wiki Corpus Refactor Program owns canonical-shape evolution after evidence arrives. A source disposition may update an owner, create a justified new mental object, fold into a section or ledger, merge competing owners, archive evidence, or produce no change. The source fabric must not assume that the current file graph is the permanent ontology.

Current-State Audit

The repository already contains substantial source infrastructure, but its depth is asymmetric. Source: local repository inventory, npm run brain -- status, and npm run status, 2026-08-12

Surface Local evidence Current strength Structural gap
X bookmarks 1,949 final source decisions covering the current saved corpus Deep enrichment, replies, artifacts, media, correlations, durable reviews, and zero queued deep follow-ups Future bookmark deltas still need the same exact decision and artifact contract
Agent sessions 546 indexed parent conversations (507 Codex, 1 Cursor, 38 Claude) plus 2,253 lineage-preserving delegated traces; 2,799 evidence files reference 105.3 GB in place and span July 20–August 12 across 55 workspace hints Contract v4 assigned 155,761 message identities across 5,369 replayed traces; exact lineage receipts bind current sources, revisions, and signals without copying transcript stores Ten recently modified or active traces remain pending; remote-only/deleted history, July 1–19 local absence, inaccessible attachments, and provider exports remain explicit acquisition gaps
GitHub 133 files README, pinned-repo, stars, and project evidence exist Repository facts, releases, dependency state, and workflow adoption are not one unified record
Calendar 87 files Local sync path exists State is 23 days stale; events are not consistently compiled into project/relationship/decision state
Email 152 files Local sync path and raw preservation exist State is 9 days stale; privacy, thread/entity resolution, task extraction, and disposition are not unified
Obsidian 45 files Current clipping sync Clippings do not receive the X-grade artifact, claim, contradiction, and promotion lifecycle
Sites 63 files Public-site captures exist Website snapshots are not a general visual/source adapter with drift tracking
Registries 32 files Capability harvest and source snapshots exist Candidate, evaluated, installed, configured, healthy, active, and retired states remain split across surfaces
Articles and research 11 files Some raw long-form sources are preserved No general article/paper/book/video adapter or reading-state ledger
Discord Existing ledgers plus authenticated replay feed immutable message revisions into the shared analysis contract; the 2026-08-12 exact audit closed 731 previously pending units covering 820 source identities Stable IDs, edit-aware revisions, X correlations, topic lenses, exact review receipts, and final held decisions are machine-checkable Nine unavailable bodies, one system event, and two private-logistics messages remain held; attachment/export completeness and inaccessible history remain acquisition gaps
Slack, meetings, Takeout, voice Automation/config routes exist Intended source classes are known Several have never synced, have no active schedule, or have no canonical source receipt
Public domain feeds Signal-radar describes HN, GitHub Trending, Product Hunt, Reddit, X and watchlists Domain discovery intent exists No run history, common item schema, novelty check, influence ledger, or merge/reject review loop

The existing source-compile automation names X bookmarks, Codex/Cursor sessions, and skill folders. It does not yet compile the full local source corpus. Freshness currently reports 28 overdue or never-run automation/sync paths. That is a harness design issue: freshness, connector health, backlog depth, and compilation state need one source-level control plane rather than scattered timestamps. Source: automations/source-compile.md; state.json; npm run status, 2026-07-15

Message identity and review-unit closure

Connector event identity, message identity, and review identity must not be collapsed. A retried delivery of one stable event is idempotent. Two messages with identical text are two observations and retain two source IDs. One edited message retains its source ID but gains a new immutable revision. A session snapshot preserves whole-trace custody but never substitutes for its messages.

Review closure is equally exact. Each review unit records a SHA-256 digest over its sorted source IDs, source-revision IDs, and signal IDs plus their counts. integrated and held are final dispositions for that digest; partial and blocked remain pending. A receipt for an older digest cannot close a changed unit. This makes a public aggregate compact without allowing a queue count, content duplicate, or last transcript message to impersonate complete review.

System Contract

Every connector must implement the same minimum contract:

  1. a stable source identity and cursor;
  2. an immutable or content-addressed raw artifact;
  3. a normalized envelope;
  4. source-specific enrichment and attachment preservation;
  5. privacy and authority classification before broad retrieval;
  6. extraction into atomic evidence units;
  7. an explicit disposition receipt;
  8. compilation into canonical owners and generated views;
  9. retrieval/effect tests;
  10. freshness, failure, backlog, and replay state.

Authority scope and source scope are independent

Before retrieval, compilation, or writeback, resolve two different questions:

Axis Question Kevin-Wiki consequence
Authority/brain Who owns the data store, policy, retention, credentials, and publication boundary? Public wiki, Kevin-private archive, project/team store, or another mounted authority never merge implicitly
Source/repository Which corpus inside that authority is being addressed? Wiki, raw X, Discord, repository, research, generated proof, and project sources retain separate stable identity and filtering

The same slug, entity, or semantic match may exist in several sources or authority domains. Resolution therefore returns a qualified identity rather than a global filename assumption. Cross-authority retrieval is explicit fan-out by an authorized agent, and synthesis cites every authority/source pair. A write stays in the owning authority and source unless a separately approved compilation receipt promotes it elsewhere. This makes privacy and project isolation part of routing, not a filter applied after retrieval. Source: GBrain brains/sources topology and source-isolation invariants at 75fae742, reviewed 2026-08-11

Connector execution contract

Cerebras Enterprise Knowledge Base Reference Architecture turns this abstract contract into a production-oriented execution model. A connector is a reviewed package with a manifest, adapter, fixture corpus, contract test, and doctor. It must declare its source scope, authorization reference, poll/event mode, stable identity and cursor semantics, semantic unit, refresh strategy, raw-retention policy, normalized fields, lexical and semantic projections, ACL strategy, freshness SLO, retry/dead-letter policy, and health checks. Source: Cerebras, 2026-07-16

Event-driven connectors follow one common path:

receive and acknowledge
→ deduplicate stable event ID
→ enqueue
→ resolve complete semantic unit
→ preserve restricted raw snapshot
→ normalize and classify
→ publish lexical projection
→ publish semantic projection
→ idempotent upsert
→ receipt, health, and freshness update

“Complete semantic unit” is source-specific. It may be a Slack/Discord thread, an article plus figures, a repository symbol and its file context, an email thread, or a meeting with transcript and attachments. A delta event is a reason to refresh that unit; it is not automatically the unit agents should retrieve.

For Discord, Discord Brain Gateway specializes this contract. message_id is stable delivery identity; each changed content or artifact hash is an immutable revision. Create, edit, delete, pin, attachment, and embed changes are distinct source events. An edit refreshes the bounded reply/thread unit, diffs extracted evidence, reopens only affected owners, and invalidates any unapplied proposal approval. A bot DM or explicitly authorized channel is the supported steady-state boundary; authenticated browser scraping remains recovery evidence and cannot prove cursor completeness.

Postgres can own the shared evidence-row and control-plane projection, but it does not replace source ownership: native systems remain operational truth, raw artifacts remain replay evidence, and canonical Markdown remains compiled brain truth.

Source Taxonomy

Source type and subject domain are independent. A Discord message may concern design, career, agent architecture, or a reminder. An article may be a tool manual, research claim, visual fixture, or personal philosophy. The harness must classify both axes.

Source family Examples Adapter-specific enrichment Default influence posture
Direct user intent Current chat, corrections, approvals, explicit preferences Thread context, quoted target, superseded instruction detection Highest authority for Kevin-specific intent; never silently generalized into world truth
Saved curation X/browser bookmarks, read-later queues, Obsidian clippings, design references Resolve links, threads, replies, media, snapshots, Kevin’s save reason Strong relevance signal; factual claims still require source-quality checks
Conversations Discord, Slack, email, iMessage, AI sessions, meetings, voice calls Threading, participants, attachments, decisions, action items, corrections Private by default; compile decisions and preferences, not conversational noise
Long-form knowledge Articles, books, papers, PDFs, essays, newsletters Full text, citations, figures, version/date, author, argument map Evidence candidate; compare claims and methods with canonical knowledge
Audio/video Podcasts, talks, demos, lectures, screen recordings Transcript, chapters, frames, visible workflow, linked artifacts Transcript claims plus visual fixture evidence; preserve timestamp provenance
Capability sources Tools, repos, skills, MCPs, CLIs, APIs, packages, docs, changelogs README/docs, releases, commits, dependencies, install and auth requirements Candidate until evaluated; never active merely because it was bookmarked
Work-system state Repositories, issues, PRs, CI, deploys, logs, analytics, incidents Current branch/version, status, ownership, failures, proof artifacts Authoritative for current project state within its freshness window
Temporal operations Calendar, tasks, reminders, deadlines, automations Due state, completion state, recurrence, timezone, stale-intent verification Actionable only after current-state and authority checks
Public signal streams last30days, HN, Reddit, GitHub Trending, Product Hunt, social watchlists Deduplication, novelty, engagement, source diversity, trend window Discovery signal; brief before promotion unless a safe workflow owns it
Personal/private records Career, relationships, health, finance, travel, location, accounts Minimal extraction, restricted entities, retention and redaction rules Private workflows only; excluded from public graph traversal and artifacts
Generated agent evidence Tests, screenshots, videos, traces, doctors, review verdicts Link to workflow run, version, environment, evaluator, pass/fail Proof of a bounded result; not a substitute for source truth

Normalized Source Envelope

All adapters emit one envelope before domain interpretation. Source-specific payloads remain attached rather than being flattened away.

source_id: src_<stable-id>
source_family: saved-curation
source_type: x-bookmark
connector_id: x-bookmarks
external_id: "207..."
canonical_url: "https://x.com/..."
captured_at: 2026-07-15T00:00:00Z
published_at: 2026-07-13T00:00:00Z
author_entities: [person_or_org_ids]
raw_artifacts: [content_hashes_and_paths]
attachments: [image_video_pdf_repo_or_link_records]
thread_context: [parent_and_reply_ids]
privacy: private
authority_domain: personal-brain
content_hash: sha256:...
adapter_schema_version: 1
freshness_policy: event-immutable
enrichment_state: complete
extraction_state: reviewed
disposition_state: incorporated
errors: []

Required distinctions:

  • published_at is not captured_at; old material can be newly relevant.
  • raw_artifacts are evidence; extracted text and summaries are derived.
  • privacy controls retrieval and compilation before content leaves the adapter boundary.
  • freshness_policy differs for immutable posts, changing docs, live project state, prices, schedules, and personal reminders.
  • schema migrations are replayable from raw artifacts.

Evidence Units

Enrichment produces typed units rather than one undifferentiated summary.

Unit Meaning Example disposition
Claim A falsifiable statement with subject, predicate, object, scope, time, and provenance Support, contradict, qualify, or park a canonical claim
Pattern A reusable technique or design/engineering move Attach to a workflow as a candidate fixture
Preference Kevin’s stated or behaviorally implied taste Update user/style model with confidence and scope
Decision A choice plus context, alternatives, owner, and effective date Update a decision or project page
Procedure Repeatable steps with inputs, dependencies, gates, and proof Candidate skill or workflow change
Capability Tool, skill, model, service, API, MCP, library, or runtime Enter capability lifecycle and version checks
Entity mention Person, project, company, place, product, paper, or concept Link to canonical entity and timeline when meaningful
Task/commitment An action with owner, state, due context, and authority Enter private/project operations only after stale-state checks
Question/tension An unresolved uncertainty or contradiction Add to research/learning queue and resurfacing hooks
Fixture A concrete visual, behavioral, architectural, or proof target Bind to workflow acceptance criteria and evaluation status

A claim record should preserve valid_from, valid_until, confidence, source quality, extraction confidence, supporting and contradicting evidence, canonical owner, and whether an agent or human reviewed it. Confidence is not truth; it is a routing aid.

Correlation Is Not Transitive Topic Identity

The evidence graph is many-to-many; the review queue must not flatten that graph into accidental subjects. A multi-link roundup that mentions Tool A and Tool B establishes two mentions edges. It does not make every other post about Tool A part of one transitive Tool A + Tool B cluster.

Use these deterministic review-unit rules:

  1. Sources with exactly one canonical resolved link may form a focused-artifact unit with other sources that resolve to that same artifact.
  2. A source with multiple canonical links stays one source-sized roundup unit. During interrogation, extract and bind every useful item and relationship separately.
  3. Linkless sources stay source-sized until an agent establishes an explicit semantic relation.
  4. Images, thumbnails, videos, and attachments are proof artifacts, not automatic topic keys.
  5. Shared links, nearby Discord intent, named entities, time adjacency, and contradictions remain queryable evidence edges even when they do not merge review units.
  6. An agent may deliberately review several units together, but the review record must name every source, signal, object comparison, and writeback; graph connectivity alone is never the justification.

This preserves repeated evidence without letting listicles or broad resource posts contaminate unrelated tool decisions. Ranking changes order only: useful signals survive even when a source is low-engagement, broad, or not yet actionable. Source: User correction and review-methodology audit, 2026-08-10; packages/brain-runtime/src/review-queue.ts

Incorporation Receipt

“Incorporated into the brain” is complete only when a receipt can answer:

  • What raw artifacts were preserved?
  • What did the source say, show, or demonstrate?
  • Which claims, patterns, entities, preferences, tasks, capabilities, or fixtures were extracted?
  • Which domain and privacy lenses reviewed it?
  • What existing knowledge supported, contradicted, or scoped it?
  • What changed: page, workflow, fixture, skill, tool route, project, task, or nothing?
  • What workflow and capability candidates were created, merged, rejected, or deferred?
  • What install next-action applies, including explicit no-install cases?
  • Why was each change justified?
  • Which generated views and retrieval indexes were rebuilt?
  • What proof shows the source can now be found and affects the intended workflow?
  • When must changing claims, tools, or live state be refreshed?
receipt_id: ingest_<id>
source_ids: [src_<id>]
primary_disposition: update-workflow
secondary_effects:
  - owner: wiki/architecture/example.md
    operation: qualify-claim
  - owner: workflows/frontend-improve
    operation: attach-fixture
review:
  domain_lenses: [design, frontend]
  contradictions: [claim_ids]
  privacy: private
proof:
  retrieval_queries: ["stable scrollbar detail"]
  workflow_evals: [frontend_fixture_eval]
freshness:
  checked_at: 2026-07-15
  recheck_after: 2026-08-15
no_change_reason: null

The receipt is the bridge between evidence and brain mutation. Hub coverage, a qmd embedding, or an absorb-log row alone does not prove incorporation.

Stable-object referential integrity

Every object named by a review is a foreign-key reference into brain/objects.json. The object ID and canonical path must both match. A review cannot invent a more specific alias for a section, point to an existing page that the operating graph does not register, or leave a writeback reachable only from its JSON receipt. brain doctor validates this boundary before projecting Changes and Objects into the UI. If a reviewed owner is genuinely durable, register it; if it is only a section of an existing owner, use that owner's stable ID. Source: graph-integrity audit and doctor regression, 2026-08-10

Source Profiles And Trust

The system should maintain profiles for recurring sources without converting reputation into a universal truth score.

Profile dimension Use
Domain competence Weight a source differently for design, research, infrastructure, business, or personal context
Primary versus secondary Prefer official docs, code, paper, direct statement, or live system state for exact claims
Historical reliability Track corrections, broken claims, stale launches, and accurate predictions
Incentives Mark marketing, launch, affiliate, employer, personal, academic, or adversarial context
Evidence quality Code, dataset, reproducible demo, citations, screenshots, anecdotes, or unsupported assertion
Freshness behavior Immutable artifact, versioned source, silently changing docs, live state, or decaying recommendation
Kevin relevance General quality is separate from usefulness to Kevin’s projects and taste

Source profiles rank review priority and contextualize claims. They must never suppress contradictory evidence or make a high-status author automatically correct.

Domain Lenses

After normalization, evidence passes through one or more domain lenses. A lens owns questions, canonical routes, workflow effects, source-quality rules, and evaluators.

Lens Questions it asks Likely owners/effects
Agent and harness systems Does this change routing, context assembly, memory, tool use, evals, or runtime boundaries? Architecture, workflow kernel, Agent Machines, Loop, skills, doctors
Design and taste What observable composition, interaction, typography, motion, or anti-pattern does it demonstrate? Design Board, Vision Constructor, Fieldwork, Sigil, visual fixtures
Frontend engineering Is it compatible, accessible, performant, maintained, and testable in current stacks? Frontend workflows, component/library routes, browser verification
Research and ML What is the claim, method, evidence, baseline, limitation, and relationship to existing theory? Research pages, question graph, experiment workflows
Backend/data/infra/security What contract, failure mode, authority boundary, cost, reliability, or operational burden changes? Domain workflows, architecture decisions, doctors
Product/business/content What user problem, distribution pattern, market evidence, narrative, or experiment follows? Project briefs, opportunity queue, content workflows
Personal learning What belief changed, what question remains, and when should it resurface? Learning graph, reading queue, spaced resurfacing
Private operations Is the information current, minimally necessary, authorized, and safe to act on? Restricted career, relationship, health, finance, account, reminder workflows

The same source can produce effects through several lenses, but one receipt owns the fan-out and records why each owner changed.

Portable context, replaceable execution

Agent-platform adoption is a layered decision, not one global build-versus-buy vote. The durable differentiation is the context and verification layer that makes any competent runtime behave like Kevin's system. The wiki therefore owns its rules, executable skills, MCP and capability contracts, workflow manifests, source identities, stable-object graph, approval policy, evaluations, and proof receipts. A hosted or self-hosted runtime may execute those contracts; it cannot become their sole canonical writer. Source: X/@davep X Article, 2026-07-27; Sierra Pinecone and MCP Gateway, July 2026

Layer Default boundary Replacement test
Canonical sources, objects, decisions, policy, and proof Own Another runtime can replay the same source and resolve the same owner without vendor memory.
Rules, skills, MCP/capability contracts, and workflow manifests Own in portable files and schemas Codex, Claude, Cursor, Hermes, or another conforming harness can load an equivalent contract with explicit capability differences.
Models, sandboxes, fleet orchestration, hosted agent UX, and low-level VM operations Rent or route by default Provider removal preserves source identity, workflow state, approval history, and proof; only volatile execution is lost.
Product-defining runtime or control plane Build selectively The layer is the product, an already-owned hard part, a required security boundary, or a permanently staffed operational commitment with measured advantage.

Stripe's Minions and Sierra's Pinecone show that bespoke infrastructure can be rational at scale, but they also make the exception legible: Stripe already owned mature devboxes and both organizations treat the system as a staffed, dogfooded product. Cursor's self-hosted workers show the opposite composition: code and tools can stay inside the customer's network while orchestration, models, and UX are bought. The source fabric keeps both options open by refusing to let provider state replace portable context or evidence. [Sources: Stripe Minions parts 1–2, February 2026; Sierra Pinecone and MCP Gateway, July 2026; Cursor self-hosted Cloud Agents and cloud-agent lessons, March–June 2026]

Minimum portability proof for a platform route:

  1. export rules, skills, MCP/capability configuration, workflow input, and run receipt without scraping a vendor UI;
  2. replay a representative source-to-owner decision in two harnesses and report semantic or capability differences;
  3. prove that provider interruption cannot erase canonical source, approval, decision, or artifact identity;
  4. keep vendor-specific adapters outside normalized source, object, review, and proof schemas; and
  5. record security, governance, cost, reliability, and replacement evidence as independent axes rather than a single adoption boolean.

Capability And Skill Lifecycle

Tools and skills need a stricter lifecycle than articles:

discovered
→ source-resolved
→ candidate
→ security/reputation/compatibility evaluated
→ trial-installed
→ configured and authenticated
→ doctor-healthy
→ workflow-bound
→ active
→ drifted or superseded
→ deprecated/retired with history

The source fabric stores discovery and evaluation evidence. The capability registry owns active state. A saved tool, impressive demo, or imported skill cannot affect agent routing until installation, configuration, authority, version, doctor, workflow owner, and rollback status are known.

Use Full Corpus Workflow and Capability Program for the independent state axes and next-action flags. In particular, installed, configured, authorized, healthy, workflow-bound, and active must never collapse into one boolean.

Contradictions, Corrections, And Belief State

Canonical pages should expose compiled truth while the evidence layer preserves disagreement.

  1. Compare new claims with current canonical claims and time bounds.
  2. Distinguish direct contradiction, newer state, narrower scope, terminology mismatch, and independent support.
  3. Route high-impact conflicts to a doubt/review workflow.
  4. Change compiled truth only with a receipt naming the superseded claim and evidence.
  5. Preserve the old claim in provenance/timeline history.
  6. Re-evaluate workflows and fixtures whose assumptions depended on the changed claim.

Direct user corrections have highest authority for Kevin’s identity, intent, preferences, and private history. They do not override external facts outside that authority domain.

Queues And Backpressure

The system needs explicit queues so 1,000 bookmarks do not compete with urgent project state.

Queue Exit condition
Capture failures Artifact preserved or failure is irrecoverable with a recorded reason
Enrichment Links/media/threads/versions resolved or explicitly unavailable
Privacy review Authority and public/private routing decided
Extraction review Evidence units accepted, corrected, or deferred
Contradiction review Canonical effect decided with provenance
Capability evaluation Candidate adopted, rejected, or deferred with gates
Promotion Canonical owner and workflow/fixture effects written
Retrieval verification Intended queries and workflow routes find the change
Freshness/drift Source rechecked, superseded, or expiry justified
Automated change proposals Human approves, rejects, snoozes, or requests revision; no silent merge

Priority combines explicit user selection, active-project relevance, contradiction severity, actionability, source quality, novelty, freshness risk, backlog age, and review cost. It must not be engagement-only.

Graph-guided frontier expansion

The object graph can guide what the source loop investigates next without becoming an evidence generator. Begin from a coarse canonical object or an unresolved question, explore existing equivalent and related nodes before creating another, expand toward more atomic concepts, and query with the target node plus its ancestor context. Retrieved posts, papers, sites, repositories, media, and conversations then enter the normal source envelope and review contract. Source: Kimi K3 technical report §4.2.2, frozen at MoonshotAI/Kimi-K3@3cb39dfd

This is a candidate-discovery lane, not automatic truth or automatic review clustering. Agent-created nodes, query keywords, synthetic tasks, inferred edges, and generated summaries remain derived artifacts. They cannot support a claim, merge review units, or update a workflow until the underlying materials are captured, cited, interrogated against the current owner, and given a proof receipt. Use coverage and unresolved-tension signals to select the next branch; do not recursively crawl the graph merely because a node exists.

Retrieval And Context Compilation

The runtime should retrieve compiled knowledge first, then evidence when needed. Retrieval is an ensemble, never an embeddings-only lookup.

  1. The workflow manifest declares a reusable project/source bundle, knowledge routes, privacy authority, and freshness requirements.
  2. ACL and project filters run before any candidate retrieval and cannot be widened by the query planner.
  3. The context compiler loads canonical pages and current project state.
  4. Independent retrievers produce exact/lexical, semantic, structural/graph, rarity, recency, and live-tool candidates when the underlying data shape supports them.
  5. Weighted reciprocal-rank fusion combines consensus without trusting one scorer.
  6. Source deduplication and per-source caps prevent one file or thread from occupying the result set.
  7. A question-specific reranker selects a bounded set; context expansion adds neighboring sections or the complete semantic unit.
  8. The final packet includes source, date, confidence, privacy, why it was loaded, and citation metadata.
  9. Generated context bundles remain deterministic projections of the selected workflow and canonical owners.
  10. The proof receipt records whether the retrieved context actually affected the result.

The default fusion reference is Σ weight / (60 + rank), followed by source consolidation, diversity caps, reranking, and context expansion. Exact constants remain evaluation parameters, not doctrine. qmd remains the local compiled-knowledge retriever; source adapters and live tools add evidence candidates through the shared interface. Source: Cerebras, 2026-07-16

The context packet should behave like a moving working set, not an attempt to load the whole archive. Begin with the smallest owner/project bundle that can answer the task, retain peripheral signals as lightweight candidate edges, and expand into full source units or neighboring objects only when the query or evidence justifies the move. This is the useful content behind Polygres' “infinite context” framing: the model's immediate attention remains finite while the addressable evidence can grow. The claim is retrieval architecture, not a literally unbounded transformer window. Source: X/@daleverett X Article, 2026-07-12

Structural retrieval is a distinct lane, not a replacement for lexical or semantic search. pgGraph demonstrates a rebuildable CSR graph index over ordinary Postgres tables; Polygres combines graph expansion with pgContext dense, sparse/text, filtered, and hybrid retrieval. This becomes relevant when the evidence store is already relational and repeated bounded traversal across declared relationships improves answerability. It does not justify moving Markdown/wiki truth into Postgres or replacing qmd. Authorization must be proved before graph expansion: pgGraph 1.0 documents that topology reads check table-level SELECT but do not re-evaluate row-level-security policies, while graph.search() re-queries source properties as the caller. Private or multi-tenant evidence graphs therefore remain ineligible until candidate generation and returned paths are demonstrably scoped before context assembly. Source: Evokoa/pgGraph README and docs/known-issues.mdx at 6fd7da9; Evokoa/pgContext at 70ee2ef, reviewed 2026-08-10

This avoids two failures: dumping the entire archive into context and hiding useful sources behind over-compressed summaries.

Privacy And Public Compilation

Privacy classification happens before global indexing and entity fan-out.

  • Raw private artifacts live in restricted locations and are excluded from public builds, public backlinks, asset manifests, and search collections.
  • Derived claims inherit the strongest relevant privacy class unless a separate public source independently supports them.
  • Public pages may preserve historical professional facts without copying private planning, finances, conversations, or relationship context.
  • Conversation participants and attachments are not promoted into entity pages by default.
  • Proof artifacts redact private source excerpts and local paths.
  • Deletion, retention, export, and audit behavior must be defined per connector.

Public portability uses the same boundary. The OKF v0.2 exporter receives only the public projection decision; it cannot reinterpret private: true, publish the private operational log, or traverse a local source path into output. Public concepts may expose resolvable public source URLs and a digest of any unmapped canonical source note, but its text, frozen private artifacts, and workflow receipts stay outside the bundle. This makes deletion and replay responsibility unambiguous: the source fabric owns evidence retention, while OKF is rebuildable delivery. Source: OKF v0.2 SPEC; ui/scripts/lib/okf-export.mjs, 2026-08-11

Control Plane

The source control plane should expose:

  • connector: configured, authenticated, scheduled, healthy, last success, cursor, schema version;
  • corpus: raw count, enriched count, extraction count, disposition count, backlog and oldest item;
  • compilation: affected owners, failed writes, generated surfaces, qmd/index state;
  • quality: unresolved links/media, duplicate rate, entity-link precision, contradiction queue, human correction rate;
  • freshness: overdue live sources, expired tool versions, stale project state, changing-source rechecks;
  • privacy: restricted items, public-build exclusions, redaction failures;
  • cost: model/token/network/storage cost per source and per incorporated decision.

Daily Brief is the human review surface, not the state database. Daily Brief Control Plane owns the durable proposal/event ledger, state transitions, dedupe, ranking, privacy, exact approvals, and apply dispatch. The native app and CLI show ranked receipts and allow approve, reject, request revision, snooze, discuss, retag, restrict, assign a workflow, or request deeper research.

Automated research refreshes follow Workflow Research Refresh Workflow and land here as a batched proposal queue, not as one conversation per source or workflow. Each proposal exposes separate last-researched/changed/verified/run/failure clocks, upstream changes, affected canonical owners and workflows, before/after diff, source evidence, independent lens reports, strongest objection, confidence, eval result, authority, cost, and rollback path. Automation may update evidence and prepare a branch or PR; workflow, skill, automation, canonical-truth, and public-output application or merge remains explicitly human-approved. Source: Private Discord message 1527130200620404898, 2026-07-15

The control plane accepts typed proposal envelopes from source, workflow, capability, project, and operational adapters. It rejects items without stable identity, privacy, affected owners, source review state, expected proof, idempotency, and authority. Repeated automation runs update one aggregate instead of producing duplicate cards.

Implementation Boundaries

Component Owns Does not own
Source adapters Acquisition, cursors, raw artifacts, source-specific enrichment Canonical wiki edits or workflow policy
Source registry Connector schemas, health, freshness, privacy defaults Secrets or generated summaries
Evidence extractor Typed units with provenance and confidence Final truth decisions
Entity/claim linker Canonical candidates, support/conflict edges Silent page mutation
Disposition engine Proposed primary outcome and affected owners Unreviewed high-risk promotion
Domain lens Source-quality rules and workflow-specific interpretation Cross-domain global authority
Brain compiler Canonical writes, timelines, receipts, indexes and projections Raw connector operation
Workflow registry Runtime behavior, dependencies, proof and writeback contracts Source preservation
Daily Brief app and CLI Native rendering, offline read cache, human decision commands Policy, repository writes, hidden canonical state
Daily Brief control plane Proposal/event ledger, dedupe, ranking, decisions, exact approvals, dispatch Source acquisition, workflow truth, arbitrary tool execution
Doctors/evals Contract, privacy, freshness, routing and effect verification Best-effort repair without receipts

Staged Release

Release 0 — Inventory and receipts

  • Create the source registry and normalized envelope schema.
  • Import current connector/freshness state without rewriting raw sources.
  • Generalize the X disposition receipt into a source-agnostic receipt.
  • Measure backlog separately for capture, enrichment, review, promotion, and freshness.

Release 1 — Three representative adapters

Prove the full loop with:

  1. X bookmark: social thread, link, replies, images/video, existing deep pipeline;
  2. arbitrary URL/article/repository: long-form and capability evidence;
  3. AI session or Discord thread: conversational decisions, corrections, attachments, and privacy.

Each must reach canonical writeback, workflow influence, retrieval verification, and replay from raw evidence.

Build them against one connector SDK and contract suite. Prove stable-event deduplication, complete-semantic-unit refresh, raw replay, lexical-before-semantic availability, ACL/project filtering, idempotent upsert, partial-failure recovery, schema migration, and clean removal/retention behavior. Retrieval tests must cover exact identifiers, paraphrases, freshness, diversity, and neighboring context.

Release 2 — Domain shaping

  • Implement agent/harness, design/frontend, and research/learning lenses.
  • Bind source fixtures to named workflows and evaluation status.
  • Add contradiction review and belief-change receipts.
  • Add candidate-to-active capability lifecycle gates.

Release 3 — Private and live sources

  • Add email, calendar, meetings, Slack, voice/iMessage, tasks, GitHub/CI, and project-state adapters.
  • Enforce private retrieval and public compilation boundaries before enabling automation.
  • Add stale-intent/current-state checks for tasks and reminders.

Release 4 — Daily Brief control plane

  • Implement the proposal envelope, event ledger, state machine, privacy, dedupe, ranking, workflow clocks, exact approvals, and CLI.
  • Build the thin native macOS client after the control-plane contract passes fixtures.
  • Migrate automation definitions to Workflow Automation V2 Contract so proposed work cannot become a false schedule.
  • Prove source change → adversarial proposal → Daily Brief decision → approved apply/verify with a silent no-change fixture.

Release 5 — Aliveness and scale

  • Add public domain feeds, last30days, novelty ranking, resurfacing, and Daily Brief actions.
  • Benchmark batch sizes, cost, precision, correction rate, and time-to-incorporation.
  • Automate safe dispositions only after receipt/eval history proves reliability.

Acceptance Metrics

Metric What it protects
Raw preservation rate No silent source loss
Enrichment completeness by source type Links, media, threads, versions and attachments are actually examined
Disposition coverage Every selected source exits with an explicit outcome
Source-to-owner precision/recall Fan-out is complete without indiscriminate page churn
Entity-link precision People, projects, tools and concepts resolve correctly
Contradiction precision and review latency Important belief pressure surfaces without noise
Retrieval hit rate Incorporated evidence can be found by intended questions
Workflow effect rate Adopted patterns actually change workflow behavior or proof
Human correction/rejection rate Automation confidence remains calibrated
Freshness SLO by source class Live state and versioned tools do not masquerade as current
Privacy leakage tests Restricted evidence never reaches public surfaces
Cost and latency per disposition The system remains economically and interactively usable
Proposal dedupe rate Repeated schedules do not create repeated cards
Unsolicited conversation/notification count Ordinary research proposals remain quiet
Approval integrity Changed artifacts invalidate prior approval and no protected mutation bypasses the gate
Queue age and decision latency Important proposals surface without becoming an unbounded inbox

Initial benchmark sets should include known X fixtures, the 151-message Straight Fats reconciliation with 39 edited rows and known virtualized-scroll misses, selected article/repository captures, deliberate contradictions, duplicate sources, old-but-newly-captured items, private/public collisions, and tools that should remain candidates rather than activate.

Failure Modes

  • treating sync success as incorporation;
  • summarizing a source while losing its claims, artifacts, figures, replies, or demonstrations;
  • letting platform type stand in for domain interpretation;
  • creating one page per source instead of compiling mental objects;
  • allowing a popular source to overwrite stronger evidence;
  • activating a tool or skill before installation/configuration/doctor proof;
  • globalizing a project-specific or stylistic pattern;
  • hiding contradictions inside a rewritten summary;
  • embedding private content before classification;
  • letting queues grow without stage-specific backlog and age metrics;
  • refreshing indexes while canonical owners remain unchanged;
  • generating proactive briefs with no merge/reject/writeback contract;
  • keeping raw evidence forever without retention, export, or deletion policy.
  1. Make the source envelope and incorporation receipt kernel contracts; keep extraction implementations adapter-specific.
  2. Use a relational/event ledger for source state, effects, claims, queues, and receipts; keep raw artifacts and canonical Markdown in their current owner stores.
  3. Do not make embeddings the source of truth. Use them for candidate retrieval after privacy filtering, then resolve to canonical owners and evidence IDs.
  4. Build the first release around X, arbitrary URL/repo, and private conversation evidence before adding more connectors.
  5. Treat domain lenses as workflow-owned evaluators, not permanent autonomous personas.
  6. Require replayability: changing an extractor or schema should recompile from preserved raw evidence without duplicating canonical writes.
  7. Require a no-change receipt. Correct rejection and deferral are successful ingestion outcomes.
  8. Adopt the Cerebras connector shape—small source adapter plus a shared evidence interface—but retain raw artifacts and canonical Markdown as separate owners.
  9. Make hybrid retrieval explicit: lexical + semantic + rarity + recency, fused with RRF, deduplicated, diversity-capped, reranked, and expanded to surrounding context.
  10. Use workflow manifests as reusable project/source bundles. Planners may narrow a scope but never silently broaden it.

Timeline