Back to all concepts

Intent-Structured Attention and Experience Infrastructure

Brief

Intent-Structured Attention (ISA) is a model where attention is not a neutral spotlight but a routing system shaped by inferred intent structures, continuously reorganizing what is visible, relevant, and actionable across code, UI, and system state.

Experience Infrastructure (EI) is the persistent, layered system that stores, connects, and reinterprets lived computational experience (events, logs, reflections, tests, UI feedback), turning runtime and interaction history into a continuously re-usable epistemic substrate.

Together, ISA and EI form a coupled system:

intent shapes attention; experience infrastructure preserves and re-feeds what attention produces back into future intent.

WHY THIS MATTERS

Across the extracts, the core shift is from “software as execution” to software as a continuously self-rewriting cognitive environment.

Traditional systems:

  • take input → run logic → produce output → discard context

ISA + EI systems:

  • take partial intent → route attention → execute + observe → store as structured experience → re-infer future intent

This enables three major shifts:

  1. From commands to intent fields
  • Developer/user input is not treated as instructions but as partial intent fragments
  • Systems reconstruct what the user is “trying to become” operationally
  1. From logs to epistemic memory
  • Logs, tests, failures, and UI signals become queryable experience objects
  • Not debugging artifacts, but reusable cognitive material
  1. From tools to environments
  • VSCode extensions, WebSocket bridges, and runtime feedback loops become a continuous experience loop
  • The system behaves less like software and more like a structured environment for thought

Deep synthesis

Operating Logic

1. Intent is inferred, not declared

Across VSCode events, React hooks, and WebSocket messages:

  • intent is reconstructed from context + event type + state change

Example:

  • file change + invalid metadata → “validation intent”
  • route change → “context shift intent”

2. Attention is structured routing, not selection

Attention operates as:

  • filtering (what matters)
  • zooming (what detail level matters)
  • anchoring (what object is currently active)

It shifts between:

  • function-level reasoning
  • system boundary reasoning
  • UI feedback reasoning

3. Experience is continuously accumulated infrastructure

Instead of ephemeral logs:

  • every event becomes a node
  • every transformation becomes an edge
  • every failure becomes a signal artifact

This creates a persistent cognitive substrate

4. Feedback loops close the system

Example loop:

  • editor change
  • debounce layer
  • API sync
  • WS broadcast
  • UI status update
  • validation feedback

This is not just synchronization—it is experience circulation

5. System correctness emerges from routing consistency

Failures described in extracts often come from:

  • mismatched origin propagation
  • unclear intent boundaries
  • side-effect leakage into event handlers

Thus correctness is:

alignment between intent structure and event routing topology

Pattern Language

parse event.

file edited.

Boundary Conditions

Key boundaries include 1. Over-inference of intent, 2. Attention overload, 3. Graph explosion, 4. False epistemic confidence, and 5. Coupling creep in event systems.

Patterns

1. Event → Intent → Action decomposition

Never handle raw events directly.

Instead:

  • parse event
  • infer intent
  • execute handler

Prevents:

  • logic fragmentation
  • mixed side effects
  • implicit coupling

2. Separation of state derivation and side effects

Derived state:

  • metadata validity
  • document structure
  • routing decisions

Side effects:

  • WebSocket sends
  • UI updates
  • file writes

Key rule:

derive first, act second

3. Experience layering architecture

Three layers:

  • Raw layer: events, logs, file changes
  • Structured layer: signals, hypotheses, intents
  • Reflective layer: graph, interpretation, re-ranking

4. Dual-system feedback surfaces

  • Status bar → persistent truth signal
  • Notification → transient anomaly signal
  • Markdown/UI → structural state signal

Each surface encodes a different attention bandwidth

5. Message envelope standardization

All communication unified:

{
  "type": "...",
  "payload": "...",
  "origin": "...",
  "target": "..."
}

Enables:

  • cross-protocol consistency (HTTP ↔ WS)
  • causal traceability
  • routing correctness

6. Workspace routing abstraction

Centralized resolver:

  • tmp vs canonical file routing
  • validation gates
  • metadata merging

Prevents:

  • duplicated logic across handlers
  • inconsistent file state interpretation

7. Hook-based attention modules (React)

Custom hooks become:

  • attention containers
  • lifecycle-aware intent handlers

But must avoid:

  • mixing transport + UI logic
  • unstable dependency-triggered loops

8. Hypothesis-driven system design

Instead of:

  • “implement feature → test”

Use:

  • “assume structure → generate hypothesis → test → observe signal”

This turns debugging into structural discovery

EXAMPLES AND SCENARIOS

Example 1: VSCode extension loop

  1. file edited
  2. metadata invalid
  3. event triggers validation intent
  4. API sync updates WS
  5. status bar reflects persistent state

→ experience infrastructure closes loop

Example 2: WebSocket + HTTP bridge

  • HTTP request carries intent
  • API server attaches origin
  • forwards into WS graph
  • preserves causality across protocol boundary

Example 3: Refactoring as intent resolution

  • “split function” intent emerges
  • system detects mixed responsibility
  • attention shifts to boundary definition
  • code is reorganized accordingly

Example 4: Signal-based debugging

  • test fails
  • produces high-intensity signal
  • signal links to metadata parsing module
  • hypothesis generated: “routing drift in tmp workspace”
  • next tests refine hypothesis

Primitives

1. Intent Unit

A partial expression of goal or direction:

  • “split into smaller functions”
  • “validate metadata correctness”
  • “reduce Quokka restart friction”

Not an instruction, but a latent transformation directive

2. Attention Anchor

A current focal object:

  • function
  • file
  • event handler
  • WebSocket message
  • UI state layer

Attention is always anchored, never global

3. Event → Intent Mapping

Events are not raw triggers but intent candidates:

  • onDidChangeTextDocument → validate metadata + sync
  • WebSocket changeText → update document state
  • React useEffect(filepath) → load canonical state

This creates implicit intent inference from runtime structure

4. Experience Record

A persistent object containing:

  • execution trace
  • signal output
  • UI feedback
  • test result
  • reflection or interpretation

Stored across:

  • Postgres (event history)
  • graph layer (Neo4j-style relationships)
  • embeddings (retrieval layer)

5. Signal (from testing + runtime)

A weighted observation:

  • intensity
  • impacted concepts
  • source event
  • confidence

Signals replace raw logs as primary epistemic units

6. Hypothesis Object

A structured claim over experience:

  • “metadata validation failure correlates with tmp workspace routing”
  • “WS origin mismatch causes routing drift”

Hypotheses:

  • are stored
  • tested
  • re-scored over time

7. Experience Loop

Canonical cycle:

intent → event → transformation → execution → observation → signal → storage → re-interpretation → new intent

This loop replaces static program execution with continuous re-formation

8. Workspace Duality

A structural split:

  • temporary workspace (mutable, unsafe)
  • canonical workspace (source of truth)

Attention shifts depending on safety and intent layer

9. Origin / Identity Primitive

In distributed systems:

  • browser
  • VSCode
  • API bridge
  • system process

Origin becomes a routing dimension, not just metadata

10. Tension Graph (implicit ISA extension)

Relationships are not only hierarchical:

  • supports
  • contradicts
  • transforms
  • weakens

Attention is guided by tension density, not just relevance

HOW THE CONCEPT WORKS

1. Intent is inferred, not declared

Across VSCode events, React hooks, and WebSocket messages:

  • intent is reconstructed from context + event type + state change

Example:

  • file change + invalid metadata → “validation intent”
  • route change → “context shift intent”

2. Attention is structured routing, not selection

Attention operates as:

  • filtering (what matters)
  • zooming (what detail level matters)
  • anchoring (what object is currently active)

It shifts between:

  • function-level reasoning
  • system boundary reasoning
  • UI feedback reasoning

3. Experience is continuously accumulated infrastructure

Instead of ephemeral logs:

  • every event becomes a node
  • every transformation becomes an edge
  • every failure becomes a signal artifact

This creates a persistent cognitive substrate

4. Feedback loops close the system

Example loop:

  • editor change
  • debounce layer
  • API sync
  • WS broadcast
  • UI status update
  • validation feedback

This is not just synchronization—it is experience circulation

5. System correctness emerges from routing consistency

Failures described in extracts often come from:

  • mismatched origin propagation
  • unclear intent boundaries
  • side-effect leakage into event handlers

Thus correctness is:

alignment between intent structure and event routing topology

Product and business

1. Intent-Aware Developer Environments

IDE that:

  • infers intent from edits
  • restructures UI based on inferred goals
  • highlights “attention anchors”

2. Experience Graph Debugging Platform

Instead of logs:

  • graph-based failure exploration
  • “why did this happen?” becomes graph traversal

3. Signal-Based Testing Framework

  • tests produce structured signals
  • failures become weighted epistemic artifacts
  • CI becomes “concept drift detector”

4. Distributed Intent Messaging Layer

  • unified HTTP + WS + editor event system
  • origin-aware routing fabric
  • message envelope standardization layer

5. Cognitive DevOps Infrastructure

  • file watchers → intent triggers
  • CI pipelines → hypothesis evaluation engines
  • deployments → experience graph updates

Research directions

1. Intent graph formalization

Model intent as:

  • evolving graph, not static instruction set
  • nodes: intents, events, hypotheses
  • edges: transformation + tension relations

2. Attention as routing function over state graphs

Replace “attention weights” with:

  • graph traversal under constraint rules
  • tension-aware prioritization
  • signal-driven reweighting

3. Experience-as-database vs experience-as-graph

Hybrid systems:

  • Postgres → event truth layer
  • Neo4j → relational cognition layer
  • embeddings → retrieval substrate

4. Signal-based testing theory

Tests become:

  • observation generators
  • not pass/fail gates

Key question:

what does this failure mean structurally, not just functionally?

5. Origin-aware distributed cognition

Study how identity propagation:

  • affects routing
  • preserves causality
  • prevents semantic drift

6. Self-rewriting experience infrastructure

Systems that:

  • ingest their own logs
  • generate hypotheses about them
  • modify their own structure

Risks and contradictions

1. Over-inference of intent

Risk:

  • system hallucinating user goals

2. Attention overload

Risk:

  • too many anchors competing for focus
  • loss of coherent routing

3. Graph explosion

Risk:

  • experience infrastructure becomes unmanageable without pruning or compression

4. False epistemic confidence

Risk:

  • signals interpreted as meaning when they are only correlation artifacts

5. Coupling creep in event systems

Risk:

  • event → intent → action chains become implicit and fragile

Open Questions

  • How should intent be validated, if it is always inferred?
  • What is the minimal viable structure for experience infrastructure?
  • Can attention routing be formalized without collapsing into standard ML attention mechanisms?
  • How do you prune experience without losing emergent signal?
  • When does hypothesis generation become noise amplification?

Worldbuilding

1. Cognitive IDEs as living environments

Code editors that:

  • reorganize themselves based on developer intent fields
  • surface “attention currents” like weather systems

2. Experience infrastructure as shared memory substrate

Entire organizations operate on:

  • persistent experience graphs
  • not documents or tickets

3. Hypothesis-driven AI collaborators

AI agents that:

  • do not execute tasks
  • instead propose and test structural hypotheses about systems

4. Attention-field computing

Systems where:

  • computation follows “resonance fields”
  • high-tension nodes attract execution resources

5. World as replayable experience graph

Reality logging systems:

  • every action becomes replayable node
  • cognition becomes graph traversal of lived history

EXAMPLES AND SCENARIOS

Example 1: VSCode extension loop

  1. file edited
  2. metadata invalid
  3. event triggers validation intent
  4. API sync updates WS
  5. status bar reflects persistent state

→ experience infrastructure closes loop

Example 2: WebSocket + HTTP bridge

  • HTTP request carries intent
  • API server attaches origin
  • forwards into WS graph
  • preserves causality across protocol boundary

Example 3: Refactoring as intent resolution

  • “split function” intent emerges
  • system detects mixed responsibility
  • attention shifts to boundary definition
  • code is reorganized accordingly

Example 4: Signal-based debugging

  • test fails
  • produces high-intensity signal
  • signal links to metadata parsing module
  • hypothesis generated: “routing drift in tmp workspace”
  • next tests refine hypothesis