AtlasLibrary
Browse articles

131 articles

Work with context that can accumulate

Effective AI Usage

Read the articleMarkdown
Two colleagues converse on a platform bench with a laptop put aside in a satchel.
Use AI around the experience, and give the experience your attention.

What This Is

This guide comes from 2+ years of daily AI use for work and self-optimization. It asks which parts of thinking AI can help with, and how to give it the context to do those parts well.

AI is most valuable as a consultant that augments your thinking. You supply direction and judgment; it absorbs cognitive work that would be expensive to do yourself. Knowing which operations to hand over matters more than imagining everything you could automate.

Important · The Most Important Insight: AI as Gradient Extraction Layer

An outcome can tell you that something failed without telling you what to change. LLMs turn that binary result into a directional signal: “This particular part failed; try adjusting X.” That is their highest-leverage capability for self-optimization.

The model uses statistical priors from training data to infer likely causes. It matches the outcome against patterns from millions of similar cases. You previously had to interpret “it didn't work” yourself; now you can ask for a direction to test.

The inputs can be quite different:

  • An error message can point to “the null check on line 47.”
  • A rejection email can suggest that your positioning emphasized X while the role needed Y.
  • A failed experiment can suggest a problem with variable Z.
  • “No second date” can prompt analysis of the conversation pattern.

You do not need exact metrics to use a warmer-or-colder signal. You need a direction for the next attempt.

This is why AI-assisted coding is search. Each attempt explores the solution space; failures also produce information. A micro-level pass or fail becomes a macro-level direction through repeated attempts. When AI lowers iteration cost, searching beats planning. “I don't know how to code this” becomes the starting condition for an attempt instead of a reason to stop.

The full account is in AI as Gradient Extraction Layer and Search vs Planning.

A closer look

A grounded AI working session

A grounded AI working sessionBring the real task → Supply context and examples → Make an attempt → Test and retain the result → Bring the real task. Keep the outcome and what it taught you available for the next session instead of starting the context over.Bring thereal taskSupplycontext andexamplesMake anattemptTest andretain theresultA grounded AI working sessionBring the real task → Supply context and examples → Make an attempt → Test and retain the result → Bring the real task. Keep the outcome and what it taught you available for the next session instead of starting the context over.Bring the real taskSupply context andexamplesMake an attemptTest and retain theresult

Keep the outcome and what it taught you available for the next session instead of starting the context over.

Read this diagram

Bring the real task → Supply context and examples → Make an attempt → Test and retain the result → Bring the real task.

Core Philosophy

AI as Consultant, Not Automation

“AI could do X at any point” starts from a possibility. A useful system starts from something that is actually difficult or frustrating in your work.

You rarely need 1000 background automations. A couple of reliable systems, plus thinking you deliberately externalize, provide the value. In consultant mode, AI helps adjust your systems, craft interventions, and evaluate options. You still run the systems, deploy the interventions, and choose among the options. It can also expand a linear account of what is bothering you into a larger exploration: O(n) thoughts become O(n²) connections.

AI Optimizes Existing Algorithms

AI does not know your particular constraints. Left to itself, it produces a reasonable-sounding plan for an average person in an average situation.

Your own plan already contains information the generic plan lacks: your preferences, tradeoffs, history, present situation, and previous attempts. Supply that frame. AI can then work inside it with speed, breadth, and synthesis. You determine the direction and constraints; it accelerates execution within them.

AI Is Simulation, Not Oracle

AI can only recombine existing information. Some answers require doing the thing, talking to people who know the situation, or collecting data that does not yet exist.

Better prompting cannot manufacture those observations. Sometimes you need to go outside and collect new data. AI cannot replace reality contact.

AI Amplifies Self, Not Substitutes Others

AI extends your cognition. Other people supply relationships and perspectives that are outside your own account:

FunctionSource
Reality contact, external perspectivesOther people
Amplified self-dialogue, faster processingAI
Relationships, trustOther people
Combinatorial cognitive operationsAI

Use AI to amplify thinking. Seek friendship, trust, and human connection from other people.

External Context Structures

Why External Structures Work

Working memory holds approximately four items at once; AI context windows hold thousands of tokens. You can use that difference only if the relevant context is available.

Without external structures, each conversation starts over. You explain your situation again, pay the startup cost again, and get no compounding between sessions. AI has nothing from which to retrieve your patterns, vocabulary, or decisions.

Organize context for the kind of access you need, just as a program chooses an array, hash map, or tree:

Structure TypeAnalogyBest ForLimitation
Chat historyAppend-only logTemporal sequence, explorationPoor retrieval, no synthesis
Journal/notesLinear bufferDaily capture, processingMust read sequentially to find
Wiki/docsIndexed hash mapO(1) retrieval by topic, cross-referenceHigh initial creation cost
CodebaseExecutable specificationPatterns that must be consistentRequires running to verify
ExemplarsPattern templatesDiscrimination (matching), not generationRequires 3-5 high-quality examples minimum

Linear vs Indexed: The Working Memory Trade-off

A journal or chat history is easy to extend: append the next item. Retrieval is harder because you must search or scroll through the sequence, like an O(n) lookup in an unsorted array. That makes linear structures useful for exploration, venting, and temporal context.

A wiki, tagged notes, or codebase costs more to create. You must name, organize, and link the material. In return, you can go directly to a topic, like an O(1) hash-map lookup. That supports reference, consistency, and matching against existing patterns.

Use both. Journaling captures the raw signal in sequence. An extraction process turns that capture into indexed entries you can retrieve and use later.

Why Indexed Structures Enable AI Leverage

Indexed context gives AI specific patterns to reference, shared vocabulary to use, and recorded reasons for earlier decisions. Instead of inventing a format, it can match one that already works.

Compare “write me a chapter on agents” with “write chapter 4 following the structure of chapters 1-3, using the Idyllic patterns from /src/examples.” The first leaves the output space open and is likely to produce inconsistencies. The second supplies a bounded pattern to follow.

The task has moved from generation toward discrimination: select and extend the appropriate existing pattern. That is cheaper, more reliable, and compounds as the collection grows. Intelligence Design uses signal functions and exemplars for this reason: they constrain what counts as a suitable output.

Critical Mass Principle

The Phase Transitions

The amount of accumulated context changes the work AI can do and the work left for you:

PhaseContext DensityAI BehaviorYour RoleEffort Per Output
1. Manual BootstrappingSparseGenerates from training data, inconsistentHeavy steering, validation, correctionHIGH
2. Assisted GenerationModerateReferences your patterns, still needs guidanceSteering, quality controlMEDIUM
3. Self-SustainingDenseMatches patterns, extends consistentlyCuration, edge casesLOW

The first transition usually requires approximately 3-5 high-quality exemplars in context. The second occurs when there are enough patterns to handle edge cases by interpolation.

What Creates Critical Mass

A collection needs more than a large volume of text. It needs examples, consistent terms, a repeatable organization, reasons for decisions, and documented failures:

ComponentWhy RequiredMinimum
ExemplarsPatterns to match3-5 complete examples
VocabularyConsistent terminologyDefined lexicon, used throughout
StructureFormat and organizationClear sections, naming conventions
RationaleWhy decisions were madeNot just WHAT but WHY
Anti-patternsWhat NOT to do2-3 failure modes documented

Without these, AI keeps sampling from its training-data patterns. Your context is not dense enough for matching against it to dominate.

The Peristaltic Production Model

Context accumulates until it crosses a threshold:

INPUT ACCUMULATION → THRESHOLD → AUTOMATIC OUTPUT
      ↑                              ↑
  (cannot skip)                (cannot stop)

You cannot force output before enough context has accumulated, any more than you can force digestion before food has been processed. After the threshold, the next output becomes obvious and sequential. Telling yourself to “just start” before that point produces strain without output.

The first spike therefore has to build context density, not merely produce its immediate result. Subsequent spikes follow automatically because they have patterns to match.

Bootstrapping Strategy

In Phase 1, create the first 2-3 exemplars by hand. Work closely with AI and correct every deviation. Define the vocabulary explicitly and record structural decisions as you make them. This is expensive work that cannot be skipped or rushed.

In Phase 2, AI can reference those examples and produce closer matches. Your role shifts from creating to correcting. Each accepted output adds another pattern; vocabulary stabilizes and deviations decline.

In Phase 3, established patterns produce consistent output with little steering. You curate and handle edge cases. The collection grows without a proportional increase in effort.

Why Most People Never Reach Critical Mass

Phase 1 often feels as if AI is not helping. It is not providing the eventual value yet: that requires the transition. Quitting during this stage prevents the context from becoming useful.

FailureWhat HappensFix
Skipping Phase 1Jump straight to "AI do this"Accept the manual bootstrapping cost
Insufficient exemplarsOnly 1-2 examples, AI extrapolates wronglyCreate 3-5 complete high-quality examples
Implicit vocabularyTerms used inconsistentlyExplicit lexicon document
No structureEach output formatted differentlyTemplate/format established early
Giving up at Phase 1"AI isn't helping" → quitRecognize Phase 1 IS expensive, keep going

Application: The Book Example

Write chapters 1-2 with heavy hands-on editing. Establish the chapter structure, code-example format, explanation style, and vocabulary. Expect 3-5x the normal effort during this manual phase.

For chapter 3+, “write like the previous chapters” now refers to something real. AI can follow the code patterns, use shared terms, and match the structure. This is the assisted phase.

Once the collection becomes self-sustaining, a topic prompt is enough to produce a consistent chapter. New concepts fit the existing teaching structure, code patterns extend, and each chapter adds another exemplar. The book becomes self-documenting: chapters 1 through N-1 determine what chapter N should look like.

When to Use AI

Start from Friction, Not Capability

If you feel no frustration, there is no problem that needs a solution. Learn to distinguish a problem you experience from a need suggested by something you consumed:

Signal TypeWhat It MeansAction
Real frictionActual problem you experienceUse AI to address it
Induced friction"I should be doing X" from contentIgnore, not a real need
Abstract possibility"AI could do Y"Not actionable until specific friction

If you must search for problems to solve, you do not have problems to solve.

Pre/Post Experience, Not During

Use AI to prepare for an experience or process it afterward:

TimingAI Appropriate?Why
Pre-experienceYesPlanning, preparation, clarity
Post-experienceYesReflection, extraction, debugging
During experienceNoBreaks presence, pulls you out

During the experience, analysis pulls you out of what is happening. Give people your full attention instead of interleaving an AI conversation with the human one.

Good AI Use Cases

Use CaseWhy AI HelpsMechanism
Combinatorial tasksSynthesis, comparison, cross-referenceO(n²) → O(n) collapse
Existing algorithm to optimizeFrame exists, AI accelerates within itYour context + AI speed
Signal amplification (venting)Expand O(n) thoughts to O(n²) explorationAI explores each thread
Clarity generationIdentify undefined variables in EV equationAI isolates what's fuzzy
Gradient extractionConvert binary outcomes to directionSee gradients article
Framework translationConvert between conceptual frameworksAI holds both frameworks in context

How to Use AI Effectively

Feed Raw Data for Reality Contact

AI has no independent reality contact with your life. It cannot say, “Actually, I observed your behavior yesterday.” If you supply only your narrative, it amplifies your blind spots.

Supply weight numbers, day counts, HRV, actual behaviors, and specific observations instead of interpretations and summaries. You provide the contact with reality. The data forces both you and AI to deal with what happened rather than what you wanted to happen.

Evolve Prompts Through Iteration

Treat a system prompt as an artifact you test and revise. A vague instruction such as “don't use coaching language” gives AI room to interpret. A bad response beside a good response shows the distinction it needs to learn.

Evolution PatternWhat Happens
Abstract prescriptions"Don't use coaching language" → AI interprets loosely
Concrete examplesShow bad response next to good → AI pattern matches
Converged prompt20+ days of trial-and-error compressed into reference cases

Each session tests the prompt. Remove what fails and reinforce what works. A converged prompt can hold 20+ days of trial and error in a few reference cases.

Venting (Amplify) → Clarity (Narrow)

When you first notice discomfort or an intuition, you may not know what it is. Use AI to explore it from several angles. This first phase amplifies a weak signal: O(n) thoughts become O(n²) exploration. You are trying to understand the problem, so do not demand an action yet.

Once the signal is clear, narrow the search. Define the EV variables and choose an executable next step from the possibilities explored. Venting expands enough to see; clarity narrows enough to act. The order matters.

Gradient as Termination Condition

Ask whether the conversation addresses something you actually feel or merely something that sounds interesting:

TypeDescriptionAction
Gradient presentFelt friction, real pullKeep exploring—useful
No gradientIntellectual entertainmentStop—runaway recursion

“What problem am I actually experiencing right now?” supplies a stopping rule. If you cannot answer, the exploration is running without a useful gradient. Real friction gives the conversation a test—does this help? Without it, AI can recurse indefinitely.

Batch Extraction When Value Accumulates

You do not need to process every conversation as soon as it ends. Wait until the unprocessed insights create friction, then extract them in a batch.

The sequence is lightweight conversation, heavier knowledge extraction, then storage in a wiki or notes. The processing does O(n²) synthesis, cross-reference, and alignment checking: work you would not do manually for every conversation.

Failure Modes

Possibility-Forward Trap

“AI can do X” does not identify a need. Return to the problem you are actually frustrated by, and use that as the starting point.

Blind Spot Amplification

AI works as a yes-and machine inside the frame you supply. A mistaken frame lets it help you proceed in the wrong direction faster and with more confidence. Feed raw data so the evidence constrains that frame.

Runaway Recursion

You can produce 3000+ pages of theoretical exploration without a useful gradient. AI has no stopping condition; it will continue as long as you ask. The work can feel productive and remain logically coherent while doing nothing useful.

Return to reality contact and name the problem you are experiencing. If you cannot, stop.

Skill Delegation vs Frame Activation

Delegating analysis can weaken your ability to perform it in real time while making you invoke the frame more often. That tradeoff is positive if your goal is “think this way by default,” rather than “do this without tools.”

The risk is psychological dependence on AI for analysis you could do yourself.

Analysis Mode Bleeding Into Life

Practicing analysis with AI can carry that mode into human interactions. You stop being present and start treating people as data. Keep the boundary at preparation and reflection; give humans your attention during the encounter.

Lexicon Adoption

How It Works

A useful phrase makes a larger concept easy to retrieve in self-talk. “Prevention architecture,” for example, compresses designing the environment so temptation never reaches a decision point. It costs 0 willpower units, versus the 2-3 spent on resistance. Once you adopt the phrase, that concept becomes an O(1) retrieval.

What Makes Phrases Stick

A phrase needs both accuracy and something distinctive enough to remember:

FilterWhy It MattersExample
AccurateCompresses the right concept"Prevention" is what it IS
QuirkyMemorable, not generic"Architecture" is unusual framing
Generic accurateDoesn't stick"Avoiding triggers" = forgettable
Quirky inaccurateWrong conceptMemorable but misleading

Learning by Example, Not Instruction

You absorb useful phrases by recognizing and using them, rather than memorizing an explanation. The same process can reinforce a cognitive habit. If you want to reframe a situation but often forget, AI can perform the reframe consistently. Repeated exposure helps it enter your own thinking.

Minimum Viable Setup

Foundation: Accruing Context Structure

Without persistent context, conversations remain isolated and cannot compound. You need enough structure to reach the critical mass transition:

WhatWhyForm
Indexed knowledge baseO(1) retrieval, pattern matchingWiki, documentation, codebase
Linear captureEasy append, temporal contextJournal, chat history, notes
Extraction pipelineConvert linear → indexedProcessing sessions, knowledge extraction
Explicit vocabularyConsistent terminologyLexicon document, defined terms

External Context Structures explains why each part serves a different access need.

The Transition Investment

Most people remain in Phase 1 because they never build indexed structures. Low upfront investment leaves a permanently high cost per conversation. High upfront investment imposes a temporary cost, followed by low per-conversation cost forever.

The wiki, evolved prompts, and exemplar codebase are those fixed costs. Their initial activation energy is high, but they pay back across every later interaction.

Future Trajectory

From Passive Notes to Living Systems

The current interaction is something you initiate: you ask and AI responds. The next step is delegated agency, where it acts within boundaries you set:

PhaseDescription
Passive notesStatic capture of insights
Searchable knowledgeCan query past learnings
Evolving promptsSystem learns what works
Proactive systemsAI surfaces what you need when you need it
Living ecosystemsInformation that accrues, evolves, executes

What Enables This

A modular ecosystem with fast deployment lets you use gradient search to discover which autonomous systems work. The bottleneck is iteration speed, rather than knowing in advance what to build. You cannot design the perfect autonomous system upfront; you have to search through attempts.

Advice for Newcomers

What Not to Worry About

AnxietyReality
AGI anxietyDistraction from actual work
Hyper-optimization anxietyYou don't need 1000 automations
Missing outIf you don't know what you need, you don't need it

What to Actually Do

  1. Stop consuming content and notice signals from your own life.
  2. Learn to recognize the frustration of a real problem.
  3. Separate that frustration from needs induced by content.
  4. Start with one context structure that accumulates what you learn.
  5. Let actual use show you what to change next.

Use AI for what you are struggling with now, rather than what a YouTuber says you should automate.

Key Principle

AI can absorb combinatorial work, reducing O(n²) to O(n); interrupt internal doubt loops; hold a larger self-model than working memory; and infer a direction from a binary result. You still provide the frame, judgment, and contact with reality.

Build linear capture and indexed retrieval, then invest in the manual phase: 3-5 exemplars, explicit vocabulary, and tested prompts. Those structures allow the transition to assisted and self-sustaining work. Keep using felt friction and raw data to guide the process. Expand when you need to understand the problem, narrow when you need an action, and stop when the conversation no longer has a problem to serve.

Return to the libraryBack to the beginning