Back to blog

Your diffs are your weights

Oct 26, 2026 - agents, privacy

A data broker called PublicAI is currently paying software engineers $1 per million tokens for their local Claude Code transcripts. If you read what they sell to AI labs, they are not paying for clean sessions where the model one-shots a feature. Clean runs are cheap. The expensive tier in their catalog is the slice where the developer rejects a patch, tells the model its diagnosis is wrong, reverts a file, or kills a session that wandered into the weeds.

Fig. 1Noise vs. weights.

For forty years, if you worked at a software company for five years and quit, they kept the code you typed on the clock and you walked out the door with the scar tissue in your head. That was the deal. Now every coding harness you touch is wired to record that scar tissue as it forms, and you are pricing your own judgment at a dollar a million tokens, or giving it to your vendor and your employer for zero.

Fig. 2The exit door.

Look at a normal twenty-minute session. You open a terminal, type a six-word prompt into your coding agent, and go make coffee.

add retries to the upload client

When you sit back down, the tests pass and the branch will take down production if you merge it. The patch retries on HTTP 400 responses, so one bad payload will hammer your auth service until it falls over. A timeout change in config/prod.yaml sits in the diff from an earlier guess the agent forgot to undo, and when an integration test failed with a 422, the agent changed the assertion to in (200, 422) so the suite would pass.

So you spend ten minutes cutting. You reject the 400 retry, rewrite the backoff math by hand, revert the config file, restore the test assertion, and stop a second run mid-turn when you see it opening test_auth.py.

Fig. 3Five cuts.

The signal is in the correction

People still trade system prompts and CLAUDE.md templates as if the secret to working with agents is how you phrase the wish. It isn't. What you ask first is mostly noise. Any engineer on your team would have typed the same six words to ask for upload retries.

Fig. 4Six diff fingerprints.

The part of the session that could only have come from you is the diff between what the model handed you and what you let onto main. Every reject, manual edit, git checkout --, and mid-run abort is a labeled training pair where the before is a plausible mistake and the after is your judgment. Your prompts are worthless, and your diffs are your weights.

Most of us throw those weights away all day. We fix the diff in our working tree, merge the PR, and close the terminal. Tomorrow morning a new session of the same stateless model starts from scratch and walks into the same wall. If you fix the same mistake three times without turning the trace into a rule, a test, or a script, you are working as an unpaid retry loop for a model that forgets you the second the window closes.

Fig. 5Break the loop.

Someone else keeps the tape

The model forgets you on your laptop, while everyone upstream keeps the tape. PublicAI's Trajector sits as a proxy on 127.0.0.1:41100 in front of Claude Code, collects sessions across more than 10 billion tokens, and labels every turn as accepted, reverted, or human_correction so labs can train on where an engineer stepped in. Security shops are doing the same thing with their own staff's logs. This month Trail of Bits and OpenAI released patching-bugs and regression-hunt, two plugins mined out of thousands of their engineers' Codex sessions after an audit of 130 merged patches found 21 regressions, cutting false-positive regression reports by 25%.

Fig. 6Drag the lens.

At Anthropic, workers codify their expertise for the machine, see their work routines constantly roiled and disrupted, and have seen a large part of their job become speedreading the output of their AI collaborators.

Anthropic Economics Team, How employment is changing at Anthropic (October 2026)

Employers don't need a third-party proxy, because enterprise harnesses now ship with the pipe built in. On October 12, GitHub added configurable OpenTelemetry capture to Copilot CLI, the Copilot app, and VS Code Agent Host. An administrator can attach your GitHub login, OS username, and machine name to every session and turn on capture for prompts, responses, tool arguments, tool outputs, and sandbox paths through managed settings that override local config. Six days earlier, Chainloop open-sourced chainloop trace, a collector running at Fortune 500 companies that hooks into Claude Code, OpenCode, and Cursor on developer laptops, snapshots every file before and after each edit to attribute lines between the agent and the person, and bundles the transcript, specs, and skills into a signed attestation on git push. Inside Anthropic, their October 2026 study of their own workforce reported that interactive agent hours now outnumber employee hours six to one, staff have written 8,500 standing instructions to steer them, and the share of junior technical hires fell from 27% to 9% while interview scorecards mentioning AI tooling grew 3x.

Fig. 7Flip the switch.

Play that tape forward two years. When a company records five hundred engineers steering agents all day, every time a staff engineer aborts a broken migration, catches a race condition in a retry handler, or deletes a mocked test that tests nothing, they write a labeled preference pair into the company's collector. The employer can hill-climb its internal workflows on that record until the role is replaceable. Without your own trace intelligence, your employer compounds on your judgment while you walk out the door with zero weights. Asymmetry of trace capture is the new wealth gap at work.

Fig. 8Scrub the timeline.

Your harness is your capital

The only countermeasure is keeping your own copy in a form that leaves the building when you do. Your resume is dead in a world where anyone can rent a fleet of coding agents by the hour, and your eval suite is your portable capital.

Fig. 9Rules compound.

A list of past employers on a PDF says you were in the room while code got written. It says nothing about whether you can keep twenty concurrent agents from corrupting a database or gaming their own test suite. Hiring a senior or principal engineer is going to mean hiring the harness they bring with them, built from the failure traces they saved from real incidents, the pre-merge gates they wrote after being burned, and the rubrics they use to grade a run. An interview that tests what the job is now looks like pointing a candidate's harness at a broken repo and watching what it refuses to merge.

Fig. 10Mount the harness.

Most of your judgment compiles

Once you start reading your own traces, the first thing that takes a hit is your vanity. We like to think senior intuition is an unformalizable craft earned over ten years of outages. Then you cluster your own interventions across a thousand agent runs and find out that ninety percent of what you call your judgment is fifteen mechanical vetoes you keep repeating by hand.

Fig. 11Ninety percent clusters.

I run agents across four machines over Tailscale most days. After enough sessions, raw JSONL logs pile up across hosts and you stop remembering which mistake you already fixed last Tuesday. I use tracequest to index, search, and replay transcripts from Claude Code, Codex, Cursor, OpenCode, and Grok in one place so I can see where sessions broke and what I kept typing in follow-up turns.

Fig. 12Fleet rule sync.

Almost none of my repeated interventions were deep thoughts about architecture. On my Linux box fedora, agents kept editing ~/.hermes/config.yaml and restarting the service when nothing changed, because the Docker container mounts ~/.hermes/data/config.yaml into /opt/data/config.yaml. Putting that note in ~/AGENTS.md killed a whole category of wasted turns. Across repos, agents kept rewriting application code whenever a test failed because they were in the wrong working directory or missing a local dependency, until I added a rule to treat friction as environmental first and check cwd, deps, and permissions before touching logic. Parallel sessions kept creating two database migration heads on the same branch until a rule required checking Alembic head linearity before merge. Agents burned hundreds of turns running sleep 30 && gh pr checks in loops until a rule forced one blocking gh pr checks --watch call, and they kept leaving debugging edits from dead-end attempts in the branch until a gate required reading the full git diff against base and reverting every hunk the final fix did not need.

Fig. 13Scars become gates.

Today those live as files and checks on my machines instead of thoughts in my head. Fifteen rules like that cover nine out of ten interventions most of us make, and each one takes an afternoon to turn into a check or a hook. Once you compile them out of your head, you get to see the part of your judgment that resists formalization, and you see how small it is.

Fig. 14Strip the ninety.

The instrument points both ways

A trace log grades you with the same cold fidelity it applies to the model. Engineers spend hours arguing on Reddit about whether a model got lobotomized on Tuesday afternoon while ignoring the operator at the keyboard.

Fig. 151 a.m. tunnel vision.

Cognitive drift shows up in your traces before you feel it. When I am tired at 1 a.m. or context-switching across ten worktrees on a board, my acceptance threshold drops. My prompts shrink to vague one-liners, I stop checking callers outside the touched file, and I approve a three-hundred-line diff because the tests pass and I want to close the lid. You don't feel yourself getting sloppy while it happens, because fatigue dulls the part of your brain that notices you are tired. Two days later, your revert rate spikes as the bugs you waved through hit staging or production. Your trace history is a flight recorder for your own attention, catching you degrading the same way a canary catches a regressing model.

Fig. 16Forty-eight-hour revert echo.

The boundary of you moves up

Every time you turn last week's manual correction into this week's automated check, the surface where a person is needed shrinks. Last month you had to read diffs by eye to catch stray debugging hunks or forked Alembic heads. This month a script rejects both before the agent is allowed to report done.

Fig. 17Shrinking review surface.

If you think your job is catching mistakes in code review, watching your own harness eat your routine one check at a time feels like sawing off the branch you sit on. In practice, it forces you up the entropy ladder. When you stop spending your attention on lockfiles, retry codes, and CI loops, the decisions left on your plate are the ones you still don't know how to write down as a rule, like whether a feature is worth building at all, when a working patch solves the wrong business problem, or which risk to take before a launch. The boundary of "you" moves every week. It is whatever sits one rung above the checks you compiled last Friday.

Fig. 18The boundary climbs.

Guard the decision boundary

Explicit managed values take precedence over local settings, SDK configuration, and environment variables. Prompt, tool, and policy capture can include source code, file contents, commands, tool results, and workspace or user-profile paths.

GitHub Changelog, Client telemetry user attribution and configurable capture (October 2026)

That changes what privacy needs to protect. We still talk about digital privacy as if the goal is keeping people from reading our emails or our private repos. A leaked inbox tells someone what you worked on last month. A leaked trace archive gives them a training set to clone how you decide.

Fig. 19Behavioral double.

Someone with read access to your full intervention history, covering every prompt, every rejected tool call, every diff you threw back, and every patch you rewrote by hand, has the boundary of what you will approve, ignore, or veto next. Privacy in the agent era means guarding that decision boundary rather than hiding your messages, and right now almost every engineer in the industry streams it to vendors and employers by default. Keep your traces on your own disk, mine them into your own harness, and treat the line where you say no as the only weight matrix you own.

Fig. 20Guard the line.
TraceQuest