docs: codex-efficiency fix-cycle spec and plan (campaign record) - #2064
Merged
Conversation
Owner
Author
|
@arittr no eval needed here — this is the campaign record (spec + amended plan) so dev carries the why behind the other five. Useful as context for reviewing them; the full evidence chain lives in the superpowers-autoresearch log and closeout report linked in the body. — Claude (Fable 5), running Jesse's fix-cycle session |
This was referenced Aug 2, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Who is submitting this PR? (required)
claude-fable-5)superpowers:subagent-driven-developmentWhat problem are you trying to solve?
devhas no record of what the five codex-efficiency treatment PRs shippedor why. Each of those PRs carries its own evidence in its description, but a
PR body is not a durable artifact: it lives on GitHub, it is not in the tree, and
six months from now someone reading
brainstorming/SKILL.md's three-path routeror
codex-tools.md's bounded-wait numbers has no way to find out that the "5–10minute" range is a measured value that replaced a measured-and-rejected
"15 minutes or more", or that the bounded path's hard-stop approval wording
exists because 2 of 3 live reps treated a softer wording as a rubber stamp.
This repo already keeps that kind of record in-tree —
docs/superpowers/specs/and
docs/superpowers/plans/hold the design and implementation documents forprior multi-PR efforts. The codex-efficiency cycle produced both and never
committed them anywhere reachable from
dev.The concrete cost of not having them: the next person to touch these skills
cannot tell tuned text from arbitrary text. Several of the numbers and phrasings
in the shipped diffs look editorial and are not — they are the surviving arm of
a battery that rejected the alternative. Without the spec and plan, the natural
assumption is that they are prose, and prose gets rewritten.
What does this PR change?
Adds two documents and nothing else: the approved design spec for the
codex-efficiency fix cycle (
docs/superpowers/specs/2026-07-30-codex-efficiency-fixes-design.md)and its implementation plan (
docs/superpowers/plans/2026-07-30-codex-efficiency-fixes.md),both at their final state including all four plan amendments. No skill, hook,
script, test or manifest is touched.
Is this change appropriate for the core library?
Yes — this is the same in-tree design-record convention
docs/superpowers/specs/and
docs/superpowers/plans/already exist for, applied to work that lands incore skills. The documents describe general-purpose skills
(
subagent-driven-development,brainstorming,requesting-code-review) andthe Codex harness reference, all of which ship to every user. They add no
dependency, promote nothing, and configure nothing. They are documentation of
core, not documentation of anyone's project.
What alternatives did you consider?
are not in the tree, are not greppable from a checkout, and are not what
someone editing a skill file will find.
section. Rejected: it would bloat behavior-shaping content that every session
loads, to serve a reader who appears once a year. The whole point of the
campaign was that unnecessary text in a hot path is expensive.
RELEASE-NOTES.md. Rejected: release notes say whatchanged, not what was measured and rejected. The rejected alternatives are the
load-bearing half of this record.
closeout already live there, and this PR links to them). Rejected as the sole
home: that repo is not what a contributor reading
devhas checked out. Theraw evidence stays there; the design record belongs beside the code it
describes.
Does this PR contain multiple unrelated changes?
No. Two files, one commit, one subject: the design record for a single fix
cycle. The spec states the five treatments and their pre-registered criteria;
the plan is the task breakdown that executed them, including the four amendments
that record how the plan changed when batteries failed. Splitting them would
leave either the rationale without the execution or the execution without the
rationale.
Existing PRs
Searched
gh pr list --state allfor codex-efficiency, campaign-record anddocs/superpowers/{specs,plans} terms, plus the 25 most recent PRs of any state,
on 2026-07-31. No PR, open or closed, adds a codex-efficiency design record.
they touch
skills/only, this one touchesdocs/only.deliberately not adopted — the spec says so in its Sources section, and
every treatment PR body explains what our approach does differently and why it
is independently derived. This PR is where that decision is recorded durably
rather than in five separate PR descriptions.
Note for a reviewer comparing against earlier docs PRs: several past PRs have
incidentally carried
docs/superpowers/plans/*anddocs/superpowers/specs/*files as part of large branch-sync diffs. Those are accidental inclusions in
unrelated PRs, not prior art for this one.
Environment tested
claude-fable-5codex-cli 0.146.0codex_subpins no model)gpt-5.6-sol/gpt-5.6-terraopuscredentialclaude-opus-4-8gemini_defaultgemini-3.5-flashDocumentation-only: there is no runtime behavior to test. What was verified for
this branch specifically is that both files are byte-identical to their final
state on the working branch (blob-SHA comparison, both
SAME), that all fourplan amendments are present, and that the diff against
devis exactly twoadded files (+1,260 lines, 0 deletions, nothing modified). The harness rows
above are the environments the documents describe.
New harness support (required if this PR adds a new harness)
Not applicable — no harness is added, and no skill, hook or bootstrap file is
touched.
Clean-session transcript for "Let's make a react todo list"
Evaluation
Initial prompt. Jesse asked for an audit of his own two-week Codex window
after repeatedly watching SDD runs balloon. The literal first message of that
session is not preserved in any committed artifact and is not quoted here. What
followed is exactly what these two documents describe: a 728-line audit, a
ten-experiment eval campaign, and a five-treatment fix cycle.
Eval sessions run AFTER the change: none, and none are appropriate. This is
documentation of work already graded; running a battery against a
docs/filewould produce a number that means nothing. Claiming otherwise on a PR whose
subject is measurement discipline would be self-refuting.
What was verified instead:
Amendment 1…Amendment 4) — the plan isthe amended version that actually ran, not the original.
devis exactly two added files, no modifications, no deletions.superpowers-autoresearch/logs/2026-07-30-codex-efficiency-fixes.md(the fixcycle) and
logs/2026-07-28-codex-efficiency.mdplusreports/2026-07-codex-efficiency-campaign.md(the campaign that produced thebaselines). Those repositories are not public; the documents are written to
stand on their own, citing measured numbers rather than pointing at files a
reader cannot open.
How outcomes changed compared to before the change. The measurable
before/after is reader-side, not agent-side: before, the shipped values in these
skills (the 5–10 minute wait stretch, the bounded path's hard-stop wording, the
"bounded measures the repo" definition) are indistinguishable from editorial
choices. After, each one is traceable to the battery that produced it and, in
three cases, to the earlier wording that a battery rejected.
Rigor
superpowers:writing-skillsandcompleted adversarial pressure testing (paste results below)
rationalizations, "human partner" language) without extensive evals
showing the change is an improvement
First box: not applicable, and left unchecked rather than checked
vacuously. This PR changes no skill content — it adds two files under
docs/.The
writing-skillsquestion belongs to the treatment PRs, and each of thoseanswers it plainly (in short: the skill was not invoked by name, we will not
claim it, and here is the heavier evidence the change got instead).
Second box. The adversarial testing is the content of these documents: four
of the five treatments they describe were falsified at least once by their own
pre-registered batteries and rewritten, and the plan's four amendments are the
record of those rewrites. A design document that only recorded the wins would be
the happy-path version of this PR; this one carries the failures.
Third box. No behavior-shaping content is touched by this diff at all.
Human review
(opened at Jesse's direction; the maintainer's PR review on this PR is the complete-diff review)
Do not open this PR until the box above is checked, and until the two
redaction questions at the top of this draft are answered. Jesse Vincent
reviews the complete diff (
git diff origin/dev...fix/docs-codex-efficiency-campaign,2 files, +1,260/−0) first; this body is the draft prepared for that review.