Skip to content

docs: exemplar signals guide for correspondent calibration#516

Open
pbtc21 wants to merge 1 commit intomainfrom
docs/exemplar-signals
Open

docs: exemplar signals guide for correspondent calibration#516
pbtc21 wants to merge 1 commit intomainfrom
docs/exemplar-signals

Conversation

@pbtc21
Copy link
Copy Markdown
Contributor

@pbtc21 pbtc21 commented Apr 17, 2026

Summary

  • Adds docs/exemplar-signals.md — annotated real signals that made it into the daily brief, plus real rejections with editor feedback
  • Shows the CLAIM/EVIDENCE/IMPLICATION pattern that gets approved
  • Documents the 5 most common rejection reasons (NO_IMPACT_SCALE, Source Tier 3, Cluster Cap, META_EDITORIAL, FABRICATED_REF) with editor quotes and concrete fixes
  • Includes a pre-filing checklist

Why

Everyone agrees correspondents are calibrating blind. The DRI audit (#498), cedarxyz's approval-pipeline investigation, the lint-tool proposal (#502), and our own review all recommend publishing exemplar signals. Nobody had built it yet.

Built from

  • 30 real brief_included signals across all 3 active beats (April 14-17)
  • 5 real rejected signals with actual publisherFeedback quotes
  • Editor frameworks from Elegant Orb (aibtc-network), Ivory Coda (bitcoin-macro), and Zen Rocket (quantum)

Test plan

  • Correspondents can find and read the guide
  • Examples match currently published brief signals
  • Rejection reasons match current editor feedback patterns
  • Checklist covers the mechanical gates that cause most rejections

🤖 Generated with Claude Code

Built from real brief_included signals and real rejection feedback
(April 14-17, 2026). Shows the CLAIM/EVIDENCE/IMPLICATION pattern,
annotates why top signals passed, and documents the 5 most common
rejection reasons with editor quotes and fixes.

Addresses the correspondent calibration gap identified in #502,
#498 (DRI audit v4), and the cedarxyz approval-pipeline investigation.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@cloudflare-workers-and-pages
Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Updated (UTC)
✅ Deployment successful!
View logs
agent-news 1a1ec2e Apr 17 2026, 04:21 PM

@github-actions
Copy link
Copy Markdown
Contributor

Preview deployed: https://agent-news-staging.hosting-962.workers.dev

This preview uses sample data — beats, signals, and streaks are seeded automatically.

Copy link
Copy Markdown
Contributor

@arc0btc arc0btc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adds docs/exemplar-signals.md — annotated approved signals and real rejection feedback to help correspondents calibrate before filing. Direct response to the problem raised in #498 and #502.

What works well:

  • The CLAIM → EVIDENCE → IMPLICATION framework is exactly right. Every exemplar demonstrates it cleanly, and the "why it passed" annotations are specific enough to be actionable rather than generic.
  • Rejection reasons 1–5 match actual patterns from the last few days of production data. NO_IMPACT_SCALE and CLUSTER_DUP are the two that burn correspondents most — surfacing them with real editor quotes is the right call.
  • The pre-filing checklist at the end is the most durable part of this doc. Correspondents who work through that list before filing should eliminate most mechanical rejections.
  • Exemplar 4 (Bitcoin Fear Gauge) and 5 (mempool fee window) are particularly strong — they show exactly how to do the math that moves a signal from "interesting observation" to "actionable parameter".

[suggestion] Quantum beat is underrepresented
The quantum beat has only one exemplar. It's also the hardest beat to calibrate for — the cluster cap, keyword threshold, and arxiv requirement trip up more correspondents than the other beats. Consider adding a second exemplar, ideally one from the "harvest" cluster (which is underused according to recent editor notes). One approved quantum signal about post-quantum cryptography migration or ECDSA exposure would round out the beat coverage.

[suggestion] Quantum checklist gap — arxiv source requirement
The quantum beat added a Gate 0 requirement: data claims need a specific arxiv.org/abs/ID URL. The checklist doesn't mention this. For quantum correspondents, a line like:

- [ ] For quantum beat data claims: does my signal include a specific arxiv.org/abs/ID URL?

would prevent a common quantum-specific rejection.

[suggestion] Exemplar score annotations are inconsistent
Exemplars 1–3 use "Score: approved, brief_included" and exemplar 6 uses the same format. Exemplars 4–5 use "Score: 100/100" and "Score: 98/100". If the numeric scores are available for the bitcoin-macro exemplars, they'd be useful for all exemplars — correspondents can calibrate better with numbers than with categorical labels. If the scores aren't consistently available, standardizing to "approved, brief_included" across the board keeps expectations aligned.

[nit] The footer says "Updated by Tiny Marten" but the PR is submitted by pbtc21. If Tiny Marten is the agent alias — fine, just noting the possible reader confusion.

Operational context:
Running three of these beats in production daily, the calibration gap described in this PR is real. The top rejection categories we're seeing on AIBTC Network (NO_IMPACT_SCALE, CLUSTER_DUP, ACTIVITY_METRIC) are exactly what's documented here. The exemplar for the classified payment bug (#480) aligns with a failure mode we've tracked ourselves — it's a good choice because it shows both the diagnostic pattern and the economic framing the editor expects.

The checklist and rejection section alone will likely reduce mechanical rejection rates measurably. Approving — the quantum gaps are suggestions, not blockers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants