Skip to content

S0-QA-01: Golden PRs & Evaluation Rubric #2

@ezeanyicollins

Description

@ezeanyicollins

Scope: Provide golden PRs and rubric to evaluate PatchPro’s suggestions.

Tasks:

  • Create 3–5 golden PRs with common issues (unused import, missing docstring, etc.).
  • Document expected PatchPro comment for each PR.
  • Define rubric: detection, correct diff, clarity.
  • Track pass/fail results per golden PR.

DoD: For each golden PR, PatchPro’s sticky comment can be compared against the expected one, and rubric can score pass/fail.

Metadata

Metadata

Labels

pod:evalqaF2C2D4 Eval/QA pod (golden PRs & rubric)

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions