Visitar URL original
Page Every Review and Read Copilot's Listed and Table Findings by ptr727 · Pull Request #4066 · ptr727/ProjectTemplate · GitHub
Skip to content

Page Every Review and Read Copilot's Listed and Table Findings - #4066

Merged
ptr727 merged 4 commits into
developfrom
feature/review-gate-paging-copilot-parsing
Nov 11, 2026
Merged

ptr727 merged 4 commits into
developfrom
feature/review-gate-paging-copilot-parsing

Conversation

@ptr727

@ptr727 ptr727 commented Nov 11, 2026

Copy link
Copy Markdown
Owner

Summary

  • Page every review (pr_review.py Loses Coverage Once Thread Replies Push a Pull Request Past 100 Reviews #4002). gql now replaces a windowed reviews read with every page of the connection, oldest first, through page_reviews in scripts/pr_review_payload.py. page_files moved there too, so scripts/pr_review.py shrinks. Thread replies can no longer push a round behind the window and cost a head its coverage. The digest's REVIEWS TRUNCATED block and the + on section counts are retired, along with the window sentences in scripts/README.md. reviews_truncated stays as a fail-closed gate condition. It is vacuous on a paged read, so a "truncated review history" condition in rule text still reads true.
  • Read Copilot's "The review identified these findings" list (Read Copilot's "The Review Identified These Findings" List as Findings #3875). The spelling is now a findings-list label in scripts/reviewers/copilot.json. An item naming a path and no line counts as carried only by a thread on that path that repeats two or more of its longer words, two thirds of them at least. One thread carries one item. Any other item counts under FINDINGS WITH NO THREAD and prints with its key.
  • Count a Review notes table on its [P\d] markers (Count Copilot Findings Stated Only in a Review Notes File Table #3893). A notes cell counts each marker it holds, and a Reviewed. row counts nothing. Where the cells name more findings than any list, they print under the no-thread block.
  • Retire the Copilot coverage-marker ask (Validate the structured Copilot review marker on live reviews #798, option 1). This removes .github/copilot-instructions.md item 5 and the fleet-code-review marker paragraph, along with the pointer to the marker in pr-review-conduct, and drops findings= from the regex. The reader for reviewed/changed stays.
  • pr_review.py: a GitHub Actions billing-failure notice can be misread as UNRECOGNIZED_REVIEWER_OUTPUT #1071 is re-checked and not closed. Under the current gate, a constructed billing-failure body still reads as a non-refusal round, which holds the head as shapes=HELD. The issue is narrowed in a comment to what remains.

Every behavior has a test that fails on develop, and each fixture is constructed.

Closes on promotion: #4002, #3875, #3893, #798

🤖 Generated with Claude Code

ptr727 and others added 3 commits November 10, 2026 20:34
Read every page of a pull request's reviews, so thread replies cannot
push a round behind the window and cost the head its coverage. Retire
the digest's truncated-review reading along with it.

Count Copilot's "The review identified these findings" list and its
"Review notes" table as findings, matched to a thread by path and text.

Retire the Copilot coverage-marker ask and the marker's findings field,
keeping the reviewed and changed reader.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Copilot AI lite review requested due to automatic review settings November 11, 2026 04:44
@coderabbitai

coderabbitai Bot commented Nov 11, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@ptr727

ptr727 commented Nov 11, 2026

Copy link
Copy Markdown
Owner Author

A recorded local strict-review pass covers head 3a604dc68305127ba3c358d3b19fcc72e2541ead, the content this pull request carries at that commit against develop, and it recorded 0 findings.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Critical correctness issues remain in per-marker matching, aggregate link counting, review-head consistency, and fail-closed pagination, so the resulting review coverage can be inaccurate or incomplete.

4 open issues
What changed in this PR

This pull request makes review-history reads complete and expands Copilot finding parsing for identified findings and Review notes tables.

Changes:

  • Adds reusable pagination for review and changed-file connections.
  • Matches path-only findings against review threads and counts table markers.
  • Retires the Copilot coverage-marker requirement and updates documentation, skills, generated copies, and tests.
File Description
tests/​test_pr_review.py Updates coverage fixtures and adds review pagination tests.
tests/​test_pr_review_policy.py Updates the partial-coverage fixture.
tests/​test_pr_review_copilot.py Adds tests for identified findings, Review notes tables, and marker changes.
tests/​test_pr_merge.py Updates merge-gate fixtures and count expectations after review pagination.
scripts/​reviewers/​copilot.json Adds vocabulary for Copilot findings lists and Review notes tables.
scripts/​README.md Documents review pagination and expanded finding handling.
scripts/​pr_review.py Adds review-page queries and integrates shared review and file pagination.
scripts/​pr_review_rounds.py Uses paged review history and thread text for finding matching.
scripts/​pr_review_payload.py Provides reusable review and changed-file pagination helpers.
scripts/​pr_review_digest.py Removes obsolete review-window truncation output and adjusts related reporting.
scripts/​pr_review_copilot.py Parses identified findings and Review notes markers and matches path-only findings to threads.
.github/​skills/​pr-review-conduct/​SKILL.md Removes the retired coverage-marker reference.
.github/​skills/​fleet-code-review/​SKILL.md Removes the required coverage-marker instruction.
.github/​copilot-instructions.md Removes the Copilot coverage-marker review instruction.
.claude-plugin/​fleet-skills/​skills/​pr-review-conduct/​SKILL.md Updates the generated conduct skill copy.
.claude-plugin/​fleet-skills/​skills/​fleet-code-review/​SKILL.md Updates the generated review skill copy.
.claude-plugin/​fleet-skills/​.source-digests/​pr-review-conduct Refreshes the generated conduct-skill digest.
.claude-plugin/​fleet-skills/​.source-digests/​fleet-code-review Refreshes the generated review-skill digest.
.agents/​skills/​pr-review-conduct/​SKILL.md Updates the canonical conduct skill source.
.agents/​skills/​fleet-code-review/​SKILL.md Updates the canonical review skill source.

Review effort: Lite

Comment thread scripts/pr_review_copilot.py Resolved
Comment thread scripts/pr_review_copilot.py Resolved
Comment thread scripts/pr_review_payload.py Resolved
Comment thread scripts/pr_review_payload.py Resolved
@codecov

codecov Bot commented Nov 11, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 89.47368% with 10 lines in your changes missing coverage. Please review.
✅ Project coverage is 79.35%. Comparing base (bdeb7d9) to head (8911eaf).
⚠️ Report is 1 commits behind head on develop.

Files with missing lines Patch % Lines
scripts/pr_review_payload.py 60.00% 10 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #4066      +/-   ##
===========================================
+ Coverage    79.24%   79.35%   +0.11%     
===========================================
  Files           38       38              
  Lines        12802    12857      +55     
===========================================
+ Hits         10145    10203      +58     
+ Misses        2657     2654       -3     
Flag Coverage Δ
python-3.13 79.35% <89.47%> (+0.11%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ptr727

ptr727 commented Nov 11, 2026

Copy link
Copy Markdown
Owner Author

@coderabbitai review

@ptr727

ptr727 commented Nov 11, 2026

Copy link
Copy Markdown
Owner Author

/review

@coderabbitai

coderabbitai Bot commented Nov 11, 2026 •

Copy link
Copy Markdown
Action not completed

Review rate limited.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@ptr727

ptr727 commented Nov 11, 2026

Copy link
Copy Markdown
Owner Author

A recorded local strict-review pass covers head 8911eaf3be3aa67f5ec76e4aed92e4a169fc81fa, the content this pull request carries at that commit against develop, and it recorded 0 findings.

@ptr727
ptr727 merged commit 5f38e4d into develop Nov 11, 2026
13 checks passed
@ptr727
ptr727 deleted the feature/review-gate-paging-copilot-parsing branch November 11, 2026 05:12
ptr727 added a commit that referenced this pull request Nov 11, 2026
…iew Paging, Owner-First Secret Stems (#4070)

## Summary

Promotes burndown round 2 of the attended run of 2026-11-10 from
`develop` to `main`.

- #4069: the carried VS Code Lint tasks run `scripts/docker_lint.py`
through `hub_fetch_run.py`. Fetched companions keep their hub-relative
paths, a fetch prints the `main` commit it used, and a terminated run
leaves no snapshot behind. The "Editor and Tasks" sentence names no
literal path.
- #4067: a resync re-levels `develop` before converting, and lands the
instruction set and carried skills in one pull request. The standup
ambiguities from the DevKitCIoT dry run are settled, the stale
`placeholders` lists are gone behind a new spec-gate check, and the
KiCad line-ending example is corrected.
- #4066: the review gate pages every review rather than reading a
window. It reads Copilot's "identified these findings" list and its
`Review notes` table as findings, and the marker ask is retired.
- #4065: host secret files are claimed by their owner's registry short
name, and `scaffold` lists every file whose first field names none.

Fixes #1147
Fixes #4049
Fixes #3922
Fixes #3920
Fixes #3938
Fixes #4002
Fixes #3875
Fixes #3893
Fixes #798
Fixes #3959

#1071 stays open, narrowed to reading a billing-failure notice as a
refusal.

🤖 Generated with [Claude Code](https://claude.com/claude-code)


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

<!-- coderabbit-ai-generated:v1 -->

## Summary by CodeRabbit

* **Improvements**
* Pull request review reports now include findings across review pages
and recognize findings listed in review notes. Coverage reporting no
longer depends on a findings count, and incomplete file coverage can be
explained in the review.
* Lint tasks now use a shared runner. Completed or abandoned runs are
less likely to leave temporary snapshots behind.
* **Documentation**
* Updated guidance clarifies repository audits, line-ending conversions,
resync and standup steps, review coverage, and secret-file naming.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants