Skip to content

ci: adopt strict benchmark collector and quiet Saga logging - #1039

Merged
intel352 merged 1 commit into
mainfrom
fix/benchmark-collector-adopt
Oct 8, 2026
Merged

intel352 merged 1 commit into
mainfrom
fix/benchmark-collector-adopt

Conversation

@intel352

@intel352 intel352 commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

Saga log messages interrupt BenchmarkSagaConcurrent measurements, and the previous collector can accept incomplete comparison output. This change discards logging in that benchmark and adopts the staged strict collector. It validates raw measurements, six samples per series, configuration and CPU identity, and the complete comparison before accepting a result. Raw results and restored baselines remain available as artifacts; the standard baseline cache key and save path are unchanged.

The exact two-file candidate is bd4b736165a5cb64f332bc04f6ea180bfbfc4ca7, based on accepted Task15 main 15683f0da55359716c2aa6893c0ad796dccc011c. The full local reference/candidate pair passed strict validation and the existing regression threshold. Native Go1.27.1 analysis covered all 14 modules, retaining the two approved fixture errors and the same 59 residual findings. macOS and Linux each passed all 350 policy tests; trusted scans, static checks and the repaired fixture harness passed. The original harness's exact EVENT_NAME: unbound variable B2 failure remains recorded.

Hosted candidate output contains all 240 valid measurements. The hosted comparison rejects the retained Task15 baseline's Saga log output, so no hosted comparison or regression clearance is claimed. That exact legacy-baseline failure and the existing B2 failure use the previously approved narrow dispositions; no CPU, configuration, sample-count, regression or vulnerability exception is added.

After merge, the existing main workflow must save a complete valid baseline at go-benchmark-main-<actual-merge-sha>. A fresh Task3 PR must restore those hash-identical raw bytes and pass its full strict comparison before Task3 merges. Actual-main, snapshot and image acceptance remain required.

@intel352
intel352 marked this pull request as ready for review October 8, 2026 06:58
@intel352
intel352 merged commit f043410 into main Oct 8, 2026
23 of 25 checks passed
@intel352
intel352 deleted the fix/benchmark-collector-adopt branch October 8, 2026 07:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant