fold/tests/benchmarks/projects/yams_source.json
trvon 21ff1799c5
Some checks failed
build / build-linux (push) Failing after 7m52s
build / build-macos (push) Has been cancelled
build / release (push) Has been cancelled
bench: calibrate yams wall gate to measured machine variance
Round 4, iteration 2 of the fold optimization loop
(docs/research/optimization-loop-2026-07-30.md).

The yams wall-regression gate at 20% fired on a 113% concurrent-load
swing (8.1s -> 17.3s on identical code) and passed quiet at -11% —
with measured identical-code walls of 7.2-11.4s (quiet) and 17.3s
(loaded), a 20% threshold on a ~9s workload is noise-dominated and
flaky. A flaky gate is worthless as a regression oracle.

Calibrated to 50%: fires above 12.15s sustained (50% over the 8.10s
baseline) — catches true 2x regressions while tolerating the measured
40-113% machine swings. Validated: yams eval ok (7.37s vs 8.104s
baseline, -9%), gold precision/recall 1.0, full suite 137/137.
Fingerprints exactly preserved.
2026-08-31 18:37:50 -06:00

33 lines
933 B
JSON

{
"schema_version": 1,
"project": "yams",
"lane": "source",
"corpus": {
"path": "../../../../yams",
"compile_db": "../../../../yams/build/release/compile_commands.json",
"missing_corpus": "skip"
},
"analysis": {
"scopes": ["quality", "redundancy"],
"path_regex": "/(connection_pool|content_index_writer)\\.cpp$",
"exclude_regex": "(^|/)(third_party|subprojects|generated)(/|$)|(^|/)proto_serializer\\.cpp$",
"max_tus": 0,
"processes": 2,
"budget_seconds": 60,
"per_query_ms": 2000,
"per_tu_timeout": 60
},
"evaluation": {
"repeats": 2,
"dispositions": "../yams/metadata_dispositions.json",
"gold": "../../../bench/gold/yams_self_gold.json",
"gold_thresholds": {
"precision": 1.0,
"recall": 1.0
},
"baseline": "baselines/yams_source.json",
"wall_regression_pct": 50.0,
"rss_regression_pct": 20.0,
"z3_timeout_budget": 0
}
}