a016268e1f
Round 3, iteration 2 of the fold optimization loop
(docs/research/optimization-loop-2026-07-30.md).
The foundation audit found both manifests declaring
wall_regression_pct/rss_regression_pct with no baseline artifacts —
the regression gates never engaged in the entire campaign.
New: tests/benchmarks/projects/baselines/{fold_source,yams_source}.json
(full prior-eval summaries with matching tu-set/config fingerprints
and exact finding fingerprints). Both manifests now reference their
baselines, activating the eval's baseline-compare path
(compare_performance_lanes + rss_regression).
Engage proof:
- fold: baseline_comparison engaged (paired-by-repetition, baseline
103.65s vs candidate 82.7s, -20.2%), status ok
- yams: gate FIRED on a 113% concurrent-load swing (proving it
discriminates), then passed quiet (7.181s vs 8.104s)
Also extends the schema-test prune to {runs, baselines} — third
instance of the same glob-sweep fragility the foundation audit
predicted. Full suite 137/137; fingerprints exactly preserved
(0fec78e5.../247523c5...); gold precision/recall 1.0 both.
43 lines
1.1 KiB
JSON
43 lines
1.1 KiB
JSON
{
|
|
"schema_version": 1,
|
|
"project": "fold",
|
|
"lane": "source",
|
|
"corpus": {
|
|
"path": "../../..",
|
|
"compile_db": "../../../build/release/compile_commands.json",
|
|
"missing_corpus": "fail"
|
|
},
|
|
"analysis": {
|
|
"detectors": [
|
|
"clone",
|
|
"unused-function",
|
|
"uninit-read",
|
|
"hardcoded-credential",
|
|
"use-after-move",
|
|
"sql-injection"
|
|
],
|
|
"path_regex": "/src/(cli/tu_security_prefilter|detect/clone|detect/hardcoded_credential|detect/sql_injection|frontend/subprocess|index/store|symbolic/function_effects|symbolic/loop_inventory)\\.cpp$",
|
|
"max_tus": 0,
|
|
"processes": 1,
|
|
"budget_seconds": 60,
|
|
"per_query_ms": 2000,
|
|
"per_tu_timeout": 60
|
|
},
|
|
"evaluation": {
|
|
"repeats": 2,
|
|
"dispositions": "../fold/source_dispositions.json",
|
|
"gold": "../../../bench/gold/fold_self_gold.json",
|
|
"gold_thresholds": {
|
|
"precision": 1.0,
|
|
"recall": 1.0
|
|
},
|
|
"baseline": "baselines/fold_source.json",
|
|
"wall_regression_pct": 20.0,
|
|
"rss_regression_pct": 20.0,
|
|
"stability": {
|
|
"max_churn": 0,
|
|
"min_pairwise_jaccard": 1.0
|
|
},
|
|
"z3_timeout_budget": 0
|
|
}
|
|
}
|