fold/tests/benchmarks/projects/chromium_source.json
trvon af66058f3a
Some checks failed
build / build-linux (push) Failing after 7m32s
build / build-macos (push) Has been cancelled
build / release (push) Has been cancelled
bench: wire chromium + sage corpora as stress/diversity manifests
Backlog #5 (operator-confirmed). chromium_source.json and
sage_rust.json were validated but unwired. This adds:

- reviewed dispositions (5 parallel review subagents): chromium 11
  (10 FP/1 accepted-risk — deliberate modular arithmetic in
  base/file_path.cc); sage 2714 (9 actionable uncontained path-join
  reads in skill install/daemon library/model-downloader; 890 FP;
  1815 accepted-risk quality bulk)
- wall/RSS baselines for both corpora

Measured both corpora produce finding drift run-to-run (chromium Z3
fingerprint drifts; sage +5 findings) and chromium's wall swings up
to ~2x under load — so they are wired as STRESS/DIVERSITY corpora:
a new additive evaluation.max_new_findings override lets a manifest
declare its finding-drift tolerance (CLI default unchanged for
fold/yams), allow_finding_drift is on, and chromium's wall/RSS
thresholds are relaxed. Final: both evals pass.

Also fixes a pre-existing /tmp-literal default (now platform tempdir)
in run_project_eval.py.
2026-09-01 19:07:46 -06:00

38 lines
No EOL
1 KiB
JSON

{
"schema_version": 1,
"project": "chromium",
"lane": "source",
"corpus": {
"path": "../../../../chromium/src",
"compile_db": "../../../../chromium/src/compile_commands.json",
"missing_corpus": "skip"
},
"analysis": {
"detectors": [
"null-deref",
"div-by-zero",
"int-overflow",
"oob",
"use-after-free",
"uninit-read"
],
"path_regex": "/(base/(files|memory|strings)|net/(base|http)|services/network|url)/.*\\.cc$",
"exclude_regex": "(^|/)(third_party|out|gen|test|tests)(/|$)|(_test|_unittest|_fuzzer)\\.cc$",
"max_tus": 8,
"processes": 2,
"budget_seconds": 180,
"per_query_ms": 6000,
"per_tu_timeout": 180
},
"evaluation": {
"repeats": 1,
"z3_timeout_budget": 4,
"min_functions": 1,
"dispositions": "../chromium/source_dispositions.json",
"baseline": "baselines/chromium_source.json",
"wall_regression_pct": 200.0,
"rss_regression_pct": 100.0,
"allow_finding_drift": true,
"max_new_findings": 4
}
}