Add negative_cases_from_universe to expand an explicit file-by-rule universe into labeled negatives (enabling TP/FP/TN/FN, not just TP/FP), plus project-eval harness updates in run_project_eval and the score/score_fp/quality-gate helpers.
11 lines
484 B
JSON
11 lines
484 B
JSON
{
|
|
"name": "binary-security-cwe",
|
|
"description": "Binary-lane CWE testcase gold: each compiled ELF maps to the expected finding kind (or clean-negative).",
|
|
"expected": [
|
|
{"kind": "oob-access", "files": ["cwe121_bof.elf"]},
|
|
{"kind": "div-by-zero", "files": ["cwe369_div0.elf"]},
|
|
{"kind": "int-overflow","files": ["cwe190_overflow.elf"]},
|
|
{"kind": "null-deref", "files": ["cwe476_nullderef.elf"]},
|
|
{"kind": "use-after-free","files": ["cwe416_uaf.elf"]}
|
|
]
|
|
}
|