yams/tests/unit/search
Trevon 08322369cb
Search/grep UX, runtime hardening, and CI stabilization (#39)
* test(storage): add crash-replay and handle-failure coverage for ReferenceCounter

Adds 6 test cases:
- Recovery after forced close preserves committed data
- Uncommitted transaction rolled back after forced close
- Corrupted database file rejected on open
- Consistent stats after interrupted commit recovery
- Multiple PENDING transactions survive force close
- WAL checkpoint survives forced close

* fix(ci): remove ccache — conflicts with OpenBLAS ASM as direct compiler

* fix(ci): use explicit CC/CXX paths to prevent Conan from using ccache directly

ccache was picked up by Conan/CMake as the compiler itself (/usr/bin/ccache)
rather than as a transparent wrapper, causing OpenBLAS ASM compilation to fail
with 'ccache: invalid option -- D'. Setting explicit compiler paths prevents this.

* fix(ci): add YAMS_SKIP_CCACHE to avoid OpenBLAS ASM ccache conflict

setup.sh wraps CC/CXX with ccache for faster incremental builds, but
this causes Conan/CMake to use ccache directly as the ASM compiler for
OpenBLAS, where it fails on -D flags. Add an opt-out gate in setup.sh
and set YAMS_SKIP_CCACHE=1 in .build.yml for sourcehut CI VMs.

* fix(ci): add libomp-dev, libfaiss-dev, libopenblas-dev for FAISS build

* fix(ci): limit meson compile to -j1 to prevent OOM on sourcehut VMs

* fix(build): restore hooks and shrink srht

Compile the storage library with YAMS_TESTING in test builds so
debug-only hooks link again.

Include the POSIX chmod header used by the storage utility
Catch2 coverage cases.

Prune SourceHut fallback stage archives to runtime files so
branch artifacts stay under the upload limit.

* refactor(storage): drop dead code, add coverage

* refactor(cli): polish grep/search graph UX

* fix(daemon): stabilize shutdown and CI paths

- force vector-backed tests to opt out of CI-wide disable flags
- reset reference prune statements between deletes
- make optional-plugin and POSIX-only test assumptions portable
- extract ServiceManager open/shutdown helpers for safer WAL recovery work

* test(daemon): add db vacuum coverage

* test(daemon): add WAL startup recovery

- cover stale WAL startup recovery in ServiceManager
- cover repeated restart cycles with seeded WAL sidecars
- assert daemon recovery reporting for corrupt data-dir DBs
- verify oversized metadata DBs shrink after WAL recovery shutdown

* refactor(grep): consolidate indexed content scan

* fix(grep): remove pre-scan candidate truncation

* refactor(runtime): split startup, harden storage

* feat(bench): add manifest retrieval corpus

* fix(bench): run fusion experiment on simeon

* fix(cli): sharpen search graph hints

* fix(build): refresh version metadata

* fix(ci): stabilize sync search and srht packaging

* fix(ci): unblock windows and shrink artifacts

* fix(ci): stabilize linux runtime checks

* fix(build): shrink srht manifest
2026-05-27 12:15:17 -04:00
..
benchmark_history_store_catch2_test.cpp fix(tests): use portable getpid shim 2026-05-20 15:54:13 -04:00
chunk_coverage_catch2_test.cpp running linter 2025-12-13 16:27:07 -05:00
corpus_stats_search_integration_test.cpp fix(tests): use portable getpid shim 2026-05-20 15:54:13 -04:00
entity_linker_catch2_test.cpp running linter 2025-12-13 16:27:07 -05:00
graph_expansion_catch2_test.cpp feat: installation tests and build improvements. Test fixes related to optimizations for reranker 2026-04-08 14:01:18 -04:00
hotzone_manager_catch2_test.cpp fix(ci): stabilize PR checks 2026-05-21 16:18:08 -04:00
hybrid_search_comprehensive_test.cpp fix(tests): use portable getpid shim 2026-05-20 15:54:13 -04:00
internal_benchmark_catch2_test.cpp feat: fixes for repair batching logic, hnsw rebuild and search refinements before graph building improvements land 2026-04-04 20:06:12 -04:00
kg_scorer_simple_catch2_test.cpp ingestion optimizations, continued test migrations 2025-12-12 12:50:56 -05:00
lexical_scoring_catch2_test.cpp Stabilize daemon recovery and vector reconciliation (#36) 2026-05-23 21:21:55 -04:00
parallel_post_processor_catch2_test.cpp feat: Improving search speed for hybrid engine. Trying best to balance speed and precision 2026-04-10 17:30:21 -04:00
query_concept_extractor_catch2_test.cpp test: cover factory helpers 2026-05-20 10:50:41 -04:00
query_helpers_catch2_test.cpp fix(ci): stabilize tests and coverage 2026-05-21 09:26:43 -04:00
query_literal_extractor_catch2_test.cpp fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
query_parser_catch2_test.cpp feat: fuzzing and config expansion. Moving to optimizing ingestion. Adding tunable embedding (chunk size etc.) 2026-02-11 23:21:26 -05:00
query_qualifiers_catch2_test.cpp running linter 2025-12-13 16:27:07 -05:00
query_router_catch2_test.cpp feat: search / grep freshness and query intent router improvements. Test improvements 2026-04-14 13:37:41 -04:00
relevance_label_store_catch2_test.cpp fix(tests): use portable getpid shim 2026-05-20 15:54:13 -04:00
result_fusion_catch2_test.cpp test: expand storage-readiness coverage — 48.1%→59.8% broad, 74.3% narrow (#38) 2026-05-25 22:58:15 -04:00
result_ranker_catch2_test.cpp feat: bug fixes in daemon lifecycle, cleaning up tests and resolving test failures 2026-02-17 11:04:22 -05:00
retrieval_benchmark_support_catch2_test.cpp Search/grep UX, runtime hardening, and CI stabilization (#39) 2026-05-27 12:15:17 -04:00
search_engine_config_catch2_test.cpp test: expand storage-readiness coverage — 48.1%→59.8% broad, 74.3% narrow (#38) 2026-05-25 22:58:15 -04:00
search_engine_simeon_lexical_catch2_test.cpp test: expand storage-readiness coverage — 48.1%→59.8% broad, 74.3% narrow (#38) 2026-05-25 22:58:15 -04:00
search_engine_topology_catch2_test.cpp Search/grep UX, runtime hardening, and CI stabilization (#39) 2026-05-27 12:15:17 -04:00
search_filters_catch2_test.cpp fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
search_results_catch2_test.cpp fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
search_smoke_catch2_test.cpp ingestion optimizations, continued test migrations 2025-12-12 12:50:56 -05:00
search_tracing_catch2_test.cpp feat: further removing hnsw references and centralizing on simeon pq implementation 2026-04-22 01:10:57 -04:00
search_tuner_catch2_test.cpp test: expand storage-readiness coverage — 48.1%→59.8% broad, 74.3% narrow (#38) 2026-05-25 22:58:15 -04:00
search_vector_pipeline_catch2_test.cpp test: expand storage-readiness coverage — 48.1%→59.8% broad, 74.3% narrow (#38) 2026-05-25 22:58:15 -04:00
simeon_bandit_backend_catch2_test.cpp feat(search): add Simeon bandit tuning (#33) 2026-05-17 04:08:50 -04:00
simeon_bandit_catch2_test.cpp feat(search): add Simeon bandit tuning (#33) 2026-05-17 04:08:50 -04:00
simeon_lexical_backend_catch2_test.cpp test: expand storage-readiness coverage — 48.1%→59.8% broad, 74.3% narrow (#38) 2026-05-25 22:58:15 -04:00
topological_quality_catch2_test.cpp feat: expanding topology instrumentation to expose quality of clusters, cli ux improvements and expanded modifiers 2026-04-23 21:28:35 -04:00
tuning_features_catch2_test.cpp feat: further search improvements and daemon sleep fixes. Commit before service manager refactor/cleanup 2026-04-15 21:50:03 -04:00
tuning_slot_catch2_test.cpp feat: improved search fusion logic and tuning parameters. CI improvements, reverting to push with wrangler in CI. Experimenting with vector rebuild to address additional lost overhead in search 2026-05-05 08:58:20 -04:00