Commit graph

219 commits

Author SHA1 Message Date
trvon
c7c48e8934
removed hnsw vector manager. search optimizations 2026-01-05 23:39:18 -05:00
trvon
d7271b16a7
tests: Fix cross-platform integration test failures
- Add runLoop thread to GrepServiceExpectationsIT for request processing
- Increase daemon startup timeout to 15s for CI environments
- Add settling time after daemon Ready state
- Add BEIR dataset infrastructure for SciFact benchmark
2026-01-04 15:25:08 -05:00
trvon
485c413174
v0.7.11 staging 2026-01-03 00:17:21 -05:00
trvon
94d89fe0d5
bug fixes, test updates and ci improvements for TSAN test runs 2026-01-01 13:52:52 -05:00
trvon
a7e44a9d57
additional bug fixes and language extraction expansions 2025-12-31 19:20:06 -05:00
trvon
5eadb107d4
test improvements and search bugs fixes 2025-12-31 18:46:32 -05:00
trevon
ee87296eba
ui improvements, download bug fixes, updated tests and new graph tools 2025-12-29 23:45:54 -05:00
trevon
b1acc52040
watch additions and new tests 2025-12-29 03:14:16 -05:00
trvon
01b5cfd190
yams-u2m: sync vector_db readiness 2025-12-23 13:04:20 -05:00
trevon
df75484d89
search bug fixes and ingestion optimizations 2025-12-22 13:16:16 -05:00
trevon
5656833b46
embeddings fix 2025-12-22 01:07:38 -05:00
trevon
ab7bde5e02
ci improvements, UI consistency updates and performance tuning 2025-12-21 21:53:57 -05:00
trevon
492e7ed5dd
graph improvements and plugin fixes for windows 2025-12-20 16:46:46 -05:00
trevon
2e687eef79
docs improvements, tuning manager now scales postingestqueue, stats exposed in yams stats 2025-12-20 13:36:59 -05:00
trevon
23aa8a8f82
adding .gitignore support on add. Cleaning up gitmodules for cloudflare site builds 2025-12-20 12:08:25 -05:00
trevon
248ee037ba
plugin improvements. continued gtest -> catch2 test migration 2025-12-19 22:27:31 -05:00
trevon
7ad3f6f784
graph optimizations and cleanup. CI improvements for submodules 2025-12-18 13:04:57 -05:00
trevon
31cee85340
graph improvments and symbol extraction optimizatoins 2025-12-18 00:21:25 -05:00
trevon
efb2ca4375
symbol extraction bug fixes 2025-12-17 16:08:14 -05:00
trevon
b82a3ccd36
grammar and symbol extractor bug fixes 2025-12-13 14:50:44 -05:00
trevon
0ab2bb2b36
ingestion optimizations, continued test migrations 2025-12-12 12:50:56 -05:00
trevon
e47142343e
updating tests / completing catch2 migration. plugin trust fixes 2025-12-12 10:58:48 -05:00
trevon
e60e82c4f0
improvements for v0.7.10 2025-12-11 22:07:22 -05:00
trevon
196c80fdb9
checkpoint. working on session work. Plugin updates and merge fixes 2025-12-10 01:03:43 -05:00
trvon
069c9116f0
bug fixes, linter run and improvements staging v0.7.10 2025-12-03 15:11:09 -05:00
trevon
70be470ce8
bug fixes and external plugin support for other languages 2025-12-03 14:16:35 -05:00
trevon
d24a961e2e
checkpoint system, removed hybrid search engine after its been deprecated, build updates 2025-12-02 15:21:31 -05:00
trevon
cbbc191f2f
updating documentation for previous changes 2025-12-02 12:08:24 -05:00
trevon
c4e8099f07
improvements for daemon service management 2025-12-02 12:03:40 -05:00
trevon
a7c61f9313
init updates, model defaults changes and stats improvements 2025-11-29 23:08:37 -05:00
trevon
1de9e31a58
cleaning up tests and exposing windows packaging and builds in ci 2025-11-27 10:54:09 -05:00
trevon
3b58ac1743
test stabilizations for windows. search metadata/tags improvements 2025-11-26 21:45:50 -05:00
trevon
ebe81823db
improvements for daemon lifecycle, tree repair, and mcp regression 2025-11-26 14:22:35 -05:00
trevon
e6991b4813
Merge branch 'main' of https://github.com/trvon/yams 2025-11-25 10:41:19 -05:00
trevon
244cf02822
windows build stable on dev machine 2025-11-23 23:22:30 -05:00
trvon
c4c42e0266
additional streaming fixes for idle daemons 2025-11-18 16:16:39 -05:00
trvon
f6b8334371
removing working pool and daemon cleanup 2025-11-16 22:42:56 -05:00
trvon
5b23afa99d
adding dedicate graph component for graph operations, updating socket stale logic and fixing CI issues in release. 2025-11-16 13:31:04 -05:00
trvon
41bb390be9
hot fix v0.7.9 2025-11-15 11:02:30 -05:00
trvon
d9c7b14208
bug fixes. v0.7.8 2025-11-14 20:26:09 -05:00
trvon
2913adcd20
pre-release v0.7.8 2025-11-14 11:58:19 -05:00
trvon
b06e9335b9
staging v0.7.8. running benchmarks on updated search engine and improving code for testing/benchmarking 2025-11-13 10:27:10 -05:00
trvon
ebd0701054
search and retrieval optimizations leveraging parallel processing introduced with grep 2025-11-09 08:42:21 -05:00
trvon
c1d6a992fc
feat(search): implement parallel post-processing (PBI-001 Phase 3)
Parallel Post-Processor with Threshold-Based Activation
--------------------------------------------------------
- New ParallelPostProcessor class (120 lines header, 247 lines impl)
- Uses std::async for concurrent facet/highlight/snippet generation
- Threshold = 100 results (sequential below, parallel at/above)
- Facets now operate on filtered results (fixed data flow bug)

Performance Results (100 iterations)
------------------------------------
- 100 results: 0.06ms (~1.66M ops/sec) - sequential path
- 500 results: 0.23ms (~2.21M ops/sec) - parallel path
- 1000 results: 0.43ms (~2.32M ops/sec) - parallel path
- Speedup: ~3.4x faster at 1000 results

Test Coverage
-------------
- 5 unit tests (threshold behavior, facets, snippets, edge cases)
- All tests passing (5/5 ✅)
- 3 benchmarks added to search_benchmarks.cpp

Files Changed
-------------
- include/yams/search/parallel_post_processor.hpp (NEW)
- src/search/parallel_post_processor.cpp (NEW)
- src/search/search_executor.cpp (integrated)
- tests/unit/search/search_executor_test.cpp (+6 tests)
- tests/benchmarks/search_benchmarks.cpp (+3 benchmarks)
- CHANGELOG.md (documented with measured results)
- docs/delivery/001/prd.md (Phase 3 → ✅ COMPLETED)

Technical Details
-----------------
- Parallel path: filtering → parallel(facets + highlights) → wait
- Sequential path: identical logic, no std::async overhead
- Correctness preserved: identical output to previous sequential impl
- Build: 46/46 targets compiling successfully
2025-11-09 08:04:15 -05:00
trvon
66825f8219
grep bug fixes and performance improvements 2025-11-09 02:24:07 -05:00
trvon
4cad9a8152
mcp fix and ci / repo updates 2025-11-07 15:51:23 -05:00
trvon
4702a345ad
ci fixes, test updates and documentation imrpovements 2025-11-07 13:20:58 -05:00
trvon
eba47216a3
search engine improvements 2025-11-07 11:08:32 -05:00
trvon
0cd1bd0b4c
stabilizations. removing http as I am not using it. Focusing on streamlining build and system 2025-11-05 10:52:27 -05:00
trvon
97cfe741e5
clang tidy fixes and macos crash fix 2025-11-04 18:31:58 -05:00