trvon
e39273a207
fix: fixing repair regression
2026-02-16 19:47:28 -05:00
trvon
be77f1f4d3
feat: additional test improvements, improved logic for ingestion queue to increase throughput and client stability
2026-02-16 18:13:54 -05:00
trvon
33821d93f1
feat: test hardening, added benchmark for multiclient and improve stability to support up to 16 clients before performance degrades, improved parallization and request handling in daemon ingestion pipeline
2026-02-16 15:46:16 -05:00
trvon
94a49472f1
feat: fixing bug with multiple processes access gpu, read/write pools now added in metadata repository, and updated plugins for opencode and vscode
2026-02-14 18:16:57 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work
2026-02-11 12:07:08 -05:00
trvon
ff77c6b304
fix: improving socket and chunking reliability and robustness. Added better regression tests and errror logging logic for state connections
2026-02-10 12:25:30 -05:00
trvon
1d255d59ce
feat: address bugs with scaling, batching in daemon processing
2026-02-09 17:07:00 -05:00
trvon
cc1212bb1f
fix: fixing pipeline ingestion of kg and embeddings. Still finding stalls and will continue to investigate
2026-02-09 10:39:48 -05:00
trvon
0c8ffea321
feat: improving ingestion speed with kg batch and updating metrics to use constexpr
2026-02-09 01:33:24 -05:00
trvon
3101780fe2
feat: adding additional benchmark and validating onnxruntime model usage for embedding generations. Should be much faster
2026-02-08 21:59:14 -05:00
trvon
f4f3c055fe
feat: benchmark expansion and normalization. Imrpoving metrics for repair and models
2026-02-08 20:35:39 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates
2026-02-08 18:33:29 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling
2026-02-07 22:07:56 -05:00
trvon
8a06575a0c
fix: reverted bad change. moved embedding generation to repair coordinator. Still tuning resource usage and governors
2026-02-05 10:21:25 -05:00
trvon
f2a9adbd42
revert: test fixes
2026-02-05 00:09:31 -05:00
trvon
b071112836
feat: test coverage improvements. Scaling bug addresses
2026-02-04 20:20:18 -05:00
trvon
de5abde337
fix: test improvements
2026-02-03 12:49:05 -05:00
trvon
2946b231dd
fix: license header file updates, mcp improvements, windows build fixes
2026-01-30 17:23:33 -05:00
trvon
e309d96414
bug fixes for daemon, ui fixes for grep and search
2026-01-25 22:52:25 -05:00
trvon
d3b50e4dc4
bug fixes for onnx and improving support for larger models. tuning serach engine and expanding module communication via daemon
2026-01-10 01:32:48 -05:00
trvon
b078329bc8
search regressions fixes. removed bktree for symspell
2026-01-07 23:43:12 -05:00
trvon
f780513889
optimizations for data ingestion and search, updating documentation
2026-01-07 17:36:56 -05:00
trvon
027fdc001e
clangd fixes, moved symbol extractor to vectordb, investigating slow vector search performance
2026-01-07 10:38:05 -05:00
trvon
b3d44b9e98
removing deprecated search executor. continuing work for rag benchmarking
2026-01-04 18:29:09 -05:00
trvon
d7271b16a7
tests: Fix cross-platform integration test failures
...
- Add runLoop thread to GrepServiceExpectationsIT for request processing
- Increase daemon startup timeout to 15s for CI environments
- Add settling time after daemon Ready state
- Add BEIR dataset infrastructure for SciFact benchmark
2026-01-04 15:25:08 -05:00
trvon
92ccd287b5
daemon communication imrpovements and bug fixes related to tests
2026-01-02 11:55:58 -05:00
trevon
ee87296eba
ui improvements, download bug fixes, updated tests and new graph tools
2025-12-29 23:45:54 -05:00
trevon
d24a961e2e
checkpoint system, removed hybrid search engine after its been deprecated, build updates
2025-12-02 15:21:31 -05:00
trvon
70e88af608
running linter
2025-11-25 13:10:29 -05:00
trevon
244cf02822
windows build stable on dev machine
2025-11-23 23:22:30 -05:00
trvon
f6b8334371
removing working pool and daemon cleanup
2025-11-16 22:42:56 -05:00
trvon
5b23afa99d
adding dedicate graph component for graph operations, updating socket stale logic and fixing CI issues in release.
2025-11-16 13:31:04 -05:00
trvon
2913adcd20
pre-release v0.7.8
2025-11-14 11:58:19 -05:00
trvon
b06e9335b9
staging v0.7.8. running benchmarks on updated search engine and improving code for testing/benchmarking
2025-11-13 10:27:10 -05:00
trvon
ebd0701054
search and retrieval optimizations leveraging parallel processing introduced with grep
2025-11-09 08:42:21 -05:00
trvon
c1d6a992fc
feat(search): implement parallel post-processing (PBI-001 Phase 3)
...
Parallel Post-Processor with Threshold-Based Activation
--------------------------------------------------------
- New ParallelPostProcessor class (120 lines header, 247 lines impl)
- Uses std::async for concurrent facet/highlight/snippet generation
- Threshold = 100 results (sequential below, parallel at/above)
- Facets now operate on filtered results (fixed data flow bug)
Performance Results (100 iterations)
------------------------------------
- 100 results: 0.06ms (~1.66M ops/sec) - sequential path
- 500 results: 0.23ms (~2.21M ops/sec) - parallel path
- 1000 results: 0.43ms (~2.32M ops/sec) - parallel path
- Speedup: ~3.4x faster at 1000 results
Test Coverage
-------------
- 5 unit tests (threshold behavior, facets, snippets, edge cases)
- All tests passing (5/5 ✅ )
- 3 benchmarks added to search_benchmarks.cpp
Files Changed
-------------
- include/yams/search/parallel_post_processor.hpp (NEW)
- src/search/parallel_post_processor.cpp (NEW)
- src/search/search_executor.cpp (integrated)
- tests/unit/search/search_executor_test.cpp (+6 tests)
- tests/benchmarks/search_benchmarks.cpp (+3 benchmarks)
- CHANGELOG.md (documented with measured results)
- docs/delivery/001/prd.md (Phase 3 → ✅ COMPLETED)
Technical Details
-----------------
- Parallel path: filtering → parallel(facets + highlights) → wait
- Sequential path: identical logic, no std::async overhead
- Correctness preserved: identical output to previous sequential impl
- Build: 46/46 targets compiling successfully
2025-11-09 08:04:15 -05:00
trvon
52d27169c9
re-running lint
2025-11-09 02:24:39 -05:00
trvon
66825f8219
grep bug fixes and performance improvements
2025-11-09 02:24:07 -05:00
trvon
eba47216a3
search engine improvements
2025-11-07 11:08:32 -05:00
trvon
a7c14f54cc
Bug fixes for prune command and test improvements.
2025-11-06 09:13:29 -05:00
trvon
166d8c520d
staging v0.7.7
2025-11-01 16:02:12 -04:00
trvon
61d5074c8b
import and linux fixes for linux builds
2025-10-24 15:03:12 -04:00
trvon
d19a5d7b64
bug fixes and optimizations for v0.7.7. Finalizing tests, benchmarks and bug fixes prior to release
2025-10-24 12:49:00 -04:00
trvon
8d23211af2
improvements for ci, setup.sh and updates to new symbol extraction plugin
2025-10-21 19:38:45 -04:00
trvon
8069318bf2
weekly update staged.
2025-10-18 00:39:19 -04:00
trvon
83fa1ad1ba
v0.7.5 staging and license updates
2025-10-13 17:07:31 -04:00
trvon
72ef838e5d
Merge branch 'main' of github.com:trvon/yams
2025-10-12 08:04:04 -04:00
trvon
4a894911da
testing fixings for ubuntu and grep / search improvements
2025-10-12 08:03:58 -04:00
trvon
08f03c3209
ci fixes for packaging and tests
2025-10-11 19:18:39 -04:00
trvon
3ad7417b1e
ci and other fixes
2025-10-11 14:11:20 -04:00
