trvon
|
12fc1b8a50
|
resolved concurrency bugs in daemon. added fuzzing work in progress per issue #8
|
2025-11-11 10:10:07 -05:00 |
|
trvon
|
ebd0701054
|
search and retrieval optimizations leveraging parallel processing introduced with grep
|
2025-11-09 08:42:21 -05:00 |
|
trvon
|
c1d6a992fc
|
feat(search): implement parallel post-processing (PBI-001 Phase 3)
Parallel Post-Processor with Threshold-Based Activation
--------------------------------------------------------
- New ParallelPostProcessor class (120 lines header, 247 lines impl)
- Uses std::async for concurrent facet/highlight/snippet generation
- Threshold = 100 results (sequential below, parallel at/above)
- Facets now operate on filtered results (fixed data flow bug)
Performance Results (100 iterations)
------------------------------------
- 100 results: 0.06ms (~1.66M ops/sec) - sequential path
- 500 results: 0.23ms (~2.21M ops/sec) - parallel path
- 1000 results: 0.43ms (~2.32M ops/sec) - parallel path
- Speedup: ~3.4x faster at 1000 results
Test Coverage
-------------
- 5 unit tests (threshold behavior, facets, snippets, edge cases)
- All tests passing (5/5 ✅)
- 3 benchmarks added to search_benchmarks.cpp
Files Changed
-------------
- include/yams/search/parallel_post_processor.hpp (NEW)
- src/search/parallel_post_processor.cpp (NEW)
- src/search/search_executor.cpp (integrated)
- tests/unit/search/search_executor_test.cpp (+6 tests)
- tests/benchmarks/search_benchmarks.cpp (+3 benchmarks)
- CHANGELOG.md (documented with measured results)
- docs/delivery/001/prd.md (Phase 3 → ✅ COMPLETED)
Technical Details
-----------------
- Parallel path: filtering → parallel(facets + highlights) → wait
- Sequential path: identical logic, no std::async overhead
- Correctness preserved: identical output to previous sequential impl
- Build: 46/46 targets compiling successfully
|
2025-11-09 08:04:15 -05:00 |
|
trvon
|
52d27169c9
|
re-running lint
|
2025-11-09 02:24:39 -05:00 |
|
trvon
|
66825f8219
|
grep bug fixes and performance improvements
|
2025-11-09 02:24:07 -05:00 |
|
trvon
|
d491081bd4
|
v0.7.7 re-release
|
2025-11-08 09:43:48 -05:00 |
|
trvon
|
4702a345ad
|
ci fixes, test updates and documentation imrpovements
|
2025-11-07 13:20:58 -05:00 |
|
trvon
|
65bdf3dac8
|
CI bug fixes
|
2025-11-07 11:37:02 -05:00 |
|
trvon
|
d989da66dd
|
fixing prune command and tests fixes
|
2025-11-06 12:19:08 -05:00 |
|
trvon
|
1366eeeb1d
|
test fix
|
2025-11-06 09:14:41 -05:00 |
|
trvon
|
a7c14f54cc
|
Bug fixes for prune command and test improvements.
|
2025-11-06 09:13:29 -05:00 |
|
trvon
|
b9d73ea60e
|
additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted
|
2025-11-04 14:43:42 -05:00 |
|
trvon
|
166d8c520d
|
staging v0.7.7
|
2025-11-01 16:02:12 -04:00 |
|
trvon
|
bbf23bb190
|
test migrations to catch2, service manager + socket server refactor for better startup performance. search bug fixes
|
2025-10-29 23:08:09 -04:00 |
|
trvon
|
d19a5d7b64
|
bug fixes and optimizations for v0.7.7. Finalizing tests, benchmarks and bug fixes prior to release
|
2025-10-24 12:49:00 -04:00 |
|
trvon
|
8d23211af2
|
improvements for ci, setup.sh and updates to new symbol extraction plugin
|
2025-10-21 19:38:45 -04:00 |
|
trvon
|
b6ca31dfb0
|
adding symbol extraction work, simplying build with ./setup.sh, updated plugin tests with new meson shard and other goodies
|
2025-10-20 16:11:31 -04:00 |
|
trvon
|
8069318bf2
|
weekly update staged.
|
2025-10-18 00:39:19 -04:00 |
|
trvon
|
b25a9f690d
|
v0.7.5
|
2025-10-13 20:07:48 -04:00 |
|
trvon
|
83fa1ad1ba
|
v0.7.5 staging and license updates
|
2025-10-13 17:07:31 -04:00 |
|
trvon
|
4a894911da
|
testing fixings for ubuntu and grep / search improvements
|
2025-10-12 08:03:58 -04:00 |
|
trvon
|
0aa529bd5e
|
improvements, benchmark updates and test improvements
|
2025-10-11 13:32:13 -04:00 |
|
trvon
|
b065e6a2c1
|
v0.7.5
|
2025-10-11 00:34:31 -04:00 |
|
trvon
|
ed676e5fe9
|
v0.7.4
|
2025-10-10 12:51:39 -04:00 |
|
trvon
|
14d87e0f14
|
ci fixes
|
2025-10-08 19:17:11 -04:00 |
|
trvon
|
5bb124a3c1
|
v0.7.3
|
2025-10-08 17:02:37 -04:00 |
|
trvon
|
7b9da100ff
|
v0.7.3 staging
|
2025-10-07 11:18:35 -04:00 |
|
trvon
|
ce3d9d526b
|
PBI-043: Integrate tree_diff benchmarks into nightly CI (Task 043-16)
- Add tree_diff benchmark run step to nightly workflow
- Add regression check against baseline thresholds
- Create baseline file with AC#7 metrics (tree_overhead ≤15%)
- Update artifact uploads to include tree_diff results
Validates:
- AC #2: Diff latency < 750ms p95 (10k entries)
- AC #7: Tree storage overhead ≤ 15%
- Task 043-07: Multi-snapshot dedup metrics
Progress: Task 043-16 in_progress
|
2025-10-07 10:52:11 -04:00 |
|
trvon
|
e04effe2d2
|
fixing conan file so ft5s builds
|
2025-10-04 21:12:19 -04:00 |
|
trvon
|
3ec96a6788
|
diff command improvements and tests updates
|
2025-10-03 10:56:39 -04:00 |
|
trvon
|
72d04f66e0
|
v0.7.2 staging
|
2025-10-03 04:02:52 -04:00 |
|
trvon
|
66f9041b06
|
v0.7.1 staging before test improvement per issue tracking
|
2025-09-29 21:20:30 -04:00 |
|
trvon
|
e586892e06
|
checkpoint. Expanded tests and resolved minor issues with grep, ci/cd and daemon protocol add spec
|
2025-09-29 14:38:04 -04:00 |
|
Trevon
|
ed03770833
|
fixing build regresion and adding additional tests
|
2025-09-28 13:59:58 -04:00 |
|
Trevon
|
b99c8b4593
|
improving add hints for files not found:
|
2025-09-27 21:48:13 -04:00 |
|
Trevon
|
5fd0db37eb
|
test updates and prompt improvements for codex
|
2025-09-27 21:40:47 -04:00 |
|
Trevon
|
19fb4fee75
|
updating, stagging fixes, then will address ci
|
2025-09-27 04:39:58 -04:00 |
|
Trevon
|
54f1364502
|
test flakiness improvements, ci improvements and fixes documented for v0.7.1
|
2025-09-26 06:40:48 -04:00 |
|
Trevon
|
f861fcd961
|
stagging v0.7.0
|
2025-09-25 16:40:56 -04:00 |
|
Trevon
|
20fcaca931
|
ci imrpovements, prompt update and test improvements
|
2025-09-25 12:15:10 -04:00 |
|
Trevon
|
a29ed05d80
|
adding missing header to github, updating github ci warm logic
|
2025-09-25 11:16:00 -04:00 |
|
Trevon
|
0f5b58df48
|
expanding ci platform testes, improving test coverage and resolve platform bugs related to migrated implementations and sanitization
|
2025-09-25 11:06:54 -04:00 |
|
Trevon
|
e39ccefae4
|
test expansion from meson migration and ci improvements
|
2025-09-24 18:42:35 -04:00 |
|
Trevon
|
463bd9c367
|
test improvements, search bug fixes, sourcehut build patches
|
2025-09-24 11:33:55 -04:00 |
|
Trevon
|
9f4c3b734c
|
test framework stabilizations and bug fixes
|
2025-09-23 22:07:22 -04:00 |
|
Trevon
|
d99ef81a16
|
additional merge resolutions and ci fixes
|
2025-09-23 14:25:16 -04:00 |
|
Trevon
|
117927eee0
|
graph improvements before plugin update
|
2025-09-22 10:31:08 -04:00 |
|
Trevon
|
43699f99a3
|
v0.7.0-prerelease
|
2025-09-20 22:55:34 -04:00 |
|
Trevon
|
5c46e592fe
|
v0.6.35
|
2025-09-16 18:59:12 -04:00 |
|
Trevon
|
80b7f84893
|
improvements and bug fixes. v0.6.27
|
2025-09-14 22:55:33 -04:00 |
|