Commit graph

207 commits

Author SHA1 Message Date
trvon
8f38ee76be
feat: updating metrics for search and retrieval for future learning system. Additional tuning for search performance 2026-02-13 21:09:26 -05:00
trvon
11ba59f4bb
feat: updating embedding default checking to paragraph 2026-02-12 11:55:59 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work 2026-02-11 12:07:08 -05:00
trvon
ff77c6b304
fix: improving socket and chunking reliability and robustness. Added better regression tests and errror logging logic for state connections 2026-02-10 12:25:30 -05:00
trvon
00c3a76771
feat: recovery test improvements 2026-02-09 23:27:12 -05:00
trvon
f4f3c055fe
feat: benchmark expansion and normalization. Imrpoving metrics for repair and models 2026-02-08 20:35:39 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates 2026-02-08 18:33:29 -05:00
trvon
c4a7992122
fix: repairmanager, post ingest and pipeline fixes 2026-02-08 14:02:57 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
trvon
567ee32a99
fix: fixing macos coreml detection 2026-02-06 10:16:35 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files 2026-02-06 04:31:09 -05:00
trvon
ab06614505
fix(repair): fix SIGSEGV crash, embedding failures, and runaway repair loops
- Fix writer_drain() SIGSEGV by setting connection_closing_ on write failure
- Add InternalError/ResourceExhausted to embedding retry list
- Fix document-level embedding chunk_id (0→999999) and level mismatch
- Add circuit breaker to bail out after consecutive/rate-threshold failures
- Add semaphore concurrency limiter (max 2) for repair embed requests
- Replace silent catch-all with error-logging catch blocks
2026-02-05 21:15:26 -05:00
trvon
f2a9adbd42
revert: test fixes 2026-02-05 00:09:31 -05:00
trvon
b071112836
feat: test coverage improvements. Scaling bug addresses 2026-02-04 20:20:18 -05:00
trvon
14c35926f1
test improvements and bug fixes in parser, scaling logic, and mcp tools 2026-02-04 14:42:28 -05:00
trvon
de5abde337
fix: test improvements 2026-02-03 12:49:05 -05:00
trvon
29de453020
fix: mcp improvements for grep and search, improving helper usage 2026-02-02 03:28:52 -05:00
trvon
79ea83eac8
fix: test fixes annd windows build downgrade to c++20 2026-02-02 02:15:09 -05:00
trvon
8835d6704e
fix: removing mobile bindings from builds 2026-01-31 17:15:25 -05:00
trvon
33b83aeb53
fix: fixing windows head ordering, reducing complexity in mcp server (debugging opencode, claude, droid failed to list tools issues) 2026-01-30 09:57:27 -05:00
trvon
0614229387
fix: onnx pool model scaling improvements, test fixes and UX improvements 2026-01-29 23:18:50 -05:00
trvon
96f19e2cd2
feat: mcp ui work and stabiliizations 2026-01-29 16:55:21 -05:00
trvon
49aa12fa90
improved tests and mcp improvements 2026-01-29 00:27:07 -05:00
trvon
da12ead280
additional bug fixes 2026-01-24 00:32:05 -05:00
trvon
5af411d45c
test improvements 2026-01-23 23:00:56 -05:00
trvon
c7fb151f3d
skipping v0.7.11 and going straight to v0.8.0. Staging pre-release 2026-01-22 14:21:32 -05:00
trvon
161f3e30e4
cleaning up code 2026-01-21 16:54:16 -05:00
trvon
9267e406bc
adding tuning tests, daemon resource advisor respects profile (efficient, balanced, aggressive), retrieval benchmark fixes 2026-01-20 12:07:30 -05:00
trvon
a8a6559377
dockerfile and ci fixes with improvements for model loading logic 2026-01-19 22:28:30 -05:00
trvon
b7aa881de2
test fixes, reranking model loading improvements 2026-01-18 22:27:30 -05:00
trvon
f40e9cf1be
search bug fixes, and thread sanitization fixes 2026-01-16 23:06:49 -05:00
trvon
eb87c8ec40
reducing ingestion bottlenecks with better batch operations 2026-01-16 19:04:11 -05:00
trvon
a52627050c
logging improvements, test fixes and using old ranking from main 2026-01-15 11:21:51 -05:00
trvon
80ea3ca869
testing improvements 2026-01-14 16:27:42 -05:00
trvon
c7743269b4
bug fixes for model loading logic, dynamic vec table dimensions, cli refactor and search bug fixes 2026-01-08 23:10:58 -05:00
trvon
83bd1b7fc1
updating entity interface and adding new plugin for entity extraction 2026-01-08 15:06:58 -05:00
trvon
b078329bc8
search regressions fixes. removed bktree for symspell 2026-01-07 23:43:12 -05:00
trvon
f32852f4b9
symspell fuzzy index optimization for search 2026-01-07 20:31:11 -05:00
trvon
f780513889
optimizations for data ingestion and search, updating documentation 2026-01-07 17:36:56 -05:00
trvon
0bce48a899
bug fixes, extended tree dedup logic for ingestion, dynamic search engine returning with internal benchmark 2026-01-06 18:57:35 -05:00
trvon
4321f29679
profiling improvements, ft5s bug fixes for retrieval, and benchmark optimizations 2026-01-06 14:57:13 -05:00
trvon
c7c48e8934
removed hnsw vector manager. search optimizations 2026-01-05 23:39:18 -05:00
trvon
b3d44b9e98
removing deprecated search executor. continuing work for rag benchmarking 2026-01-04 18:29:09 -05:00
trvon
052bdaf3e0
ci fixes 2026-01-03 13:13:56 -05:00
trvon
49e3f638bc
improving daemon startup logic, improve repair and doctor cli UX 2026-01-02 13:57:37 -05:00
trvon
92ccd287b5
daemon communication imrpovements and bug fixes related to tests 2026-01-02 11:55:58 -05:00
trvon
94d89fe0d5
bug fixes, test updates and ci improvements for TSAN test runs 2026-01-01 13:52:52 -05:00
trvon
0557c9b33b
test improvements and linter run 2025-12-31 12:51:28 -05:00
trevon
c700f0c686
Merge branch 'main' of https://github.com/trvon/yams 2025-12-30 23:11:47 -05:00
trvon
09a4113085
test improvements 2025-12-30 23:04:01 -05:00