trvon
44a94eabe1
feat: fuzzing and config expansion. Moving to optimizing ingestion. Adding tunable embedding (chunk size etc.)
2026-02-11 23:21:26 -05:00
trvon
4ecdbe7d73
fix: moved SocketServer read/write into dedicated IOCoordinator and fixed proxy socket paths resolution logic. Fixed TSAN race in SymSpell init
2026-02-11 14:40:23 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work
2026-02-11 12:07:08 -05:00
trvon
ff77c6b304
fix: improving socket and chunking reliability and robustness. Added better regression tests and errror logging logic for state connections
2026-02-10 12:25:30 -05:00
trvon
00c3a76771
feat: recovery test improvements
2026-02-09 23:27:12 -05:00
trvon
2e966c4f1b
fix: windows build fixes
2026-02-09 23:26:33 -05:00
trvon
7764a0c3c9
fix: ROCM/MIGraphX onnxruntime test validate improvements
2026-02-09 21:22:15 -05:00
trvon
288bb78c89
Merge branch 'main' of github.com:trvon/yams
2026-02-09 20:07:55 -05:00
trvon
fd32c519c5
fix: staging ROCM improvements
2026-02-09 20:07:52 -05:00
trvon
925426426a
feat: expanding mcp UI support, improvements for slots for component usage and other socket server stabilizations
2026-02-09 20:02:26 -05:00
trvon
cd7c698e07
feat: stability improvements for document ingestion
2026-02-09 19:14:45 -05:00
trvon
1d255d59ce
feat: address bugs with scaling, batching in daemon processing
2026-02-09 17:07:00 -05:00
trvon
cc1212bb1f
fix: fixing pipeline ingestion of kg and embeddings. Still finding stalls and will continue to investigate
2026-02-09 10:39:48 -05:00
trvon
0c8ffea321
feat: improving ingestion speed with kg batch and updating metrics to use constexpr
2026-02-09 01:33:24 -05:00
trvon
3101780fe2
feat: adding additional benchmark and validating onnxruntime model usage for embedding generations. Should be much faster
2026-02-08 21:59:14 -05:00
trvon
f4f3c055fe
feat: benchmark expansion and normalization. Imrpoving metrics for repair and models
2026-02-08 20:35:39 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates
2026-02-08 18:33:29 -05:00
trvon
ac843d1e93
Merge branch 'main' of github.com:trvon/yams
2026-02-08 14:06:09 -05:00
trvon
a3522b8b22
fix: expose gpu usage, add command imrpovments and other bug fixes
2026-02-08 14:04:57 -05:00
trvon
c4a7992122
fix: repairmanager, post ingest and pipeline fixes
2026-02-08 14:02:57 -05:00
trvon
430057f4bf
fix: SocketServer slots for proxy and cli requests, fixed tests and increase doctor request handling
2026-02-08 13:02:08 -05:00
trvon
3c09becde5
fix: repair improvements and socketserver hardening
2026-02-07 23:37:32 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling
2026-02-07 22:07:56 -05:00
trvon
c638d9aad4
fix: addressing test compilation issues
2026-02-06 10:37:08 -05:00
trvon
567ee32a99
fix: fixing macos coreml detection
2026-02-06 10:16:35 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files
2026-02-06 04:31:09 -05:00
trvon
ab06614505
fix(repair): fix SIGSEGV crash, embedding failures, and runaway repair loops
...
- Fix writer_drain() SIGSEGV by setting connection_closing_ on write failure
- Add InternalError/ResourceExhausted to embedding retry list
- Fix document-level embedding chunk_id (0→999999) and level mismatch
- Add circuit breaker to bail out after consecutive/rate-threshold failures
- Add semaphore concurrency limiter (max 2) for repair embed requests
- Replace silent catch-all with error-logging catch blocks
2026-02-05 21:15:26 -05:00
trvon
ded16c11d4
improvements of parallel ingestion
2026-02-05 11:51:24 -05:00
trvon
8a06575a0c
fix: reverted bad change. moved embedding generation to repair coordinator. Still tuning resource usage and governors
2026-02-05 10:21:25 -05:00
trvon
f2a9adbd42
revert: test fixes
2026-02-05 00:09:31 -05:00
trvon
b071112836
feat: test coverage improvements. Scaling bug addresses
2026-02-04 20:20:18 -05:00
trvon
14c35926f1
test improvements and bug fixes in parser, scaling logic, and mcp tools
2026-02-04 14:42:28 -05:00
trvon
de5abde337
fix: test improvements
2026-02-03 12:49:05 -05:00
trvon
29de453020
fix: mcp improvements for grep and search, improving helper usage
2026-02-02 03:28:52 -05:00
trvon
79ea83eac8
fix: test fixes annd windows build downgrade to c++20
2026-02-02 02:15:09 -05:00
trvon
a8a9c74b31
fix: ci fixes for test compilation
2026-02-01 19:24:19 -05:00
trvon
747adbc62c
fix: mcp update
2026-02-01 14:11:35 -05:00
trvon
73b7d1eabb
fix: compiler issues addressed and homebrew updates
2026-01-31 21:52:13 -05:00
trvon
0049dbe900
fix: windows build fixes
2026-01-31 18:23:15 -05:00
trvon
8835d6704e
fix: removing mobile bindings from builds
2026-01-31 17:15:25 -05:00
trvon
e12b299fca
Merge branch 'experimental'
2026-01-31 01:31:41 -05:00
trvon
46aa12c0fd
fix: performance tuning improvements, windows build fixes and other improvements
2026-01-31 01:01:52 -05:00
trvon
12c039c33a
mcp tool exposure
2026-01-30 17:55:50 -05:00
trvon
2946b231dd
fix: license header file updates, mcp improvements, windows build fixes
2026-01-30 17:23:33 -05:00
trvon
33b83aeb53
fix: fixing windows head ordering, reducing complexity in mcp server (debugging opencode, claude, droid failed to list tools issues)
2026-01-30 09:57:27 -05:00
trvon
0614229387
fix: onnx pool model scaling improvements, test fixes and UX improvements
2026-01-29 23:18:50 -05:00
trvon
96f19e2cd2
feat: mcp ui work and stabiliizations
2026-01-29 16:55:21 -05:00
trvon
1e50b0c531
Improve daemon shutdown reliability and timeout handling
...
SocketServer:
- Increase connection handler wait timeout from 100ms to 2s
- Increase accept loop wait timeout from 500ms to 3s
- Prevents race conditions where handlers are cancelled mid-operation
WorkCoordinator:
- Replace thread detach with extended join attempt
- Prevents use-after-free from detached threads accessing freed resources
Daemon Command:
- Increase shutdown wait timeout from 3s to 6s
- Increase default waitForDaemonStop timeout from 5s to 10s
- Allows time for graceful SocketServer shutdown
These changes address SIGABRT and SIGTERM issues during daemon shutdown
by ensuring async operations complete before resources are freed.
2026-01-29 11:55:07 -05:00
trvon
b81040bffa
Update ONNX tuning tests for new profile scale values
...
Profile scale values changed to:
- Efficient: 0.0 (minimum 2 slots)
- Balanced: 0.5
- Aggressive: 1.0
Updated all test expectations accordingly.
2026-01-29 10:35:13 -05:00
trvon
c012adc03a
Fix client timeout recovery tests - add missing error message keywords
...
The tests were checking for specific error message keywords that didn't
cover all possible error scenarios:
- Added 'pipe' and 'shutdown' for cancellation errors
- Added 'establish' for connection refused errors
These keywords cover 'Broken pipe' and 'Failed to establish connection'
error messages that occur during daemon shutdown.
2026-01-29 09:39:08 -05:00
