Commit graph

732 commits

Author SHA1 Message Date
trvon
a177027320
fix: house cleaning 2026-02-09 21:12:26 -05:00
trvon
288bb78c89
Merge branch 'main' of github.com:trvon/yams 2026-02-09 20:07:55 -05:00
trvon
fd32c519c5
fix: staging ROCM improvements 2026-02-09 20:07:52 -05:00
trvon
925426426a
feat: expanding mcp UI support, improvements for slots for component usage and other socket server stabilizations 2026-02-09 20:02:26 -05:00
trvon
cd7c698e07
feat: stability improvements for document ingestion 2026-02-09 19:14:45 -05:00
trvon
e1975730eb
fix: moving submodule to https 2026-02-09 19:05:40 -05:00
trvon
0c8a5ee451
fix: adding cap at onnx concurrency limit 2026-02-09 17:09:53 -05:00
trvon
1d255d59ce
feat: address bugs with scaling, batching in daemon processing 2026-02-09 17:07:00 -05:00
trvon
cc1212bb1f
fix: fixing pipeline ingestion of kg and embeddings. Still finding stalls and will continue to investigate 2026-02-09 10:39:48 -05:00
trvon
4d6c163c9d
feat: adding drain to constrexpr metrics 2026-02-09 01:45:38 -05:00
trvon
0c8ffea321
feat: improving ingestion speed with kg batch and updating metrics to use constexpr 2026-02-09 01:33:24 -05:00
trvon
c64a0b239d
feat: adding fuzzing updates and fixes in ipc 2026-02-08 22:20:47 -05:00
trvon
b2c6121990
Merge branch 'main' of github.com:trvon/yams 2026-02-08 22:19:55 -05:00
trvon
1e0ca1566c
fix: fixing bind issue when generating large batches in repair 2026-02-08 22:19:15 -05:00
trvon
fa3d15eedf
Merge branch 'main' of github.com:trvon/yams 2026-02-08 22:00:46 -05:00
trvon
3101780fe2
feat: adding additional benchmark and validating onnxruntime model usage for embedding generations. Should be much faster 2026-02-08 21:59:14 -05:00
trvon
f4f3c055fe
feat: benchmark expansion and normalization. Imrpoving metrics for repair and models 2026-02-08 20:35:39 -05:00
trvon
de4cb653e2
Merge branch 'main' of github.com:trvon/yams 2026-02-08 18:49:11 -05:00
trvon
907cddf6d3
feat: fuzzing tooling 2026-02-08 18:48:54 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates 2026-02-08 18:33:29 -05:00
trvon
90dc507951
feat: bump submodule 2026-02-08 15:16:12 -05:00
trvon
6fe735f10c
Merge branch 'main' of github.com:trvon/yams 2026-02-08 14:52:39 -05:00
trvon
1a0667d28f
fix: improving graph repair 2026-02-08 14:51:57 -05:00
trvon
d229d9f20b
chore: update submodules 2026-02-08 14:29:48 -05:00
trvon
1c800e086b
fix: removing claude/skills 2026-02-08 14:28:56 -05:00
trvon
fe003bcfeb
build: update symspell submodule 2026-02-08 14:26:33 -05:00
trvon
fd95eb44f7
Merge branch 'main' of github.com:trvon/yams 2026-02-08 14:18:59 -05:00
trvon
27881ecfbd
docs: update changelog; ignore local artifacts 2026-02-08 14:09:57 -05:00
trvon
ac843d1e93
Merge branch 'main' of github.com:trvon/yams 2026-02-08 14:06:09 -05:00
trvon
a3522b8b22
fix: expose gpu usage, add command imrpovments and other bug fixes 2026-02-08 14:04:57 -05:00
trvon
c4a7992122
fix: repairmanager, post ingest and pipeline fixes 2026-02-08 14:02:57 -05:00
trvon
430057f4bf
fix: SocketServer slots for proxy and cli requests, fixed tests and increase doctor request handling 2026-02-08 13:02:08 -05:00
trvon
3c09becde5
fix: repair improvements and socketserver hardening 2026-02-07 23:37:32 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
trvon
c638d9aad4
fix: addressing test compilation issues 2026-02-06 10:37:08 -05:00
trvon
567ee32a99
fix: fixing macos coreml detection 2026-02-06 10:16:35 -05:00
trvon
3fd243f687
fix: repair command improvements and optimizations 2026-02-06 10:15:50 -05:00
trvon
90d28d722e
fix: docker build fixes addition clamping logic for onbound memory group 2026-02-06 09:27:34 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files 2026-02-06 04:31:09 -05:00
trvon
d960839e54
fix: embeddings optimizations 2026-02-05 21:27:12 -05:00
trvon
ab06614505
fix(repair): fix SIGSEGV crash, embedding failures, and runaway repair loops
- Fix writer_drain() SIGSEGV by setting connection_closing_ on write failure
- Add InternalError/ResourceExhausted to embedding retry list
- Fix document-level embedding chunk_id (0→999999) and level mismatch
- Add circuit breaker to bail out after consecutive/rate-threshold failures
- Add semaphore concurrency limiter (max 2) for repair embed requests
- Replace silent catch-all with error-logging catch blocks
2026-02-05 21:15:26 -05:00
trvon
fc4b5ceffb
fix: fixing metrics system and removing deadcode 2026-02-05 19:41:50 -05:00
trvon
e0612298d3
fix: fixing rocm builds, removing dead code and some optimizations nightly-20260206-e0612298 2026-02-05 18:33:54 -05:00
trvon
af6fdbd5c3
docs: updating changelog 2026-02-05 12:52:00 -05:00
trvon
5b06ca7a2c
fix(onnx): ensure GPU provider defines are passed to plugin
The ONNX plugin was not receiving -DYAMS_ONNX_COREML_ENABLED=1 because
the CMake dependency method doesn't propagate COMPILE_DEFINITIONS from
Conan's pkg-config.

Changes:
- Try pkg-config first to get compile definitions with GPU flags
- Fall back to CMake method if pkg-config not available
- Add explicit platform detection fallback for macOS CoreML
- Support all GPU providers: CoreML, CUDA, DirectML, MIGraphX

Fixes GPU acceleration not being enabled despite setup.sh detecting it.
2026-02-05 12:48:07 -05:00
trvon
357720407b
fixing rocm gpu build logic 2026-02-05 12:07:10 -05:00
trvon
ded16c11d4
improvements of parallel ingestion 2026-02-05 11:51:24 -05:00
trvon
8a06575a0c
fix: reverted bad change. moved embedding generation to repair coordinator. Still tuning resource usage and governors 2026-02-05 10:21:25 -05:00
trvon
a9f8a3dd63
Revert "reverting resource changes"
This reverts commit b35c84cb2e.
2026-02-05 00:18:42 -05:00
trvon
1af0356419
adding back governor code 2026-02-05 00:16:01 -05:00