Commit graph

496 commits

Author SHA1 Message Date
trvon
4b2185dbcf
feat(governance): implement Netflix Gradient2 adaptive concurrency limiters
Replace CPU-threshold-based scaling with latency-feedback-based adaptive
concurrency control using the Netflix Gradient2 algorithm.

Core Changes:
- Add GradientLimiter class implementing Netflix Gradient2 algorithm
- Integrate limiters into all 6 post-ingest stages (extraction, kg, symbol,
  entity, title, embed)
- Add TuneAdvisor configuration knobs for gradient limiter tuning
- Simplify ResourceGovernor to emergency-only backstop (CPU > 95%, mem > 95%)
- Update TuningManager to read dynamic limits from gradient limiters
2026-02-04 23:38:33 -05:00
trvon
b071112836
feat: test coverage improvements. Scaling bug addresses 2026-02-04 20:20:18 -05:00
trvon
14c35926f1
test improvements and bug fixes in parser, scaling logic, and mcp tools 2026-02-04 14:42:28 -05:00
trvon
de5abde337
fix: test improvements 2026-02-03 12:49:05 -05:00
trvon
29de453020
fix: mcp improvements for grep and search, improving helper usage 2026-02-02 03:28:52 -05:00
trvon
79ea83eac8
fix: test fixes annd windows build downgrade to c++20 2026-02-02 02:15:09 -05:00
trvon
f6251f6982
fix: performance updates, v0.8.2 pre-staging 2026-02-01 17:48:19 -05:00
trvon
7ca1afb954
fix: extract bug fixes and cleaning up unused session logic 2026-01-31 01:31:08 -05:00
trvon
46aa12c0fd
fix: performance tuning improvements, windows build fixes and other improvements 2026-01-31 01:01:52 -05:00
trvon
2946b231dd
fix: license header file updates, mcp improvements, windows build fixes 2026-01-30 17:23:33 -05:00
trvon
33b83aeb53
fix: fixing windows head ordering, reducing complexity in mcp server (debugging opencode, claude, droid failed to list tools issues) 2026-01-30 09:57:27 -05:00
trvon
0614229387
fix: onnx pool model scaling improvements, test fixes and UX improvements 2026-01-29 23:18:50 -05:00
trvon
96f19e2cd2
feat: mcp ui work and stabiliizations 2026-01-29 16:55:21 -05:00
trvon
1e50b0c531
Improve daemon shutdown reliability and timeout handling
SocketServer:
- Increase connection handler wait timeout from 100ms to 2s
- Increase accept loop wait timeout from 500ms to 3s
- Prevents race conditions where handlers are cancelled mid-operation

WorkCoordinator:
- Replace thread detach with extended join attempt
- Prevents use-after-free from detached threads accessing freed resources

Daemon Command:
- Increase shutdown wait timeout from 3s to 6s
- Increase default waitForDaemonStop timeout from 5s to 10s
- Allows time for graceful SocketServer shutdown

These changes address SIGABRT and SIGTERM issues during daemon shutdown
by ensuring async operations complete before resources are freed.
2026-01-29 11:55:07 -05:00
trvon
38ec4336bf
refactored memory scaling logic 2026-01-29 10:36:33 -05:00
trvon
49aa12fa90
improved tests and mcp improvements 2026-01-29 00:27:07 -05:00
trvon
41db2b1fb7
reverting metadata cache patch and fixing list metadata pathing for speed. cleaning up ux add and list commands and remove legacy metadata path 2026-01-28 16:51:03 -05:00
trvon
1a2178af13
improving UX of metrics 2026-01-27 22:38:34 -05:00
trvon
8c9cd40c38
bug fixes and metrics exposure improvements 2026-01-27 21:35:21 -05:00
trvon
a43ddb99c3
bug fixes and improvements for the list, stats, daemon command UX. Exposing and optimizations metadata filtering logic 2026-01-27 17:36:22 -05:00
trvon
2b0f5f4d89
imrpoving daemon internals, mcp fixes for metadata queries 2026-01-27 12:09:08 -05:00
trvon
47e6292261
thread safety fixes and metric seeding fixes 2026-01-26 20:23:42 -05:00
trvon
0de5bdf466
bug fixes and additional tuning fixes 2026-01-26 19:30:38 -05:00
trvon
1bb333648c
improving tuning and pooling of daemon components 2026-01-25 23:47:35 -05:00
trvon
e309d96414
bug fixes for daemon, ui fixes for grep and search 2026-01-25 22:52:25 -05:00
trvon
210a6f005f
test improvements, bug fix for tuning clamps 2026-01-25 19:08:21 -05:00
trvon
d0313bf303
windows onnx fixes 2026-01-24 15:50:52 -05:00
trvon
80ceef9a93
additional bug fixes and testing improvements 2026-01-24 14:18:50 -05:00
trvon
36c587e776
bug fixes and test improvements 2026-01-24 11:49:48 -05:00
trvon
5af411d45c
test improvements 2026-01-23 23:00:56 -05:00
trvon
9d34326f44
concurrency scaling bug fix, windows build fix and daemon lifecycle improvements: 2026-01-23 14:37:09 -05:00
trvon
c0e17835ac
search optimizations 2026-01-22 23:33:10 -05:00
trvon
633c3ce1cc
gliner term expansion for better search and search model ranking update 2026-01-22 23:17:40 -05:00
trvon
ec059e434b
streaming reliability improvements and ui fixes 2026-01-22 22:12:14 -05:00
trvon
c7fb151f3d
skipping v0.7.11 and going straight to v0.8.0. Staging pre-release 2026-01-22 14:21:32 -05:00
trvon
124dd53c01
additional tuning imrpovements 2026-01-22 10:06:42 -05:00
trvon
2f84e362b7
concurrency limits fixed 2026-01-22 01:02:43 -05:00
trvon
d5c9a3219f
local mac changes 2026-01-22 00:28:29 -05:00
trvon
55d61f143a prompt, snippet improvements and error command improvements 2026-01-22 05:27:40 +00:00
trvon
161f3e30e4
cleaning up code 2026-01-21 16:54:16 -05:00
trvon
4738adba89
post ingestion pipeline governor improvements 2026-01-20 14:48:52 -05:00
trvon
ceadbd52e8
repair manager is now tuning aware with dedupe support with running jobs in post ingest 2026-01-20 14:24:51 -05:00
trvon
b3fbff0457
fixing model logic to reduce pool size when using cpu 2026-01-20 13:05:42 -05:00
trvon
9267e406bc
adding tuning tests, daemon resource advisor respects profile (efficient, balanced, aggressive), retrieval benchmark fixes 2026-01-20 12:07:30 -05:00
trvon
63286ac450
evicting model when idle, post processing in search is parallelized and additional model management improvements 2026-01-20 11:27:29 -05:00
trvon
440e8f8df3
Merge remote-tracking branch 'origin' into experimental 2026-01-20 00:12:55 -05:00
trvon
783f713318
adding tune advisor guidance and cleaning up stats ui 2026-01-20 00:11:58 -05:00
trvon
a8a6559377
dockerfile and ci fixes with improvements for model loading logic 2026-01-19 22:28:30 -05:00
trvon
cc75a5504f
benchmark fixing and pool allocation improvements 2026-01-19 21:26:04 -05:00
trvon
ad8b50ac25
cleaning up gliner pipeline and limit to a signal thread so onnx can consume the rest of the pool for embeddings 2026-01-19 19:35:34 -05:00