trvon
611d77054c
perf: instrumentation and ingestion optimizations
2026-04-27 11:01:59 -04:00
trvon
e2332a8440
optimizations: throughput optimizations, bug fixes, docs updates and benchmark cleanup
2026-04-26 21:43:00 -04:00
trvon
39576186ee
test: instrumentation expansions for ingestion speed experiments and tuning improvements
2026-04-26 19:55:29 -04:00
trvon
eae3c5afbb
feat: adding storage check, db corruption check and tests
2026-04-26 18:54:17 -04:00
trvon
f825bc3cf5
feat: ci/test regressions updates, reinstated onnxruntime (simeon will still be default), expanding topology instrumentation in search, newsletter update with throughput comparison
2026-04-26 17:03:37 -04:00
trvon
42ee44cef4
fix(ci): ci test and bug fixes. Improvements for testing topology construction
2026-04-26 13:08:55 -04:00
trvon
7d29f96df5
fix(ci): test fixes
2026-04-26 01:02:36 -04:00
trvon
42406b99b0
fix(ci): test fixes and newsletter numbers updates
2026-04-25 22:15:01 -04:00
trvon
36152546b0
fix: simeon bump and double lock addressed in search
2026-04-25 16:10:17 -04:00
trvon
84015b39b7
build(ci,tests): cleaning build system and updates related to ci test failures and compat
2026-04-25 14:48:44 -04:00
trvon
49b40d5471
fix(ci): ci build fixes for windows, linux, macos tests lanes
2026-04-25 12:55:02 -04:00
trvon
8772cc8e54
fix(docs,ci): addressing breaking changes in zig v0.16.x in Dockerfile, docs update and code cleanup
2026-04-25 11:27:18 -04:00
trvon
0b61c0818a
docs: clean up docs and ci fixes for tests
2026-04-25 00:08:18 -04:00
trvon
082c381687
feat: cleaning up request path and fixing checkpoint logic underload
2026-04-24 18:42:00 -04:00
trvon
8de19b84f0
feat: adding instrumentation and config options for build and repair system. Bumping simeon and improving topology system with experimental findings
2026-04-24 17:38:24 -04:00
trvon
7de4d95a43
feat: repair logic improvements, expanding config options to disable rebuilding/repair for memory constrained systems
2026-04-24 10:53:15 -04:00
trvon
8417340289
feat: extending instrumentation for memory and cluster profiling. COntinue UX improvements for grep and search cli commands and mcp
2026-04-24 08:31:16 -04:00
trvon
1fcb7cf6df
feat: expanding topology instrumentation to expose quality of clusters, cli ux improvements and expanded modifiers
2026-04-23 21:28:35 -04:00
trvon
cc49704791
feat: bench harness data_dir reuse + richer telemetry, doc updates
...
Topology ablation bench: read YAMS_BENCH_DAEMON_DATA_DIR so multiple
daemon spawns can share a stable data_dir. Lets the topology tuner's
persisted MAB state carry over between bench reps; without this, every
fresh DaemonHarness spawn cold-starts UCB1 and picks the alphabetically-
first arm. Pairs with the TopologyTuner persistence (already on HEAD).
Bench also gains per-surface vector-leg counters (vec_unique_doc_counts,
topology_weak_routing_applied, vector_tier_skip_reason, embedding_status,
vector_db_dim/query_embedding_dim) and a modeOf reducer for categorical
metrics — Phase F1-era richer attribution carried forward.
Docs: AGENTS.md / daemon_architecture / retrieval_precision_optimization /
PROMPT-eng-codex updates from the parallel sessions.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-23 20:26:26 -04:00
trvon
06b4992c10
feat: improving tuning and expanding instrumentation for memory allocation
2026-04-23 20:24:43 -04:00
trvon
926ef8a640
feat: memory optimizations, and topology tuning improvements
2026-04-23 20:06:45 -04:00
trvon
2ced7a7e5c
feat: reinforcing proxy path for quick ux, adding topology tuning engine for corpus cluster usage in search, simeon memory management improvements
2026-04-23 17:33:47 -04:00
trvon
e88578a9fc
feat: adding support for phss vector search, test fixes, daemon status regression fix, ci fixes for docker builds with new third-party library
2026-04-23 11:02:18 -04:00
trvon
127bc9e9e0
fix: fixing leakage of build artifacts in release, unifying repair path, adding cache to tuning path and bumping simeon version
2026-04-23 10:20:25 -04:00
trvon
df0c78cf29
feat: test fixes, metric expansion, build improvements for gliner
2026-04-23 08:48:33 -04:00
trvon
2ee0a753ff
fix: cleaning up startup logic and timers as corpus grows
2026-04-22 17:38:35 -04:00
trvon
0975e3e740
fix: fixing neon build and memory pressure issues
2026-04-22 15:41:05 -04:00
trvon
d8cb0764d8
feat: address test drift, removing hnsw remants for simeon backend implementation, continued refactor of vector backend
2026-04-22 15:03:36 -04:00
trvon
f381597c0f
fix: text fixes, connection handingly fixes and continued refactor work
2026-04-22 13:20:18 -04:00
trvon
6174b13caf
feat: continued extraction from serach engine and vector improvements. This allows for better testing and experimentation
2026-04-22 12:24:28 -04:00
trvon
be0feac605
feat: refactor vector engine to reduce monoliths in codebase
2026-04-22 08:36:55 -04:00
trvon
a3f1d529c9
fix: addressing unoptimal copies of vectors in repair path
2026-04-22 02:09:58 -04:00
trvon
4617bf4d8f
feat: further removing hnsw references and centralizing on simeon pq implementation
2026-04-22 01:10:57 -04:00
trvon
d669c009d0
feat: removing experiments and unifying compression in embeddings storage.
2026-04-21 18:13:37 -04:00
trvon
1b6f137132
fix: prune fixes for build artifacts, readiness improvements and hnsw api unification
2026-04-21 17:03:58 -04:00
trvon
bdcff5b636
fix: HNSW and topology rebuilds are now batched in repair. Cleaning up from previous migration work
2026-04-21 13:58:10 -04:00
trvon
2b60bed67b
feat(breaking): breaking change. removing onnxruntime for embeddings in favor of simeon. embeddings will now use less system resources, run faster but require avx/neon support per library
2026-04-21 12:23:38 -04:00
trvon
801980ce11
fix: fixing onnx model logic so that memory does not hold indefinitely. Removing re-ranker logic from plugin
2026-04-21 11:49:12 -04:00
trvon
e44c28b2ff
feat: extractor reranker and helpers from search engine. Establishing dual paths for simeon and onnxruntime to present heavy vs light system trade offs
2026-04-21 11:35:31 -04:00
trvon
6c2c31f2bc
fix: cli clean up of old comments and duplicate code. search improvements as we migrate yams to simeon.
2026-04-21 10:20:01 -04:00
trvon
6fa8b037b0
feat: removing other graph clustering algorithms for hdbscan with sgc
2026-04-21 10:20:00 -04:00
trvon
94c8e6a9db
feat(linter): running linter on codebase
2026-04-20 16:13:30 -04:00
trvon
c510d5574a
fix: refining communication path in daemon
2026-04-20 14:34:31 -04:00
trvon
4f92b4ed39
fix: correctness fix for abalation test, fixes for daemon response (regression is present underload/repair)
2026-04-20 13:20:24 -04:00
trvon
3ac9bd68b8
feat: graph clustering improvements for topology system. Checkpoint before experiment with better clustering systems and simeon module bump
2026-04-20 11:31:40 -04:00
trvon
a01bd767ce
feat: bumping simeon, improving graph building, clustering, configuration tuning of said system and updating benchmark files. Additional fixes for daemon readiness and status return underload.
2026-04-20 09:31:45 -04:00
trvon
e4a8639ef6
feat: tuning topology system to work better with simeon via configuration
2026-04-19 20:10:46 -04:00
trvon
8c313fc023
feat: expanding topology system and search for better testing and simeon integration
2026-04-19 09:25:28 -04:00
trvon
c2a9d322ad
fix: clang warning fixes and daemon startup wal guard and fallback regression fix
2026-04-18 17:43:48 -04:00
trvon
ce560509bf
fix: fixing mcp code routing and paramater normalization with a light refactor
2026-04-18 17:03:18 -04:00
