Commit graph

1,002 commits

Author SHA1 Message Date
trvon
d0e33f4fe0
fix: addressing gaps and todo in storage implementation. Improving tests 2026-05-02 00:20:43 -04:00
trvon
5581fa08e0
security: additional security fixes and improvements for storage correctness 2026-05-01 23:15:54 -04:00
trvon
886c9c0430
security: storage implementation improvements 2026-05-01 22:54:42 -04:00
trvon
ff10c70d45
tests: test fixes and simeon version bump 2026-05-01 16:05:27 -04:00
trvon
e5eaaf8292
fix: fixing fragiling SocketServer loop 2026-05-01 12:07:40 -04:00
trvon
0204072397
fix(asan): Addressing asan test regressions and suite failures from recent changes 2026-05-01 09:18:39 -04:00
trvon
2f505b009e
fix: mcp router fix 2026-04-30 09:42:52 -04:00
trvon
438572cc1a
fix: ci build fix for pinned version change. checkpoiting write improvements before move all writes to single component 2026-04-30 08:59:05 -04:00
trvon
c3db49ffdd
test: test fixes for flaky tests and bug fix for single db writing for kg. Contemplating swapping backend 2026-04-29 22:41:45 -04:00
trvon
ae1f0c10d2
perf: cleaning up search experiments, moving to new routing system for search for larger corpus improvements, repair system now triggers semantic / graph repair 2026-04-29 20:36:02 -04:00
trvon
ff7696a0ff
ci: addressing warm issues with ci. staging bug fixes and search research work 2026-04-29 17:22:20 -04:00
trvon
3919e92c8e
refactor: sandbox improvements and docs updates 2026-04-29 14:51:36 -04:00
trvon
f4ffb3d8c5
feat(daemon): adaptive physical-walk TTL + statvfs fast-path, hot-tier getenv→TuningSnapshot, RepairScheduling/RepairTuning slice extractions 2026-04-28 15:39:11 -04:00
trvon
611d77054c
perf: instrumentation and ingestion optimizations 2026-04-27 11:01:59 -04:00
trvon
e2332a8440
optimizations: throughput optimizations, bug fixes, docs updates and benchmark cleanup 2026-04-26 21:43:00 -04:00
trvon
39576186ee
test: instrumentation expansions for ingestion speed experiments and tuning improvements 2026-04-26 19:55:29 -04:00
trvon
eae3c5afbb
feat: adding storage check, db corruption check and tests 2026-04-26 18:54:17 -04:00
trvon
f825bc3cf5
feat: ci/test regressions updates, reinstated onnxruntime (simeon will still be default), expanding topology instrumentation in search, newsletter update with throughput comparison 2026-04-26 17:03:37 -04:00
trvon
42ee44cef4
fix(ci): ci test and bug fixes. Improvements for testing topology construction 2026-04-26 13:08:55 -04:00
trvon
7d29f96df5
fix(ci): test fixes 2026-04-26 01:02:36 -04:00
trvon
42406b99b0
fix(ci): test fixes and newsletter numbers updates 2026-04-25 22:15:01 -04:00
trvon
36152546b0
fix: simeon bump and double lock addressed in search 2026-04-25 16:10:17 -04:00
trvon
84015b39b7
build(ci,tests): cleaning build system and updates related to ci test failures and compat 2026-04-25 14:48:44 -04:00
trvon
49b40d5471
fix(ci): ci build fixes for windows, linux, macos tests lanes 2026-04-25 12:55:02 -04:00
trvon
8772cc8e54
fix(docs,ci): addressing breaking changes in zig v0.16.x in Dockerfile, docs update and code cleanup 2026-04-25 11:27:18 -04:00
trvon
0b61c0818a
docs: clean up docs and ci fixes for tests 2026-04-25 00:08:18 -04:00
trvon
082c381687
feat: cleaning up request path and fixing checkpoint logic underload 2026-04-24 18:42:00 -04:00
trvon
8de19b84f0
feat: adding instrumentation and config options for build and repair system. Bumping simeon and improving topology system with experimental findings 2026-04-24 17:38:24 -04:00
trvon
7de4d95a43
feat: repair logic improvements, expanding config options to disable rebuilding/repair for memory constrained systems 2026-04-24 10:53:15 -04:00
trvon
8417340289
feat: extending instrumentation for memory and cluster profiling. COntinue UX improvements for grep and search cli commands and mcp 2026-04-24 08:31:16 -04:00
trvon
1fcb7cf6df
feat: expanding topology instrumentation to expose quality of clusters, cli ux improvements and expanded modifiers 2026-04-23 21:28:35 -04:00
trvon
cc49704791
feat: bench harness data_dir reuse + richer telemetry, doc updates
Topology ablation bench: read YAMS_BENCH_DAEMON_DATA_DIR so multiple
daemon spawns can share a stable data_dir. Lets the topology tuner's
persisted MAB state carry over between bench reps; without this, every
fresh DaemonHarness spawn cold-starts UCB1 and picks the alphabetically-
first arm. Pairs with the TopologyTuner persistence (already on HEAD).

Bench also gains per-surface vector-leg counters (vec_unique_doc_counts,
topology_weak_routing_applied, vector_tier_skip_reason, embedding_status,
vector_db_dim/query_embedding_dim) and a modeOf reducer for categorical
metrics — Phase F1-era richer attribution carried forward.

Docs: AGENTS.md / daemon_architecture / retrieval_precision_optimization /
PROMPT-eng-codex updates from the parallel sessions.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-23 20:26:26 -04:00
trvon
06b4992c10
feat: improving tuning and expanding instrumentation for memory allocation 2026-04-23 20:24:43 -04:00
trvon
926ef8a640
feat: memory optimizations, and topology tuning improvements 2026-04-23 20:06:45 -04:00
trvon
2ced7a7e5c
feat: reinforcing proxy path for quick ux, adding topology tuning engine for corpus cluster usage in search, simeon memory management improvements 2026-04-23 17:33:47 -04:00
trvon
e88578a9fc
feat: adding support for phss vector search, test fixes, daemon status regression fix, ci fixes for docker builds with new third-party library 2026-04-23 11:02:18 -04:00
trvon
127bc9e9e0
fix: fixing leakage of build artifacts in release, unifying repair path, adding cache to tuning path and bumping simeon version 2026-04-23 10:20:25 -04:00
trvon
df0c78cf29
feat: test fixes, metric expansion, build improvements for gliner 2026-04-23 08:48:33 -04:00
trvon
2ee0a753ff
fix: cleaning up startup logic and timers as corpus grows 2026-04-22 17:38:35 -04:00
trvon
0975e3e740
fix: fixing neon build and memory pressure issues 2026-04-22 15:41:05 -04:00
trvon
d8cb0764d8
feat: address test drift, removing hnsw remants for simeon backend implementation, continued refactor of vector backend 2026-04-22 15:03:36 -04:00
trvon
f381597c0f
fix: text fixes, connection handingly fixes and continued refactor work 2026-04-22 13:20:18 -04:00
trvon
6174b13caf
feat: continued extraction from serach engine and vector improvements. This allows for better testing and experimentation 2026-04-22 12:24:28 -04:00
trvon
be0feac605
feat: refactor vector engine to reduce monoliths in codebase 2026-04-22 08:36:55 -04:00
trvon
a3f1d529c9
fix: addressing unoptimal copies of vectors in repair path 2026-04-22 02:09:58 -04:00
trvon
4617bf4d8f
feat: further removing hnsw references and centralizing on simeon pq implementation 2026-04-22 01:10:57 -04:00
trvon
d669c009d0
feat: removing experiments and unifying compression in embeddings storage. 2026-04-21 18:13:37 -04:00
trvon
1b6f137132
fix: prune fixes for build artifacts, readiness improvements and hnsw api unification 2026-04-21 17:03:58 -04:00
trvon
bdcff5b636
fix: HNSW and topology rebuilds are now batched in repair. Cleaning up from previous migration work 2026-04-21 13:58:10 -04:00
trvon
2b60bed67b
feat(breaking): breaking change. removing onnxruntime for embeddings in favor of simeon. embeddings will now use less system resources, run faster but require avx/neon support per library 2026-04-21 12:23:38 -04:00