Commit graph

1,094 commits

Author SHA1 Message Date
trvon
fe8cbd1471
fix(perf): pushing newsletter, and embedding lock update 2026-04-25 17:02:13 -04:00
trvon
36152546b0
fix: simeon bump and double lock addressed in search 2026-04-25 16:10:17 -04:00
trvon
84015b39b7
build(ci,tests): cleaning build system and updates related to ci test failures and compat 2026-04-25 14:48:44 -04:00
trvon
49b40d5471
fix(ci): ci build fixes for windows, linux, macos tests lanes 2026-04-25 12:55:02 -04:00
trvon
8772cc8e54
fix(docs,ci): addressing breaking changes in zig v0.16.x in Dockerfile, docs update and code cleanup 2026-04-25 11:27:18 -04:00
trvon
0b61c0818a
docs: clean up docs and ci fixes for tests 2026-04-25 00:08:18 -04:00
trvon
9b774d6073
feat: profiling improvements 2026-04-24 23:23:02 -04:00
trvon
1f9387e5aa
fix: topology fixes improvements, alignment in daemon readiness checkpoint 2026-04-24 20:56:22 -04:00
trvon
082c381687
feat: cleaning up request path and fixing checkpoint logic underload 2026-04-24 18:42:00 -04:00
trvon
8de19b84f0
feat: adding instrumentation and config options for build and repair system. Bumping simeon and improving topology system with experimental findings 2026-04-24 17:38:24 -04:00
trvon
7de4d95a43
feat: repair logic improvements, expanding config options to disable rebuilding/repair for memory constrained systems 2026-04-24 10:53:15 -04:00
trvon
8417340289
feat: extending instrumentation for memory and cluster profiling. COntinue UX improvements for grep and search cli commands and mcp 2026-04-24 08:31:16 -04:00
trvon
1fcb7cf6df
feat: expanding topology instrumentation to expose quality of clusters, cli ux improvements and expanded modifiers 2026-04-23 21:28:35 -04:00
trvon
cc49704791
feat: bench harness data_dir reuse + richer telemetry, doc updates
Topology ablation bench: read YAMS_BENCH_DAEMON_DATA_DIR so multiple
daemon spawns can share a stable data_dir. Lets the topology tuner's
persisted MAB state carry over between bench reps; without this, every
fresh DaemonHarness spawn cold-starts UCB1 and picks the alphabetically-
first arm. Pairs with the TopologyTuner persistence (already on HEAD).

Bench also gains per-surface vector-leg counters (vec_unique_doc_counts,
topology_weak_routing_applied, vector_tier_skip_reason, embedding_status,
vector_db_dim/query_embedding_dim) and a modeOf reducer for categorical
metrics — Phase F1-era richer attribution carried forward.

Docs: AGENTS.md / daemon_architecture / retrieval_precision_optimization /
PROMPT-eng-codex updates from the parallel sessions.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-04-23 20:26:26 -04:00
trvon
06b4992c10
feat: improving tuning and expanding instrumentation for memory allocation 2026-04-23 20:24:43 -04:00
trvon
926ef8a640
feat: memory optimizations, and topology tuning improvements 2026-04-23 20:06:45 -04:00
trvon
2ced7a7e5c
feat: reinforcing proxy path for quick ux, adding topology tuning engine for corpus cluster usage in search, simeon memory management improvements 2026-04-23 17:33:47 -04:00
trvon
e88578a9fc
feat: adding support for phss vector search, test fixes, daemon status regression fix, ci fixes for docker builds with new third-party library 2026-04-23 11:02:18 -04:00
trvon
127bc9e9e0
fix: fixing leakage of build artifacts in release, unifying repair path, adding cache to tuning path and bumping simeon version 2026-04-23 10:20:25 -04:00
trvon
0eeed2ed41
feat: bumping simeon module and linking new fragmented strategy 2026-04-23 08:58:14 -04:00
trvon
df0c78cf29
feat: test fixes, metric expansion, build improvements for gliner 2026-04-23 08:48:33 -04:00
trvon
52fa720dc6
feat: add hint for graph to search and grep files 2026-04-22 22:10:43 -04:00
trvon
2ee0a753ff
fix: cleaning up startup logic and timers as corpus grows 2026-04-22 17:38:35 -04:00
trvon
0975e3e740
fix: fixing neon build and memory pressure issues 2026-04-22 15:41:05 -04:00
trvon
d8cb0764d8
feat: address test drift, removing hnsw remants for simeon backend implementation, continued refactor of vector backend 2026-04-22 15:03:36 -04:00
trvon
debfbcaa26
fix: addressing code smell from previous commits 2026-04-22 13:40:12 -04:00
trvon
f381597c0f
fix: text fixes, connection handingly fixes and continued refactor work 2026-04-22 13:20:18 -04:00
trvon
6174b13caf
feat: continued extraction from serach engine and vector improvements. This allows for better testing and experimentation 2026-04-22 12:24:28 -04:00
trvon
be0feac605
feat: refactor vector engine to reduce monoliths in codebase 2026-04-22 08:36:55 -04:00
trvon
a3f1d529c9
fix: addressing unoptimal copies of vectors in repair path 2026-04-22 02:09:58 -04:00
trvon
4617bf4d8f
feat: further removing hnsw references and centralizing on simeon pq implementation 2026-04-22 01:10:57 -04:00
trvon
d669c009d0
feat: removing experiments and unifying compression in embeddings storage. 2026-04-21 18:13:37 -04:00
trvon
1b6f137132
fix: prune fixes for build artifacts, readiness improvements and hnsw api unification 2026-04-21 17:03:58 -04:00
trvon
bdcff5b636
fix: HNSW and topology rebuilds are now batched in repair. Cleaning up from previous migration work 2026-04-21 13:58:10 -04:00
trvon
2b60bed67b
feat(breaking): breaking change. removing onnxruntime for embeddings in favor of simeon. embeddings will now use less system resources, run faster but require avx/neon support per library 2026-04-21 12:23:38 -04:00
trvon
801980ce11
fix: fixing onnx model logic so that memory does not hold indefinitely. Removing re-ranker logic from plugin 2026-04-21 11:49:12 -04:00
trvon
e44c28b2ff
feat: extractor reranker and helpers from search engine. Establishing dual paths for simeon and onnxruntime to present heavy vs light system trade offs 2026-04-21 11:35:31 -04:00
trvon
6c2c31f2bc
fix: cli clean up of old comments and duplicate code. search improvements as we migrate yams to simeon. 2026-04-21 10:20:01 -04:00
trvon
8914169bd5
feat: cleaning up comments and migrating search to simeon 2026-04-21 10:20:01 -04:00
trvon
3c8d60addb
feat: removing isolated and deadcode from graph command 2026-04-21 10:20:00 -04:00
trvon
6fa8b037b0
feat: removing other graph clustering algorithms for hdbscan with sgc 2026-04-21 10:20:00 -04:00
trvon
94c8e6a9db
feat(linter): running linter on codebase 2026-04-20 16:13:30 -04:00
trvon
6cdba45660
feat: vendoring hdbscan for clustering of documents, refactor duplicate code logic in cli and daemon paths, topology instrumentation 2026-04-20 15:59:47 -04:00
trvon
c510d5574a
fix: refining communication path in daemon 2026-04-20 14:34:31 -04:00
trvon
4f92b4ed39
fix: correctness fix for abalation test, fixes for daemon response (regression is present underload/repair) 2026-04-20 13:20:24 -04:00
trvon
3ac9bd68b8
feat: graph clustering improvements for topology system. Checkpoint before experiment with better clustering systems and simeon module bump 2026-04-20 11:31:40 -04:00
trvon
d7e55e0dad
feat: updating git module to https 2026-04-20 09:34:22 -04:00
trvon
a01bd767ce
feat: bumping simeon, improving graph building, clustering, configuration tuning of said system and updating benchmark files. Additional fixes for daemon readiness and status return underload. 2026-04-20 09:31:45 -04:00
trvon
e4a8639ef6
feat: tuning topology system to work better with simeon via configuration 2026-04-19 20:10:46 -04:00
trvon
f27077bc67
feat: additional config imrpovements and deeper integrations of simeon in yams search 2026-04-19 16:40:13 -04:00