Commit graph

38 commits

Author SHA1 Message Date
trvon
4778c9154b
ci: pin experimental release source
Signed-off-by: trvon <me@trevon.dev>
2026-09-03 21:39:16 -06:00
trvon
da905290e9
ci(github): bound apt mirror retries 2026-08-19 11:45:51 -06:00
Trevon
0dd3985db4
refactor: simplify runtime paths and harden retrieval (#61)
* refactor(tuning): prune dormant runtime knobs

Remove unused tuning controls and adaptive search budget state. Extract testable ONNX slot reconciliation and search telemetry hydration seams, and correct the Apple Silicon sysctl value width.

* refactor(vector): retire dormant backends

Remove unused FAISS, model-infrastructure, VectorIndexManager, and TurboQuant paths while keeping Simeon PQ and float-vector storage.

Migrate unused V2.2 quantized schemas transactionally to V2.3. Databases containing non-default quantized formats or packed-code blobs fail closed with recovery guidance and no mutation.

* refactor(plugins): remove legacy SDK tooling

Remove the Ghidra and SDK submodules, their bespoke tests, and stale scan exclusions. Retain generic PluginProcess coverage against the repository mock fixture.

* build(vector): remove stale FAISS overrides

* refactor(ipc): remove dormant FSM snapshots

* refactor(ingest): unify bounded KG enqueue

* fix(plugins): harden allocation contracts

Keep ABI outputs null or fully initialized when allocations fail, and represent empty object payloads without relying on malloc(0).

* fix(storage): define empty object reads

Return a null buffer with zero length for successful empty-object reads instead of treating malloc(0) as an allocation contract.

* refactor(storage): trim through string views

* test: prune dormant harness helpers

Remove unused readiness and fixture helpers, and keep benchmark client-count doubling in a wide integer domain.

* chore(cpp): initialize analyzer-facing locals

* build(simeon): advance analyzer cleanup

* refactor(config): drop dead daemon client keys

* refactor(ipc): inject daemon client transport

Socket and in-process execution now share DaemonClient request dispatch, so CLI fallbacks do not need alternate service paths.

* refactor(retrieval): route CLI through daemon

Search and grep now use the same daemon handlers over socket or in-process transport. Live grep remains an explicit freshness inspection.

* refactor(graph): move CLI scope into daemon

Graph CLI requests now share daemon handlers across socket and in-process transports. CWD filtering occurs before pagination so scoped totals and pages stay correct.

* build: isolate test-only runtime controls

* refactor(metadata): decouple lock telemetry

* fix(services): return on request timeout

* fix(retrieval): enforce workspace scope

* fix(graph): scope nodes before pagination

* fix(grep): drop binary result lines

* fix(daemon): bound checkpoint wait

* fix(repair): use KG health checks

* fix(storage): always verify compressed CRC

* perf(vector): skip unchanged PQ snapshots

* build(zyp): exclude bench from default build

* build: protect Meson files from formatter

* refactor: remove unreachable production APIs

* refactor(daemon): remove dormant runtime state

* fix(vector): harden daemon provider calls

Timed-out coroutines must own their client and requests. Provider discovery must also fail instead of returning synthetic embeddings in production.

* refactor(storage): remove unusable adapters

* fix(cli): unify in-process add requests

* fix(tsan): preserve async worker progress

* test(cli): isolate daemon-dependent suites

* fix(repair): expose queue backoff progress
2026-07-31 14:16:45 -04:00
trvon
bed8578857
fix(ci): stablize ci 2026-07-02 21:34:18 -04:00
Trevon
090a5ca69c
fix(testing): stabilize TSAN coverage, harden daemon shutdown, and speed up KG/storage paths (#53)
* perf(search, metadata): add KG write buffer, score cache, adaptive budgets

* perf(indexing): wire KGWriteBuffer into indexing service

   Converts per-document addEdgesUnique calls into batched flush via
   KGWriteBuffer.  500-doc ingest: 500 SQL round-trips → 1 batch.

   Verified: 14.2× edge insert gap (14.8K→195K edges/s) in kg_edge bench.
   Tests: 10/10 Catch2 pass (105 assertions).

* perf(storage): add fsync durability, parallel batch, read integrity

* test(storage): add stress, crash-sim, cold-cache, batch benchmarks

* fix: CI optimizations and work coordinator shutdown fix

* fix(testing): stabilize TSAN coverage gate

* fix: harden KG flush, score cache, and benches

   - keep KG buffers intact when batch commit fails
   - count flushed edges per batch instead of lifetime totals
   - guard the Simeon score cache and clear it on rebuild
   - fall back to fsync when F_FULLFSYNC fails on macOS
   - remove interactive sudo from cold-cache benchmarks
2026-06-26 17:57:02 -04:00
trvon
5c890ddc0b
ci: use VS 2026 Windows runners
Signed-off-by: trvon <git@trevon.dev>
2026-06-19 20:11:52 -04:00
trvon
4fb779c31d
ci: harden linux apt installs 2026-05-19 12:54:55 -04:00
trvon
db778ce72d
ci: disable faiss in warm and test jobs 2026-05-06 21:27:48 -04:00
trvon
b4b22e428c
ci(warm): add ccache dep, tolerate populate timeout 2026-05-05 21:09:19 -04:00
trvon
18b10dc444
fix: addressing build regressions where fiass needed openmp installed 2026-05-05 19:50:16 -04:00
trvon
c3127d55c9
fix(ci): restore cache-hit guard for macOS/Windows warm step
The conan install step fails on macOS when run unconditionally (previously
hidden by the cache-hit skip). Restore the guard for non-Linux platforms
while keeping Linux always-running to populate ccache.
2026-05-05 18:41:13 -04:00
trvon
76c7e9d60f
security,ci: security issues address from codeql and improving cache usage logic in ci 2026-05-05 18:27:43 -04:00
trvon
8fb1af8a4c
:) 2026-05-02 21:33:21 -04:00
trvon
438572cc1a
fix: ci build fix for pinned version change. checkpoiting write improvements before move all writes to single component 2026-04-30 08:59:05 -04:00
trvon
ff7696a0ff
ci: addressing warm issues with ci. staging bug fixes and search research work 2026-04-29 17:22:20 -04:00
trvon
86025d5e89
ci: ci cache improvements and version bump for msvc compat 2026-04-28 23:04:48 -04:00
trvon
e88578a9fc
feat: adding support for phss vector search, test fixes, daemon status regression fix, ci fixes for docker builds with new third-party library 2026-04-23 11:02:18 -04:00
trvon
e8ddb31145
fix: address ci source venv and graph repair timeouts 2026-04-17 14:13:35 -04:00
trvon
a1253d1f69
feat: fixing brittleness in CI pip usage that breaks under package updates and system delayed updates. Improving graph repair process and reducing locks in ingestion pipeline 2026-04-17 12:32:00 -04:00
trvon
0261b90a7b
refactor(build): centralize dependency discovery and trim Meson duplication 2026-03-23 15:41:13 -04:00
trvon
31eb110391
fix: hardening release CI, addressing issues with onnxruntime linking on macos and linux and expanding benchmark 2026-03-06 08:30:14 -05:00
trvon
bbe5217101
ci improvements for faster builds 2026-01-21 15:53:19 -05:00
trvon
9844b82d6b
ci and tests improvements 2026-01-08 14:16:38 -05:00
trvon
d7271b16a7
tests: Fix cross-platform integration test failures
- Add runLoop thread to GrepServiceExpectationsIT for request processing
- Increase daemon startup timeout to 15s for CI environments
- Add settling time after daemon Ready state
- Add BEIR dataset infrastructure for SciFact benchmark
2026-01-04 15:25:08 -05:00
trevon
7ad3f6f784
graph optimizations and cleanup. CI improvements for submodules 2025-12-18 13:04:57 -05:00
trevon
61caa05edf
only recursive pull sqlite vec cpp until secrets fixed 2025-12-13 16:14:08 -05:00
trevon
d9690de5dc
fixing ci build logic 2025-12-13 16:07:16 -05:00
trevon
537d4594f4
docs update and ci improvements for qpdf 2025-11-27 14:25:29 -05:00
trevon
eb7e9c27e2
windows build running. resolving plugin loading 2025-11-25 09:56:50 -05:00
trvon
7d9dcd986d
additional ci fixes for docker and meson setup 2025-11-01 16:46:31 -04:00
trvon
49428ad508
ci fixes 2025-11-01 16:19:40 -04:00
trvon
8d23211af2
improvements for ci, setup.sh and updates to new symbol extraction plugin 2025-10-21 19:38:45 -04:00
trvon
35d07abfad
fixing warm matrix 2025-10-10 13:08:27 -04:00
trvon
ed676e5fe9
v0.7.4 2025-10-10 12:51:39 -04:00
trvon
7b9da100ff
v0.7.3 staging 2025-10-07 11:18:35 -04:00
trvon
e04effe2d2
fixing conan file so ft5s builds 2025-10-04 21:12:19 -04:00
Trevon
a29ed05d80
adding missing header to github, updating github ci warm logic 2025-09-25 11:16:00 -04:00
Trevon
0f5b58df48
expanding ci platform testes, improving test coverage and resolve platform bugs related to migrated implementations and sanitization 2025-09-25 11:06:54 -04:00