Commit Graph

38 Commits

Author SHA1 Message Date
dog
441e6f3dfe feat: rework mouse post-processing pipeline (soft monotonic, global endpoint warp)
Golden mouse baselines temporarily failing; re-captured in follow-up commit.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 17:48:22 +08:00
dog
556f7f861d feat: add warp_endpoints (global residual correction, shape-preserving)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 17:44:07 +08:00
dog
94c52bd3be feat: add damp_start (smoothstep lateral damping, no release kink)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 17:31:24 +08:00
dog
c2ed7b3cb9 feat: add soften_forward (backtrack tolerance + tanh overshoot compression)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 17:25:50 +08:00
31fd884dfd refactor(lib): remove legacy generator.py / coord.py / scroll module
Drop the pre-migration PyTorch inference pipeline now that the ONNX-backed
MouseModel/ScrollModel in mouse.py and scroll.py are wired up through the
public ai_mouse API.

Deleted:
  * src/ai_mouse/generator.py        (legacy torch flow ODE + post-processing)
  * src/ai_mouse/coord.py            (legacy public coord transforms,
                                      superseded by ai_mouse._coord)
  * src/ai_mouse/_scroll_legacy.py   (legacy torch scroll VAE inference)
  * scripts/build_golden_*.py        (one-shot capture scripts, no longer
                                      needed once goldens are committed)
  * tests/unit/test_generator.py     (legacy module gone)
  * tests/unit/test_scroll_generator.py (legacy module gone)
  * tests/unit/test_coord.py         (legacy module gone; ai_mouse._coord is
                                      tested by test__coord.py)
  * scripts/                         (empty, removed)

Tools migrations:
  * tools/trainer.py: import encode_trajectory from ai_mouse._coord
    instead of the deleted ai_mouse.coord
  * tools/server/routes_verify.py, tools/server/routes_scroll.py: route to
    the public ai_mouse.generate / generate_scroll. They no longer accept
    a model_dir override — the bundled ONNX is the source of truth, and a
    fresh export goes through `python -m tools.export_onnx`.
  * tools/eval/__main__.py: same migration; model_dir CLI arg retained as
    a deprecation shim but ignored.

Final src/ai_mouse/ layout (matches plan):
  __init__.py, _assets.py, _coord.py, _model_cache.py, _postprocess.py,
  errors.py, mouse.py, py.typed, scroll.py, assets/

Test suite: 188 passed (was 188 before deletion; obsolete suites cleaned
out alongside the modules they covered).
2026-05-12 01:23:52 +08:00
525e555884 test(lib): add golden regression suite for mouse + scroll
64 parametrised cases (8 routes/scrolls x 4 seeds each) compare the
rewritten ORT/NumPy pipeline against captures from the pre-migration
PyTorch implementation.

The pre-migration captures used torch.manual_seed + torch.randn for the
flow-ODE noise; the rewrite uses np.random.default_rng. These RNGs
produce different random numbers for the same seed, so the per-point
trajectories cannot match bit-for-bit. The suite therefore guards
*structural* equivalence:

  * mouse: identical shape, start/end snapping, xy diff within
    max(30 px, 20% of move distance), timestamp diff within 700 ms
  * scroll: identical shape (skip with reason on quantum boundary
    drift), identical deltaMode, identical total signed scroll
    distance, per-event delta within 2 wheel quanta, timestamp diff
    within 700 ms

Observed worst-case in this run: ~170 px xy diff on a 1681 px move
(~10% of distance, well under the 20% envelope) and ~600 ms timestamp
drift. All 64 cases pass; 0 skipped.

Goldens stored as compressed .npz under tests/unit/data/ and tracked
via Git LFS-free vanilla blobs (each file is ~kB).
2026-05-12 01:19:58 +08:00
d39db46170 feat(lib): switch __init__ to ONNX-backed generate/generate_scroll 2026-05-12 01:16:03 +08:00
4e69ecc963 feat(lib): add ScrollModel (numpy + ONNX Runtime); rename legacy scroll module 2026-05-12 01:14:37 +08:00
bae9a93ffa feat(lib): add MouseModel (numpy + ONNX Runtime) 2026-05-12 01:13:06 +08:00
2231e4e24b feat(lib): add sample_duration, truncnorm_sample (no scipy) 2026-05-12 01:09:22 +08:00
b93d240641 feat(lib): add resample_arc, build_timestamps 2026-05-12 01:08:39 +08:00
6cfcb6d1a4 feat(lib): add smooth_start, enforce_forward_monotonic 2026-05-12 01:07:58 +08:00
09e8ebee4a feat(lib): add snap_endpoints to _postprocess 2026-05-12 01:07:19 +08:00
6d848dc23d feat(lib): add gaussian_smooth to _postprocess 2026-05-12 01:06:42 +08:00
3c1cf171a7 feat(lib): add _assets module for bundled-weight resolution
Provide bundled_path() and resolve() helpers that locate ONNX
weights and JSON metadata via importlib.resources, falling back to
a user-supplied directory. Missing assets raise ModelLoadError.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-12 01:04:37 +08:00
8182bb1a01 feat(lib): add errors module
Introduce AiMouseError base class plus ModelLoadError and
GenerationError subclasses so downstream consumers can catch the
umbrella or specific failure modes.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-12 01:02:57 +08:00
17b406c28b feat(lib): add private _coord.py with numpy transforms
Copy of coord.py (which is already pure numpy) into the private
underscored module to be consumed by upcoming mouse.py rewrite.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-12 01:02:25 +08:00
6702269494 test(tools): cover export_onnx with tiny synthetic models 2026-05-12 00:57:32 +08:00
fc7b2bd236 refactor(tests): split into tests/unit and tests/tools 2026-05-12 00:47:00 +08:00
3507fdc202 refactor: move eval/ and data_adapters/ to tools/ 2026-05-12 00:40:33 +08:00
d1ecb13175 refactor: move server/ to tools/server/ 2026-05-12 00:37:47 +08:00
6c96ab68c8 refactor(scroll): move trainer/models/collector to tools/scroll/ 2026-05-12 00:34:05 +08:00
ba52c49edf refactor: move trainer/models/utils/config to tools/ 2026-05-12 00:30:55 +08:00
e3d4626031 test: capture scroll generate() golden output (pre-migration) 2026-05-12 00:20:13 +08:00
98daef54ca test: capture mouse generate() golden output (pre-migration) 2026-05-12 00:19:39 +08:00
05be116cde feat(eval): Markdown report builder with matplotlib plots
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-10 13:39:13 +08:00
dc38f031b8 feat(eval): kinematics metrics, FFT spectrum, KL divergence
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-10 13:33:19 +08:00
3fb4d3a8c0 feat(generator): add 5-point gaussian smoothing on lateral 2026-05-10 13:27:15 +08:00
50dbf40709 refactor(generator): remove deterministic speed_profile and hard log_dt clip
These post-processing hacks were added to compensate for small-data
training. With Balabit pretraining they suppress the multimodal
timing distribution and cause the template-y Δt curves seen in the
verify UI.
2026-05-10 13:22:57 +08:00
1d9dff4f2a fix(trainer): rename _LOG_1_1 → _LOG_INV_0_9, add tests for aug_ids 2-5 2026-05-10 13:11:27 +08:00
e992823aef feat(trainer): add resume_from for two-stage training 2026-05-10 13:08:37 +08:00
bba8fc567b feat(trainer): replace eager _augment with streaming TrajectoryDataset
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-10 12:51:52 +08:00
0b1d18d15c feat(adapter): implement process_session and CLI 2026-05-10 12:42:43 +08:00
cc855e0ae2 feat(adapter): implement segment quality filters 2026-05-10 12:38:17 +08:00
82f803403c feat(adapter): implement click-anchored segmentation 2026-05-10 12:35:43 +08:00
1559f7ab11 feat(adapter): implement Balabit CSV parser 2026-05-10 12:32:20 +08:00
97a835769e feat(adapter): scaffold balabit data adapter package 2026-05-10 12:29:11 +08:00
4d414fd180 chore: initialize git repo, add matplotlib dep, extend config
- Add .gitignore for Python/data/models
- Add matplotlib>=3.8.0 for eval plots
- Add PretrainConfig, FinetuneConfig, BalabitAdapterConfig, EvalConfig dataclasses
2026-05-10 12:24:07 +08:00