Skip to content

Add lightweight metrics and WeightWatcher audit - #94

Merged
charlesmartin14 merged 1 commit into
mainfrom
agent/fix-weight-quotient-papermill-parameters
Aug 20, 2026
Merged

Add lightweight metrics and WeightWatcher audit#94
charlesmartin14 merged 1 commit into
mainfrom
agent/fix-weight-quotient-papermill-parameters

Conversation

@charlesmartin14

Copy link
Copy Markdown
Member

Summary

  • fix the single-run MuonClip Jacobian audit so completed-run provenance is validated from the persistent run while model references come from the verified tail cache
  • normalize Papermill JSON-list and boolean strings in the one- and three-seed weight-quotient notebooks
  • add notebook 21, a lightweight CSV-only dashboard for test accuracy/loss and per-layer WeightWatcher alpha (raw versus fix_fingers=clip_xmax)
  • persist sanity checks, fit availability, source rows, plots, an audit summary, and strict provenance
  • document the exact command-line invocation

Performance

Notebook 21 loads no checkpoints, runs no Jacobians or child notebooks, and performs no new WeightWatcher fits. A synthetic completed-run execution produced all expected outputs in about three seconds.

Tests

  • python -m unittest baseline.tests.test_source_syntax baseline.tests.tangent_rg.test_notebook_contract baseline.tests.tangent_rg.test_weight_quotients baseline.tests.tangent_rg.test_weight_quotient_resume -v (37 tests)
  • git diff --check
  • synthetic end-to-end execution of every code cell in notebook 21 with all expected output artifacts and zero failed sanity checks

- normalize Papermill string/list parameters in weight-quotient notebooks
- add a CSV-only metrics and WeightWatcher sanity dashboard
@charlesmartin14
charlesmartin14 force-pushed the agent/fix-weight-quotient-papermill-parameters branch from ebedcee to 667b910 Compare August 20, 2026 20:28
@charlesmartin14
charlesmartin14 merged commit e39c5c0 into main Aug 20, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant