Skip to content

Add observable command-line Jacobian analysis - #107

Merged
charlesmartin14 merged 1 commit into
mainfrom
feature/observable-jacobian-cli
Aug 22, 2026
Merged

Add observable command-line Jacobian analysis#107
charlesmartin14 merged 1 commit into
mainfrom
feature/observable-jacobian-cli

Conversation

@charlesmartin14

Copy link
Copy Markdown
Member

Summary

  • replace the opaque Papermill execution path with a normal unbuffered command-line Jacobian runner
  • log checkpoint loading, every Jacobian construction, every power-law fit, elapsed time, and rolling ETA
  • atomically persist status, partial CSVs, spectrum plots, and alpha-progress plots after each checkpoint
  • validate only selected checkpoints as they are consumed, while retaining exact provenance and optional ECS cover ranks
  • add resume behavior and full terminal/file traceback reporting

Validation

  • python -m py_compile baseline/experiments/mnist_mlp3_tangent_rg/scripts/run_short100_jacobians_cli.py
  • bash -n baseline/experiments/mnist_mlp3_tangent_rg/scripts/run_short100_jacobians_cli.sh
  • git diff --check
  • exercised fatal path: traceback appeared in terminal and jacobians.log, with structured status.json and fatal_error.json

The sandbox lacks PyTorch and pytest, so the synthetic numerical test could not be executed here; it is included for the repository environment.

@charlesmartin14
charlesmartin14 marked this pull request as ready for review August 22, 2026 00:19
@charlesmartin14
charlesmartin14 merged commit bfbc537 into main Aug 22, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant