MojiDiff

← experiments

tiny-geometry-f1-v3-path-correlated-e7b8e4a-2f4c614a-bd6c4bbc

completed —

Hypothesis

path-correlated geometry corruption is the fixture-matched treatment for factorized and whole-path comparisons

Measured behaviour

Training token accuracy (per batch)
accuracyoptimizer step00.250.50.751100200300
Table view
optimizer steptrain accuracy
10.0023
100.0930
200.3360
300.5159
400.6672
500.6325
600.7135
700.6979
800.7623
900.7113
1000.6847
1100.7115
1200.7721
1300.7800
1400.7798
1500.7525
1600.7285
1700.8202
1800.8166
1900.7871
2000.8525
2100.8344
2200.8122
2300.8495
2400.8885
2500.8636
2600.8805
2700.8842
2800.8864
2900.9127
3000.9177
3100.9334
3200.9486

Measured result

Verbatim from the run's summary.json.

cases
diverse-four
checkpoint_sha256
499b9bc9f008ad64…
config
corruption_kind
path_correlated_geometry
corruptions_per_icon
4
heldout_corruptions_per_icon
4
icon_count
4
max_loss_ratio
0.3
min_heldout_accuracy
0.75
min_train_accuracy
0.9
name
diverse-four
resample_each_step
true
resume_step
160
seed
1702
steps
320
continuous_loss_sha256
53922e1847b96e63…
final
accuracy
0.922962648556876
changed_accuracy
0.8054662379421221
changed_correct
3006
changed_total
3732
correct
8698
loss
0.21379275666549802
retained_accuracy
1.0
retained_correct
5692
retained_total
5692
total
9424
final_model_sha256
eed0fbf84315c64a…
heldout_examples
16
initial
accuracy
0.0022283531409168084
changed_accuracy
0.004555198285101822
changed_correct
17
changed_total
3732
correct
21
loss
14.90720123052597
retained_accuracy
0.0007027406886858749
retained_correct
4
retained_total
5692
total
9424
loss_ratio
0.009409970934641096
passes_predeclared_criteria
true
resume_exact
true
resumed_loss_sha256
53922e1847b96e63…
train_examples
16
train_final
accuracy
0.9279499151103565
changed_accuracy
0.7908194701170672
changed_correct
2567
changed_total
3246
correct
8745
loss
0.18988223723135889
retained_accuracy
1.0
retained_correct
6178
retained_total
6178
total
9424
code_identity
geometry_sha256
2d61f4c07725b827…
git_commit
e7b8e4a9de7579f55e2ec90644aeca6bbd35353d
packed_sha256
9b12879ba3a18236…
program_sha256
0d02b532b1dbe573…
tiny_study_sha256
a108fc4f7043beb3…
config_sha256
2f4c614a0caf4eb7…
deterministic_algorithms
true
device
cpu
fixture
data/manifests/openmoji-17.0.0-whole-path-fixture-v3.json
fixture_sha256
bd6c4bbc3440aeec…
metrics_sha256
a4cc37589332f305…
model
d_model
48
feedforward
96
heads
4
layers
2
parameters
241072
scope
fixed-topology geometry-only diagnostic
passes_predeclared_gate_candidate
true
render_metrics_sha256
b8a19f535ad044b9…
schema_version
1
study_version
tiny-geometry-f1-v3-path-correlated
torch_version
2.8.0+cpu

Visual output

trajectory
trajectory.png

Written result

Completed twice byte-identically on local CPU. Held-out aggregate/changed/retained accuracy: 92.30% / 80.55% / 100.00%. Checkpoint continuation was exact.

The changed-token recovery is 12.07 percentage points below the matched factorized control in this single-seed fixed-topology comparison.

State transitions

  1. planned2026-08-31T00:00:00Z
  2. running2026-08-31T00:00:01Z
  3. running2026-08-31T00:00:02Z
  4. failed2026-08-31T00:00:03Z
  5. running2026-08-31T00:00:04Z
  6. completed2026-08-31T00:03:00Zfixture_matched_path_correlated_treatment_completes
  7. completed2026-08-31T15:43:06Zfixture_matched_path_correlated_treatment_reproduces_byte_identically

Run record

Verbatim from runs/tiny-geometry-f1-v3-path-correlated-e7b8e4a-2f4c614a-bd6c4bbc/run.yaml, the record committed before launch.

schema_version
1
run_id
tiny-geometry-f1-v3-path-correlated-e7b8e4a-2f4c614a-bd6c4bbc
state
completed
hypothesis
path-correlated geometry corruption is the fixture-matched treatment for factorized and whole-path comparisons
parent_runs
tiny-geometry-f1-v3-factorized-e7b8e4a-fbf49d65-bd6c4bbc, tiny-geometry-f1-whole-path-e13259f-cf59a64e-bd6c4bbc
git_commit
e7b8e4a9de7579f55e2ec90644aeca6bbd35353d
config
configs/learning/tiny-geometry-f1-v3-path-correlated.yaml
config_sha256
2f4c614a0caf4eb7…
dataset_manifest
data/manifests/openmoji-17.0.0-whole-path-fixture-v3.json
dataset_manifest_sha256
bd6c4bbc3440aeec…
worker
gtc-local-cpu
resource_cap
external_spend_usd
0
optimizer_steps
320
max_local_storage_gb
0.1
command
.venv/bin/python -m mojidiff.learning.tiny_study --config configs/learning/tiny-geometry-f1-v3-path-correlated.yaml
active_job_id
None
launch_note
initial nohup wrapper exited without invoking Python or creating an artifact; foreground attempt is the authoritative execution
artifact_durability
compact-report-pending-local-git;checkpoint-local-only
result
heldout accuracy 0.9229626486; changed-token accuracy 0.8054662379; retained-token accuracy 1.0; exact checkpoint continuation
summary_sha256
a225ca46b0301ef0…
artifact_identity_rerun
true