MojiDiff

← experiments

masked-overfit-l3-binding-438a98f-4icons-9b9b1699

completed —

Measured behaviour

Held-out negative log likelihood per free token
modelposition-marginal floor
nats per tokenoptimizer step02460100020003000selected
Table view
optimizer stepmodelposition-marginal floor
05.82774.9159
1004.88324.9159
2004.17214.9159
3003.12504.9159
4002.46814.9159
5002.21874.9159
6002.14644.9159
7002.11974.9159
8002.09844.9159
9002.10294.9159
10002.06784.9159
11002.05554.9159
12002.04814.9159
13002.03844.9159
14002.03534.9159
15002.02884.9159
16002.01254.9159
17002.00724.9159
18002.00444.9159
19002.00934.9159
20001.99644.9159
21001.99654.9159
22001.99384.9159
23001.99294.9159
24001.99324.9159
25001.99024.9159
26001.99094.9159
27001.98134.9159
28001.98074.9159
29001.98974.9159
30001.98064.9159
Masked-token accuracy over unforced positions
modelposition-marginal floor
accuracyoptimizer step00.250.50.7510100020003000selected
Table view
optimizer stepmodelposition-marginal floor
00.01400.5470
1000.07010.5470
2000.14730.5470
3000.31000.5470
4000.44320.5470
5000.62550.5470
6000.75880.5470
7000.81910.5470
8000.85270.5470
9000.86400.5470
10000.90320.5470
11000.94530.5470
12000.94810.5470
13000.96630.5470
14000.97900.5470
15000.97190.5470
16000.99160.5470
17000.99720.5470
18000.99160.5470
19000.98180.5470
20000.99580.5470
21000.99720.5470
22000.99860.5470
23000.99580.5470
24000.99720.5470
25000.99860.5470
26001.00000.5470
27001.00000.5470
28001.00000.5470
29000.99720.5470
30001.00000.5470

Measured result

Verbatim from the run's summary.json.

checkpoint_round_trip
true
checkpoint_sha256
b5e756d8d74e2ca1…
checks
all_valid
true
exact_path_reproduction
true
masked_token_accuracy
true
config_sha256
d9090bc6d3be8548…
coordinate_tau
1.0
criteria
min_exact_path_reproduction_rate
1.0
min_masked_token_accuracy
0.99
require_all_valid
true
deterministic_algorithms
true
device
cuda
evaluation_icons
4
evaluation_split
train
first_train_loss
4.911922931671143
gpu
NVIDIA GeForce RTX 4080
held_out_nll_per_masked_token
1.98063345075824
icon_presentations
12000
initial_held_out_nll
5.827729170319074
inpainting
all_valid
true
attempted
4
decoding
greedy_for_criteria
true
iterations
8
samples
1
drop
median_rgba_mae
0.0034825291999515855
exact_reproduction_rate
1.0
icons
4
marginal
helped
0
mean_recovery
-1.8921178315003433
median_recovery
-2.0224896560213343
median_rgba_mae
0.010612782921810698
model
helped
4
mean_recovery
1.0
median_recovery
1.0
median_rgba_mae
0.0
paired
drop_minus_model
interval
-0.01649456796035647, 0.03891612145829885
interval_excludes_zero_above
false
mean
0.011210776748971191
n
4
positive
4
marginal_minus_model
interval
-0.0119139906416794, 0.04538188204206671
interval_excludes_zero_above
false
mean
0.016733945700193657
n
4
positive
4
rows_sha256
71d41d0a95011162…
sheet_sha256
7f1f2ba48d25ddd0…
last_train_loss
1.940286636352539
loss_reduction_factor
2.942356228553073
marginal_masked_token_accuracy
0.5469845722300141
marginal_nll_per_masked_token
4.9158920138280155
mask_mixture
drawn
geometry
1203
path
3603
random
3605
span
2422
style
1167
max_paths
2
random_rate
0.05, 0.95
weights
geometry
0.1
path
0.3
random
0.3
span
0.2
style
0.1
masked_token_accuracy
1.0
metrics_sha256
f552b07359c21059…
model_parameters
542050
nll_ratio_to_marginal
0.4029041820257391
path_binding
true
predeclared_outcome
passed
schema_version
1
selected_step
3000
sequence_length
1376
steps_run
3000
study_version
masked-overfit-l3-binding
timing
peak_vram_gib
0.49772024154663086
prepare_seconds
0.2604321110120509
train_seconds
112.19813616099418
torch_version
2.14.0a0+4fdf77b940.nv26.08
train_icons
4
vocabulary
418

Visual output

inpainting
inpainting.png

State transitions

  1. planned2026-09-21T08:32:47Z
  2. completed2026-09-21T08:35:58Zthe bound model memorises four icons exactly: masked-token accuracy 1.000, 4 of 4 masked whole paths reproduced token for token with pixel-identical renders, every completion valid; memorisation reaches 0.992 by step 1,800 against l1's 0.999, so binding costs nothing here

Run record

This run has no run.yaml. What follows is the identity and configuration carried by its rows in state/runs.jsonl, the append-only registry.

run_id
masked-overfit-l3-binding-438a98f-4icons-9b9b1699
config
configs/learning/masked-overfit-l3-binding.yaml
outputs
checkpoint_root
data/processed/masked-overfit-l3-binding
report_root
reports/learning/masked-overfit-l3-binding