MojiDiff

← experiments

masked-overfit-l6b-metric-head-62db169-4icons-9b9b1699

completed —

Measured behaviour

Held-out negative log likelihood per free token
modelposition-marginal floor
nats per tokenoptimizer step024680100020003000selected
Table view
optimizer stepmodelposition-marginal floor
06.76224.9159
1005.02474.9159
2004.57154.9159
3003.42484.9159
4002.50964.9159
5002.32584.9159
6002.24174.9159
7002.21594.9159
8002.19174.9159
9002.17444.9159
10002.15584.9159
11002.14554.9159
12002.13034.9159
13002.12604.9159
14002.11534.9159
15002.10654.9159
16002.09404.9159
17002.09234.9159
18002.08724.9159
19002.09964.9159
20002.07884.9159
21002.07344.9159
22002.07054.9159
23002.07244.9159
24002.07034.9159
25002.06774.9159
26002.06234.9159
27002.06534.9159
28002.05734.9159
29002.06104.9159
30002.05674.9159
Masked-token accuracy over unforced positions
modelposition-marginal floor
accuracyoptimizer step00.250.50.7510100020003000selected
Table view
optimizer stepmodelposition-marginal floor
00.01960.5470
1000.04630.5470
2000.09260.5470
3000.18230.5470
4000.33380.5470
5000.45440.5470
6000.58200.5470
7000.65500.5470
8000.68860.5470
9000.77000.5470
10000.80220.5470
11000.81490.5470
12000.87240.5470
13000.86540.5470
14000.90180.5470
15000.89900.5470
16000.93550.5470
17000.93270.5470
18000.95510.5470
19000.89900.5470
20000.96210.5470
21000.96910.5470
22000.96350.5470
23000.98180.5470
24000.94670.5470
25000.96910.5470
26000.98880.5470
27000.99160.5470
28000.98180.5470
29000.97900.5470
30000.99580.5470

Measured result

Verbatim from the run's summary.json.

checkpoint_round_trip
true
checkpoint_sha256
3039461a4446c34e…
checks
all_valid
true
exact_path_reproduction
true
masked_token_accuracy
true
config_sha256
67c56a8dcf164c10…
continuity
copy_previous
mean_bins_off
28.125
median_bins_off
9.25
n
4
marginal
mean_bins_off
116.125
median_bins_off
113.5
n
4
model
mean_bins_off
0.0
median_bins_off
0.0
n
4
coordinate_tau
1.0
criteria
min_exact_path_reproduction_rate
1.0
min_masked_token_accuracy
0.99
require_all_valid
true
deterministic_algorithms
true
device
cuda
evaluation_icons
4
evaluation_split
train
first_train_loss
5.730949878692627
gpu
NVIDIA GeForce RTX 4080
held_out_nll_per_masked_token
2.0566998624868513
icon_presentations
12000
initial_held_out_nll
6.762217303646564
inpainting
all_valid
true
attempted
4
decoding
greedy_for_criteria
true
iterations
8
samples
1
drop
median_rgba_mae
0.0034825291999515855
exact_reproduction_rate
1.0
icons
4
marginal
helped
0
mean_recovery
-1.8921178315003433
median_recovery
-2.0224896560213343
median_rgba_mae
0.010612782921810698
model
helped
4
mean_recovery
1.0
median_recovery
1.0
median_rgba_mae
0.0
paired
drop_minus_model
interval
-0.01649456796035647, 0.03891612145829885
interval_excludes_zero_above
false
mean
0.011210776748971191
n
4
positive
4
marginal_minus_model
interval
-0.0119139906416794, 0.04538188204206671
interval_excludes_zero_above
false
mean
0.016733945700193657
n
4
positive
4
rows_sha256
04fb338cd8804e7e…
sheet_sha256
c557efabdd197941…
last_train_loss
1.940062165260315
loss_reduction_factor
3.2878969979946673
marginal_masked_token_accuracy
0.5469845722300141
marginal_nll_per_masked_token
4.9158920138280155
mask_mixture
drawn
geometry
1203
path
3603
random
3605
span
2422
style
1167
max_paths
2
random_rate
0.05, 0.95
span_max
None
weights
geometry
0.1
path
0.3
random
0.3
span
0.2
style
0.1
masked_token_accuracy
0.9957924263674615
metric_head
true
metrics_sha256
2214e6181b46e15e…
model_parameters
528244
nll_ratio_to_marginal
0.4183777545766907
path_binding
false
predeclared_outcome
passed
schema_version
1
selected_step
3000
sequence_length
1376
steps_run
3000
study_version
masked-overfit-l6b-metric-head
timing
peak_vram_gib
0.49815893173217773
prepare_seconds
0.2627544710121583
train_seconds
111.19324588298332
torch_version
2.14.0a0+4fdf77b940.nv26.08
train_icons
4
vocabulary
418

Visual output

inpainting
inpainting.png

State transitions

  1. planned2026-09-21T09:12:52Z
  2. completed2026-09-21T09:15:29Zwith the head on at every trained position, all three criteria pass: masked-token accuracy 0.996, 4 of 4 masked paths reproduced exactly with pixel-identical renders, every completion valid, continuity error 0.0 bins on the training icons

Run record

This run has no run.yaml. What follows is the identity and configuration carried by its rows in state/runs.jsonl, the append-only registry.

run_id
masked-overfit-l6b-metric-head-62db169-4icons-9b9b1699
config
configs/learning/masked-overfit-l6b-metric-head.yaml
outputs
checkpoint_root
data/processed/masked-overfit-l6b-metric-head
report_root
reports/learning/masked-overfit-l6b-metric-head