MojiDiff

← experiments

masked-inpaint-l4-binding-438a98f-2681icons-9b9b1699

completed —

Measured behaviour

Held-out negative log likelihood per free token
modelposition-marginal floor
nats per tokenoptimizer step02460200040006000selected
Table view
optimizer stepmodelposition-marginal floor
04.86574.1110
3003.95624.1110
6003.92544.1110
9003.90054.1110
12003.89594.1110
15003.88724.1110
18003.88364.1110
21003.87564.1110
24003.87034.1110
27003.86454.1110
30003.85384.1110
33003.87264.1110
36003.85644.1110
39003.85664.1110
42003.85734.1110
45003.87714.1110
48003.85564.1110
51003.85134.1110
54003.87274.1110
57003.87274.1110
60003.84314.1110
63003.85424.1110
Masked-token accuracy over unforced positions
modelposition-marginal floor
accuracyoptimizer step00.10.20.30200040006000selected
Table view
optimizer stepmodelposition-marginal floor
00.03670.2413
3000.24170.2413
6000.24570.2413
9000.25450.2413
12000.25220.2413
15000.25710.2413
18000.25910.2413
21000.26190.2413
24000.26060.2413
27000.26230.2413
30000.26520.2413
33000.26600.2413
36000.26760.2413
39000.26740.2413
42000.26910.2413
45000.26800.2413
48000.27150.2413
51000.27170.2413
54000.27440.2413
57000.27180.2413
60000.27390.2413
63000.27510.2413

Measured result

Verbatim from the run's summary.json.

checkpoint_round_trip
true
checkpoint_sha256
6a1f28fe5fe93501…
checks
all_valid
true
beats_drop_baseline
false
beats_marginal_baseline
true
median_recovery
false
config_sha256
27f9a1a73dde47af…
coordinate_tau
1.0
criteria
beats_drop_baseline
true
beats_marginal_baseline
true
min_median_recovery
0.3
require_all_valid
true
deterministic_algorithms
true
device
cuda
evaluation_icons
339
evaluation_split
validation
first_train_loss
4.834274768829346
gpu
NVIDIA GeForce RTX 4080
held_out_nll_per_masked_token
3.8430836629468286
icon_presentations
100800
initial_held_out_nll
4.865704408062041
inpainting
all_valid
true
attempted
64
decoding
greedy_for_criteria
true
iterations
8
samples
1
drop
median_rgba_mae
0.006453019093439845
exact_reproduction_rate
0.0
icons
64
marginal
helped
0
mean_recovery
-112236156.97001305
median_recovery
-1.7608338149263418
median_rgba_mae
0.019917714385136773
model
helped
8
mean_recovery
-8971332.327989401
median_recovery
-0.8093105148673071
median_rgba_mae
0.013239454732510288
paired
drop_minus_model
interval
-0.006946371188264783, -0.0022920140771067977
interval_excludes_zero_above
false
mean
-0.00461919263268579
n
64
positive
8
marginal_minus_model
interval
0.006594306252434617, 0.014630798613971825
interval_excludes_zero_above
true
mean
0.01061255243320322
n
64
positive
51
rows_sha256
cbcff1b8671bd7ed…
sheet_sha256
107003c67933b6c1…
last_train_loss
3.869515895843506
loss_reduction_factor
1.2660938024781587
marginal_masked_token_accuracy
0.2413130873428418
marginal_nll_per_masked_token
4.1110007453812765
mask_mixture
drawn
geometry
10032
path
30461
random
30235
span
20052
style
10020
max_paths
2
random_rate
0.05, 0.95
weights
geometry
0.1
path
0.3
random
0.3
span
0.2
style
0.1
masked_token_accuracy
0.27388420863954116
metrics_sha256
d4ad63137fea5f15…
model_parameters
542050
nll_ratio_to_marginal
0.9348292303922704
path_binding
true
predeclared_outcome
falsified
schema_version
1
selected_step
6000
sequence_length
1376
steps_run
6300
study_version
masked-inpaint-l4-binding
timing
peak_vram_gib
1.9463090896606445
prepare_seconds
101.93874733400298
train_seconds
395.4905390780186
torch_version
2.14.0a0+4fdf77b940.nv26.08
train_icons
2681
vocabulary
418

Visual output

inpainting
inpainting.png

State transitions

  1. planned2026-09-21T08:35:58Z
  2. completed2026-09-21T08:47:17Zindistinguishable from l2 on every measure: held-out likelihood 3.843 against 3.869, accuracy 0.274 against 0.266, 8 icons helped against 7, worse than leaving the hole on 56 of 64, and icon by icon the two arms differ by 0.0006 RGBA MAE with binding better on 25 of 64; every completion valid

Run record

This run has no run.yaml. What follows is the identity and configuration carried by its rows in state/runs.jsonl, the append-only registry.

run_id
masked-inpaint-l4-binding-438a98f-2681icons-9b9b1699
config
configs/learning/masked-inpaint-l4-binding.yaml
outputs
checkpoint_root
data/processed/masked-inpaint-l4-binding
report_root
reports/learning/masked-inpaint-l4-binding