MojiDiff

← experiments

masked-overfit-l9-start-4c9d1e3-4icons-9b9b1699

completed —

Measured behaviour

Held-out negative log likelihood per free token
modelposition-marginal floor
nats per tokenoptimizer step02460100020003000selected
Table view
optimizer stepmodelposition-marginal floor
05.81654.9159
1004.88344.9159
2003.73374.9159
3002.51434.9159
4002.21324.9159
5002.16494.9159
6002.12364.9159
7002.09974.9159
8002.08614.9159
9002.06504.9159
10002.04744.9159
11002.03644.9159
12002.03144.9159
13002.02224.9159
14002.01304.9159
15002.00374.9159
16002.00224.9159
17001.99944.9159
18001.99484.9159
19001.99274.9159
20001.98924.9159
21001.98134.9159
22001.98134.9159
23001.97944.9159
24001.97794.9159
25001.98024.9159
26001.97604.9159
27001.97464.9159
28001.97114.9159
29001.97264.9159
30001.96864.9159
Masked-token accuracy over unforced positions
modelposition-marginal floor
accuracyoptimizer step00.250.50.7510100020003000selected
Table view
optimizer stepmodelposition-marginal floor
00.01120.5470
1000.07430.5470
2000.19500.5470
3000.39550.5470
4000.59750.5470
5000.70410.5470
6000.81490.5470
7000.87100.5470
8000.89200.5470
9000.92570.5470
10000.96490.5470
11000.97050.5470
12000.97050.5470
13000.98880.5470
14000.99580.5470
15000.99720.5470
16000.99720.5470
17000.99720.5470
18000.99860.5470
19000.99720.5470
20001.00000.5470
21001.00000.5470
22001.00000.5470
23001.00000.5470
24001.00000.5470
25001.00000.5470
26000.99440.5470
27001.00000.5470
28001.00000.5470
29001.00000.5470
30001.00000.5470

Measured result

Verbatim from the run's summary.json.

checkpoint_round_trip
true
checkpoint_sha256
5cac7c98bec62f91…
checks
all_valid
true
exact_path_reproduction
false
masked_token_accuracy
true
config_sha256
b9ec98d127feaf3b…
continuity
copy_previous
mean_bins_off
28.125
median_bins_off
9.25
n
4
marginal
mean_bins_off
116.125
median_bins_off
113.5
n
4
model
mean_bins_off
0.0
median_bins_off
0.0
n
4
coordinate_tau
1.0
criteria
min_exact_path_reproduction_rate
1.0
min_masked_token_accuracy
0.99
require_all_valid
true
deterministic_algorithms
true
device
cuda
evaluation_icons
4
evaluation_split
train
first_train_loss
4.878364086151123
gpu
NVIDIA GeForce RTX 4080
held_out_nll_per_masked_token
1.9685613303164446
icon_presentations
12000
initial_held_out_nll
5.816515822230014
inpainting
all_valid
true
attempted
4
decoding
greedy_for_criteria
true
iterations
8
samples
1
drop
median_rgba_mae
0.0034825291999515855
exact_reproduction_rate
0.75
icons
4
marginal
helped
0
mean_recovery
-1.8921178315003433
median_recovery
-2.0224896560213343
median_rgba_mae
0.010612782921810698
model
helped
4
mean_recovery
1.0
median_recovery
1.0
median_rgba_mae
0.0
paired
drop_minus_model
interval
-0.01649456796035647, 0.03891612145829885
interval_excludes_zero_above
false
mean
0.011210776748971191
n
4
positive
4
marginal_minus_model
interval
-0.0119139906416794, 0.04538188204206671
interval_excludes_zero_above
false
mean
0.016733945700193657
n
4
positive
4
rows_sha256
283fc14ddd11aded…
sheet_sha256
b88ce00da59343a7…
last_train_loss
1.9388482570648193
loss_reduction_factor
2.9547038909349164
marginal_masked_token_accuracy
0.5469845722300141
marginal_nll_per_masked_token
4.9158920138280155
mask_mixture
drawn
geometry
1203
path
3603
random
3605
span
2422
style
1167
max_paths
2
random_rate
0.05, 0.95
span_max
None
weights
geometry
0.1
path
0.3
random
0.3
span
0.2
style
0.1
masked_token_accuracy
1.0
metric_head
false
metrics_sha256
cfec9c925e5d61d8…
model_parameters
530146
nll_ratio_to_marginal
0.4004484485784141
path_binding
false
predeclared_outcome
falsified
schema_version
1
selected_step
3000
sequence_length
1376
start_features
true
steps_run
3000
study_version
masked-overfit-l9-start
timing
peak_vram_gib
0.49750185012817383
prepare_seconds
0.2583149290003348
train_seconds
117.16838825898594
torch_version
2.14.0a0+4fdf77b940.nv26.08
train_icons
4
vocabulary
418

Visual output

inpainting
inpainting.png

State transitions

  1. planned2026-09-21T09:23:39Z
  2. completed2026-09-21T09:26:58Zmasked-token accuracy 1.000 under the fixed masks, every completion valid, continuity error 0.0 bins on the training icons, and greedy whole-path completion reproduces 3 of 4 paths token for token with the fourth rendering at 1.0 recovery

Run record

This run has no run.yaml. What follows is the identity and configuration carried by its rows in state/runs.jsonl, the append-only registry.

run_id
masked-overfit-l9-start-4c9d1e3-4icons-9b9b1699
config
configs/learning/masked-overfit-l9-start.yaml
outputs
checkpoint_root
data/processed/masked-overfit-l9-start
report_root
reports/learning/masked-overfit-l9-start