MojiDiff

← experiments

masked-continuity-l13-start-head-full-f6befd5-2681icons-9b9b1699

completed —

Measured behaviour

Held-out negative log likelihood per free token
modelposition-marginal floor
nats per tokenoptimizer step024680200040006000selected
Table view
optimizer stepmodelposition-marginal floor
06.32174.7865
3004.32654.7865
6004.16904.7865
9004.12844.7865
12004.07424.7865
15004.04034.7865
18004.02234.7865
21004.00484.7865
24003.97784.7865
27003.95054.7865
30003.84394.7865
33003.77944.7865
36003.74794.7865
39003.69234.7865
42003.61354.7865
45003.49844.7865
48003.43734.7865
51003.40764.7865
54003.38284.7865
57003.35524.7865
60003.33864.7865
63003.30864.7865
Masked-token accuracy over unforced positions
modelposition-marginal floor
accuracyoptimizer step00.10.20.30200040006000selected
Table view
optimizer stepmodelposition-marginal floor
00.04570.1307
3000.11300.1307
6000.13720.1307
9000.13820.1307
12000.15170.1307
15000.15600.1307
18000.16680.1307
21000.16140.1307
24000.16460.1307
27000.17000.1307
30000.16840.1307
33000.17540.1307
36000.18020.1307
39000.18500.1307
42000.18130.1307
45000.19800.1307
48000.18450.1307
51000.19850.1307
54000.20060.1307
57000.20010.1307
60000.19100.1307
63000.20440.1307

Measured result

Verbatim from the run's summary.json.

checkpoint_round_trip
true
checkpoint_sha256
3b9e15b39acbe4fe…
checks
all_valid
true
beats_copy_previous
true
config_sha256
be6adbabaa47b503…
continuity
copy_previous
mean_bins_off
25.64749262536873
median_bins_off
17.0
n
339
marginal
mean_bins_off
140.05162241887905
median_bins_off
138.5
n
339
model
mean_bins_off
17.86283185840708
median_bins_off
10.5
n
339
coordinate_tau
1.0
criteria
beats_copy_previous
true
require_all_valid
true
deterministic_algorithms
true
device
cuda
evaluation_icons
339
evaluation_split
validation
first_train_loss
6.082370281219482
gpu
NVIDIA GeForce RTX 4080
held_out_nll_per_masked_token
3.3086356480574337
icon_presentations
100800
initial_held_out_nll
6.321668299633434
inpainting
all_valid
true
attempted
16
close_reproduction_rate
0.0
decoding
chain_order
false
greedy_for_criteria
true
iterations
8
samples
1
drop
median_rgba_mae
0.009685249485596707
exact_reproduction_rate
0.0
icons
16
marginal
helped
2
mean_recovery
-29608927.159026496
median_recovery
-1.3892468653280403
median_rgba_mae
0.026510208635923502
model
helped
1
mean_recovery
-0.7507010071727791
median_recovery
-0.20457199417362984
median_rgba_mae
0.014014085572500605
paired
drop_minus_model
interval
-0.009051582744172743, 0.0005392011325774868
interval_excludes_zero_above
false
mean
-0.004256190805797628
n
16
positive
1
marginal_minus_model
interval
-0.01302153221682321, 0.018151452143898985
interval_excludes_zero_above
false
mean
0.0025649599635378883
n
16
positive
13
rows_sha256
6a78e24b4fe2e76e…
sheet_sha256
6d9aba7b0cda1497…
last_train_loss
3.230076551437378
loss_reduction_factor
1.9106571324482382
marginal_masked_token_accuracy
0.1307154384077461
marginal_nll_per_masked_token
4.786513732286344
mask_mixture
drawn
span
100800
max_paths
2
random_rate
0.05, 0.95
span_max
1
weights
span
1.0
masked_token_accuracy
0.20441097364174288
metric_head
true
metrics_sha256
46bb6f6b39572424…
model_parameters
531892
nll_ratio_to_marginal
0.6912412317423811
path_binding
false
predeclared_outcome
passed
schema_version
1
selected_step
6300
sequence_length
1376
start_features
true
steps_run
6300
study_version
masked-continuity-l13-start-head-full
timing
peak_vram_gib
1.9460439682006836
prepare_seconds
101.41797300000326
train_seconds
418.78929798598983
torch_version
2.14.0a0+4fdf77b940.nv26.08
train_icons
2681
vocabulary
418

Visual output

inpainting
inpainting.png

State transitions

  1. planned2026-09-21T09:39:00Z
  2. completed2026-09-21T09:57:15Zstart features and the metric head at the full budget beat the copy-the-previous-endpoint policy: 17.9 bins (median 10.5) against 25.6 (median 17.0) over one hidden segment in each of 339 held-out icons; held-out likelihood 3.309, 0.691 of the floor, still falling at step 6,300; every completion valid

Run record

This run has no run.yaml. What follows is the identity and configuration carried by its rows in state/runs.jsonl, the append-only registry.

run_id
masked-continuity-l13-start-head-full-f6befd5-2681icons-9b9b1699
config
configs/learning/masked-continuity-l13-start-head-full.yaml
outputs
checkpoint_root
data/processed/masked-continuity-l13-start-head-full
report_root
reports/learning/masked-continuity-l13-start-head-full