r2s-smoke-cur-src-67bab78-f2440c87-47646604
completed —
Hypothesis
Trained on the 2,681 family-disjoint training icons with metric coordinates, path-major order, online exact augmentation and compositions, the 9.0M-parameter render-to-program model transcribes held-out validation renders better than retrieving the closest training icon. Pass requires all three: (1) mean 72 px pixel error below the nearest-training-icon baseline with the paired 95% interval on the reduction excluding zero; (2) CLIP top-1 on Gate N's 32 validation icons at or above OmniSVG 4B zero-shot, 0.609; (3) median single-icon latency on the RTX 4080 under 500 ms.
Visual output
Written result
Hypothesis. Trained on the 2,681 family-disjoint training icons with metric coordinates, path-major order, online exact augmentation and compositions, the 9.0M-parameter render-to-program model transcribes held-out validation renders better than retrieving the closest training icon. Pass requires all three: (1) mean 72 px pixel error below the nearest-training-icon baseline with the paired 95% interval on the reduction excluding zero; (2) CLIP top-1 on Gate N's 32 validation icons at or above OmniSVG 4B zero-shot, 0.609; (3) median single-icon latency on the RTX 4080 under 500 ms.
Result
| measure | value |
|---|---|
| icons evaluated | 32 (primary/validation) |
| model pixel error, mean [95% CI] | 0.1641 [0.1376, 0.1935] |
| model pixel error, median | 0.1165 |
| exact program rate | 0.000 |
| rendered rate | 1.000 |
| blank canvas pixel error | 0.1627 |
| nearest training icon pixel error | 0.0943 [0.0816, 0.1074] |
| error reduction vs nearest icon | -0.0697 [-0.1009, -0.0423] |
| icons where model beats nearest icon | 5 |
| CLIP top-1, model greedy (8 Gate N icons) | 0.125 |
| CLIP top-1, nearest training icon | 0.375 |
| CLIP top-1, OmniSVG 4B zero-shot (Gate N) | 0.609 |
Resources
| measure | value |
|---|---|
| device | NVIDIA B300 SXM6 AC |
| parameters | 9,026,338 |
| train seconds | 127 |
| peak VRAM GiB | 4.386440277099609 |
| latency ms/icon, batch 1, median | 3220.5 |
| latency ms/icon, batch 1, p95 | 3240.5 |
| throughput ms/icon, batch 32 | 176.0 |
| model calls per icon (decoding) | 650.0 |
| torch / CUDA | 2.14.1+cu130 / 13.0 |
Latency covers encoding and decoding to a validated token program; it excludes rasterising the SVG. Samples: samples.png, rows are reference, model, nearest training icon.
State transitions
- running2026-10-30T13:47:28Z
- completed2026-10-30T13:51:07Z
Run record
Verbatim from runs/r2s-smoke-cur-src-67bab78-f2440c87-47646604/run.yaml, the record committed before launch.
schema_version
2
run_id
r2s-smoke-cur-src-67bab78-f2440c87-47646604
state
completed
planned_at
2026-10-30T13:47:28Z
hypothesis
Trained on the 2,681 family-disjoint training icons with metric coordinates, path-major order, online exact augmentation and compositions, the 9.0M-parameter render-to-program model transcribes held-out validation renders better than retrieving the closest training icon. Pass requires all three: (1) mean 72 px pixel error below the nearest-training-icon baseline with the paired 95% interval on the reduction excluding zero; (2) CLIP top-1 on Gate N's 32 validation icons at or above OmniSVG 4B zero-shot, 0.609; (3) median single-icon latency on the RTX 4080 under 500 ms.
parent_run
r2s-full-v9-colour
git_commit
67bab78fdc1a5143a1b131f59e45979d02cdf2c0
dirty_patch_sha256
config
configs/render2svg/smoke-cur-src.yaml
config_sha256
f2440c87614abb51…config_resolved
model
image_size
144
d_model
256
heads
8
encoder_layers
2
decoder_layers
6
feedforward
1024
dropout
0.1
metric
true
fourier
10
order
path
sources
2
training
steps
1200
batch_size
32
learning_rate
0.0005
weight_decay
0.01
warmup_steps
100
seed
7001
eval_every
400
eval_icons
32
train_icons
None
evaluate_on_train
false
augment_variants
0
augment_seed
9001
augment_mirror
0.5
augment_max_shift
48
augment_colour
0.1
augment_online
true
compose_probability
0.5
compose_parts
4
augment_original
0.1
loader_workers
16
extra_training
twemoji
bf16
true
final_eval_icons
32
clip_icons
8
dataset
pilot_config
configs/learning/openmoji-g1-geometric-gate-v16.yaml
cache_sha256
476466042da98d72…train_icons
4892
augmented_variants
0
extra_training
format
1
commit
b6b55fef1e8636b540a6d016a4729ca8cdf2e60b
size
144
palette
#000000, #ffffff, #92d3f5, #61b2e4, #ea5a47, #d22f27 … and 22 more
slots
128
excluded_bases
354
candidates
3375
source_files
4009
excluded_as_held_out
634
fit_and_kept
2211
cache
/home/eai-jdkxz/eai-team11/mojidiff/cache/render2svg-extra-twemoji-23878da09a9c.npz
cache_sha256
b263d60cbb1ed1ad…augmented_sha256
None
evaluated_on
primary/validation
seed
7001
determinism
seeded; cuDNN and SDPA kernels not forced deterministic
model_parameters
9026338
command
.venv/bin/python -m mojidiff.learning.render2svg --config configs/render2svg/smoke-cur-src.yaml
outputs
run_dir
runs/r2s-smoke-cur-src-67bab78-f2440c87-47646604
checkpoints
/home/eai-jdkxz/eai-team11/mojidiff/cache/runs/r2s-smoke-cur-src-67bab78-f2440c87-47646604
notes
completed_at
2026-10-30T13:51:07Z
resource
device
NVIDIA B300 SXM6 AC
torch_version
2.14.1+cu130
cuda_version
13.0
python_version
3.12.3
peak_vram_gib
4.386440277099609
train_seconds
126.59089596301783
inference_ms_per_icon
3220.548659475753
inference_p95_ms_per_icon
3240.4934730147943
icons_per_second
0.3105060987225642
batched_ms_per_icon
176.01096574981057
batched_icons_per_call
32
excludes
rendering the output SVG to pixels
baselines
blank_canvas_pixel_error
0.16265273559838533
nearest_training_icon_pixel_error
0.09432368678972125
gate_n_omnisvg_zero_shot_top1
0.609375
nearest_training_icon_clip_top1
0.375
result
icons
32
model_pixel_error
0.16406991274561733, 0.1375862131215399, 0.19350219949556052
model_pixel_error_median
0.11653226241469383
exact_program_rate
0.0
rendered_rate
1.0
blank_pixel_error
0.16265273559838533
selected_step
400
nearest_training_icon_with_extra_pixel_error
0.09097035508602858, 0.07868951396085322, 0.10397139939886985
nearest_training_icon_pixel_error
0.09432368678972125, 0.08160671039076987, 0.10738429491466377
model_minus_baseline_error_reduction
-0.06974622595589608, -0.10085207241936586, -0.042283814310212615
icons_model_beats_baseline
5
clip_retrieval
model_greedy
top1_rate
0.125
top5_rate
0.625
mean_rank
4.625
clip_to_reference_mean
0.7983768582344055
chance_top1
0.125
icons
8
nearest_training_icon
top1_rate
0.375
top5_rate
1.0
mean_rank
2.125
clip_to_reference_mean
0.8379977643489838
chance_top1
0.125
icons
8
gate_n_omnisvg_zero_shot_top1
0.609375
gate_n_omnisvg_best_of_12_top1
0.828125
model_calls_per_icon
650