omnisvg-n1-image-control-14df6c1-32icons-9b9b1699
completed —
Measured result
Verbatim from the run's summary.json.
checks
clip_to_reference
true
reference_top1_rate
true
clip
repo
openai/clip-vit-base-patch32
revision
3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268
clip_to_caption
mean
0.24530506366863847
median
0.244874969124794
n
64
clip_to_reference
mean
0.9046997493132949
median
0.9366933107376099
n
64
codec_valid_rate
0.140625
config_sha256
3d4781147bf862a3…control
clip_to_reference_mean
0.9046997493132949
control_clip_to_reference_mean
0.8112438190728426
control_codec_valid_rate
0.734375
control_reference_top1_rate
0.078125
control_rows_sha256
3f6131b329d040a5…gain_ci95
0.06902952119708061, 0.11794932712800799
icons_improved
30
mean_gain
0.09345593024045229
paired_icons
32
report_root
reports/learning/omnisvg-m1-control
criteria
min_clip_to_reference_mean
0.9
min_reference_top1_rate
0.5
decoded_rate
1.0
drawings
64
ended_rate
0.5
failures
encode:program needs 1 contours and up to 1020 segments
1
encode:program needs 1 contours and up to 505 segments
1
encode:program needs 1 contours and up to 508 segments
1
encode:program needs 1 contours and up to 510 segments
4
encode:program needs 1 contours and up to 511 segments
1
encode:program needs 1 contours and up to 512 segments
1
encode:program needs 1 contours and up to 514 segments
1
encode:program needs 1 contours and up to 737 segments
1
encode:program needs 11 contours and up to 492 segments
1
encode:program needs 18 contours and up to 329 segments
1
encode:program needs 2 contours and up to 484 segments
1
encode:program needs 3 contours and up to 466 segments
1
encode:program needs 3 contours and up to 467 segments
1
encode:program needs 3 contours and up to 496 segments
1
encode:program needs 4 contours and up to 959 segments
1
encode:program needs 9 contours and up to 421 segments
1
normalize:unsupported_color: fill color 'currentColor' is unsupported
32
pack:program needs 132 packed segments but capacity is 128
2
pack:program needs 156 packed segments but capacity is 128
1
pack:program needs 217 packed segments but capacity is 128
1
icons
32
max_new_tokens
2048
mean_snap_distance_rgb
8.490590416899696
median_paths
4.0
median_tokens
1802.0
model
adapter
None
adapter_sha256
None
checkpoint_sha256
39f36759fc677b32…fine_tuned
false
parameters
3846914048
repo
OmniSVG/OmniSVG1.1_4B
revision
117d4c4541839e02943554fe71c0a0d54fcef819
predeclared_outcome
passed
prompt_style
image
reference_rank
chance_top1
0.03125
mean
5.953125
scored
64
top1_rate
0.609375
top5_rate
0.71875
rows_sha256
5cabd027e8c4e617…samples_per_icon
2
sampling
repetition_penalty
1.05
temperature
0.3
top_k
50
top_p
0.9
schema_version
1
sheet_sha256
d0542daf44be0284…study_version
omnisvg-n1-image-control
timing
generate_seconds
1091.5658713899902
load_seconds
36.695703363016946
peak_vram_gib
7.969939231872559
seconds_per_drawing
17.055716740468597
Visual output
State transitions
- planned2026-09-22T14:41:34Z
- completed2026-09-22T15:03:02Zgiven its own 448 px render, the released model returns the icon: the right icon is retrieved first among the 32 held-out renders for 39 of 64 drawings (0.609; chance 0.031; the best caption arm 0.094), in the top five for 46, mean rank 6.0; similarity to the held-out render 0.905 mean and 0.937 median (caption control 0.811; the exact icon 0.994); paired gain over the caption control +0.093 with an interval of +0.069 to +0.118; the sheet shows the warning sign, the UP! button, WC, the mushroom, the hexagon, the shopping cart, the tired face, the airplane, the regional indicator, the couple with heart and the assembly point recognisably; only half the drawings end within 2,048 tokens because the model traces raster edges with hundreds of tiny curves, and 32 fills come out as currentColor, which the conversion now maps to black (codec validity 0.14 as run, 0.19 on re-reading the stored drawings with black)
- completed2026-09-22T15:03:26Z
Run record
This run has no run.yaml. What follows is the identity and configuration carried by its rows in state/runs.jsonl, the append-only registry.
run_id
omnisvg-n1-image-control-14df6c1-32icons-9b9b1699
config
configs/learning/omnisvg-n1-image-control.yaml
outputs
report_root
reports/learning/omnisvg-n1-image-control