Model analysis report for

• ▶
  root: {} 10 keys
  • report_name: 'rldriving_driving.analyse_cones'
  • route_list: '/home/batman/xx/routes/tests/cones.txt'
  • output_dir: null
  • save_tmp: false
  • read_only: false
  • limit: 10000
  • use_virtual_webgl: false
  • format: 'HTML'
  • ▶
    miniray: {} 8 keys
    • priority: 10
    • job_name: 'rldriving_driving.analyse_cones'
    • queue_name: 'remote2'
    • submit_host: 'redis.comma.internal'
    • result_host: 'data-ram.comma.internal'
    • no_unique_id: false
    • codedir: 'caches/workstation-yassine_2025-06-09_15-43-38'
    • force_local: false
  • ▶
    rollout: {} 10 keys
    • type: 'RawVideoRL'
    • nowindow: false
    • debug: false
    • debug_render: true
    • save_observation_keys: ['debug_rendered']
    • output_dir: null
    • rerun: false
    • ▶
      env: {} 20 keys
      • debug_window_size: [512, 512]
      • ▶
        ep: {} 7 keys
        • segment: ''
        • augment_desire: false
        • depth_type: 'EASYDEPTH'
        • calibration_source: 'MESH_3D'
        • pipeline_dir: 'http://data-ssd.comma.life/runner/training_2024_06'
        • feature_dir: null
        • ▶
          input_paths: {} 0 keys
      • start: null
      • end: null
      • env: 'xx.arena.envs.rawvideo_env.RawVideoEnv'
      • get_imgs: true
      • allow_resets: true
      • zero_desire: true
      • fps: 20
      • allow_lat: true
      • allow_long: false
      • min_hist: 40
      • compressor_model: null
      • compressor_mode: 'NONE'
      • quantized_compressor_latents: false
      • yolo_model: false
      • lpips_model: false
      • sharpness_metric: true
      • future_observation_range_seconds: null
      • with_gt: true
    • ▶
      agent: {} 12 keys
      • supercombo: '6a8a3da8-c264-4f91-b0a6-d04722cccfce/700'
      • restrict_outputs: null
      • exclude_outputs: ['vision_features', 'state', 'imgs']
      • calibrate_speed: false
      • use_allow_throttle: false
      • use_prev_desired_curv: true
      • model_trained_fps: 5
      • use_worldmodel_as_agent: false
      • use_raw_plan_lat: false
      • use_raw_plan_long: false
      • desired_curv_smooth_seconds: false
      • desired_accel_smooth_seconds: false
    • ▶
      shadow_agent: {} 0 keys

total 8 segments

total plan cone hits, model=26, gt=3

total overall plan position error 2.320 (m)

total 1s plan position error 0.479 (m)

total 2s plan position error 0.934 (m)

2c912ca5de3b1ee9|000001a4--26abcabe43/3

Number of frames with plan hitting cones: model=10, gt=0

model	gt
Num cones=12, closest model plan, frame=1026, clearance=-0.402 (m)	Num cones=11, closest gt plan, frame=934, clearance=0.561 (m)

overall	1s	2s
Worst frame overall plan position error 923, err=10.829 (m)	Worst frame 1s plan position error 923, err=2.442 (m)	Worst frame 2s plan position error 923, err=5.739 (m)

328eb791948dc4c4|2024-02-16--13-44-30/12

Number of frames with plan hitting cones: model=1, gt=0

model	gt
Num cones=7, closest model plan, frame=1064, clearance=-0.035 (m)	Num cones=0, closest gt plan, frame=1000, clearance=inf (m)

overall	1s	2s
Worst frame overall plan position error 1003, err=11.429 (m)	Worst frame 1s plan position error 1003, err=3.535 (m)	Worst frame 2s plan position error 1003, err=6.827 (m)

4cef06d33690da48|2021-04-25--06-57-53/10

Number of frames with plan hitting cones: model=0, gt=3

model	gt
Num cones=4, closest model plan, frame=470, clearance=0.190 (m)	Num cones=6, closest gt plan, frame=505, clearance=-0.263 (m)

overall	1s	2s
Worst frame overall plan position error 531, err=8.880 (m)	Worst frame 1s plan position error 534, err=1.896 (m)	Worst frame 2s plan position error 531, err=3.765 (m)

8011d605be1cbb77|000000a5--a58f231e61/10

Number of frames with plan hitting cones: model=0, gt=0

model	gt
Num cones=1, closest model plan, frame=211, clearance=1.159 (m)	Num cones=4, closest gt plan, frame=227, clearance=1.521 (m)

overall	1s	2s
Worst frame overall plan position error 131, err=15.730 (m)	Worst frame 1s plan position error 131, err=4.754 (m)	Worst frame 2s plan position error 131, err=9.397 (m)

82992303be12fe7d|2023-10-24--11-04-14/4

Number of frames with plan hitting cones: model=12, gt=0

model	gt
Num cones=5, closest model plan, frame=1059, clearance=-0.416 (m)	Num cones=2, closest gt plan, frame=998, clearance=1.836 (m)

overall	1s	2s
Worst frame overall plan position error 987, err=7.835 (m)	Worst frame 1s plan position error 987, err=2.216 (m)	Worst frame 2s plan position error 987, err=4.598 (m)

9534577804069efa|00000036--3e59d4e002/11

Number of frames with plan hitting cones: model=2, gt=0

model	gt
Num cones=1, closest model plan, frame=1056, clearance=-0.071 (m)	Num cones=0, closest gt plan, frame=1045, clearance=inf (m)

overall	1s	2s
Worst frame overall plan position error 1048, err=8.692 (m)	Worst frame 1s plan position error 1048, err=4.446 (m)	Worst frame 2s plan position error 1048, err=8.181 (m)

d5e5da41ff5086ec|2022-04-17--12-55-56/17

Number of frames with plan hitting cones: model=0, gt=0

model	gt
Num cones=7, closest model plan, frame=559, clearance=5.615 (m)	Num cones=7, closest gt plan, frame=558, clearance=7.503 (m)

overall	1s	2s
Worst frame overall plan position error 477, err=5.759 (m)	Worst frame 1s plan position error 476, err=1.680 (m)	Worst frame 2s plan position error 477, err=3.205 (m)

df8db5b63ca1031a|2021-10-07--11-42-48/8

Number of frames with plan hitting cones: model=1, gt=0

model	gt
Num cones=1, closest model plan, frame=826, clearance=-0.078 (m)	Num cones=4, closest gt plan, frame=891, clearance=0.716 (m)

overall	1s	2s
Worst frame overall plan position error 802, err=14.676 (m)	Worst frame 1s plan position error 802, err=2.194 (m)	Worst frame 2s plan position error 802, err=5.141 (m)