Model analysis report for

▶
root: {} 11 keys
- report_name: 'mlsimdriving_driving.analyse_cones'
- route_list: '/home/batman/xx/routes/tests/cones.txt'
- output_dir: null
- save_tmp: false
- read_only: false
- shuffle: false
- limit: 10000
- use_virtual_webgl: false
- format: 'HTML'
- ▶
  miniray: {} 8 keys
  - priority: 10
  - job_name: 'mlsimdriving_driving.analyse_cones'
  - queue_name: 'remote2'
  - submit_host: 'redis.comma.internal'
  - result_host: 'data-ram.comma.internal'
  - no_unique_id: false
  - codedir: 'caches/workstation-harald_2025-07-25_08-15-05'
  - force_local: false
- ▶
  rollout: {} 10 keys
  - type: 'RawVideoRL'
  - nowindow: false
  - debug: false
  - debug_render: true
  - save_observation_keys: ['debug_rendered']
  - output_dir: null
  - rerun: false
  - ▶
    env: {} 22 keys
    - debug_window_size: [512, 512]
    - ▶
      ep: {} 7 keys
      - segment: ''
      - augment_desire: false
      - depth_type: 'EASYDEPTH'
      - calibration_source: 'MESH_3D'
      - pipeline_dir: 'http://data-ssd.comma.life/runner/training_2024_06'
      - feature_dir: null
      - ▶
        input_paths: {} 0 keys
    - start: null
    - end: null
    - env: 'xx.arena.envs.rawvideo_env.RawVideoEnv'
    - get_imgs: true
    - allow_resets: true
    - zero_desire: true
    - fps: 20
    - allow_lat: true
    - allow_long: false
    - min_hist: 40
    - compressor_model: null
    - compressor_decoder_model: null
    - compressor_mode: 'NONE'
    - quantized_compressor_latents: false
    - yolo_model: false
    - lpips_model: false
    - sharpness_metric: true
    - future_observation_range_seconds: null
    - ▶
      physics: {} 4 keys
      - type: 'BICYCLE'
      - ▶
        bicycle_model_config: {} 1 keys
        
        vehicle_platform: 'HONDA_CIVIC'
      - ▶
        classic_model_config: {} 1 keys
        
        platform: 'TOYOTA_COROLLA_TSS2'
      - ▶
        ml_model_config: {} 8 keys
        
        platform: 'TOYOTA_COROLLA_TSS2'
        
        eid: '3bec45a4-9512-4c7f-bdbc-9415e5890fb6/76'
        
        y_range: [-5.0, 5.0]
        
        vocab_size: 2048
        
        temperature: 0.5
        
        use_gt_features: false
        
        platform_vec_size: 256
        
        platform_map_path: '/code.nfs/branches/caches/workstation-harald_2025-07-25_08-15-05/xx/arena/envs/lib/physics_models/assets/platform_map.txt'
    - with_gt: true
  - ▶
    agent: {} 11 keys
    - supercombo: 'f35eaf21-ef51-413d-9857-398bcdabb7da/400'
    - restrict_outputs: null
    - exclude_outputs: ['vision_features', 'state', 'imgs']
    - use_allow_throttle: false
    - use_prev_desired_curv: false
    - model_trained_fps: 5
    - use_worldmodel_as_agent: false
    - use_raw_plan_lat: true
    - use_raw_plan_long: true
    - desired_curv_smooth_seconds: false
    - desired_accel_smooth_seconds: false
  - ▶
    shadow_agent: {} 0 keys

total 13 segments

mean closest distance between path (1s) and cones

GT: 1.463(m)

Model: 1.415(m)

mean closest distance between path (2s) and cones

GT: 1.462(m)

Model: 1.259(m)

060942ef39821e5e|2022-05-23--19-49-25/10/300-500

model_preds path closest to cones frames:

1s	2s
gt=1.775(m), model=1.775(m)	gt=2.046(m), model=1.706(m)

gt path closest to cones frames:

1s	2s
gt=1.775(m), model=1.775(m)	gt=1.775(m), model=1.775(m)

0cf857b1b13bd7cd|2023-11-23--13-05-36/55/900-1100

model_preds path closest to cones frames:

1s	2s
gt=1.748(m), model=1.692(m)	gt=1.809(m), model=1.591(m)

gt path closest to cones frames:

1s	2s
gt=1.748(m), model=1.692(m)	gt=1.748(m), model=1.692(m)

328eb791948dc4c4|2024-02-16--13-44-30/12/1000-1100

model_preds path closest to cones frames:

1s	2s
gt=2.438(m), model=2.375(m)	gt=2.464(m), model=2.320(m)

gt path closest to cones frames:

1s	2s
gt=2.389(m), model=2.400(m)	gt=2.389(m), model=2.400(m)

4a229ee1af08a9f8|2021-07-18--21-48-11/69/800-1000

model_preds path closest to cones frames:

1s	2s
gt=0.524(m), model=0.507(m)	gt=0.524(m), model=0.507(m)

gt path closest to cones frames:

1s	2s
gt=0.511(m), model=0.512(m)	gt=0.503(m), model=0.556(m)

4cef06d33690da48|2021-04-25--06-57-53/10/460-580

model_preds path closest to cones frames:

1s	2s
gt=1.375(m), model=1.376(m)	gt=1.375(m), model=1.376(m)

gt path closest to cones frames:

1s	2s
gt=1.375(m), model=1.379(m)	gt=1.375(m), model=1.379(m)

51b99592a2ca74e5|2020-05-22--16-26-52/15/500-700

model_preds path closest to cones frames:

1s	2s
gt=0.332(m), model=0.332(m)	gt=0.332(m), model=0.332(m)

gt path closest to cones frames:

1s	2s
gt=0.332(m), model=0.332(m)	gt=0.332(m), model=0.332(m)

51b99592a2ca74e5|2020-05-22--16-26-52/15/750-950

model_preds path closest to cones frames:

1s	2s
gt=0.317(m), model=0.318(m)	gt=0.317(m), model=0.318(m)

gt path closest to cones frames:

1s	2s
gt=0.314(m), model=0.318(m)	gt=0.314(m), model=0.318(m)

82992303be12fe7d|2023-10-24--11-04-14/4/985-1125

model_preds path closest to cones frames:

1s	2s
gt=2.189(m), model=2.049(m)	gt=2.227(m), model=1.933(m)

gt path closest to cones frames:

1s	2s
gt=2.113(m), model=2.124(m)	gt=2.113(m), model=2.124(m)

841f184fa5c90ec4|2022-03-17--21-36-19/24/975-1175

model_preds path closest to cones frames:

1s	2s
gt=1.792(m), model=1.792(m)	gt=1.792(m), model=1.792(m)

gt path closest to cones frames:

1s	2s
gt=1.792(m), model=1.794(m)	gt=1.792(m), model=1.853(m)

9534577804069efa|00000036--3e59d4e002/11/1045-1175

model_preds path closest to cones frames:

1s	2s
gt=1.432(m), model=1.325(m)	gt=1.474(m), model=1.144(m)

gt path closest to cones frames:

1s	2s
gt=1.421(m), model=1.409(m)	gt=1.421(m), model=1.319(m)

b794e7af372e5724|2022-05-24--10-30-24/7/700-900

model_preds path closest to cones frames:

1s	2s
gt=2.491(m), model=1.882(m)	gt=2.469(m), model=1.165(m)

gt path closest to cones frames:

1s	2s
gt=2.242(m), model=2.270(m)	gt=2.242(m), model=2.270(m)

d26e907f37fcd37d|2021-11-03--12-38-25/2/100-300

model_preds path closest to cones frames:

1s	2s
gt=1.618(m), model=1.395(m)	gt=1.593(m), model=1.374(m)

gt path closest to cones frames:

1s	2s
gt=1.425(m), model=1.425(m)	gt=1.425(m), model=1.425(m)

df8db5b63ca1031a|2021-10-07--11-42-48/8/800-920

model_preds path closest to cones frames:

1s	2s
gt=1.583(m), model=1.581(m)	gt=2.741(m), model=0.806(m)

gt path closest to cones frames:

1s	2s
gt=1.583(m), model=1.617(m)	gt=1.583(m), model=1.617(m)