Model analysis report for

• ▶
  root: {} 12 keys
  • report_name: 'mlsimdriving_driving.analyse_long_rl'
  • route_list: '/code.nfs/branches/caches/workstation-harald_2026-01-07_09-23-07/xx/datasets/lists/train_500k_20240617_test_2k.txt'
  • output_dir: null
  • save_tmp: false
  • read_only: false
  • shuffle: false
  • limit: 10000
  • use_virtual_webgl: false
  • format: 'HTML'
  • ▶
    miniray: {} 8 keys
    • priority: 10
    • job_name: 'mlsimdriving_driving.analyse_long_rl'
    • queue_name: 'remote2'
    • submit_host: 'redis.comma.internal'
    • result_host: 'data-ram.comma.internal'
    • unique_id: null
    • codedir: '/code.nfs/branches/caches/workstation-harald_2026-01-07_09-23-07/xx'
    • use_local_codedir: false
  • ▶
    filter: {} 3 keys
    • min_hist: 100
    • max_hist: -60
    • max_fidx: 1200
  • ▶
    rollout: {} 10 keys
    • type: 'TinySimRL'
    • nowindow: false
    • debug: false
    • debug_render: false
    • save_observation_keys: []
    • output_dir: null
    • rerun: false
    • ▶
      env: {} 34 keys
      • debug_window_size: [512, 512]
      • ▶
        ep: {} 7 keys
        • segment: ''
        • augment_desire: false
        • depth_type: 'EASYDEPTH'
        • calibration_source: 'LOG'
        • pipeline_dir: 'http://data-ssd.comma.life/runner/training_2025_07'
        • feature_dir: null
        • ▶
          input_paths: {} 0 keys
      • ▶
        physics: {} 3 keys
        • type: 'BICYCLE'
        • ▶
          bicycle_model_config: {} 1 keys
          • vehicle_platform: 'HONDA_CIVIC'
        • ▶
          ml_model_config: {} 11 keys
          • platform: 'TOYOTA_COROLLA_TSS2'
          • eid: 'effd03d9-472d-44a1-910a-6d49a41eb63f/50'
          • y_range: [-3.0, 3.0]
          • vocab_size: 1024
          • temperature: 0.5
          • use_gt_features: false
          • platform_vec_size: 256
          • platform_map_path: '/code.nfs/branches/caches/workstation-harald_2026-01-07_09-23-07/xx/arena/envs/lib/physics_models/assets/platform_map.txt'
          • lateral_tuning_type: 'AUTO'
          • ▶
            lateral_tuning_params: {} 0 keys
          • ▶
            lateral_initial_state_params: {} 0 keys
      • start: null
      • end: null
      • env: 'xx.arena.envs.tinysim_env.TinySimEnv'
      • get_imgs: true
      • allow_resets: true
      • zero_desire: false
      • fps: 20
      • allow_lat: false
      • allow_long: true
      • min_hist: 40
      • compressor_model: null
      • compressor_decoder_model: null
      • compressor_mode: 'NONE'
      • quantized_compressor_latents: false
      • yolo_model: false
      • lpips_model: false
      • sharpness_metric: true
      • future_observation_range_seconds: null
      • noise_model: 'NONE'
      • photo_noise_model: 'NONE'
      • augment_mode: 'DEPTH'
      • inpaint_mode: 'NONE'
      • initial_speed: null
      • allow_any_frame: false
      • max_x_error: 4.0
      • max_y_error: 3.0
      • max_yaw_error: 0.2
      • reset_every: null
      • avoid_hood: false
      • cache_granularity: true
      • worldmodel: null
    • ▶
      agent: {} 8 keys
      • supercombo: 'f1d30a23-4122-400a-80a6-557502284c36/200'
      • restrict_outputs: null
      • exclude_outputs: ['imgs']
      • use_allow_throttle: false
      • model_trained_fps: 5
      • use_worldmodel_as_agent: false
      • desired_curv_smooth_seconds: false
      • desired_accel_smooth_seconds: false
    • ▶
      shadow_agent: {} 0 keys

Plan analysis

All segments (whole segments)

1690 segments || 1464.6508333333334 minutes

Metrics

1584/1690 aka 93.72781065088758%

better: 0/1690 aka 0.0%

best (0.5m): 0/1690 aka 0.0%

global mae x: 1.192

global mae y: 0.066

total # resets: 5969.000

reset per minute : 4.075

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 0.328 m/(ss)

Mean abs long acceleration GT: 0.372 m/(ss)

Mean abs long jerk: 0.896 m/(sss)

Mean abs long jerk GT: 0.548 m/(sss)

Easy straight (whole segments)

665 segments || 563.6333333333333 minutes

Metrics

663/665 aka 99.69924812030075%

better: 0/665 aka 0.0%

best (0.5m): 0/665 aka 0.0%

global mae x: 1.214

global mae y: 0.023

total # resets: 1968.000

reset per minute : 3.492

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 0.269 m/(ss)

Mean abs long acceleration GT: 0.288 m/(ss)

Mean abs long jerk: 0.742 m/(sss)

Mean abs long jerk GT: 0.449 m/(sss)

Hard acceleration

305 segments || 16.121666666666666 minutes

Metrics

295/305 aka 96.72131147540983%

better: 58/305 aka 19.016393442622952%

best (0.5m): 29/305 aka 9.508196721311476%

global mae x: 1.155

global mae y: 0.185

total # resets: 102.000

reset per minute : 6.327

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 1.274 m/(ss)

Mean abs long acceleration GT: 2.022 m/(ss)

Mean abs long jerk: 1.895 m/(sss)

Mean abs long jerk GT: 1.392 m/(sss)

Hard deceleration

490 segments || 29.314166666666665 minutes

Metrics

485/490 aka 98.9795918367347%

better: 96/490 aka 19.591836734693878%

best (0.5m): 44/490 aka 8.979591836734693%

global mae x: 1.118

global mae y: 0.136

total # resets: 177.000

reset per minute : 6.038

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 1.425 m/(ss)

Mean abs long acceleration GT: 2.107 m/(ss)

Mean abs long jerk: 1.890 m/(sss)

Mean abs long jerk GT: 1.324 m/(sss)

No lead

514 segments || 214.9575 minutes

Metrics

495/514 aka 96.3035019455253%

better: 25/514 aka 4.863813229571984%

best (0.5m): 15/514 aka 2.9182879377431905%

global mae x: 1.144

global mae y: 0.072

total # resets: 934.000

reset per minute : 4.345

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 0.269 m/(ss)

Mean abs long acceleration GT: 0.319 m/(ss)

Mean abs long jerk: 0.842 m/(sss)

Mean abs long jerk GT: 0.536 m/(sss)

Come to stop

551 segments || 110.93166666666666 minutes

Metrics

541/551 aka 98.18511796733212%

better: 59/551 aka 10.707803992740471%

best (0.5m): 17/551 aka 3.0852994555353903%

global mae x: 1.078

global mae y: 0.107

total # resets: 336.000

reset per minute : 3.029

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 0.460 m/(ss)

Mean abs long acceleration GT: 0.506 m/(ss)

Mean abs long jerk: 1.116 m/(sss)

Mean abs long jerk GT: 0.494 m/(sss)

Start from stop

452 segments || 17.278333333333332 minutes

Metrics

451/452 aka 99.77876106194691%

better: 123/452 aka 27.212389380530972%

best (0.5m): 61/452 aka 13.495575221238939%

global mae x: 1.087

global mae y: 0.221

total # resets: 74.000

reset per minute : 4.283

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 1.330 m/(ss)

Mean abs long acceleration GT: 1.392 m/(ss)

Mean abs long jerk: 1.489 m/(sss)

Mean abs long jerk GT: 0.827 m/(sss)

Strong turns (>2 m/ss)

566 segments || 42.730000000000004 minutes

Metrics

546/566 aka 96.46643109540636%

better: 114/566 aka 20.141342756183747%

best (0.5m): 55/566 aka 9.717314487632509%

global mae x: 1.208

global mae y: 0.443

total # resets: 192.000

reset per minute : 4.493

Mean model 0 path x errs: 0.000 m

Mean abs long acceleration: 0.546 m/(ss)

Mean abs long acceleration GT: 0.525 m/(ss)

Mean abs long jerk: 1.185 m/(sss)

Mean abs long jerk GT: 0.797 m/(sss)