Model analysis report for

Sample Metrics

None69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
lpips:
mean3.2804812231731443e-160.05870.0639
sharpness:
mean313.2813769887137258.2389255.9282
yolo_conf:
mean0.440904440.40530.4155

Distribution Metrics

69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
narrow rFID-16.1k4.98115.0798
big rFID-16.1k4.92324.8870

VM Disagreements

69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
BRAKE_PRESS + GAS_PRESS kl div (2s + 4s + 6s avg, bits):
nanmean0.00980.0148
nanmax5.86086.1366
nanstd0.03330.0425
lead_prob kl div (bits):
nanmean0.00580.0085
nanmax2.16443.4026
nanstd0.02720.0370
Plan.VELOCITY at t=0 (m/s):
nanmean0.10830.1348
nanmax23.312324.6580
nanstd0.07970.0939
Plan L1 (no unit):
nanmean0.07920.0967
nanmax6.72457.1462
nanstd0.07770.0823

Top 10 BRAKE_PRESS + GAS_PRESS kl div (2s + 4s + 6s avg, bits) disagreements

None69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
ea0d8e2a4cf9ce46|2021-11-02--14-23-34/31--536max disagree: 5.8608max disagree: 2.9123
b794e7af372e5724|2022-05-23--13-12-31/6--192max disagree: 2.4744max disagree: 1.3197
ee7126c8e2af1b48|2024-01-22--09-29-31/5--496max disagree: 2.2807max disagree: 1.2207
2611ca299b6b5939|2023-09-22--15-50-09/0--1040max disagree: 2.2750max disagree: 1.5400
8faf799674fa044b|2023-07-18--19-49-14/15--864max disagree: 2.2710max disagree: 2.0492
3cfdec54aa035f3f|2021-09-27--16-23-30/2--352max disagree: 2.2489max disagree: 2.7284
ee7126c8e2af1b48|2024-01-26--18-27-07/37--36max disagree: 2.1185max disagree: 2.2301
4c833174af1f11d9|00000001--ac40d4e315/2--504max disagree: 2.0859max disagree: 2.1196
62b2a39186dc9eab|2021-04-18--12-13-55/4--1168max disagree: 2.0458max disagree: 1.7956
bf0fac55013ab937|2021-12-09--10-55-41/49--4max disagree: 2.0442max disagree: 1.0500

Top 10 lead_prob kl div (bits) disagreements

None69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
a092c3532573731f|2022-06-24--20-30-54/47--276max disagree: 2.1644max disagree: 1.6027
91a5f9bc5181e3ba|2024-01-23--06-02-57/5--944max disagree: 1.9728max disagree: 2.1172
d09c814b908913a2|2023-04-13--21-08-58/13--560max disagree: 1.9611max disagree: 1.4191
d8da379d26d61d63|2022-12-09--09-20-06/1--864max disagree: 1.9096max disagree: 2.3306
57e4cb70ba976d3e|2023-11-22--14-06-15/9--704max disagree: 1.8820max disagree: 0.9709
fcb9ba4c67b2c0fb|2023-10-27--18-01-25/2--1020max disagree: 1.7827max disagree: 1.8271
a99416f1dc16ad80|2021-12-04--16-26-02/159--224max disagree: 1.6676max disagree: 0.8541
55cbd4260394fa17|2022-12-30--19-11-00/6--668max disagree: 1.6537max disagree: 1.2808
7914a2f4fbbf103b|2021-04-08--00-09-04/63--480max disagree: 1.6514max disagree: 2.3047
516d6c3bd3ce6315|2022-11-19--11-33-40/33--488max disagree: 1.4931max disagree: 1.0522

Top 10 Plan.VELOCITY at t=0 (m/s) disagreements

None69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
be40ce5f5b2e0871|2020-12-20--17-34-33/177--808max disagree: 23.3123max disagree: 24.6580
4a79abbddaacfcdb|2024-03-23--23-03-29/19--100max disagree: 7.1132max disagree: 6.7889
873884f8a54c5558|2021-10-12--16-03-45/17--4max disagree: 6.3976max disagree: 7.5990
4a229ee1af08a9f8|2021-06-08--15-01-51/21--40max disagree: 6.3405max disagree: 3.3992
f2a594dd91e37527|2022-04-10--13-29-48/41--268max disagree: 4.4212max disagree: 2.6486
26316d513b2e7140|2020-12-21--03-43-20/0--180max disagree: 4.3111max disagree: 5.6656
4a444eab146265fe|2022-06-01--14-54-45/9--156max disagree: 4.0989max disagree: 4.0240
c4870daa2d1dd14d|2021-11-10--06-12-30/47--1132max disagree: 4.0626max disagree: 6.4621
b3ac0e70e5b188a7|2024-03-01--15-44-09/43--508max disagree: 3.8962max disagree: 2.2719
841f184fa5c90ec4|2022-02-19--21-09-33/32--392max disagree: 3.7265max disagree: 3.8689

Top 10 Plan L1 (no unit) disagreements

None69e6e7e1-4100-48c1-a041-b01cc7940f3b/1104672da0d-19f5-44f8-a5fb-2215981c9c0e/50
be40ce5f5b2e0871|2020-12-20--17-34-33/177--808max disagree: 6.7245max disagree: 7.1462
cbd6df88df64ed1e|2023-10-21--16-17-45/10--324max disagree: 3.8346max disagree: 3.6994
92e13d6c269f512d|2023-02-18--04-31-33/82--720max disagree: 3.6868max disagree: 3.5956
436363c17591bdd7|2021-01-25--16-29-01/18--368max disagree: 3.5168max disagree: 3.5176
d5e5da41ff5086ec|2022-05-21--09-59-21/9--736max disagree: 3.4769max disagree: 3.3786
d934d61074e5ca75|2021-01-04--09-08-44/2--620max disagree: 3.4470max disagree: 3.5644
026b6d18fba6417f|2021-06-03--16-38-58/4--916max disagree: 3.4425max disagree: 3.4480
4a080fe908e25eb2|2022-12-23--15-28-55/3--1160max disagree: 3.3793max disagree: 3.3951
88b664a0adc4a54e|2021-11-17--11-52-43/6--376max disagree: 3.2862max disagree: 3.3288
88b664a0adc4a54e|2021-11-17--12-19-26/27--868max disagree: 3.2656max disagree: 3.1801