report for model: 59cfd731-6f80-4857-9271-10d952165079/200

18191 segments

17447 routes

2144 devices

number of segments distribution

>=5 min: 1365 devices

>=10 min: 900 devices

>=15 min: 471 devices

>=20 min: 72 devices

59 devices with RHD toggle on

FACE DETECT RATE (not engaged)

new not engaged face rate: 0.9909

FACE DETECT RATE (engaged)

new engaged face rate: 0.9943

LOW STD RATE (engaged)

new engaged low std rate: 0.9877

YELLOW WHEELTOUCH ALERT FREQUENCY (engaged)

P_per_seg(engaged) : 0.0038 (1/262min)

YELLOW ALERT FREQUENCY (engaged)

P_per_seg(engaged) : 0.1119 (1/8min)

Random Yellow Alerts

Dark Segment Sanity Check

5010000.20.40.60.81
frameface_prob_lhd
5010000.20.40.60.81
frameface_prob_rhd

RHD Preds Test

ROC curve with 18163 segments:

17.791k20370(0)(1)(1)(0)
RHD confusion matrixPredGT

Accuracy : 1.000

Precision: 0.995

Recall : 1.000

F1 Score : 0.997

Mismatches: 20 (18 correct pred)