Abstract
Compressed detectors for embedded perception are characterized by an accuracy figure and a latency figure that are measured separately, although a downstream safety function needs every individual output to be both correct and on time. This paper presents JADE, a per-sample, time-stamped joint accuracydeadline evaluation protocol that classifies each detection or warning event as correct and timely, correct but late, wrong but timely, or wrong and late, and reports the error rate, the timeout rate, their overlap, a coupling lift and the timely-correct rate (TCR). An application layer replays 2,703 pedestrian tracks from JAAD at 30 Hz through measured outcome models and latency traces, so that warning misses, false alarms and lead times are computed at the true output time. Across 135 measured runs on KITTI covering four public detectors, FP32 and INT8 precision, three input sizes, fixed and deadline-adaptive execution, clean and degraded inputs and three CPU-load conditions, the most accurate configuration (AP50 = 0.523) delivers no timely-correct output at a 100 ms deadline, whereas INT8 nano models keep a TCR of 0.48-0.51 under sustained contention. Errors and timeouts are nearly independent for fixed configurations (lift 0.99-1.10), while adaptive execution converts lateness into errors (lift 0.63-0.80, error rate +0.18 under contention). Perception TCR predicts the timely-correct warning rate far better than AP50 (Kendall τ = 0.66 versus 0.19), and evaluating on 2 Hz keyframes instead of 30 Hz annotations scrambles the configuration ranking (τ = 0.32).