Skip to content

Home  /  All notes

What it cannot see

An average accuracy figure conceals that the errors are not evenly distributed. Plus the physical conditions that no software fixes, and the drift that happens quietly.

5 notes

Where the Errors Fall

Systems involving human appearance have repeatedly performed unevenly across skin tone, sex and age. An average conceals this, and the concealment is the problem.

Analysis

Performance Drifts

A system that worked at installation degrades quietly. What causes it, how to detect it without ground truth, and what to re-measure.

Procedure

Lighting, Angle, Occlusion

The physical conditions that determine whether a system works, most of which are fixed by moving a camera rather than by changing a model.

Reference

Systems Get Worked Around

Any monitoring system with consequences attached will be adapted to. What that looks like in practice, and why it is usually a design finding.

Analysis

Reading a Vendor Claim

A short guide to the phrases that appear in marketing for this field, what each usually means, and what to ask in response.

Reference