Where the Errors Fall
Systems involving human appearance have repeatedly performed unevenly across skin tone, sex and age. An average conceals this, and the concealment is the problem.
Analysis
An average accuracy figure conceals that the errors are not evenly distributed. Plus the physical conditions that no software fixes, and the drift that happens quietly.
5 notes
Systems involving human appearance have repeatedly performed unevenly across skin tone, sex and age. An average conceals this, and the concealment is the problem.
Analysis
A system that worked at installation degrades quietly. What causes it, how to detect it without ground truth, and what to re-measure.
Procedure
The physical conditions that determine whether a system works, most of which are fixed by moving a camera rather than by changing a model.
Reference
Any monitoring system with consequences attached will be adapted to. What that looks like in practice, and why it is usually a design finding.
Analysis
A short guide to the phrases that appear in marketing for this field, what each usually means, and what to ask in response.
Reference