Skip to content

Home  /  All notes

Building and evaluating

Camera placement is the highest-return investment and appears in no vendor proposal. Plus the evaluation that means something and the threshold decision that is a business call, not a setting.

9 notes

Where the Training Data Comes From

The dataset determines the failure modes. Collecting it lawfully, composing it deliberately, and the questions to ask a vendor about theirs.

Procedure

Evaluating It Properly

An evaluation that means something needs independent ground truth, a held-out set, and reporting by condition and by subgroup.

Procedure

Choosing the Operating Point

The threshold is a business decision disguised as a technical setting, and it is usually left at a default nobody chose.

Procedure

Human Review That Works

Human oversight is the standard mitigation and is frequently designed in a way that guarantees rubber-stamping. What makes it real.

Analysis

Monitoring the System in Production

A vision system fails quietly. What to instrument so that a degradation is visible before someone notices the alerts stopped meaning anything.

Procedure

Buying One

The questions that separate a product you can assess from one you cannot, and the answers that should end a conversation.

Procedure

Running a Pilot That Can Fail

A pilot designed to succeed is a procurement exercise. What to fix in advance so the result means something.

Procedure

Camera Placement

The highest-return investment in most deployments, the one absent from every vendor proposal, and the one no software fixes.

Procedure

When the Training Data Is People

Building a model that sees people means collecting images of people. The obligations that attach, and the practices that avoid most of them.

Analysis