Field standards

Field performance audits

Standardized scenarios evaluate decision quality and SOP application consistently across locations—creating comparable benchmarks, highlighting variability, and enabling targeted actions to improve operational performance.

Field performance audits
Problem
Field evaluations can be inconsistent and dependent on local evaluators. Comparability across sites is weak, masking risk and variability.
Outcome
Reliable cross-site benchmarking, clearer risk signals, and evidence-based actions to improve operational consistency.
Worked example

What it looks like at Nano Masters AI Electric Utility

Role: Distribution field crew leaders across regional depots
Format: 15-minute storm restoration scenario, identical rubric at every depot with local network details, delivered by link
Fictional blueprint company, used for illustration.

The situation

The utility has strengthened safety and compliance readiness for field operations, and leadership wants a consistent view of how crews apply permit-to-work and switching procedures in every region. Local ride-along evaluations vary by assessor and are hard to compare. In the scenario, a severe storm has tripped several feeders, one of which supplies a water treatment site.

The decision

The crew leader arrives at a faulted section with a switching plan issued before the regional communication outage. Radio contact with the control room has failed, and the water treatment site is asking when power will return.

Option A
Make the site safe, apply isolation and lockout per the permit, and use the backup communication channel to confirm network state before performing any switching.
Restoration takes longer, but no switching happens on assumptions about a network that may have changed. The crew stays within procedure and the control room regains an accurate picture.
Option B
Leave a marker at the site and move to the next fault on the list to keep restoration moving.
It avoids unsafe switching, but the hazard is left unattended and the critical customer gets no update. The audit would flag weak situational ownership rather than a safety breach.
Option C
Execute the switching plan as issued, since it came from the control room and the critical site needs supply.
Supply may return sooner, but the crew has acted on a plan that does not reflect any changes made since the outage. This is the safety-critical deviation the audit is designed to detect.

What the scorecard shows

Because every depot runs the same scenario and rubric, results are comparable across sites. The cohort report highlights variation, for instance one depot consistently confirming network state and another relying on issued plans, so operations leaders can target coaching where the risk is. Scorecards are documentation-ready, which supports compliance reviews, and repeat runs show whether variability narrows.

What we measure

Permit-to-work adherence
Whether isolation, lockout and permit steps are completed before any work or switching begins.
Situational awareness
Whether the crew leader recognizes that an issued plan may be out of date after a communication gap.
Control-room coordination
How the crew re-establishes contact and confirms network state using available channels.
Hazard ownership
Whether hazards are secured and handed over properly rather than left unattended.
Critical customer communication
Whether priority sites receive accurate, timely updates through the right route.

FAQ

Common questions

Decision quality, process adherence, escalation, communication, and role-specific judgment under realistic constraints.

Yes—use a shared rubric with localized scenario details where necessary.

Identify recurring risk patterns, focus coaching, and track improvement over time.

It supports compliance by producing consistent evidence and documentation-ready outputs.
Want this use case tailored to your roles?
We generate scenarios, decision points, and scorecards in days.