Define the institutional need
Document the current condition, affected population, baseline performance, operational burden, and intended public value.
Define the test before implementation begins.
The STEAD Pilot Design and Evaluation Plan defines the problem, scope, authority, baseline, safeguards, measures, stopping rules, evaluation process, and decision gates required before a pilot can begin.
Pilot purpose
A credible pilot begins with a specific problem, a measurable hypothesis, a known baseline, a defined population, and a limited operating scope.
The pilot must establish who has authority, what systems may change, what rights and safeguards remain protected, how employees will be trained, how results will be measured, and when implementation must pause or stop.
The purpose is to generate reliable evidence that can support correction, rejection, or carefully phased expansion.
Pilot design components
Document the current condition, affected population, baseline performance, operational burden, and intended public value.
Identify statutory, agency, procurement, labor, clinical, privacy, records, and oversight authority.
Limit facilities, users, functions, data, systems, vendors, duration, budget, and decision rights.
Define staffing, training, backfill, safety, workload, labor participation, support, and change-management needs.
Establish due process, privacy, access, correction, appeal, clinical control, human review, and complaint channels.
Test identity, cybersecurity, integration, data quality, reliability, recovery, interoperability, and fallback operation.
Include planning, implementation, staffing, operations, support, evaluation, contingency, rollback, and transition.
Establish metrics, data collection, comparison, review, reporting, stopping rules, and expansion thresholds.
Pilot principle
A pilot must be designed so that failure can be detected early and corrected safely.
A pilot without a baseline, stopping rule, rollback plan, or independent review is not a controlled test. It is an uncontrolled implementation with limited visibility.
STEAD pilots should preserve manual procedures, fallback operations, professional authority, continuity of care, employee safety, and the ability to restore prior operations when necessary.
The pilot succeeds only when the institution can determine what changed, why it changed, whether the result is sustainable, and whether the benefits justify the cost and risk.
Evaluation measures
Injuries, serious incidents, contraband, emergency response, order, and future victimization.
Staffing, overtime, workload, training, injuries, morale, retention, and usability.
Implementation, operations, maintenance, labor, energy, support, renewal, and total lifecycle cost.
Uptime, recovery, data quality, response, interoperability, and fallback operation.
Healthcare, education, work, transportation, scheduling, completion, and continuity.
Conduct, participation, credentials, health, savings, employment, housing, and reentry.
Privacy, access, due process, correction, complaints, human review, and auditability.
Whether measurable benefits justify cost, risk, complexity, and long-term obligation.
Pilot decision gates
Authority, workforce, funding, safeguards, infrastructure, and evaluation are complete.
Scope, baseline, training, acceptance, monitoring, and stopping rules are approved.
Safety, operations, cost, workforce, and safeguards remain within approved limits.
Reliability, usability, support, integration, security, and continuity requirements are met.
Outcomes, costs, risks, limitations, and unintended effects are documented.
Identified legal, technical, workforce, financial, clinical, or operational gaps are resolved.
Staffing, maintenance, support, renewal, oversight, and transition remain sustainable.
Broader deployment is authorized only after transparent evidence and renewed public approval.
STEAD Pilot Design and Evaluation Plan
STEAD pilots define the problem, authority, scope, workforce, safeguards, technology, funding, evaluation, measures, stopping rules, and decision gates before implementation begins.