01The Plan at a Glance
| Phase | Days | Goal | Exit criterion |
|---|---|---|---|
| Foundation | 0 to 30 | Charter, DORA and SPACE baseline, security contract, cost model | All four written and acknowledged by leadership |
| Pilot in production | 31 to 60 | 2 to 4 pilot teams live, per-seat cost reporting, review-gate active | Baseline delta reported, no security or cost blockers open |
| Adoption and gate | 61 to 90 | Prove outcome delta; go, hold, or reset decision | DORA outcomes stable or improved, SPACE net positive, cost within 20 percent of forecast |
02TL;DR for Engineering Leaders
An AI coding assistant rollout is a measurement and governance program before it is a tool rollout. The first 90 days should produce a productivity baseline the team can defend, a per-seat cost model with hard caps, a security review closed against actual usage patterns, and a documented go, hold, or reset decision at day 90.
Rollouts that succeed follow a narrow pattern: baseline before enabling, default to seat-flat pricing during the pilot, put a review gate on every agent-generated change, and track reviewer load alongside pull-request throughput. Rollouts that fail typically enable the tool without a baseline, adopt credit-metered pricing without cost controls, and discover reviewer overload at the same moment leadership asks for productivity evidence.
03Problem Definition
Roughly 88 percent of enterprise agentic AI pilots do not reach production, and the blocker is almost never the model itself; it is governance, isolation, and data residency infrastructure the vendor does not ship with the tool (Northflank enterprise agent deployment). Vendor-published productivity numbers are typically derived from scoped, favorable studies that do not extrapolate to organization-level throughput (GitHub Copilot study, vendor-authored).
Rollouts consistently fail in one of six ways:
- enabled without a productivity baseline, making day-90 evidence impossible to produce
- adopted credit-metered pricing without per-seat consumption monitoring
- launched without a security review closed against actual usage patterns
- rolled out with no review gate on agent-generated changes
- expanded before reviewer capacity was measured, producing a review bottleneck
- shipped without a shadow-AI reduction plan, leaving code egress risk in place
This blueprint prescribes a 30/60/90 sequence that closes each of those gaps before broad rollout. It assumes the vendor and layer choice have already been made using the AI Coding Assistants Evaluation Guide.
04Methodology Snapshot
This blueprint is built from StackAuthority's implementation-first framework. The framework prioritizes measurement and governance before tool enablement.
- baseline DORA and SPACE before enabling the tool in any pilot cohort
- close the security and contract review before pilot start, not after
- default to seat-flat pricing during rollout, add credit-metered plans only with caps and reporting
- put a review gate on every agent-generated change
- gate expansion on DORA outcomes, SPACE dimensions, cost predictability, and a passed security review
For full methodology details, see Methodology.
05Target Operating Principles
- Measurement before enablement: no tool is enabled in any cohort until DORA and SPACE baselines are recorded for at least 4 weeks.
- Contract before code: model-training exclusion, retention policy, IP indemnity, and audit surface are contractually confirmed before pilot start.
- Cost predictability first: seat-flat pricing is the default; credit-metered plans require per-seat caps and weekly consumption reporting.
- Agent changes are reviewed: no agent-generated commit reaches a protected branch without human review; supervision surface is a rollout requirement, not a Day 2 concern.
- Reviewer capacity is planned: reviewer load and time-to-first-review are tracked from day 1 alongside pull-request throughput.
If any principle cannot be shown to be implemented and measured at the end of 90 days, the rollout should hold rather than expand.
06Preconditions Before Starting
Do not start this blueprint until each of the following is true. Starting without them produces the failure modes the blueprint is designed to prevent.
- vendor and layer decisions made using the AI Coding Assistants Evaluation Guide
- executive sponsor who has agreed to the primary measurement framework (DORA plus SPACE, or an internal composite) and the day-90 target
- security representative available for contract review and pilot sign-off
- finance representative available for cost model review
- 2 to 4 candidate pilot teams identified with diverse editor and workflow profiles
- ability to instrument DORA metrics (deployment frequency, lead time, change failure rate, MTTR) at the team level
If any precondition is missing, resolve it before Day 0.
07Phase 1: Days 0 to 30 - Foundation
The goal of the first 30 days is to establish a defensible baseline, a security contract, a cost model, and a measurement plan. No tool is enabled in this phase.
Week 1 to 2: Charter and pilot cohort selection
Write and circulate a one-page rollout charter with:
- the primary measurement framework and the day-90 target
- pilot cohort composition (2 to 4 teams, diverse editor and workflow profiles)
- the escalation path for security, cost, or productivity issues
- the executive sponsor, platform lead, and security representative by name
- the go, hold, and reset decision criteria for the 90-day gate
Circulate to engineering leadership, security, and finance for written acknowledgment. Missing acknowledgment from any group at this stage predicts rollout friction later.
Select pilot teams by fit, not by volunteer status. Recommended composition:
- one team on Visual Studio Code, one team on JetBrains IDEs, at least one team with mixed editors
- one team with strong existing DORA metrics and one with weaker metrics, so both baselines are represented
- one team with a heavy code review culture and one with a lighter one, to test reviewer load effects
Week 2 to 3: Baseline instrumentation
Instrument DORA metrics at the team level for each pilot cohort:
- deployment frequency (per team, weekly)
- lead time for changes (median hours from commit to production)
- change failure rate (percent of deployments requiring rollback or hotfix)
- mean time to recovery (median hours from incident detection to resolution)
Instrument SPACE metrics via a written survey to pilot teams:
- Satisfaction (5-point scale on developer experience today)
- Performance (self-reported time to complete common tasks)
- Activity (pull-request throughput, code review load)
- Communication (self-reported handoff and review friction)
- Efficiency and flow (self-reported interruption rate)
Baseline duration is 4 weeks minimum. Rollouts that shorten this window produce evidence at day 90 that leadership can reasonably dispute.
Week 2 to 3: Security and contract review
Close the security and contract review in parallel with baseline instrumentation. Deliverables:
- contractual exemption from vendor model training verified in the master agreement
- SOC 2 Type II report and ISO 27001 certificate reviewed and dated within 12 months
- data retention policy documented per tier with retention window in days
- audit log export tested against a sample workflow
- IP indemnity clause reviewed with legal, cap and exclusions documented
- deployment posture matched to security requirement (SaaS, VPC, on-premises, or air-gapped)
Rollouts that defer security review until after pilot start typically discover a compliance gap at week 8 that either delays the 90-day gate or requires the tool to be rolled back.
Week 3 to 4: Cost model and controls
Build a 12-month cost model with three scenarios:
- baseline (all pilot users at expected consumption)
- heavy (top 20 percent of users at 3x expected consumption)
- worst case (top 20 percent at maximum tier consumption)
Configure cost controls before enabling the tool:
- per-seat hard cap or documented soft-cap behavior at the vendor
- weekly per-seat cost reporting exportable to the platform team
- cost anomaly alert threshold set at 150 percent of forecast
If the vendor cannot enforce per-seat caps and the plan is credit-metered, default to seat-flat pricing for the pilot regardless of vendor preference.
Phase 1 exit criteria
- charter circulated and acknowledged by engineering, security, and finance leadership
- DORA and SPACE baselines captured for at least 4 weeks
- security and contract review closed, including model-training exclusion and IP indemnity
- 12-month cost model built with per-seat caps configured
- pilot cohorts identified with named engineering leads
If any exit criterion is missing at day 30, hold before Phase 2.
08Phase 2: Days 31 to 60 - Pilot in Production
The goal of the second 30 days is one measured pilot cohort using the tool in production, with cost reporting, review gates, and reviewer load tracking all live.
Week 5 to 6: Enable the tool in the pilot cohort
Enable the tool for the pilot cohort with:
- SSO and audit log capture verified end to end
- per-seat cost reporting exported to the platform team weekly
- endpoint policy updated to permit the sanctioned tool and, optionally, block unsanctioned alternatives
- a written user guide covering the sanctioned tool's approved workflows and the exception process
Any pilot that enables the tool without weekly cost reporting from day 1 is untestable as an investment and will not produce the data leadership needs at the 90-day gate.
Week 6 to 7: Agent review gate
If the sanctioned tool ships agent capability, configure the agent review gate before agent workflows are permitted in the pilot:
- no agent-generated commit reaches a protected branch without human review
- agent-generated pull requests are labeled distinctly for reviewer awareness
- an approval workflow exists for agent-initiated infrastructure or dependency changes
- an audit trail exists for every agent action against the codebase
Rollouts that permit agent commits to protected branches without a review gate produce audit failures and, occasionally, production incidents from unreviewed changes.
Week 7 to 8: Reviewer load monitoring
Add reviewer load and time-to-first-review to the weekly reporting alongside pull-request throughput. Look for:
- rising pull-request volume without a proportional rise in reviewer capacity
- rising time-to-first-review even as individual throughput improves
- rising defect escape rate from reviews being conducted under time pressure
If reviewer load rises faster than reviewer capacity, adjust pull-request size guidance or reviewer assignment rules before Phase 3.
Phase 2 exit criteria
- pilot cohort using the tool in production for 4 weeks
- weekly per-seat cost reporting delivered for 4 weeks
- agent review gate configured and used at least once
- reviewer load and time-to-first-review tracked and reported weekly
- no open security or compliance blocker
If exit criteria are not met at day 60, hold rather than start Phase 3.
09Phase 3: Days 61 to 90 - Adoption and Gate
The goal of the final 30 days is to prove outcome delta on the pilot cohorts before deciding whether to expand, hold, or reset.
Week 9 to 10: Delta analysis
Compare the pilot cohorts' DORA and SPACE metrics against the 4-week baseline captured in Phase 1. Report weekly to leadership:
- deployment frequency, lead time, change failure rate, MTTR (delta vs baseline per team)
- SPACE dimensions from a repeat written survey (delta vs baseline per team)
- weekly per-seat cost and variance vs forecast
- reviewer load and time-to-first-review vs baseline
- shadow-AI telemetry: rate of paste-into-consumer-chat activity vs baseline
A delta on individual pull-request throughput without a delta on DORA outcomes indicates that the tool is producing faster local activity without team-level delivery improvement, which is the pattern independent studies most often report.
Week 10 to 11: Scoping the expansion decision
Draft the expansion recommendation with leadership input. Cover:
- the pilot outcome per team, with baseline delta on all four DORA metrics and SPACE dimensions
- the actual 12-month cost projection based on pilot consumption
- the security posture confirmed against actual usage patterns
- the reviewer capacity plan for expansion
- the shadow-AI reduction plan and its early results
Week 11 to 12: 90-day gate review
The 90-day gate is a go, hold, or reset decision made by the executive sponsor with the platform lead, security representative, and finance representative. The gate has three defensible outcomes:
- Go: DORA outcomes stable or improved, SPACE net positive, cost within 20 percent of forecast, security passed. Expand to the next cohort with the same measurement discipline.
- Hold: some evidence positive but at least one dimension (DORA, SPACE, cost, or security) not yet convincing. Extend the pilot by 30 to 60 days rather than expand.
- Reset: DORA outcomes degraded, cost variance out of control, or security review reopened. Revisit vendor, plan tier, or cohort composition before further investment.
A go decision without DORA and cost evidence is not a defensible go. A hold that becomes permanent without adoption movement is a reset in denial.
Phase 3 exit criteria
- DORA and SPACE deltas reported for the pilot cohorts against a documented baseline
- 12-month cost projection based on actual pilot consumption
- security posture confirmed against actual usage patterns
- reviewer capacity plan for the expansion cohort documented
- explicit go, hold, or reset decision recorded by the executive sponsor
10Cost Governance Reference
Cost surprises are the most reported enterprise pain in AI coding rollouts. The following controls should be in place before the tool is enabled for any user beyond the platform team's own testing.
Baseline controls
- seat-flat pricing at the enterprise tier where the vendor offers it
- per-seat monthly consumption reporting delivered to the platform team weekly
- cost anomaly alert threshold set at 150 percent of forecast
- documented behavior on per-seat cap exhaustion (soft cap, hard cap, or overage billing)
Credit-metered controls
- vendor-enforced per-seat hard cap in the master agreement
- daily cost reporting for the first 60 days of any credit-metered plan
- weekly review of top 10 consumers by cost to catch runaway usage early
- monthly cost variance report to finance with variance drivers named
Rollouts that adopt credit-metered pricing without both baseline and credit-metered controls consistently produce the multi-thousand-dollar monthly overages reported in community post-mortems.
11Security and Compliance Reference
Contractual requirements
- explicit written exemption from vendor model training on customer prompts and completions
- data retention policy documented per tier with a retention window compatible with compliance policy
- IP indemnity clause with disclosed cap and exclusions
- SOC 2 Type II report and ISO 27001 certificate current within 12 months
- deployment posture matched to data residency requirement
Operational requirements
- SSO and SCIM provisioning enabled
- audit log capture verified end to end from admin actions and user prompts
- endpoint policy updated for the sanctioned tool
- shadow-AI telemetry captured to measure code egress rate
Ongoing requirements
- quarterly review of vendor SOC 2 and ISO reports
- annual security posture re-review against usage evolution
- documented incident response process for agent-caused production issues
12Measurement Reference
Primary metrics
- DORA four: deployment frequency, lead time for changes, change failure rate, mean time to recovery. Report weekly per team; baseline for 4 weeks before enabling; delta vs baseline is the primary evidence at the 90-day gate.
- SPACE dimensions: Satisfaction, Performance, Activity, Communication, Efficiency and flow. Capture via a written survey; net positive delta on Satisfaction and Efficiency is the strongest secondary signal.
Secondary metrics
- pull-request throughput per engineer per week
- time-to-first-review and total review load per reviewer
- change failure rate at the pilot cohort level
- shadow-AI telemetry (rate of paste-into-consumer-chat activity)
Metrics to avoid reporting as outcomes
- lines of code produced or accepted
- suggestion acceptance rate as a proxy for value
- chat message counts or plugin session counts
- vendor-supplied ROI dashboards as the primary source
Activity metrics predict nothing on their own. Outcome metrics tied to DORA and SPACE deltas against a documented baseline are the only defensible input to the 90-day gate decision.
13Anti-Patterns During Rollout
These are execution-phase failure modes distinct from the strategic failure modes covered in the AI Coding Assistants Evaluation Guide. Each has a specific rollout-phase signal.
Anti-pattern 1: Enable-before-baseline
Turning the tool on for the pilot cohort before DORA and SPACE baselines are captured. The failure signal is a day-90 conversation in which leadership asks whether the tool helped and no defensible answer exists. Fix: enforce the Phase 1 rule that baselines run for 4 weeks before any user in the pilot cohort has access.
Anti-pattern 2: Credit-metered without caps
Adopting a credit-metered plan without per-seat hard caps because the sales team promised soft-cap behavior. The failure signal is a mid-pilot cost spike that finance discovers before the platform team does. Fix: require vendor-enforced hard caps in the master agreement or default to seat-flat pricing.
Anti-pattern 3: Volunteer-only pilot cohort
Picking pilot teams by volunteer enthusiasm rather than by editor and workflow diversity. The failure signal is a day-90 report in which every metric looks positive but only for a self-selected group of AI-tolerant early adopters. Fix: enforce the Phase 1 rule that pilot cohorts include both editor standards and both high and lower DORA-metric teams.
Anti-pattern 4: Agent commits to protected branches
Permitting agent-generated commits directly to protected branches to speed up the pilot demo. The failure signal is either a production incident from an unreviewed change or an audit finding on missing review evidence. Fix: configure the review gate before any agent workflow is permitted in the pilot cohort.
Anti-pattern 5: Reviewer overload discovered at expansion
Rolling the tool out to the next cohort without checking reviewer capacity from the pilot cohort. The failure signal is rising time-to-first-review across the expansion cohort within 3 weeks of enablement. Fix: track reviewer load from day 1 of Phase 2 and adjust reviewer capacity or PR size guidance before Phase 3 expansion.
Anti-pattern 6: Shadow-AI ignored
Deploying the sanctioned tool without measuring or reducing existing shadow-AI usage. The failure signal is that endpoint telemetry continues to show paste-into-consumer-chat activity after the sanctioned tool is available. Fix: make the sanctioned tool the fastest path for the top 3 developer workflows, not just the policy-compliant one, and communicate that clearly.
14Roles and Ownership
| Role | Owned by | Primary responsibilities |
|---|---|---|
| Executive sponsor | VP Engineering or CTO | 90-day gate decisions, measurement framework agreement |
| Platform lead | Named person | Rollout execution, cost reporting, tool configuration |
| Platform engineers | 1 to 3 people | Tool integration, audit surface, cost anomaly response |
| Security representative | Named person | Contract review, deployment posture sign-off, audit review |
| Finance representative | Named person | Cost model, variance monitoring, contract sign-off |
| Pilot cohort tech leads | Named per team | Baseline capture, weekly outcome reporting, review-gate compliance |
| Reviewer capacity owner | Engineering manager per cohort | Reviewer load tracking, PR-size guidance, review assignment |
Ownership continuity through all three phases matters more than titles. Rollouts where the platform lead or security representative changes mid-blueprint typically restart Phase 1.
15Phase Gate Decision Reference
| Gate | When | Go criteria | Hold triggers | Reset triggers |
|---|---|---|---|---|
| Phase 1 exit | Day 30 | Charter, baseline, security review, cost model all complete | Any exit criterion missing | Security contract cannot close, or measurement framework cannot be agreed |
| Phase 2 exit | Day 60 | Pilot in prod 4 weeks, cost reporting, review gate, reviewer tracking live | Reporting or review gate not yet stable | Cost variance out of control, or security issue reopened |
| Phase 3 exit | Day 90 | DORA and SPACE positive delta, cost within 20 percent of forecast, security passed | One dimension unconvincing but no blocker | DORA degraded, cost runaway, or security review reopened |
The gates exist to make hold and reset defensible decisions rather than admissions of failure. Rollouts that treat every gate as a go decision by default produce the cost surprises and audit issues this blueprint is designed to prevent.
1690-Day Deliverables Checklist
By day 90 the platform team should be able to produce, on request:
- the rollout charter with signatures from engineering, security, and finance
- DORA and SPACE baseline plus delta for each pilot cohort
- 12-month cost projection based on actual pilot consumption
- security posture confirmation against actual usage patterns
- reviewer capacity plan for the expansion cohort
- shadow-AI telemetry showing reduction against the Phase 1 baseline
- a written go, hold, or reset decision from the executive sponsor
If any deliverable is missing at day 90, the rollout has not completed the blueprint.
17Frequently Asked Questions
How long should the pilot last
The blueprint budgets 30 days for foundation and 30 days for the pilot in production, so 60 days total from charter to pilot completion, plus 30 days of delta analysis and gate review. Teams that shorten the pilot to 4 weeks or fewer typically produce day-90 evidence that leadership can reasonably dispute; teams that extend it past 90 days delay the go, hold, or reset decision and let the pilot drift into an unofficial rollout.
What if we already enabled the tool before starting the blueprint
Capture a baseline retroactively from the last 4 to 8 weeks of DORA metrics from before enablement if the data is available, and re-baseline SPACE via a fresh survey. If a pre-enablement baseline is not recoverable, run a controlled hold cohort for 4 weeks (a matched team without the tool) to build a comparison. Skip neither; a rollout without a baseline cannot produce defensible day-90 evidence.
Can we run this blueprint on credit-metered pricing
Yes, but only with vendor-enforced per-seat hard caps in the master agreement, daily cost reporting for the first 60 days, and weekly review of top consumers. Without those controls, default to seat-flat pricing for the pilot regardless of vendor preference. The mid-2026 Cursor pricing incident is the reference case for why credit-metered plans without controls produce multi-thousand-dollar monthly overages on small teams.
How do we handle a pilot cohort that rejects the tool
Treat rejection as intended pilot output rather than as failure. A tool that produces positive DORA and SPACE deltas on one cohort and neutral or negative deltas on another is the primary signal the pilot is designed to produce. Investigate whether the rejecting cohort represents a workflow the tool does not fit, and use that finding in the expansion decision.
What if leadership wants to skip the baseline to speed the pilot
Push back with the Phase 1 exit criterion: no tool is enabled in any cohort until baselines are captured. Skipping the baseline is the single most common reason enterprise AI coding rollouts cannot defend their investment at the 90-day gate. If leadership overrides the requirement, record the override in the phase gate documentation so the outcome is attributable and the reset decision is not personal.
How do we decide between hold and reset
Hold when at least three of the four gate dimensions (DORA, SPACE, cost, security) are positive and one is unconvincing but not blocking. Reset when either DORA outcomes are degraded, cost variance is out of control, or the security review has been reopened. A hold with a broken measurement framework or a broken cost model is a reset in denial.
What is the right size for the platform team during rollout
One platform lead plus 1 to 3 platform engineers plus fractional security and finance representation. Teams smaller than one dedicated engineer cannot maintain the weekly cost and review-gate reporting cadence the blueprint requires. Teams larger than three engineers before Phase 3 exit typically over-invest in tool configuration and under-invest in measurement discipline.
How do we know the shadow-AI reduction plan is working
Endpoint telemetry should show a declining rate of paste-into-consumer-chat activity within 30 days of the sanctioned tool being enabled. If it does not, the sanctioned tool is not yet the fastest path for the workflows engineers care about, and the sanctioned-tool user guide or the tool's own capability set needs revision before expansion.
18Architecture Diagram: Rollout Loop
[Charter + baseline + security + cost model]
|
v
[Pilot cohort enabled, cost reporting live]
|
v
[Agent review gate configured]
|
v
[Reviewer load tracked alongside throughput]
|
v
[Delta analysis vs baseline]
|
v
[90-day gate: go, hold, or reset]
|
v
[Expansion plan or reset decision]
The loop continues past day 90. Every subsequent cohort runs through a compressed version of the same three phases with baseline capture, cost reporting, and review gates already in place.
19External References
- Thoughtworks Technology Radar Vol. 33
- Northflank enterprise AI coding agent deployment
- DORA metrics guidance from DX
- SPACE developer productivity framework
- Cursor pricing incident timeline
20Related Reading
- AI Coding Assistants: An Evaluation Guide for Engineering Teams
- Leading AI Engineering Service Providers
- Leading AI Agent Development Partners
- Runtime Governance for AI Systems Implementation Blueprint
- Methodology
21Limitations
This blueprint prescribes a 30/60/90 execution sequence for an initial AI coding assistant rollout on 2 to 4 pilot cohorts. It does not replace the vendor and layer decisions covered in the pillar evaluation guide, nor does it address specialized rollouts such as regulated-industry air-gapped deployments, developer training curriculum, or code review process redesign at scale. Pricing and vendor policies are current as of publication and change frequently. Final decisions on scope, cohort selection, and gate criteria should be adjusted for organizational context and reviewed with security, finance, and executive stakeholders before Day 0.
Author: Ishan Vel Reviewed by: StackAuthority Editorial Team Review cadence: Quarterly (90-day refresh cycle)