Leading your engineers towards an AI-assisted future
Pete Hodgson ยท article ยท 2025-06-26 source โ Reader ๐ฅ๏ธ
Craft CommunityDORA & Engineering MetricsEnterprise AI Adoption & ReadinessHuman-in-the-LoopJevons ParadoxMeasuring AI ImpactTeam AutonomyVibe Coding
An engineering leader should drive AI-coding adoption the same way they'd drive any major capability shift โ by setting a clear, phased goal (Experimentation, then Adoption, then Impact) measured with lightweight KPIs, giving teams real autonomy over how they get there, and backing that autonomy with concrete organizational support (training, budget, protected time, a community of practice, empathetic communication) โ rather than mandating a usage percentage from day one.
practical ยท argumentative โ A how-to for engineering leaders, structured as an argument for a specific change-management strategy (phased goals + autonomy + support) against the implicit alternative (mandate a usage target and measure compliance).
Structure
| Part | Role |
|---|---|
| Opening dialogue with a pressuring CEO | motivating narrative โ establishes the organizational pressure the rest of the post answers |
| Overall approach: Aligned Autonomy and the three-phase roadmap (Experimentation -> Adoption -> Impact) | central claim / framework |
| Finding the Middle Path (vibe-coding overreach vs. defensive skepticism) | justification for why Experimentation must come before mandated Adoption |
| Driving Experimentation and Adoption (concrete KPIs per phase) | operationalization |
| Supporting AI adoption (structure, training, removing impediments, time, Community of Practice) | operationalization of the 'organizational support' leg |
| Leading with Empathy | addresses the emotional/identity dimension the metrics-and-process framework doesn't cover on its own |
| Communicating progress | closes the loop back to the opening dialogue โ gives the leader something concrete to tell the CEO |
Key terms
- Aligned Autonomy
A change-management pattern (the author's own, from a 2019 post on Mission Command): leadership sets a clear goal and objective measures of progress toward it, then gives teams full autonomy over how they get there, backed by organizational support. - Mission Command
The military-derived leadership style underlying Aligned Autonomy: communicate current state, target state, and the comparison between them, then ask the team for their plan and what support they need โ rather than issuing a direct order. - Experimentation / Adoption / Impact (the three phases)
A deliberate sequence of organizational goals: first get teams meaningfully trying tools and sharing learning (Experimentation), then measure actual day-to-day usage (Adoption), then measure effect on productivity/quality/agility (Impact) โ each phase with its own KPIs. - The middle path
The calibrated position between engineers who cede too much judgment to AI ('vibe-coding', shipping large AI-authored PRs after a cursory review) and engineers who reflexively reject AI output to defend code quality โ using AI for real leverage while keeping human decision-making central. - Jagged intelligence
A borrowed term (credited to a tweet) for AI capability that is unevenly distributed across tasks โ strong in some areas, surprisingly weak and unintuitive in others โ which is why getting good results requires learning specific, non-obvious techniques rather than just 'being smart.'
Propositions
- explicitAn engineering leader facing pressure to show AI adoption should start with a genuine Experimentation phase โ not a usage-percentage target โ because the right way to use AI coding tools is not yet known even to the leader, and the org needs a period of collective discovery before it can set a meaningful Adoption target.conf: high
- explicitThe Aligned Autonomy pattern โ leadership sets a clear goal and objective progress metrics, teams get full autonomy over how to hit it, leadership backs that with organizational support โ is the right vehicle for AI adoption because it already worked for prior waves of change (DevOps, test automation, observability, microservices, cloud, continuous delivery) and doesn't require inventing a new change-management playbook for AI specifically.conf: high
- explicitAI coding agents are genuinely useful for certain tasks today, but AI is not currently capable of producing well-designed software without a human in the loop โ the engineer's job shifts to compensating for the tool's limitations and resisting the pull toward sloppy design, not to stepping back.conf: high
- explicitMetrics for AI adoption should be scoped and sequenced to the current phase (pilot counts and retro cadence in Experimentation; tool usage and sentiment in Adoption; DORA/SPACE-style productivity and quality metrics combined with adoption metrics in Impact) rather than a single all-purpose KPI applied from day one.conf: highsupportsAI-Assisted Software Development: Team Profiles and Capabilities for Putting Research into Action ยท p3 โ Hodgson's recommendation to combine DORA/SPACE metrics with AI-adoption metrics anticipates DORA's own later empirical finding that AI adoption's benefit is conditional on exactly these organizational capabilities, not adoption alone.refines#5: AI Workflow Patterns: The Real Unit of AI Adoption in 2026 ยท p1 โ Where that piece argues AI-adoption conversations debate the wrong unit (models/agents instead of workflows), Hodgson's phased team-level KPIs (pilot counts, tool usage by task category, sentiment) are an operationalization that already targets workflow-level usage rather than model choice.
- explicitMetrics used to drive AI adoption must be visibly framed as a tool for the team's own self-assessment, not a surveillance mechanism โ leaders should avoid drilling into individual engineers' numbers and avoid sharing granular metrics with leadership above them, or the metrics will corrode the trust the whole program depends on.conf: high
- explicitThe most common blockers to AI adoption are organizational, not technical: tool budget treated as a line-item concern despite being marginal next to fully-loaded engineer cost, and compliance/legal friction that a leader must actively clear rather than leave teams to fight alone.conf: high
- explicitTeams will not spend time experimenting with AI unless a leader explicitly carves out capacity in the roadmap and says so out loud โ absence of an explicit mandate to spend time on this defaults teams back to pure feature/bug-fix delivery.conf: high
- explicitA Community of Practice should be seeded by leadership (clear accountability to bootstrap it, initial cadence of meetings) but should remain grassroots and practitioner-centered in substance โ leadership's job is infrastructure, not content.conf: high
- explicitcorroboratedUsing AI productively is a distinct, learnable, and currently non-obvious skill set (because AI capability is 'jagged' โ strong and weak in unintuitive places) and therefore merits a structured training curriculum, not just access to tools.conf: highsupports โCo-Intelligence, by Ethan Mollick: a Summary ยท p2 โ Hodgson independently argues that using AI productively is a distinct, learnable skill precisely because capability is jagged (strong/weak in unintuitive places); this summary's account of Mollick's Jagged Frontier is the originating research behind that same diagnosis, applied here to general knowledge work rather than engineering specifically.
- explicitLeaders must address the fear that AI will take engineers' jobs or remove the most rewarding part of their work directly and empathetically rather than dismissing it, because this fear is legitimate and widespread, not a morale problem to be managed around.conf: highsupportsResearch: Why You Shouldn't Treat AI Agents Like Employees ยท p5 โ Both identify visible, empathetic leadership behavior (role-modeling, direct acknowledgment of fear) as more effective for driving genuine adoption than top-down mandates or hype framing.
- explicitcorroboratedAI will likely automate the tedious parts of engineering work rather than the job itself, and Jevons Paradox implies that cheaper software production increases total demand for software enough to keep engineers employed, even as per-unit cost falls.conf: mediumsupports โThe third golden age of software engineering โ thanks to AI, with Grady Booch ยท p9 โ Both argue AI automates tedious/low-judgment work (delivery pipelines; rote tasks) rather than eliminating demand for engineers overall.
- implicitA leader's responsibility includes translating team-level AI-adoption data into a simple upward-facing narrative (a dashboard, a trend line) so that pressure from above (like the opening dialogue's CEO) can be met with evidence of a managed process rather than an improvised answer.conf: medium
Arguments
Leaders should set phased goals with autonomy and support, rather than mandating an AI-usage percentage target from the outset. strength: medium
Explicit premises:
- Generative AI's capabilities and best practices are moving too fast for anyone, including leadership, to know the 'right' usage target in advance.
- Engineers hold polarized positions (over-trusting vibe-coders vs. defensive skeptics) that a blunt usage mandate would entrench rather than resolve.
- Prior successful technology rollouts (DevOps, cloud, CD) used goal-plus-autonomy-plus-support, not top-down mandates.
Implicit premises:
- A team that discovers for itself where AI helps and where it doesn't will produce more durable adoption than a team told to hit a number.
- Analogy to prior rollouts is a valid basis for predicting what will work for AI, despite the author's own claim that AI's pace of change is unlike anything in 20+ years.
Inferences:
- This implies leadership credibility with engineers is itself a scarce resource the program must protect โ which is why the metrics-misuse warnings (avoid pointy-haired-boss dynamics, don't share granular data upward) are treated as load-bearing, not cosmetic.
Engineers should use AI coding tools for real leverage while keeping human judgment central โ the 'middle path' โ rather than either full delegation (vibe-coding) or reflexive rejection. strength: medium
Explicit premises:
- AI coding agents are demonstrably useful for certain tasks today.
- AI cannot currently produce well-designed software without human oversight.
- Some engineers already cede too much autonomy to AI (shipping large AI-authored PRs after cursory review); others over-defend code quality against all AI involvement.
Implicit premises:
- There exists a stable, identifiable middle position between these two extremes that is actually achievable by most engineers, rather than the extremes being closer to attractor states that drift toward one pole or the other over time.
Inferences:
- If the middle path is in fact an unstable equilibrium rather than a stable one, then the Experimentation phase's success criterion (teams 'figuring out where it works') may not be self-correcting โ some teams could experiment their way toward vibe-coding rather than toward calibration, which the piece does not anticipate.
Narratives
- The post opens with an invented dialogue in which the reader's CEO, citing a startup founder's claim that '50% of their code is written by AI,' pressures the reader (an engineering leader) to prove the team isn't falling behind.
โ Establishes the exact organizational pressure โ an executive anchored on a vanity metric from an uncontextualized outside data point โ that the entire Aligned Autonomy framework is built to let a leader answer credibly instead of reactively. - A reference to the Dilbert 'pointy-haired boss' as the image leaders must avoid becoming when they introduce AI metrics.
โ Functions as a compressed warning narrative: it implicitly supports the proposition that metrics misuse (surveillance, numbers-for-their-own-sake) is a known, recognizable managerial failure mode that engineers are primed to detect and resent.
Questions addressed
- โ
How should an engineering leader respond when pressured from above to demonstrate AI adoption, without either overselling superficial metrics or dismissing the pressure?
Build a phased, metrics-backed program (Experimentation -> Adoption -> Impact) using Aligned Autonomy, and use the resulting dashboard to answer upward pressure with a managed narrative. - โ
Will AI-assisted coding make software engineers' jobs obsolete?
No โ the tedious parts of the job will be automated, and Jevons Paradox will keep overall demand for engineering work high even as per-unit software cost falls. The author flags this as personal belief ('I personally believe'), not a demonstrated certainty. - โญ How should 'impact' of AI-assisted coding actually be measured, beyond simple usage?
The post recommends leaning on existing engineering-productivity frameworks (DORA, SPACE) combined with adoption metrics, but doesn't work through how to disentangle AI's specific contribution from other concurrent changes to a team's practice โ an open measurement problem the post gestures at rather than solves.
Gaps
- incompleteThe framework assumes the Experimentation phase will surface a path forward into Adoption, but never addresses the legitimate outcome where a team experiments in good faith and concludes AI tooling isn't (yet) worth adopting for their context โ there's no guidance for a leader who has to report that result upward, which is exactly the scenario the opening CEO dialogue sets up as the thing being avoided.
Read next: Look for case studies or frameworks that explicitly cover a negative or mixed outcome from a structured AI-adoption pilot, and how that gets communicated to non-technical leadership without reading as failure. - incompleteThe entire piece assumes the reader has (or can act as if they have) management authority โ budget sign-off, roadmap control, and a direct relationship with a CEO who asks for updates in 1:1s. It doesn't address a technical-track leader (staff/principal engineer, architect) who must drive the same adoption program through influence rather than authority โ exactly the structural position many senior ICs occupy.
Read next: Pair with leadership material written for influence-without-authority roles, or Team Topologies-style material on how a non-manager drives cross-team change. - illogicalThe piece argues both that AI's pace of change is unlike anything the author has seen in 20+ years, and that established change-management patterns from prior technology waves (DevOps, cloud, CD) will straightforwardly transfer โ without reconciling why a genuinely unprecedented shift would be well-served by a non-unprecedented adoption playbook. The claim that 'proven methodologies' suffice is asserted, not argued against the claim of novelty made two paragraphs earlier.
Read next: Look for arguments specifically about what, if anything, is structurally different about AI adoption that would break a Mission Command-style rollout โ e.g. the rate of tool obsolescence outpacing a Community of Practice's ability to stay current.
Related documents
- Research: Why You Shouldn't Treat AI Agents Like Employees
- Research: How AI Agents Broaden the Scope of Knowledge Work
- 2024_final_dora_report
- Stop Automating Old Processes. Design New Ones Instead.
- Presentation: Leadership in AI-Assisted Engineering
- How AI will change software engineering
- Engineering Leadership Report 2026
- Is Agile Dead? How AI and Extreme Agile Redefine Work
- The 8 software engineering metrics AI broke
- Agentic Code Review