2024_final_dora_report
DORA Β· pdf Β· 2024-10-25 Reader π₯οΈ
AI as AmplifierBurnout & RecoveryDeveloper Experience & FlowDORA AI Capabilities Model (Team Profiles & Capabilities)DORA & Engineering MetricsEnterprise AI Adoption & ReadinessGolden PathMeasuring AI ImpactPlatform Engineering
Technology investments β generative AI adoption and internal developer platforms alike β reliably raise individual, team, and organizational performance only when paired with the underlying sociotechnical fundamentals (small-batch delivery discipline, developer independence, transformational leadership, a genuine user-centric and documentation culture, and stable priorities); absent those fundamentals, the same investments degrade software delivery throughput and stability and can increase burnout, so AI and platforms amplify whatever organizational system already exists rather than fixing it.
practical Β· mixed β A decade-ten, 39,000-respondent empirical survey report (expository, statistical) that is explicitly in service of practical organizational action: it closes with a recommended continuous-improvement method and named interventions (stabilize priorities, be user-centric, become data-informed, commit to cloud or stay out), so the findings are presented as inputs to 'what should a team or org do.'
Structure
| Part | Role |
|---|---|
| Executive summary and key findings | context |
| Software delivery performance chapter β splits the historic 'four keys' into two statistically distinct factors, throughput and stability, and introduces 'rework rate' as a second stability metric | evidence / redefinition of measurement |
| Artificial intelligence: adoption and attitudes β survey data on who uses AI, for what tasks, and how much they trust it | evidence |
| Exploring the downstream impact of AI β AI's effects on process measures (doc/code quality, review speed), on software delivery throughput/stability, and on organizational/team/product performance | evidence / core finding |
| Platform engineering β productivity and performance gains from internal developer platforms, developer independence, and the throughput/stability trade-off | evidence / parallel case |
| Developer experience β user-centricity, documentation culture, and the burnout effects of unstable priorities | evidence |
| Leading transformations β transformational leadership, user-centricity, data-informed decision making, and cloud commitment as the four practical levers | conclusion / recommendation |
Key terms
- Software delivery throughput
A statistically distinct factor composed of change lead time, deployment frequency, and failed deployment recovery time β the speed component, newly separated from stability this year because the data showed independence between the two. - Software delivery stability
A factor composed of change failure rate plus a newly added 'rework rate' metric (unplanned deployments to fix a user-facing bug) β DORA's hypothesis that change failure rate functions as a proxy for rework. - Developer independence
Existing users of an internal platform being able to perform their tasks for the entire application lifecycle without relying on an enabling team. - Golden paths
Highly automated, self-service workflows a platform's users follow when provisioning or operating application infrastructure, designed to abstract away delivery complexity so the developer only worries about code. - Transformational leadership
A leadership model scored across five specific dimensions β vision, inspirational communication, intellectual stimulation, supportive leadership, personal recognition β used as a validated survey construct, not a vague honorific.
Propositions
- explicitdevelopedAI adoption is now broad and fairly uniform across industries (75.9% of respondents rely on it for at least one daily task), and it measurably improves individual-level outcomes (flow, productivity, job satisfaction) and process measures (code quality, internal documentation quality, code review speed, approval speed) and team/organizational performance.conf: highextends βThe Pragmatic Engineer 2025 Survey: What's in your tech stack? Β· p1 β DORA's 2024 report found 75.9% daily-task AI adoption; this survey a little over a year later finds 85% report using at least one AI tool β consistent continued-adoption trajectory from a different measurement method and population.
- explicitβ‘ disputed & corroboratedDespite those process-level and individual-level gains, a 25% increase in AI adoption is associated with a 1.5% decrease in software delivery throughput and, more sharply, a 7.2% decrease in software delivery stability.conf: highsupportsAI-Assisted Software Development: Team Profiles and Capabilities for Putting Research into Action Β· p5 β This 2024 finding (AI adoption reduces delivery stability) is the earlier-year evidence that DORA's 2025 AI Capabilities Model report corroborates with its own instability finding.supports βHow AI will change software engineering Β· p2 β Restates the same 2024 DORA finding (1.5% throughput / 7.2% stability decline per 25% AI-adoption increase) as independent corroborating evidence in a different outlet.contradicts βIs Agile Dead? How AI and Extreme Agile Redefine Work Β· p1 β This article's claimed 30-100x productivity multiplier from AI-augmented Agile is an order of magnitude beyond β and in direction opposite to β DORA's 2024 measured finding of a 1.5% throughput decrease per 25% AI-adoption increase.
- implicitcorroboratedDORA hypothesizes the delivery-performance harm occurs because AI lets developers produce more code per unit time, which likely grows changelist (batch) size β and DORA's decade of research has consistently shown larger changes are slower and more prone to instability; improving upstream process measures does not automatically improve delivery unless small-batch discipline and robust testing are maintained.conf: mediumsupportsAI-Assisted Software Development: Team Profiles and Capabilities for Putting Research into Action Β· p7 β Both reports converge on the same small-batch-size mechanism for why AI pressures delivery stability β the 2024 report states it as a fresh hypothesis, the 2025 report restates it as an established pressure point.supports βTechnology Radar: An opinionated guide to today's technology landscape (Volume 30) Β· p3 β This April 2024 practitioner observation (AI throughput -> larger PRs -> strained review) predates and independently corroborates the same mechanism DORA's October 2024 report could only infer from survey data.
- explicitAI adoption benefits organizational performance (+2.3% per 25% increase) and team performance (+1.4%) but shows no clear association with product performance, because team/org performance depend on communication, knowledge-sharing and decision-making bottlenecks that AI eases, while product success depends more on taste, empathy, and user-experience judgment that AI does not yet substitute for.conf: high
- explicitInternal developer platforms raise individual productivity (+8%), team performance (+10%), and organizational performance (+6%), but reduce throughput (-8%) and change stability (-14%) relative to not using a platform, and platform-driven instability combined with the platform itself is specifically linked to higher burnout.conf: high
- explicitdevelopedDeveloper independence (completing the full application lifecycle without an enabling team) is the platform-engineering lever with the clearest productivity payoff β a 5% gain at both individual and team level β larger in per-capita terms than having a dedicated platform team, which produced a 6% team-level gain but a negligible individual-level one.conf: highsupportsPresentation: Platform Engineering in the Age of AI Β· p2 β Both sources treat platform-engineering fundamentals (here, developer independence; there, service intent/APIs) as unchanged in kind by AI β AI shifts magnitude of effects, not the underlying discipline.extends βArchitecture Modernization: Aligning software, strategy, and structure β’ Nick Tune β’ CodeCrafts 2024 Β· p11 β DORA 2024 finds developer independence without an enabling team to be the stronger steady-state productivity lever; Tune's enabling team is explicitly scoped as a temporary transition structure for the modernization push itself, not a permanent capability dependency β a scope qualification on when enabling teams help versus hurt.
- explicitRequiring teams to use a platform exclusively for the entire application lifecycle (removing the option to break out of it) costs throughput (-6%) β mandated, inflexible platform adoption undercuts the independence that otherwise drives the platform's benefits.conf: high
- explicitTransformational leadership (vision, inspirational communication, intellectual stimulation, supportive leadership, personal recognition) raises productivity (+9% per 25% increase), job satisfaction, team/product/organizational performance, and reduces burnout, but functions only as an enabler of technical and product practices, not as a standalone driver of performance β it works through delegating authority, supplying metrics/business intelligence, and aligning incentives to value delivery over feature delivery.conf: high
- explicitUnstable organizational priorities produce small productivity decreases but substantial burnout increases, and this burnout effect is resistant to otherwise-protective factors β strong leadership, good internal documentation, and a user-centered approach do not counteract it; only stabilizing priorities (and shielding employees' day-to-day from priority churn) helps, and the chronic-uncertainty / loss-of-control mechanism behind this mirrors general chronic-stress research.conf: high
- explicitQuality internal documentation has no meaningful effect on predicted product performance by itself, but amplifies the positive effect of user-centricity on product performance β documentation is the channel through which user signals propagate across a team into the product.conf: high
Arguments
AI's harm to software delivery stability stems from an erosion of small-batch delivery discipline, not from AI-generated code being inherently worse. strength: medium
Explicit premises:
- AI improves upstream process measures historically correlated with better delivery performance (doc quality, code quality, review speed, approval speed, reduced complexity).
- Despite those improvements, AI adoption is associated with worse delivery throughput and especially worse delivery stability.
- DORA's prior decade of research shows larger changesets are slower and more unstable.
Implicit premises:
- AI's productivity gains manifest partly as developers producing and committing more code per unit time.
- Teams are not compensating for this increased code volume by deliberately shrinking batch size.
- No other confound (e.g., riskier work being attempted because AI makes it feel feasible) fully explains the gap.
Inferences:
- Without explicit discipline to keep changesets small, raw AI-driven throughput gains convert into integration and stability costs rather than net delivery improvement.
- The fix is organizational/process (batch-size and testing discipline), not a wait for better models.
Platform engineering's net value depends on preserving user-centeredness and developer independence rather than mandating platform use, because the same mechanism that creates value (self-service) also explains why forced, non-independent use erodes it. strength: medium
Explicit premises:
- Developer independence correlates with a 5% productivity gain at both individual and team level.
- Exclusive, mandatory platform use correlates with a 6% throughput decrease.
- A platform without a user-centered approach is 'more a hindrance than an aid.'
Implicit premises:
- Platforms generalize best when treated as products with real user feedback loops, not as infrastructure mandates.
- The added 'handoffs' a platform introduces (automated testing, security checks, deployment, monitoring) are a legitimate throughput cost that independence and good UX can offset but not eliminate.
Inferences:
- A platform strategy that optimizes purely for adoption percentage (coverage) rather than for developer independence and escape hatches will show the productivity/team gains but amplify the throughput and stability losses.
- Platform engineering's 'unexpected downside' (lower throughput/stability, burnout linkage) is best read as a trade-off to actively manage, not evidence against the discipline.
Narratives
- An interview participant (P2) compares trusting AI-generated code to the early days of Stack Overflow β assuming answers from experienced people and copy-pasting them, 'and then things explode' β while another participant (P3) says their company isn't worried about Copilot/ChatGPT copy-pasting because they already have 'so many layers to check it.'
β Supports the proposition that developers don't need (or have) absolute trust in AI-generated code; a 'mostly correct, tweak it' relationship to AI output is compatible with existing quality-assurance layers and is not a new problem class, just a faster version of an old one.
Questions addressed
- β
Does AI adoption improve software delivery performance (throughput and stability)?
No β it has a small negative effect on throughput and a larger negative effect on stability, even though it improves the upstream process measures that historically predicted better delivery. - β
Does AI adoption improve organizational, team, and product performance?
Yes for organizational and team performance (small positive effects); no clear effect found for product performance. - β Why do larger organizations report less reliance on AI in daily work than smaller ones?
- β
Can strong leadership, good documentation, and a user-centered culture protect employees from the burnout caused by unstable organizational priorities?
No β the burnout effect of unstable priorities is resistant to all three; only stabilizing priorities themselves helps. - β Does platform engineering's throughput/stability cost mean the discipline isn't worth it, or is it a manageable trade-off?
DORA offers three competing hypotheses (confident experimentation producing deliberate rework; platforms enabling bad changes through; unstable/burned-out teams building platforms as a response) without adjudicating between them.
Gaps
- incompleteDORA infers that AI erodes delivery stability via growing changelist size, but never directly measures changelist/PR size β the mechanism is a plausible, decade-consistent hypothesis, not a demonstrated causal chain from AI adoption to larger diffs to instability.
Read next: Look for studies that directly instrument diff size, PR size, or batch size alongside AI-adoption level and delivery-stability metrics, to test the batch-size mechanism DORA only infers.closed byTechnology Radar: An opinionated guide to today's technology landscape (Volume 30) β Thoughtworks's TAB reports, from direct observation across many client engagements in a document published six months before the DORA 2024 report, the same mechanism DORA could only infer (AI-assisted coding raises throughput, which tends to produce larger PRs, straining review). This is practitioner testimony, not a controlled measurement, but it is independent, dated-earlier corroboration of the hypothesized causal chain rather than a mere plausibility argument. - incompleteThe report's 'team performance' and 'organizational performance' factor scores are coarse composites; it does not examine whether specific team structures (team size, dedicated platform teams vs. embedded, degree of autonomy) moderate how AI adoption affects delivery stability β a gap directly relevant to a team/org durability lens.
Read next: Team-topology- or team-structure-specific empirical work on how AI adoption's delivery-stability cost varies by team design, rather than by adoption percentage alone. - incompleteDORA offers three mutually exclusive hypotheses for why platform engineering correlates with higher change instability and burnout (confident rework, platform-enabled bad changes slipping through, or reverse causation from pre-existing instability/burnout driving platform adoption) but does not design a follow-up to distinguish them.
Read next: Longitudinal or quasi-experimental platform-adoption studies that could separate reverse causation from a genuine platform-induced instability effect.
Closes gaps elsewhere
- The Pulse: Interesting AI coding stats from Cursor Β· g2 β DORA's 2024 survey supplies adoption-level correlational evidence that AI adoption increases rework/change-failure (lower software delivery stability) β the rework-rate signal that gap asked for, though it is organization-level survey data rather than a direct audit of unreviewed-AI-commit outcomes, so it narrows but does not fully close the gap.
Related documents
- AI-Assisted Software Development: Team Profiles and Capabilities for Putting Research into Action
- State Of AI-Assisted Software Development
- Engineering Leadership Report 2026
- The 8 software engineering metrics AI broke
- AI productivity is burning out your best engineers
- π§ Community Wisdom: How AI is changing product operating models, tracking work stress with Whoop, whether you neeβ¦
- Achieving Compliance as a Platform Engineering Team by Helping Developers
- DORA Community Discussion - DX Core 4
- Measuring AI impact, assessing readiness, and new data trends
- From dashboards to decisions