The Agile methodology is a project management approach that breaks larger projects into several phases. It is a process of planning, executing, and evaluating with stakeholders. Our resources provide information on processes and tools, documentation, customer collaboration, and adjustments to make when planning meetings.
From Agile to the Product Operating Model
CORE
Why Developers Must Be Part of the Customer Validation Process
AI coding assistants are becoming increasingly capable at generating code, explaining systems, and accelerating development workflows. But in real engineering environments, the biggest blocker is often not the model’s ability to write code. The bigger issue is whether the assistant has the right context before it starts making changes. A developer rarely works from a single source of truth. A Jira ticket may describe the implementation task. A Google Doc may contain the detailed requirements. A slide deck may explain the business goal. A meeting summary may include key decisions, open questions, and next steps that never made it back into the ticket. For a human developer, this creates friction. For an AI coding assistant, it creates risk. The assistant may generate code that looks correct, passes basic syntax checks, and follows existing patterns - but still implements the wrong behavior because the actual feature context was fragmented across multiple places. This is where a PARA-style context workspace becomes useful. PARA - Projects, Areas, Resources, and Archives is commonly used to organize knowledge by actionability. Applied to AI-assisted software development, it can become a practical architecture pattern for preparing scattered engineering knowledge before an AI coding assistant touches code. The goal is not to dump every document into the model. The goal is to organize scattered context so the assistant can reason with the right information for the task. The Problem: AI Coding Assistants Often See Only Part of the Work Consider a developer asked to build a new data pipeline that calculates a generic quality score. The implementation sounds straightforward: Build a pipeline that joins multiple input tables, applies business rules, and produces a quality score output table. But the actual context may be spread across several sources: SourceWhat It May ContainTicketImplementation scope, acceptance criteria, due dateRequirements docBusiness rules, scoring logic, data definitionsSlide deckBusiness goal, stakeholder alignment, expected impactMeeting summaryFinal decisions, open questions, changed thresholdsExisting codePipeline patterns, naming conventions, dependency structureOlder documentsPrevious decisions, deprecated approaches, known constraints If the AI coding assistant only sees the ticket, it may miss the deeper context needed to implement the feature correctly. This is especially risky for data pipelines and analytics features, where correctness depends not only on code structure but also on interpretation: which source tables to use, how freshness should be handled, how business rules are applied, and how downstream consumers will use the output. What Can Go Wrong If the Agent Only Reads the Ticket? A ticket often captures the visible work, but not the full reasoning behind the work. If the assistant only uses the ticket, it may: Implement the task but miss business rules from the requirements documentIgnore key decisions captured in meeting summariesUse a technically available source table that is not the approved source for this featureMiss freshness expectations for the output tableProduce a score that does not match how downstream dashboards or reports will consume itFollow an outdated implementation pattern because it found old but similar codeGenerate a pull request that looks reasonable but fails product or data-quality expectations This is the core issue: The AI assistant may know how to write code, but it may not know which code should be written. That distinction matters. For coding agents to become more reliable, developers need a better way to prepare context before code generation begins. Reframing PARA for AI Coding Agents PARA can be adapted from a personal knowledge organization method into a context classification pattern for AI-assisted development. In a PARA-style context workspace: PARA CategoryEngineering MeaningAgent Context RoleProjectsActive work being deliveredCurrent feature scope, ticket, task goalAreasOngoing responsibilitiesStandards, ownership, governance, quality expectationsResourcesReusable knowledgeDocs, runbooks, design patterns, pipeline examplesArchivesCompleted or inactive knowledgeHistorical decisions, old approaches, past incidents This structure helps the AI assistant understand the role of each piece of information. A current requirement should not be treated the same way as an old design decision. A meeting decision should not be buried behind a generic document search. A reusable pipeline pattern should be available to guide implementation, while archived material should be used carefully as historical context. The value of PARA is not just an organization. It gives the assistant a way to distinguish between active task context, long-running rules, reusable references, and historical information. This flow changes how the assistant approaches implementation. Instead of asking: “What code should I generate from this ticket?” The assistant can reason from a richer question: “What is the active feature goal, what rules must be followed, what reusable references apply, and what historical context should be considered before changing code?” That shift is small, but important. Applying PARA to a Quality Score Pipeline Now apply this to the quality score pipeline example. The feature requires a pipeline that joins multiple input tables, applies business rules, and writes a quality score output table. The exact business logic is intentionally generic, but the pattern is common across analytics engineering, data engineering, machine learning platforms, and reporting systems. A PARA-style workspace could organize the context like this: Project Context This is the active feature work. It may include: The current ticketFeature scopeAcceptance criteriaCurrent implementation statusTarget output tableExpected delivery milestoneKnown blockers or open questions For the coding assistant, this answers: “What am I being asked to build right now?” Area Context This represents ongoing expectations that apply beyond this one feature. It may include: Data quality standardsFreshness expectationsOwnership rulesPrivacy or compliance constraintsNaming conventionsRelease processTesting expectations For the coding assistant, this answers: “What rules and standards must this implementation follow?” Resource Context This is reusable technical knowledge. It may include: Existing pipeline patternsSimilar transformation logicData model documentationDashboard dependency notesCommon test patternsRunbooksData validation examples For the coding assistant, this answers: “What reusable references should guide the implementation?” Archive Context This is historical information that may still be useful, but should not automatically drive the implementation. It may include: Older design decisionsDeprecated scoring logicPast pipeline migrationsPrevious quality metric experimentsHistorical meeting notesOld RCA or incident learnings For the coding assistant, this answers: “What historical context may explain why the system works this way?” The critical point is that archived context should be used for awareness, not blindly copied into the current implementation. Why Meeting Summaries Matter Meeting summaries are often underestimated in AI-assisted development. In many teams, the final decision is not always reflected immediately in the ticket or requirements document. A meeting summary may contain important details such as: A threshold was changed after stakeholder discussionA source table was rejected because of data freshness concernsA metric definition was clarifiedA downstream dashboard dependency was identifiedA launch decision was postponedAn open question was assigned to another teamA temporary workaround was approved only for the first release For a human developer, these details may be remembered from the meeting. For an AI coding assistant, they are invisible unless they are included in context. This is one reason a PARA-style workspace can be valuable. It gives meeting summaries a place in the feature context without treating them as random notes. A meeting summary tied to an active feature belongs in the Project context. A recurring decision about data freshness may become the Area context. A reusable explanation of metric calculation may become the Resource context. Once the feature is complete, the same meeting summary may eventually move into the Archive context. How the Coding Assistant Should Use Context Before Changing Code Before generating code, the AI coding assistant should use the structured context to form an implementation understanding. For a quality score pipeline, it should first understand: What the feature is trying to accomplishWhich input data sources are approvedWhich business rules define the scoreWhich decisions were finalized in meetingsWhat freshness or latency expectations existWhich existing pipeline patterns should be followedWhat downstream dashboards, reports, or consumers depend on the outputWhich historical approaches should be avoided Only after that should it propose an implementation plan or modify code. This changes the assistant’s role. It is no longer simply a code generator responding to a ticket. It becomes a context-aware engineering assistant that can reason across requirements, decisions, standards, and existing system patterns. The Bigger Shift: From Prompting to Context Preparation Prompting is still useful, but it is not enough for complex engineering work. A good prompt cannot fully compensate for missing requirements, outdated context, or scattered decisions. For AI coding assistants, the quality of the result depends heavily on the quality of the context that comes before the prompt. This is especially true when the task involves business logic, analytics definitions, data contracts, or cross-team decisions. In those cases, the question is not: “How do we write a better prompt?” The better question is: “How do we prepare the right engineering context before asking the assistant to write code?” For developers building with AI coding agents, this may become one of the most important habits: do not ask the agent to write code first. Prepare the context first. Because the future of AI-assisted development will not belong only to teams with the most powerful coding models. It will belong to teams that know how to structure knowledge so those models can make better engineering decisions.
Mainframe modernization is once again at the center of enterprise conversations. Not because something suddenly broke, but because the environment around it has changed. Organizations are being asked to move faster, integrate more easily with newer platforms, and support initiatives like cloud and AI that weren’t part of the equation a decade ago. At the same time, experienced teams are shrinking, costs are under scrutiny, and expectations from the business are higher than ever. The way organizations are approaching modernization is evolving as well. Instead of treating it as a one-time, large-scale effort, many are taking a more incremental path and making changes over time. Many are introducing more modern, agile development practices and working to bring mainframe development closer in line with how the rest of the enterprise builds and delivers code changes and manages their development cycles. Even with that shift, the same challenges still tend to surface. The Clarity Most Organizations Are Missing Most organizations approaching modernization are not lacking motivation. What’s often missing is clarity around what’s really broken, what needs to change, and what success should look like. There’s a general sense that systems are too slow, processes are inefficient, or teams are struggling to keep up. But those issues aren’t always clearly defined before decisions are made. Instead, the focus shifts quickly to solutions (new platforms, new tooling, AI) without fully understanding the root of the problem. If the issue is how work flows through the organization (how decisions are made, how teams interact, and how long it takes to move from development to production, etc.), then changing the technology alone won’t solve it. In many cases, it simply exposes the problem more quickly. Where Modernization Efforts Start to Break Down When that lack of clarity carries into execution, the gaps become much harder to ignore. Processes are often more complex than expected, approval chains are longer than they need to be, and workarounds have developed over time to compensate for inefficiencies in the official process. Introducing new tools into that environment doesn’t remove those issues; it highlights them. A faster system makes bottlenecks more obvious, and a more connected environment exposes gaps between teams. What may have been tolerated before now becomes difficult to ignore. There’s also a persistent belief in what many teams jokingly call the “magic factor.” The idea that a new platform, a new vendor, or even AI will come in and solve everything. It’s an appealing story, especially when teams are under pressure. But it sets expectations that reality can’t meet. Timelines add another layer of tension. Modernization is often scoped as a short-term project, when in reality it requires sustained effort. Training, testing, and adoption all take time, and organizations are rarely able to move as quickly as initial plans assume. Perhaps most critically, many organizations lack a true internal owner of the effort. Vendors and partners can guide the work, but they can’t drive internal adoption. When no one inside the organization is accountable for the outcome, progress slows, decisions get delayed, and momentum fades. All of this plays out against a backdrop of uncertainty. For experienced mainframe professionals, modernization can feel like a threat to years of hard-earned expertise. For newer developers, it can feel unfamiliar and difficult to navigate. Without clear communication and support, both groups can disengage. At that point, modernization doesn’t fail outright; it just never quite delivers what it promised. What Changes When It’s Done Right When organizations take a step back and approach modernization more thoughtfully, the picture can look very different. Instead of treating the mainframe as something separate, they start to bring it into the same ecosystem as the rest of their development environment. Tools like Git, modern IDEs, and CI/CD pipelines become part of the workflow. Developers no longer have to switch contexts or work in isolation. That shift alone changes how teams operate. Historically, mainframe teams have operated separately from distributed, web, and mobile teams. Each team had different tools, different workflows, and limited visibility into each other’s work. Modernization, particularly when it introduces more unified workflows, begins to break down those silos. Teams gain a clearer view of how their work connects, collaboration becomes more natural, and knowledge starts to move more freely across the organization. That has a real impact, especially as experienced team members retire and newer developers step in. Instead of relying on formal handoffs or last-minute knowledge transfer, learning becomes part of the day-to-day work. A more modern development experience also makes it easier to bring in new talent and help existing teams work more effectively, which is becoming increasingly important as experienced developers retire. There are financial benefits as well, though they tend to follow rather than lead. As organizations adopt more flexible tooling and, in some cases, open-source solutions, they gain options. They are no longer as tightly bound to a single vendor or licensing model. Over time, that flexibility can translate into meaningful cost improvements. What Successful Organizations Do Differently Those outcomes don’t happen by accident. The organizations that get real value out of modernization tend to have leadership teams that approach it differently from the start. They don’t treat it as a tool decision or a one-time project. They treat it as an effort to improve how their environment operates, and they’re deliberate about how they go about it. That shows up in a few consistent ways: They get specific about the problem before looking for a solution. They take the time to determine why they’re modernizing before deciding how. Whether it’s speed, cost, talent, or competitiveness, that clarity shapes every decision that follows. A clearly defined objective keeps the effort grounded and helps teams prioritize what matters, measure progress, and avoid getting pulled in directions that don’t support the end goal.They take a hard look at how work flows today. Not how it’s documented or expected to work, but how it actually plays out in practice. That means mapping out the full path from development through deployment, including where work slows down, where approvals stack up, and where teams have created workarounds just to keep things moving. This step often surfaces issues that aren’t visible at a leadership level.They involve the people closest to the work. The most useful insights tend to come from the teams working in the process every day. Developers, operators, and support teams see where the friction is and what would make the biggest difference. Bringing those voices in early leads to better decisions and fewer surprises later.They establish clear ownership inside the organization. Modernization efforts move faster and more consistently when there’s a clear internal owner. Someone who understands the goal, can make decisions, and is accountable for keeping the work moving.They plan for adoption, not just implementation. Even when the technical work is straightforward, the transition isn’t. Teams need time to adjust to new workflows, learn new tools, and build confidence in the changes. Organizations that plan for that upfront tend to avoid the frustration that comes from trying to move too quickly.They start with a focused effort and build from there. Rather than trying to modernize everything at once, they begin with a smaller, well-defined scope. A pilot or targeted initiative creates a chance to test the approach, learn what works, and make adjustments before expanding more broadly. It also helps build internal support as people start to see tangible results. Making Modernization Work At its core, modernization isn’t about replacing one system with another. It’s about improving how the organization operates. Technology matters, but it only works when it’s built on a process that makes sense. Without that, modernization becomes another expensive layer on top of existing problems. When done well, modernization doesn’t just improve systems. It changes how teams work, how quickly the business can respond to what comes next, and turns a technical effort into a true business advantage.
TL;DR: The AI Definition of Done Your team has a Definition of Done for a product increment. It has none for the 20-plus AI-supported outputs that leave the team each week: status reports, stakeholder emails, release notes, and updates for the C-level. Each one carries your team’s name. “I know quality when I see it” is the standard most teams actually run by, and you cannot audit it, teach it to a new colleague, or defend it when a claim turns out to be wrong. The AI Definition of Done fixes that with one page per task class, agreed by the team, before the output ships. Your Increment Has a Standard; Does Your AI Output? A model turns the Jira board into a Friday status update, and the update tells an enterprise prospect that the security feature is in production. Unfortunately, it is not. The feature was descoped three months ago, but the old ticket title persisted because no one felt responsible. So the model reported the title instead of the reality. Nobody checked the claim against the release notes because nobody had agreed that someone should. The email was sent with the team’s name on the cover. A functioning agile team should be able to tell you what “done” means for a product increment. Few can tell you what “done” means for that status update. No agreed standard governs it, and it ships every week. The product increment passes through a standard that the team argued over and agreed on. The AI-assisted output passes through one person’s gut feeling at the moment they clicked send. One of those you can defend to a stakeholder, an auditor, or a new hire. The other you cannot. The AI Definition of Done closes that gap without adding a governance department, which is exactly why it survives in organizations where “AI governance” earns eye rolls. It takes a practice every agile practitioner already owns and points it at the work you have started handing to a model. It is not for everything: skip it for private brainstorming, throwaway prompts, or personal sensemaking, unless the output later informs a decision or leaves the team. The Four Questions Every AI Definition of Done Answers The Concept Verification Level Which claims get checked, by whom, against what source, and how? “Looks good” is not a method. A method names the claim, the checker, the source, and the test: every factual claim about product status gets checked against the release notes by the sender before sending, every time. Where teams get stuck: approval gets mistaken for review. Someone skims a draft, clicks send, and the team’s name now sits on a claim nobody verified. Provenance Disclosure What does the team declare about how the output was produced? Three labels cover practice: a) Human means no material AI contribution to the content, claims, or structure (a spellchecker does not count), b) AI-assisted means AI contributed to drafting, summarizing, or analysis, and a named human reviewed the output and decided, and c) AI-automated means AI produced and sent the output under predefined rules, without human review before release, audited at a set cadence. The line that matters runs through “reviewed”: clicking send on an unread draft is approval, never review. An output approved without reading is AI-automated, whatever the team tells itself. Data Hygiene What never enters a model on the way to this output? Name the exclusions concretely: personal data from team surveys, customer-identifiable information, anything your organization’s AI policy restricts. If the input rules in your A3 Handoff Canvas already cover this, point to them. Do not keep two versions of the same rule. Where teams get stuck: nobody wrote the exclusions down, so each person guesses, and the guesses differ. Sufficiency Tier and Environment Which model, plan, and data boundary are good enough for this task class, and why? A top-notch frontier model drafting calendar invitation may fail in this regard. The cheapest model, run locally on an old Mac mini, can write a board update but likely fails in the other. Capability is only half of it: a board update may need an enterprise plan with a no-training guarantee or an approved connector, even when a mid-tier model is plenty. If your team has a routing policy, point to the tier and the environment it mandates. If it does not yet, name the model and the plan, and explain in one sentence why both are enough. The AI Definition of Done Template Four questions, plus two operating controls, one page. Here is the template a team fills in per task class: DimensionYour Standard for This Task ClassTask classVerification level: What is checked, by whom, against what, howProvenance label: Human (Avoid) / Assist / Automate from the A3 Delegation Framework, and where the label appearsData hygiene: What never enters the modelSufficiency tier and environment: Wich model, plan, and data boundary, and why they are enoughSign-off: Who agreed, on what date, and the review dateStop rule: When the delegation is paused, downgraded, or returned to manual work The last two rows are operational, not definitional: Sign-off records who agreed and when, and the stop rule names the condition that pauses the delegation, because this standard should say not only when an output may ship but when the task class stops being eligible for AI at all. Without it, teams keep tuning the prompt or skill long after the delegation has proven unfit. A Worked Example: External Status Communication The status update failure that opened this article maps to one task class, status communication, leaving the company. Here is the team’s first AI Definition of Done for it: DimensionStandardTask classStatus communication leaving the companyVerification levelEvery claim about feature status is checked against the release notes by the sending manager, before sending, every timeProvenance labelAI-assisted; footer states “Drafted with AI, reviewed by [name]”; Assist is not permitted for this task classData hygieneNo customer names, no security-finding details, no internal financials enter the modelSufficiency tier and environmentMid-tier model on an enterprise plan with no model training; drafting from structured release data needs no frontier modelSign-offTeam agreed, dated; review after the next four status updatesStop ruleIf two updates in a review cycle need a factual correction after sending, the task class returns to manual drafting until the standard is revised The standard costs the sending manager about four minutes a week, set against an error that can put a flagship deal at risk. Write Your AI Definition of Done in 75 Minutes An AI Definition of Done that one person downloads and pastes into the wiki doesn’t change anything. The argument over the standard is where the standard takes hold. Run it as a workshop: Pick three task classes (10 minutes): Choose from work the team actually shipped in the last two weeks, never hypotheticals. The best candidates are outputs that leave the team.Draft in pairs (20 minutes): Each pair fills the template for one task class. Pairs work without comparing notes; divergence is the point.Argue the differences (25 minutes): Compare drafts. Where pairs disagree on verification level or provenance, the team has found an unspoken assumption. Resolve each disagreement with a decision, never with “both are fine.”Set the labels (10 minutes): Agree where provenance labels appear: email footers, document headers, report covers. Visible beats buried.Adopt and date (10 minutes): Sign off each AI Definition of Done with a review date, and add the adoption to your AI working agreement. Ownership stays with the team running the delegation. Compliance, security, or legal may constrain the standard, but they do not write it for the team. When someone says, “We do not need this for internal outputs,” ask what happened the last time an internal draft got forwarded outside the team. Every team has that story. The Record You Get for Free Each signed-off AI Definition of Done is a dated, versioned, one-page record. Stack them, and they answer the due diligence question enterprise buyers increasingly ask, “How do you control AI-generated output?” with documents instead of assurances. Nobody wrote a governance report. The records came out of normal work. That answer is already part of procurement and due diligence conversations. Article 4 of the EU AI Act has been applied since February 2, 2025, and requires providers and deployers to ensure a sufficient level of AI literacy among staff and others operating AI systems on their behalf. The EU Commission’s Q&A places supervision and enforcement under national market surveillance authorities, with the enforcement rules applying from early August 2026. The practical question underlying the regulation is simpler, and a prospect’s procurement team will ask it before any regulator does: can you show the standard that underlies the output you sent us? Three Ways It Fails The downloaded standard: A template adopted without the workshop. Nobody argued, so nobody owns it. An AI Definition of Done that nobody argued about is one nobody will follow. The universal standard: One AI Definition of Done for all work. Verification that aligns with external communication suffocates internal brainstorming, and the team abandons the practice within a month. One page per task class. Contrary to the classic Definition of Done, there is no one-size-fits-all in our use case. The static standard: Written once, reviewed never. Models change, people change, task classes change. The review date is part of the artifact, and your next delegation inspection enforces it. Conclusion: Pick One Output This Week Pick one AI-assisted output your team ships regularly. The Friday status update, the Sprint summary, or the stakeholder email. Walk it through the four questions out loud in your next Retrospective: what gets checked and by whom, how we label it, what never enters the model, and which tier is enough. You will likely find at least one question where the honest answer is “nobody decided that.” Write the one-page response for that task class, argue it, sign it, and date it. One standard, agreed by the team, is the difference between a team that uses AI and a team that a customer can trust with it. Which of your AI-assisted outputs has a standard behind it right now, and which one is merely a habit? Key Questions This Article Answers What Is an AI Definition of Done? An AI Definition of Done is a one-page, team-agreed standard that an AI-assisted output must meet before it leaves the team. Teams write one per task class, such as external status communication or data analysis summaries, never one per task. It answers four questions: what gets verified, how the output is labeled, what data never enters the model, and which model and environment are sufficient. It borrows the discipline of the Scrum Definition of Done and applies it to work on a model touched. What Is the Difference Between Approval and Review for AI Output? Review means a named human reads the AI-generated output and checks its claims against a source before it ships. Approval means someone clicked send. Clicking send on an unread draft is approval, not review, whatever the team calls it. An output approved without reading is effectively AI-automated, and it should carry that provenance label rather than the AI-assisted label, which implies a human verified it. How Do You Write an AI Definition of Done? Run a 75-minute team workshop, not a solo download. Pick three task classes from work shipped in the last two weeks, draft the standard in pairs, then compare and resolve every disagreement with a decision. Agree where provenance labels appear, set a stop rule that returns the task class to manual drafting when outputs repeatedly fail, sign off each standard with a review date, and add the adoption to your AI working agreement. The argument over the standard is what makes the team own it. How Do Agile Teams Prove They Govern AI Output? Each signed-off AI Definition of Done is a dated, one-page record. Together, a team’s standards answer the procurement and due diligence question “how do you control AI-generated output” with documents rather than assurances. The records are a byproduct of normal work, so no separate governance report is needed. This matters because buyers and regulators, including under the EU AI Act Article 4, increasingly require evidence of controlled AI adoption. What Are the Four Dimensions of an AI Definition of Done? Verification level (which claims get checked, by whom, against what source, and how), provenance disclosure (Human, AI-assisted, or AI-automated, and where the label appears), data hygiene (what never enters the model), and sufficiency tier and environment (which model, plan, and data boundary are good enough and why). Each dimension fits on one line of a one-page template, signed off with an adoption date and a stop rule that pauses the delegation when outputs repeatedly fail.
CORE
There is a pattern that repeats itself across engineering organizations regardless of team size, tech stack, or industry. A sprint ends. Features are shipped. The QA team is still writing automation for the previous sprint. The backlog of unautomated scenarios grows. Leadership asks what it would take to close the gap. The answer comes back: more engineers, more time, more tooling budget. Six months later, the gap is the same size. Sometimes larger. This is not a resource problem. It is an architectural problem. And until the architecture changes, the gap does not close. The Upstream Problem Nobody Measures When engineering teams analyze their automation coverage gaps, they almost always focus on execution test runs that are slow, maintenance is high, and flaky tests waste time. These are real problems. But they are downstream of a more fundamental issue that rarely gets measured: the time between a requirement being written and automation existing for it. In a traditional QA workflow, that gap looks like this: Requirement lands in JiraDeveloper builds the featureQA engineer reads the requirement, interprets it, designs test scenariosQA engineer writes test casesQA engineer scripts automation in Playwright or SeleniumQA engineer executes, debugs, maintains Steps 3 through 5 take days. Sometimes weeks. Every sprint adds to the backlog. Every requirement change breaks existing automation. The team runs hard and stays in the same place. The industry has responded to this by automating step 6, making execution faster, smarter, and more parallelized. But steps 3 through 5, requirement interpretation, test design, and scripting, remain almost entirely manual in most organizations. This is the upstream problem. And it is where the real automation opportunity sits in 2026. What Changes When You Start From Requirements The architecture shift that actually closes the coverage gap starts much earlier in the pipeline than most automation teams consider. Instead of "requirement arrives → developer builds → QA manually creates coverage," the new model is "requirement arrives → AI evaluates and enhances → AI generates test cases → AI generates scripts → AI executes → results with traceability returned." The human does not design coverage. The human does not script automation. The human reviews requirements, approves test cases when necessary, and focuses on exploratory testing and quality strategy, the work that actually requires human judgment. This is what requirement-driven autonomous testing means in practice. The requirement is the input. The executed test result is the output. AI owns everything in between. The 5 Stages of a Requirement-to-Result Pipeline Platforms like TestMax implement this model as a connected five-stage pipeline. Understanding each stage explains why the architecture works differently from traditional automation approaches. Stage 1: Requirement Ingestion The pipeline accepts requirements from wherever they live, Jira tickets, Azure DevOps work items, Word documents, PDFs, Excel files, or requirements authored directly in the platform. No reformatting required. The requirement enters the system as it exists. This matters because one of the friction points in traditional QA automation is the translation step, converting a Jira ticket into a format that test tooling can work with. When ingestion is native, that step disappears. Stage 2: Requirement Intelligence Before any test generation begins, every requirement is evaluated by AI across five quality dimensions: clarity, completeness, consistency, testability, and correctness. This stage is the most underestimated in the entire pipeline. Poor requirements produce poor tests always. A requirement that says "the login form should work correctly" is not testable. A requirement that specifies valid credentials, invalid passwords, empty field behavior, account lockout thresholds, and session persistence rules is. When AI catches ambiguity at the requirement stage, it costs nothing to fix. When that same ambiguity surfaces after automation has been built against it, it costs days. The requirement of the intelligence layer moves the defect detection upstream to where it is cheapest. Requirements that fail quality review are flagged with specific improvement suggestions. AI offers rewrites. Nothing ambiguous proceeds to test generation. Stage 3: AI Test Case Generation Once a requirement passes quality review, the platform generates structured test cases automatically. Not surface-level happy path scenarios, complete coverage across positive paths, negative paths, boundary conditions, and edge cases. For a single requirement, like users can reset their password via email verification, the generated coverage includes: Valid email address submitted – verification email receivedInvalid email format – appropriate error returnedEmail address not registered – system response without revealing account existenceVerification link clicked – password reset flow initiatedVerification link expired – appropriate error with re-send optionNew password does not meet policy requirements specific validation messagesSuccessful reset – session handling, redirect behaviour All of this is generated automatically from the requirement. No human designs the coverage strategy. Stage 4: Automation Generation Approved test cases are converted into executable Playwright scripts automatically. Production-ready code with appropriate waits, assertions, and selector strategies generated without a human writing a single line. This is the step that eliminates the scripting bottleneck. In traditional automation, scripting bandwidth is a hard ceiling on coverage growth. When the team can script 50 test cases per sprint, coverage grows at that rate regardless of how many requirements are produced. When scripts are generated automatically from approved test cases, that ceiling disappears. Coverage can grow at the rate requirements are produced, not the rate engineers can write code. Stage 5: Autonomous Execution and Evidence AI agents execute the generated test suite through Playwright MCP. They manage environment setup, handle retries, capture logs, screenshots, and video per test, and return a complete traceability matrix linking every result to its source requirement. The output is not a pass/fail count. It is a complete evidence package suitable for audit, governance, and release decision-making generated automatically from the requirements the team was already writing. Why This Architecture Closes the Coverage Gap The traditional automation model has a linear constraint: coverage grows proportionally to engineering effort. More requirements always mean more backlog because the human work required per requirement is roughly constant. The requirement-driven autonomous model removes the linear constraint. When AI handles test design, scripting, and execution per requirement, the engineering effort per requirement drops dramatically. Coverage can scale with the requirements themselves rather than with team headcount. There are three concrete consequences: Coverage lag is eliminated. When test generation takes minutes rather than days, new features can have automation in the same sprint they are built. The perpetual state of automation backlog, where coverage is always weeks behind the code it is supposed to validate, is a consequence of the manual model, not an inevitability. Maintenance burden shifts. In traditional automation, 60 to 80 percent of automation engineering effort goes to maintaining existing scripts. When AI generates scripts from requirements, the maintenance responsibility belongs to the generation layer. UI changes that would previously break dozens of handwritten selectors are addressed at the generation stage. Requirement quality improves as a side effect. When every requirement must pass an AI quality evaluation before entering the test pipeline, the incentive to write precise, testable requirements increases. Teams that implement requirement-driven testing typically report improvement in requirement quality within two to three sprints, not because they trained their product managers differently, but because the pipeline now provides immediate, specific feedback on every requirement. Integrating With Existing Workflows A practical concern with any architectural change is migration cost. The requirement-driven autonomous model does not require replacing existing infrastructure. Generated Playwright scripts integrate directly into existing CI/CD pipelines. Teams running Jira or Azure DevOps connect those systems natively requirements flow in without manual re-entry. For teams using ATF or other existing test frameworks, the autonomous testing layer runs alongside rather than replacing what already exists. The practical starting point is a single sprint. Take the new requirements entering your backlog this week. Run them through a requirement-driven platform. Compare the test coverage produced in time, in scenario depth, in maintenance overhead against what your team would have produced manually. The experiment answers the adoption question more convincingly than any benchmark. The Architectural Question for 2026 The relevant question for QA teams in 2026 is not whether to use AI in testing. Almost every serious testing platform has added AI capabilities in some form. The question is: where in the pipeline is AI actually doing meaningful work? At one end of the spectrum, AI heals broken selectors and suggests which tests to run. The human still reads requirements, designs coverage, writes scripts, and manages execution. AI makes individual tasks faster. At the other end, AI owns the pipeline from requirement evaluation through execution and evidence delivery. The human provides requirements and reviews results. AI does everything in between. The teams that figure out where they sit on that spectrum and decide consciously which model their coverage goals require are the ones that will stop having the same conversation about automation backlogs next quarter.
Teams often say they are building one app. A lot of the time, that is not true. I saw this while reviewing a telemedicine MVP. At first, the plan sounded simple enough: video visits, messaging, scheduling, and basic records. Then the version-one list kept growing: Patient appprovider dashboardAdmin panelMessagingVideoBillingEHR connectionDevice support later At that point, this was no longer one app. It was several systems being planned as one MVP. A patient-facing productA provider-facing productAn admin productA set of outside-service connections When a team treats all of that like one first release, things get messy before development even starts. The Moment It Stopped Being One App The problem was not the number of screens. The problem was the number of users, roles, and data rules hiding behind those screens. A patient needed intake, booking, reminders, and follow-up. A provider needed schedules, patient context, notes, and quick actions during the day. An admin needed visibility, support tools, and role controls. The outside-services side added video vendors, messaging vendors, EHR work, and, later, device data. That is not one product. That is a group of different systems with different jobs. Once that became obvious, the planning changed. Split the Product by User First Before estimating anything, it helps to split the product by who it is for. For this telemedicine project, the first useful split looked like this: 1. Patient Side This part handled: IntakeBookingRemindersFollow-up messagingJoining a visit The patient's side had to stay simple. It also had to be clear about what the patient could and could not see. 2. Provider Side This part handled: Schedule viewPatient detailsVisit notesQuick responsesRole-based access This was not just a different set of screens. It had different speed needs, different daily habits, and different data access rules. 3. Admin Side This part handled: Role setupSupport actionsVisibility into operationsReportingNon-clinical controls Admin work often looks small during planning. In real projects, it adds a lot of rules and a lot of testing. 4. Outside-Service Work This part handled: Video vendor setupMessaging vendor setupEHR-related workFuture device dataLogging and audit-related movement of data This is where many teams get surprised. Video, messaging, and EHR are not tiny add-ons. Each one brings its own work. Start With Access Rules Before the Feature List In multi-role products, one of the quickest ways to find hidden work is to define access rules early. Before locking the feature list, ask: Who can create this dataWho can read itWho can change itWho can delete itWho can export it For the telemedicine project, this made a big difference. A few features looked simple in the scope doc. Once the team asked who could view or change the related data, the work got much larger. A basic example: Admins can help fix booking problems. That sounds harmless. But then the real questions start: Can admins see messages?Can they see visit notes?Can they see call history?Can they open uploaded files? That one sentence can change a big part of the system. Access rules often show hidden work much faster than a feature list does. Treat Outside Services as Separate Work Another mistake teams make is treating outside services like small items on a checklist. On paper, it can look like this: VideoMessagingEHR later In practice, each one adds its own work: Vendor setupRequest and response formatsError handlingRetry rulesLoggingReplacement cost if the vendor needs to change later That is why these items should be planned separately. For the telemedicine case, once video, messaging, and EHR work were split out from the main product list, the first release became easier to define. Some items that seemed close to launch were clearly not ready for version one. Ship One Complete Path First Once the team stopped calling everything an MVP, the first release got smaller. The version-one path that stayed in looked like this: Patient intakeAppointment bookingSecure video through the chosen vendorFollow-up messagingBasic provider access controls That was enough to test whether the product solved a real problem for a clinic. What moved out of the first release: Deeper EHR workMore reportingDetailed billing flowsDevice supportBroader admin tooling Those things were not bad ideas. They just did not belong in the first build. 4 Simple Documents to Create Before Sprint Planning When a team starts to suspect that one MVP is several systems, four short documents can help a lot. 1. User-to-System Map List each part of the product and the main user for it. 2. Permission Matrix Write down who can create, view, change, delete, and export each type of data. 3. Outside-Service List Separate core product work from vendor work and data that moves in or out of the system. 4. First-Release Path Write the one end-to-end path that version one has to get right. These are short documents, but they make planning much better. Why This Matters Outside Healthcare, Too This lesson is not only for telemedicine. It applies to any multi-role product where the team is building for more than one type of user. That includes: Customer apps with admin panelsSaaS products with back-office toolsPlatforms with provider and client sidesProducts that depend on outside vendors from day one The moment a team has different users with different goals, the work stops being “just one app.” Final Point A lot of MVPs get too big because teams keep calling them one product long after that stops being true. The fix is not always better estimates. Sometimes the fix is much simpler: Split the product by user.Write down the access rules.Separate outside-service work.Ship one complete path first. That makes the first release easier to plan, easier to build, and easier to test.
In my 30 years of navigating the IT landscape, I’ve seen ‘Agile’ transform from a revolutionary mindset into what often feels like a series of manual project hurdles. In many large projects I’ve led, I’ve noticed we’ve traded innovation for a culture of ‘babysitting’ Jira boards and tracking Excel sheets. I wish to develop the Agentic Agile Office (AAO) not as another layer of automation, but as a fundamental shift in how I believe we must manage project velocity and governance. The Bottlenecks I’ve Encountered In my experience, traditional Enterprise Agile often buckles under its own weight. I’ve watched Technical Program Managers (TPMs) and Scrum Masters spend up to 60% of their time on administrative overhead. I’ve seen the "manual tax" of chasing status updates slow down the very speed Agile was designed to create. I believe it’s time to move past this. How I Define Autonomous AI Agents The AAO framework I’m proposing moves beyond simple chatbots. I am focusing on agentic AI — systems capable of reasoning, planning, and executing tasks autonomously. Within my framework, these agents don't just answer questions; they take action: The Backlog Agent: This will automatically analyze user feedback and technical debt to suggest prioritization scores for the Product Owner.The Dependency Agent: This agent scans multiple team boards in real-time. I want it to identify and flag architectural conflicts before they cause a sprint failure.The Governance Agent: I see this as the ultimate safeguard, ensuring all code commits meet compliance standards without a human auditor needing to manually check every pull request. Deep Dive: The Architecture of the AAO While defining these agents is the first step, I believe it is critical to understand the architectural engine that drives this office. To move beyond simple automation, I have structured the AAO as a three-tier system: 1. The Intelligence Layer: Reasoning Over Data In my three decades in the industry, the biggest issue hasn't been a lack of data, but the "data fog." I designed the AAO to use large action models (LAMs) that don't just read your tickets; they understand the intent behind them. Contextual memory: I want these agents to remember that a delay in a previous quarter was caused by a specific API bottleneck so they can predict similar risks today.Reasoning loops: Instead of a static trigger, I’ve structured these agents to use "Chain of Thought" processing to validate if a story is actually "Ready" based on historical standards. 2. The Workflow: A Day in the Life of an Agentic Sprint I’ve reimagined the standard sprint cycle to show exactly where I believe these agents provide the most value: Pre-planning: Before the team meets, I have the Backlog Agent scrub requirements. If a user story lacks an acceptance criterion, the agent flags it to the Product Owner immediately, saving us 30 minutes of "discovery" time during the meeting.In-sprint execution: I’ve implemented the Dependency Agent to act as a "digital scout." If a developer changes a schema that another team relies on, the agent detects the conflict in the pull request and notifies both Scrum Masters before the build even fails.The "always-on" retrospective: I believe retrospectives shouldn't just happen every two weeks. My Insight Agent tracks velocity trends daily. If I see a team's burndown stalling, the agent provides me with a root-cause analysis before I even ask. 3. My Strategy: Agentic Over Generative AI I want to be clear on a point of common confusion: Generative AI writes the email; agentic AI recognizes a project risk, decides an email is necessary, and drafts it for my review. In my framework, I am moving the human from being the operator of the tool to being the editor of the agent's actions. I’m shifting our workload from "doing the work" to "verifying the outcomes." Why I Believe This Redefines Our Roles This technical shift leads to a natural question: if agents are handling the logistics, what happens to the people? In my view, this shift doesn't diminish our roles; it elevates them. By offloading the "babysitting" of Jira boards to autonomous agents, I want to empower leadership to focus on: Complex problem solving: Negotiating high-level blockers that require a human touch.Mentorship: Spending more time coaching teams to improve their craft.Strategic alignment: Ensuring technical output truly maps to business value. My Vision for the Future To me, the Agentic Agile Office represents the transition from Agile-by-process to Agile-by-intelligence. I am confident that by integrating these agents, enterprises can finally achieve continuous delivery without the human burnout I’ve witnessed throughout my career. I no longer ask "How do we scale Agile?" I now ask: "How quickly can I help you integrate the agents that will do the scaling for you?"
TL;DR: Why A Former Micromanager Will Make AI Adoption Work Twenty years of Agile coaching failed to fix the micromanager who meddles with every draft, every meeting, every decision. This article shows where their distrust stops damaging teams and starts producing the verification work AI adoption actually needs. Welcome the Verification Architect! What Is a Verification Architect? A Verification Architect is the person responsible for deciding which AI tasks belong in Assist mode, which belong in Automate mode, and which belong in Avoid mode of the A3 framework; defining what review means in each mode; and running the verification loop that converts each AI failure into a sharper prompt, eval, or acceptance criterion. The role is not a compliance auditor: compliance asks whether rules were followed, while verification asks whether the system produces the claimed outcome under the conditions in which it operates. In smaller organizations, the work is often a responsibility carried by a Product Manager, Scrum Master, QA lead, or technical lead, rather than by someone holding the title. Learn more about why a micromanager might be an excellent fit for this role below. The Micromanager You know the type of manager: The micromanagers ask to see the draft before the team talks to the customer. They rewrite the acceptance criteria after refinement. They join the Slack thread “just to clarify” and leave with the decision back in their hands. They are not malicious. They genuinely believe the work needs their eyes before it ships. For 20-plus years, Agile coaches have tried to convince these people to trust the team, the people they hired themselves. The psychological safety workshops did not work. The servant-leadership reading lists did not work. Much of the coaching industry learned to work around this population and focus on the trainable middle. The micromanagers stayed. Now the same manager is being asked to delegate work to AI. They will not delegate without asking. But this time, their skepticism deserves a hearing. The Micromanagement Disposition Is Not the Defect There is a reason the AI industry uses the phrase human in the loop. Probabilistic systems running autonomously should not be trusted by default with consequential decisions in their current form. They hallucinate citations. They produce confident wrong code. They will follow an under-specified instruction into a wall and report success. The instinct to verify before accepting consequential output is not a defect in this domain. It is reliability engineering. This context exposes the problem with the standard Agile framing. Telling a chronic skeptic that they need to trust more works against the evidence. The skeptic micromanager looking at agentic AI sees what the engineers building it see: a powerful tool with known failure modes that has to be wrapped in observability, harnesses, evals, and verification before it produces reliable value. The skeptic’s posture toward AI is closer to reliability engineering than to the optimism that much AI adoption theater demands. Where the same instinct fails is with human colleagues, not because humans are reliably better than generative AI systems. Humans fail differently. The reason inspection often damages human work but can improve AI work is that inspection changes the system being inspected. People learn, adapt, withdraw, hide information, and protect themselves in response to how they are treated. Surveillance degrades the very capability the manager claims to protect. With AI, verification does not demotivate the model. The model produces what it produces, and the verification loop sharpens over time, as we feed back findings to improve prompts, skills, evals, constraints, and operating rules. From that perspective, the problem was never the micromanager’s distrust. The problem was where it was pointed: at humans. Two Patterns Wearing the Same Costume Two very different micromanager motives can produce the same behavior. The distinction matters because they respond to different interventions, and one of them is genuinely useful in an AI context while the other is not: The first pattern shows up as authority maintenance: The distrust is about keeping the decision in the manager’s hands, not about improving the output. Ask this manager what would count as evidence that a teammate’s work is trustworthy, and the answer is often operational nonsense: “I need to see it first.” The verification, when it happens, is performative. What gets inspected is compliance, not risk. AI tooling does not help this person because they do not actually want better evidence. They want to be the one who decides.The second pattern shows up as accumulated experience: The distrust is grounded in specific past failures. This manager can describe in detail what they have seen go wrong, what was promised and not delivered, and which verification step was skipped before the failure. With human teammates, this manifests as micromanagement because verifying human judgment is socially costly. You cannot run a unit test on a colleague’s reasoning. So they over-supervise, the team feels controlled, and the relationship degrades. With AI, verification is structured and cheap. The same disposition that damages a team produces useful work when pointed at a probabilistic system that actually benefits from repeated checks. A small diagnostic helps distinguish them: Question Authority maintenance Accumulated experience What would make this output trustworthy? “I need to see it first.” “It has to pass these three checks.” What failure are you trying to prevent? Vague loss of control. A specific failure mode they can name. When would you stop reviewing every step? Never. When the system demonstrates reliability under defined conditions. What do you inspect? The person’s compliance. The work product’s risk. What changes after your review? The decision returns to me. The system gets a sharper check, rule, prompt, or acceptance criterion. The difference is not whether the person distrusts. The difference is whether their distrust leaves behind better evidence, better criteria, and a sharper system, or merely a returned decision right. This is not permission to allow the micromanager to “direct” humans. Human work still needs verification, but the verification must be designed as a social contract: clear intent, explicit constraints, agreed-upon review points, and decision rights that do not silently migrate upward whenever the manager feels anxious. The same person who becomes useful in AI verification may still be destructive in a team context if they cannot make that shift. The disposition is not the license. The redirected target, however, provides a new perspective for the micromanager. A3 Is the Sorting Mechanism The A3 Framework (Assist, Automate, Avoid) is one way to test which pattern you are looking at. Authority maintenance can fill in the A3 boxes. It cannot use A3 honestly. The answers stay vague, reversible, and dependent on the micromanager’s comfort rather than on named risks. The accumulated-experience pattern can categorize a task in seconds, because the suspicion is grounded in specific past failures that map to specific risk profiles. In Assist, where AI drafts and a human decides, the contribution is defining what a genuine review looks like. Most teams using AI in Assist mode are rubber-stamping. The experienced skeptic refuses to. They will read the draft and tell you which two of the five suggestions contradict a constraint the model could not have known about. In Automate, where AI executes under explicit rules and audit cadences, the same person designs the audit. They will write the acceptance criteria with teeth, the failure modes worth alerting on, the rollback conditions, and the sample size for the weekly check. The team may look slower for two weeks because the work is finally visible. Six months later, that visibility is what prevents the incident everyone else would have called “unexpected.” In Avoid, where AI should not be used at all, the skeptic is the person qualified to make the call. Most organizations lack this authority. Optimistic adopters struggle to say no. Blanket skeptics say no too cheaply. The experienced skeptic can distinguish a stakeholder relationship in which one wrong AI-drafted phrase costs six months of trust from a low-stakes draft in which Assist is fine. The categorization is not the value in this case, but the decision authority is. Many AI adoption initiatives lack a qualified person with the authority to say we should not use this here, and they produce predictable failure modes as a result. Summary: AI Task Types and the Verification Mode Each Require Bound drafts a human reviews: A3 mode: Assist.What the Verification Architect does: Defines the specific criteria the draft must pass before acceptance. Repeated execution under explicit rules: A3 mode: Automate.What the Verification Architect does: Designs audit cadences, rollback conditions, and drift detection. High-trust or irreversible work: A3 mode: Avoid.What the Verification Architect does: Protects the boundary against convenience-driven AI adoption. Name the New Role for the Micromanager: The Verification Architect The piece this article has been circling is that AI creates a role the Agile movement never learned to name. Call it the Verification Architect. A Verification Architect does not ask: “Can AI do this?” They ask: “What would have to be true for AI to do this safely, repeatedly, and measurably in our context?” Their unit of work is not the prompt. It is the loop, the day-to-day work that compounds over months: Turn vague AI use cases into Assist, Automate, or Avoid decisions before anyone opens a prompt window.Define what review means in Assist mode, not as a vibe check, but as specific criteria the draft has to pass.Design audit cadences in Automate, including sample sizes, drift detection, and rollback conditions.Protect Avoid zones from convenience-driven erosion, which is the failure mode of every governance regime that lacks an enforcer.Convert each failure into a sharper prompt, a new eval, a tightened acceptance criterion, or an updated Definition of Done.Track drift over time, because models, data, and use cases all move. In smaller organizations, this may not be a job title. It may be a responsibility carried by a Product Manager or Owner, a Scrum Master/Agile Coach, a QA lead, a product operations person, or a technical lead. The title matters less than the loop. The Verification Architect is not a compliance role. Compliance asks whether the rules were followed. Verification asks whether the system produces the claimed outcome under the conditions in which it operates, with the named failure modes. The first is bureaucracy. The second is engineering judgment. The role is not new in the strict sense. Reliability engineers, design verification architects, and rigorous product operations leaders have been performing this work on traditional software for years. What is new is the application to AI-enabled work systems in non-technical organizational settings, where agentic workflows with non-deterministic outputs and rapid deployment cycles make verification load-bearing rather than nice-to-have. The organizations that ship AI without this capability produce demos. The organizations that build it produce systems that compound. The Work Inside the Dip The AI Spending Trap argued that organizations are often stuck in the J-curve dip because they buy tools and skip the intangible-capital investment that drives the eventual rise. The argument has a missing piece. The intangibles do not invest themselves. They need process redesign, retraining, restructuring, data plumbing and governance, and change management. Every category gets paid for by specific humans doing specific work. The part of the dip organizations most consistently underprice is verification work, eval design, output review, prompt or skill refinement, acceptance-criteria sharpening, and failure-mode cataloging. This is the place where the Verification Architect earns their salary. Done well, the loop becomes a compounding system. Each verification cycle encodes a little more organizational judgment about what good looks like in this specific context; the evals get sharper, and the acceptance criteria get more specific. The agent’s effective competence in this organization increases over time, not because the underlying model improves, but because the surrounding system encodes accumulated knowledge of where it fails. The trusting person ships v1 and moves on. The Verification Architect ships v1, watches it, catches the failures, refines the prompts, tightens the evals, updates the Definition of Done, and runs the loop again. Without this person, the deployment stays at v1 and degrades as conditions shift. With them, the system gets better while the headcount stays flat. That is the curve “The AI Spending Trap” described, and this is who pulls it upward. The work is currently underpriced. Eval design does not ship on Monday. Output review does not produce a launch announcement. Refining prompts in month four produces nothing that the quarterly board deck can show. That is exactly why the disposition is a competitive advantage for organizations that recognize it before the rest of the market does. A Warning About the Label The label “Verification Architect” will be hollowed out, as every useful role title in this industry eventually is. (Remember: Agile Coach, Product Owner, and Scrum Master?) Ask what the person last sent back for revision and why. Ask what they last protected from AI involvement and what would have to change for that decision to flip. Ask what their longest-running audit loop has caught. The genuine Verification Architect answers with names, dates, and specific failures. The fake one answers with frameworks and vocabulary. Conclusion: Move the Work, Not the Person If you have spent your career being told your skepticism was a problem, consider that the people telling you were trying to fit you as a micromanager into a role that does not need you. The agentic AI stack needs people who refuse to trust output they did not verify. It needs people who design the evals, who run the audit loop, who notice the failure that everyone else celebrated as a launch. The work is currently underpriced. That is the opportunity. The micromanager disposition was never the problem; shoehorning it into an unfitting role was. Pick a teammate you struggled to delegate to in the last six months. Pick an AI task that frustrated you in the same window. Compare the instructions you gave each. If the pattern is the same, you have found the problem. One system is being damaged by your inspection. The other may finally be receiving the discipline it needs. Does your distrust produce evidence, or does it merely preserve authority? My suggestion: Move the work, not the person. Key Questions This Article on Micromanagers Answers What Is a Verification Architect in AI Adoption? A Verification Architect is the person who decides which AI tasks belong in Assist, Automate, or Avoid mode, defines what review means in each mode, and runs the verification loop that converts each AI failure into a sharper prompt, eval, or acceptance criterion. Their unit of work is not the prompt; it is the loop. In smaller organizations, the responsibility may be carried by a Product Manager, Scrum Master, QA lead, or technical lead rather than someone holding the title. Why Do Micromanagers Struggle to Delegate to AI? Most do not, because their underlying distrust of probabilistic systems is engineering common sense, not a character defect. The reason inspection damages human teams but improves AI systems is that inspection changes the system being inspected: people adapt and withdraw under surveillance, models do not. The skeptic’s posture toward AI is closer to reliability engineering than to the optimism that much AI adoption theater demands. How Can I Tell If My Distrust Is Useful Verification or Authority Maintenance? Apply a five-question diagnostic. Useful verification can name a specific failure mode it prevents, define operational criteria for when to stop reviewing, assess the work product’s risk rather than the person’s compliance, and leave behind a sharper rule, prompt, or acceptance criterion after each review. Authority maintenance cannot answer those questions in operational terms; its only output is returning the decision to the reviewer. Who Does the Verification Work that Makes AI Adoption Compound over Time? The Verification Architect. The work includes eval design, output review, prompt and skill refinement, acceptance criteria sharpening, and failure-mode cataloging. Each cycle encodes more organizational judgment about what “good” looks like in a specific context, so the system’s effectiveness improves over time even when the underlying model does not. Without this person, deployments stay at v1 and degrade as conditions shift.
CORE
Agile teams ship fast. Two-week sprints, daily standups, and continuous deployment pipelines have made speed the default. But speed without verification is just organized chaos. When a developer marks a bug as "fixed" and the ticket moves to QA, what happens next determines whether that fix actually reaches production — or quietly breaks something else. Retesting is often treated as a checkbox. It shouldn't be. In modern agile environments, retesting is a discipline that, when done well, catches regressions before users do, builds confidence in your release pipeline, and keeps velocity sustainable rather than suicidal. This guide walks through the practical retesting steps that high-performing agile teams follow to manage bug fix verification without slowing down their release cycles Why Retesting Deserves More Attention Than It Gets Most teams conflate retesting with regression testing. They're related but not the same. Retesting is the act of re-executing a specific test that previously failed, after a bug fix has been applied, to confirm the fix works. Regression testing is the broader process of running the existing test suite to ensure that new changes haven't broken previously working functionality. You need both. But retesting is the more surgical, targeted activity — and it's where a lot of agile teams cut corners under sprint pressure. The cost of that shortcut surfaces quickly: the same bug reopens in production, trust between devs and QA erodes, and hotfixes eat into the next sprint's capacity. According to IBM's Systems Sciences Institute, the cost of fixing a bug in production is up to 30x higher than fixing it during development. Retesting is the last cheap checkpoint. Step 1: Reproduce the Original Failure Before the Fix Before a QA engineer can verify a fix, they need to be able to reproduce the original bug reliably. This sounds obvious, but in practice, many teams move to testing the fix without confirming that the defect is consistently reproducible in the test environment. What to do: Check out the codebase before the fix is applied (or use a tagged build from the bug-filing sprint).Execute the exact test steps documented in the bug report.Confirm the defect manifests as described. If the bug can't be reproduced before the fix, you're not testing a fix — you're testing in the dark. Either the test environment differs from production, the steps in the bug report are incomplete, or the bug is environment-specific. Agile tip: Insist that bug reports include a "Reproduction Steps" section as a Definition of Done requirement for filing. No steps, no ticket. Step 2: Understand the Fix Before Testing It QA engineers who blindly run the original failing test after a patch is applied will catch only the most obvious failures. To test effectively, you need to understand what changed and why. Checklist before testing: Read the diff or PR description.Ask the developer: "What was the root cause, and what exactly did you change?"Identify any edge cases the fix might introduce.Note any dependent modules, APIs, or services the fix touches. This conversation between dev and QA — ideally a brief 5-minute sync during triage — dramatically improves the quality of retesting. It also surfaces cases where a fix is technically correct but introduces a new failure mode. Step 3: Retest the Exact Failing Scenario This is the core of retesting: execute the specific test case that originally failed, using the same inputs, environment, and conditions, and verify that the expected behavior now occurs. What "verified" looks like: The test passes in the current build.The output matches the acceptance criteria in the original ticket.No error messages, unexpected behavior, or degraded performance appear. Common mistakes to avoid: Testing a slightly different scenario than what was documented.Retesting only the happy path when the original bug was an edge case.Testing in a different environment than where the bug was reported. Document the result explicitly. "Tested and passed" is insufficient. Log: build number, test environment, tester name, date, and a brief description of what was verified. Step 4: Run Boundary and Negative Tests Around the Fix A fix that works for the main scenario may still break under boundary conditions or invalid inputs. After verifying the primary scenario, broaden your coverage. Boundary testing for bug fixes: Test the minimum and maximum values for any data the fix touches.Test empty inputs, null values, and unexpected data types.Test concurrent requests if the fix touches shared state. Negative testing: Attempt to trigger the original bug with slightly different inputs.Test that appropriate error handling occurs when inputs are invalid.If the bug was a security issue, probe related attack vectors. This step is where automated testing pays dividends. If you have a test framework in place, write parameterized tests that cover boundary conditions and commit them alongside the fix. Future sprints benefit from this coverage automatically. Step 5: Perform Targeted Regression Testing on Affected Components Once the original fix is verified, expand your scope to the components the fix touches. This is targeted regression testing — not a full suite run, but a deliberate sweep of adjacent functionality. How to scope it: Use code coverage tools or dependency graphs to identify which modules the fix modifies.Map those modules to existing test cases.Run only the test cases relevant to the impacted components. In a mature CI/CD pipeline, this happens automatically via change-impact analysis tools. In less mature environments, this is a manual judgment call that benefits from close communication between dev and QA. The goal: Verify that fixing bug A did not break feature B, where B shares code with A. Step 6: Validate in a Production-Like Environment Test environments lie. Configurations differ, third-party service mocks behave differently than the real thing, and database states diverge from production over time. For critical bug fixes — especially those related to data integrity, performance, or security — validation in a staging environment that mirrors production is essential. What to verify in staging: End-to-end flows that include the fixed component.Integration with real external services (or the closest available approximation).Performance under realistic data volumes. For teams using containerized deployments, spinning up a production-like environment per PR is increasingly achievable. Tools like Docker Compose, Kubernetes namespaces, or platform-native review environments (e.g., Heroku Review Apps, Vercel Preview Deployments) make this accessible even for smaller teams. Step 7: Close the Loop With Documentation Retesting that isn't documented didn't happen — at least not in any way that's auditable, transferable, or useful for future sprints. Minimum documentation per retested bug: Bug ID and description.Build/commit SHA where the fix was applied.Environment tested.Test cases executed (with pass/fail status).Tester and date.Any observations or follow-up items. Update the original bug ticket with a "Verified Fixed" status and attach the relevant test evidence. If the retest reveals that the fix is incomplete or introduces a new issue, reopen the ticket with clear notes and escalate before the sprint closes. Integrating Retesting Into Your Agile Workflow Ad hoc retesting doesn't scale. As sprint velocity increases and team size grows, you need retesting to be a structured part of the development lifecycle, not something that happens informally at the end of a sprint. Practical integration points: Definition of Done: Include "bug fix verified by QA in test environment" as a DoD item for any ticket filed as a bug. This prevents developers from closing tickets unilaterally. Bug Fix PRs: Require that bug fix PRs include a test case (automated or manual test script) that reproduces the original failure and passes after the fix. This makes regression coverage self-generating. Sprint Review Checklist: Add a retesting summary to your sprint review. How many bugs were fixed? How many were retested and verified? How many regressions were caught? Track this over time — it's a leading indicator of test quality. Shift-Left Retesting: Don't wait for QA to catch a fix in the QA phase. If developers write unit tests that reproduce the bug before fixing it (TDD-style), the fix is verified before it even reaches QA. This compresses cycle time significantly. Automating Retesting in CI/CD Pipelines Manual retesting is a bottleneck. For bugs with well-defined reproduction steps, automation is the right long-term answer. The workflow: Bug is filed with reproduction steps.Developer writes a failing test that reproduces the bug.Developer implements the fix; the test now passes.The test is committed to the repo and becomes part of the CI suite.Every subsequent build runs that test automatically. This approach converts bugs into permanent regression guards. The cost of writing the test is paid once; the coverage benefit persists indefinitely. For teams using API testing tools, contract testing frameworks, or behavior-driven development (BDD) tools, this workflow integrates naturally. Each fixed bug becomes a scenario in your test suite — a living record of issues your codebase has encountered and solved. Common Retesting Anti-Patterns to Avoid "It worked on my machine." Developer self-testing is not a substitute for independent QA verification. Fix and retest should involve different people, or at minimum, different environments. Retesting only the ticket, not the risk. QA engineers should ask: "What else could this change have broken?" Every fix carries blast radius. Don't test the fix in isolation. Closing bugs before staging validation. Moving a ticket to "Verified" after testing only in a local or dev environment is premature. Production-like validation is required for high-severity fixes. Skipping retesting under sprint pressure. This is the most common and most costly anti-pattern. The pressure to close tickets before a sprint ends is real, but retesting debt accumulates quickly and surfaces as production incidents. Final Thoughts Fast release cycles don't have to mean fragile ones. The teams that ship confidently at high velocity aren't testing less — they're testing smarter. Retesting, when treated as a structured, documented, and automated process rather than an afterthought, is one of the highest-leverage activities a QA team can invest in. The steps outlined here — from reproducing the original failure, to understanding the fix, to targeted regression sweeps, to production-like validation — create a repeatable process that scales with your team. Every bug that gets properly retested is a bug that doesn't come back. Build that muscle, and your sprint reviews start to look a lot less like incident retrospectives.
Abstract This article explores the integration of AI technologies into Agile frameworks, focusing on large-scale applications such as the Scaled Agile Framework (SAFe). Beginning with personal experiences, the article discusses the synergistic potential of combining AI tools like Splunk and MuleSoft with Agile methodologies to enhance project velocity and foresight. It highlights the importance of maintaining human oversight to balance AI insights, mitigating risks through regular feedback loops. Drawing on cross-industry insights, particularly from logistics, the article demonstrates the potential improvements AI can bring to software release cycles. Addressing challenges such as bias, the article outlines the need for continuous auditing of AI models. As digitization accelerates, the piece advocates for breaking down data silos and fostering AI literacy within Agile teams. The future of AI-driven Agile practices is presented as promising yet requiring an upskill in AI knowledge to ensure successful implementation. Introduction: A Personal Journey Into AI and Agile Synergy The first time I encountered the potential of AI in an Agile setting was during a client's project in Woodland Hills. As I partnered with the MuleSoft team to unravel the intricacies of Anypoint Platform, I realized that AI wasn't just a tool; it was en route to becoming an integral part of our strategy. We were transitioning legacy systems to modern platforms, and AI seemed to promise newfound efficiency. But, like any seasoned professional would tell you, it's one thing to promise and another to deliver. Thus began my journey into understanding how AI-driven integration architectures could not only fit into but thrive within large-scale Agile environments. AI-Augmented Agile: Optimizing the SAFe Framework When we talk about scaling Agile, the Scaled Agile Framework (SAFe) comes to mind. In one of our projects, we applied AI to predict bottlenecks using historical data analysis. It wasn't without its hurdles, of course — it took several iterations for the AI to correctly identify patterns that even seasoned project managers missed. We used a combination of Splunk for monitoring and MuleSoft for integration, allowing AI to suggest sprint adjustments and resource reallocations. A quick plug: if you haven't tried these tools together, you're missing out on a synergistic boost. The real beauty of AI in this context was its ability to provide a level of foresight that could radically enhance project velocity. However, I did notice a tendency among some teams to rely too heavily on these AI insights, which leads to an important lesson: AI should augment, not replace, human judgment. There were times when the AI's predictions required contextual understanding — something only our human intuition could provide. Balance Is Key: Human Oversight and AI Collaboration Here lies a point of contention: can AI alone shoulder the responsibility of integration in dynamic environments? From my experience, the answer is no. While AI offers a plethora of insights, human oversight is crucial. For instance, during a project overhaul for a Farmers Insurance application, AI suggested a change in our development pipeline that, if implemented without human oversight, could have minimized testing time but at the risk of system vulnerabilities. We learned the hard way that while AI could suggest efficiency, it couldn't comprehend the subtleties of risk management and security concerns. So, how do we strike the right balance? Regular feedback loops and retrospectives. It's about taking AI-generated insights and discussing them within teams to fully understand their implications. This practice not only preserves human adaptability but also refines the AI model with real-world feedback. Cross-Industry Insights: Borrowing From Supply Chain Success An interesting parallel can be drawn from logistics, where AI is used for predictive maintenance and inventory management. These practices can be seamlessly translated into Agile environments to enhance software release cycles. In one particular instance, I observed logistics companies using AI to predict and preempt maintenance needs, reducing downtime by significant margins. We applied similar strategies to monitor our integration touchpoints using tools like Anypoint Monitoring and Dashboard in MuleSoft, leading to enhanced predictability in deployment processes. The lesson here is quite simple: look beyond the tech bubble. Other industries might already have the solutions we're seeking. AI-driven integration in supply chain logistics, for instance, has provided us with templates for improving end-to-end visibility and accuracy in our software delivery life cycles. Addressing Bias in AI Models: The Hidden Challenge Working with AI models comes with its own set of challenges, notably bias. This became evident when I noticed skewed decision-making patterns in an Agile setup due to historical data biases embedded within AI algorithms. During a project aimed at refining customer service platforms, the AI consistently undervalued less frequent yet critical user feedback due to its rarity in historical data. We developed a strategy to continuously audit our AI models, employing diverse datasets and cross-functional teams to ensure a wider range of perspectives. This approach, along with periodic calibration, significantly improved the reliability of our AI insights. It's not foolproof, but it's a start, and as AI models continue to evolve, we must remain vigilant in refining their objectivity. Navigating Market Dynamics: Embracing Digitization's Accelerated Pace Adopting AI in Agile wasn't without its integration complexities. Data silos and resistance to change from Agile traditionalists posed significant challenges. However, advancements in NLP and MLOps offered new avenues to ease these transitions. I recall integrating an AI-driven chatbot utilizing NLP to streamline internal communication, which drastically reduced meeting times and miscommunications—a small win, but a win nonetheless. As we move forward, the focus should be on breaking down these silos and fostering a culture that embraces change. Offering training sessions for Agile teams to become more AI-literate proved effective in some of our recent initiatives, transforming skepticism into curiosity. Future-Ready: Building AI-Literate Agile Teams The horizon looks promising with predictions pointing towards AI-driven integration architectures becoming a cornerstone of Agile practices. This evolution will necessitate an upskill in AI literacy among Agile practitioners. In my current role, we initiated training programs focusing on AI and its applications within Agile processes, an initiative that not only prepared teams for future demands but also sparked innovative ways to incorporate AI solutions. Looking back, the journey was neither straight nor smooth. Yet, the amalgamation of AI in Agile contexts has paved the way for more autonomous and self-optimizing environments. Our roles will continue to evolve, and staying competitive will mean staying informed and adaptable. Conclusion: The Path Forward in AI and Agile In weaving AI into Agile, we are not just adopting a trend; we are pioneering a transformative approach to managing, predicting, and delivering. It's about blending technological advancement with human intuition, ensuring that as we march into an AI-driven future, we do so with both curiosity and caution. The journey is personal and often unpredictable, but it's one worth taking — all while remembering that AI, much like Agile, thrives on collaboration, feedback, and continuous improvement. If we keep these principles in mind, there’s no telling just how far we can go.
The integration of AI-driven decision-making within Agile frameworks presents a transformative opportunity for optimized workflows and enhanced decision-making processes. This article delves into the real-world applications and challenges of combining AI's analytical prowess with Agile methodologies. Key topics include the benefits of contextual adaptability, AI-augmented retrospectives, and the necessity of human oversight to balance AI autonomy with human intuition. Additionally, industry-specific insights from healthcare and retail demonstrate significant efficiency improvements, while technical implementations such as AI-enhanced CI/CD pipelines and story point estimations offer tangible advantages. However, challenges like the skills gap and lack of standardized methodologies highlight areas for growth and development. The article underscores the importance of a balanced approach, leveraging both AI and human insight for sustainable innovation. Introduction I remember a chilly morning in Woodland Hills, sipping my too-hot coffee and staring at my screen, puzzled by an intricate issue in our latest MuleSoft project. Our team was caught in the weeds, struggling with manual decision-making processes that just weren't cutting it. That's when it hit me — like many organizations, we were at the cusp of a digital transformation wave, but our adaptation rate was feeling sluggish like a hesitant swimmer at the edge of a pool. The solution, as it turned out, was not merely adopting AI but integrating its decision-making capabilities seamlessly into our Agile framework. As someone who has spent years weaving technology threads together, the idea intrigued me, and the journey since then has been nothing short of eye-opening. The AI and Agile Convergence: An Unfolding Opportunity Contextual Adaptability: The New Frontier In today's fast-paced tech environments, AI systems — particularly those that adapt in real-time — are becoming indispensable. Contextual adaptability is critical. For example, during a significant project with Farmers Insurance, I noticed that traditional systems couldn't adjust quickly enough to the dynamic needs of stakeholders. AI-driven solutions, however, offered us the flexibility to modify decision-making processes on-the-fly, taking into account the shifting team dynamics and requirements. It was like having a seasoned project manager who never tired and was always a step ahead. Imagine an AI that not only identifies bottlenecks but also proposes immediate remedies based on historical data and current team performance. AI-Augmented Retrospectives: An Unexpected Ally The retrospective has always been a cornerstone of Agile — an opportunity for teams to reflect and improve. But what if we could leverage AI to turbocharge this process? On a whim, we developed a prototype that analyzed past sprint data using machine learning algorithms. It highlighted workflow inefficiencies and even suggested potential areas of improvement. Skeptical colleagues soon turned advocates as they saw AI providing actionable insights that would have taken hours to deduce manually. The AI didn't just look at defects or missed deadlines; it correlated them with team moods and external factors, presenting a holistic view that we, as humans, often missed. The Great Debate: Autonomy vs. Oversight Why Human Oversight is Crucial The allure of fully autonomous AI systems is strong. Imagine a project where AI makes decisions independently, freeing up human resources for more creative tasks. But — and there's always a 'but' — in our experience, complete autonomy isn't always advantageous. One incident stands out: our AI recommended a drastic change in resource allocation during a critical sprint based purely on quantitative data, ignoring some unquantifiable team morale factors. The oversight nearly caused a rebellion within the team. This underlined the need for a balanced hybrid approach — AI for the number crunching, humans for the intuition and oversight. After all, as much as we credit AI with intelligence, it still lacks the nuanced understanding of human emotions and the unpredictability of team dynamics. Bias: The Invisible Culprit While working on a healthcare project, we ran into an unexpected hurdle. Our AI model for decision-making inadvertently exhibited biases — stemming from pre-existing skewed data patterns. This revelation was a wake-up call, reminding us that AI is only as unbiased as the data it feeds on. We faced a dilemma: how to integrate AI's precision with the necessity for equitable decision-making in Agile frameworks. Our solution was implementing regular audits of AI outcomes, partnering AI decisions with human judgment to ensure fairness — a process that was both enlightening and humbling. AI Across Industries: Lessons from Healthcare and Retail Healthcare: A Case Study in Balancing Precision and Care In the healthcare sector, AI integration into Agile frameworks has delivered some remarkable efficiencies in project management. I recall an instance where AI helped optimize resource allocation during a project aimed at enhancing patient care systems. By analyzing patient intake data and resource availability in real-time, AI allowed us to efficiently plan sprints and allocate development resources where they were most needed. The result? A 20% reduction in project delivery time and an increase in patient satisfaction scores. It was a perfect example of AI's ability to handle the nitty-gritty, leaving the strategic decisions to Agile teams. Retail: Personalization Meets Agile Retail is where AI truly shines in Agile applications. In one retail project, we utilized AI to refine inventory management, dynamically adjusting stock levels based on predictive modeling. The system learned from past sales data to predict future demand — a boon during peak shopping periods. Additionally, AI-driven personalization of the customer experience became a seamless integration into our Agile processes, enhancing customer engagement metrics significantly. Technical Deep Dives: Practical Applications of AI in Agile Integrating AI into CI/CD Pipelines One of the most impactful areas in which I've seen AI enhance Agile practices is within the CI/CD pipeline. Using AI to predict deployment risks and optimize testing processes is akin to having a crystal ball. In my experience, integrating these capabilities reduced deployment-related failures by approximately 30%. Specific tools like Jenkins with AI plugins or proprietary solutions allowed us to predict which builds might fail, vastly improving our time-to-market. AI-Enhanced Story Point Estimation: A Remarkable Time Saver An often overlooked but powerful application of AI is in improving story point estimation accuracy. Traditionally, estimation can be more guesswork than science. However, by training AI models on historical project data, we were able to achieve estimations with minimal discrepancies. This not only helped in better resource planning but also empowered our teams to deliver more reliably within set timelines. Challenges and Insights: A Personal Reflection Bridging the Skills Gap Despite the rapid advances in technology, there's a notable skills gap in AI integration within Agile frameworks. On numerous occasions, I’ve witnessed teams struggle simply due to a lack of expertise in either domain. The solution, in my opinion, lies in targeted education and training, promoting cross-functional skills that allow teams to bridge this gap effectively. Standardization: The Missing Element I must admit, one of the most frustrating aspects of integrating AI in Agile is the absence of standardized methodologies. Every organization seems to reinvent the wheel, leading to inconsistent results. The industry needs a unified framework that outlines best practices for AI adoption within Agile environments. This standardization will not only streamline processes but also facilitate faster innovations. Conclusion: The Path Ahead As AI continues to evolve, its integration into Agile frameworks will undoubtedly expand, offering even more sophisticated decision-making capabilities. This journey has taught me the significance of balance — leveraging AI for its unparalleled analytical prowess while maintaining human oversight to provide ethical and empathetic context. As I look forward, sipping another cup of coffee, I envision a future where AI and Agile coexist not as separate elements but as a seamless part of every project, complementing each other's strengths. My advice to fellow professionals is simple: embrace AI’s potential, but never lose sight of the human element that truly drives innovation.
Stelios Manioudakis
Lead Engineer,
Technical University of Crete
Stefan Wolpers
Agile Coach,
Berlin Product People GmbH
CORE
CORE
CORE
CORE
