Heard us on
The AI Daily Brief Podcast?

Heard us on The AI Daily Brief Podcast? For AI, we're all in on AWS. Let's build AI teammates for your enterprise.

Part 1: The AI Productivity Paradox – Your Teams are Already Changing Their Jobs, Have You Noticed? 

AI has sped up work, but few companies can point to organization-wide return on investment (ROI). Everyone is calling this a paradox. This three-part series names the three things buying the tools never fixes on its own, the people, the organization, and the foundation, and what to do about each. Read all three to find where your own gap is hiding.

Part 1: The People | Part 2: The Organization | Part 3: The Foundation

Somewhere in your company right now, a handful of people have become several times more productive with AI. Not because of the training program everyone had to take or the Copilot licenses that were purchased. On their own, on real work, because it made their week better.  

If you asked them, they would tell you it feels like work that used to take them days, now completes in minutes. They are in every organization. 

But your company’s productivity numbers didn’t move. That gap is the paradox in its most personal form.  

Atlassian’s 2026 State of Teams research puts a number on it: 89% of executives say AI has increased the speed of work, but only 6% can point to organization-wide ROI. Individual speed is everywhere. Organizational results are rare. The interesting question isn’t whether AI works; your people have already answered that. It’s why individual 10x doesn’t add up to organizational 10x. 

Where the gains go 

The gains are real. They’re just trapped. Three things trap them, and none of them is technical. 

First, the gains live in individuals. The prompts, the workflows, the personal knowledge base, the judgment about when to trust the AI output and when not to, all of it sits in someone’s chat history and someone’s head. When that person is on vacation, the gain is on vacation. When they leave, it leaves with them. 

Second, nobody can see the gains from the outside. The report still lands on Friday. The analysis still arrives before the meeting. The work looks identical to what it looked like a year ago. People are using the time they saved to do more of the old job, or to go home at a reasonable hour. Neither shows up in a productivity dashboard. 

Third, people have a reason to keep quiet. The honest reaction to suddenly being several times faster is not pride. It’s something closer to this feels like we shouldn’t be doing this. If the work that used to take a week now takes an hour, what does that say about the week? About the role? About the headcount? Your most proficient people may be under-reporting, not over-claiming. The paradox has a visibility problem before it has anything else. 

What we learned running it on ourselves 

This summer we ran an experiment at Robots & Pencils called Robocon. Four weeks, company-wide, across seven cross-functional pods we were given challenges to build and publish working AI skills to a shared internal library, then show them off at a live event. No course. No training. Not just engineers, but everyone in the company. Build something real and put it in front of people. 

Two lessons came out of it, and neither was the one we expected. 

The first was that the barrier wasn’t skill. Teams lost hours, in some cases days, getting environments, repositories and file-share access to work before they could build anything. Once these hurdles were cleared, people began creating at an alarming rate. Everyone in the organization from marketing, sales, product, project managers, design, engineering, came out the other side with real AI proficiency. The expensive part of proficiency wasn’t teaching people. It was clearing the path so they could do the work. 

The second lesson landed harder. The library filled up fast, and plenty of good work shipped and then sat there, because nobody’s job was to turn what one person built into something the rest of the company used. Not everything built was worth keeping, and the pieces that were, had to be deliberately identified, hardened and surfaced to the rest of the company. Sorting them was a separate act, done by different people, with a different skill. 

That’s the pattern, and we think it generalizes. The event produced proficiency in individuals. Amplifying it across the organization was a second job, and it didn’t happen on its own. 

Roles aren’t redesigned. They are discovered.  

Most advice about AI and the workforce runs top-down: redesign the roles, then deploy the tools. In our experience it works the other way around. People pick up the tools, use them to create value for themselves first, and the role starts to change underneath them. The job description is the last thing to move. AI is moving from individual productivity to multiplayer, collaborative productivity.  

That’s the good news, because it means the change is already happening in your company. The challenge is that discovery doesn’t distribute itself. A role that has quietly changed in one person’s hands stays there unless someone does three things on purpose. 

Find it. Who has already changed how they work? You won’t learn this from a survey; you learn it by asking a different question: not “are you using AI?” but “what part of your job have you automated?” People who have stopped doing something manually are the ones whose role has evolved. 

Harvest it. Turn what one person does into something others can use. Not a training deck or show and tell, but the actual workflow, the actual prompts, data and tools they have connected, and the actual judgment calls about when the output can be trusted. Then be honest about what holds up. Our own library taught us that a lot of good individual work is not, in fact, reusable. The discipline is in keeping what is. 

Make it official.  Redefine the role around what changed and retire the old work. Skip this and people end up twice as fast in a job still defined as if they weren’t. The time saved gets refilled with more of the old job, and the productivity number never moves. 

We did this to ourselves. A client team that used to be seven to ten people is now three to five. AI didn’t take the seats — the people kept them and got more done. Each person now works with AI the way they’d work with a strong analyst: it drafts, researches, checks and runs the routine parts, and they spend their time on the judgment calls. Once that was true in practice, we rewrote how we define what a team is on paper: who’s on it, what each role owns, what nobody does by hand anymore. 

The job nobody has hired for 

Boris Cherny, who leads the Claude Code team at Anthropic, has described how engineering and product roles on his team have melted into six archetypes: the Prototyper who generates ideas most of which don’t ship; the Builder who turns a validated idea into production; the Sweeper who simplifies and removes; the Grower who iterates for scale; the Maintainer who owns the mature system; and the Orchestrator, who knows which of the other five a team should be in, and when to move between them. He notes the Orchestrator is rarer than the other five combined, and that it has no established job title. Most people are doing 2 or 3 of these archetypes today. 

We think that last role is the one the productivity paradox is missing. The Orchestrator is the person who does the finding, harvesting and socializing to teams. They notice that a role has changed before the org chart does.  

Nobody at this table has hired one. Most organizations don’t know it’s a job. But somebody in your company is already doing a version of it informally — the person other people go to when they want to know how so-and-so got that done so quickly. That person is your first Orchestrator. They just don’t have the title yet. 

Questions to take back 

Your people are already changing their jobs. The organizations that get results from AI aren’t the ones that designed the change from the top. They’re the ones that noticed it from the bottom and made it official before it evaporated. 

Two questions for your leadership team this week: 

Up next in this series, Part 2: Organization

Individual proficiency is the easy part. The harder part is turning it into something the organization can run on without you in the room. In Part 2, we break down the three structural mistakes that stall AI pilots before they reach production, and what to build instead. Read Part 2: Common mistakes in AI org design (and how to fix them).

Sources referenced: Atlassian, State of Teams 2026 (89% / 6% figures). Boris Cherny, public posts on role archetypes (X.com). 


About the Author

Brendan Flynn is SVP, Strategist at Robots & Pencils where he heads industry strategy within the Generative & Agentic AI Studio.


Key Takeaways

FAQs

What is the AI productivity paradox?

It is the gap between how fast people say AI has made their work and how rarely that speed shows up in company-wide results. Atlassian’s 2026 State of Teams research found 89% of executives report faster work from AI, while only 6% can point to organization-wide ROI.

Why don’t individual AI productivity gains show up in company-wide numbers?

The gains stay trapped in three places. They live in one person’s prompts and judgment instead of a shared process, they are invisible to standard reporting because the output looks the same as before, and people often stay quiet about how much faster they have become.

What did Robots & Pencils learn from running Robocon, its internal AI build event?

The barrier to AI proficiency was never skill. Once people had access to the environments and tools they needed, proficiency spread quickly across the company. The harder problem was turning one person’s work into something the rest of the organization could use.

What three steps turn individual AI proficiency into organizational capability?

Find who has already changed how they work, harvest what they are doing into a reusable workflow, and make the change official by redefining the role and retiring the old work it replaced.

What is an AI Orchestrator?

A term from Anthropic’s Boris Cherny for the person who notices when a role has changed because of AI and helps spread that change across a team. Most organizations already have someone doing this informally, without the title.

Part 2: The AI Productivity Paradox – Common Mistakes in AI Organization Design (and how to fix them) 

AI has sped up work, but few companies can point to organization-wide return on investment (ROI). Everyone is calling this a paradox. This three-part series names the three things buying the tools never fixes on its own, the people, the organization, and the foundation, and what to do about each. Read all three to find where your own gap is hiding.

Part 1: The People | Part 2: The Organization | Part 3: The Foundation

You have a few AI pilots that have worked. The results are promising, and the business case makes sense. You spin up a dedicated AI team, give them a mandate, and hand off the work. 

Six months later, nothing has shipped to production. The business side says the AI team doesn’t understand the constraints. The AI team says the business doesn’t understand what’s possible. Meanwhile, the productivity gains that looked obvious in the pilot have vanished. 

It’s the most common failure pattern we see, and it’s rarely a technical one. It’s organizational. 

After working through this with clients across finance, manufacturing, and operations, we’ve landed on three structural mistakes that kill AI initiatives before they scale. Here’s what they look like, and what we’ve found works. 

Mistake 1: Centralizing AI Decisions Away from the Business 

The error: You create an AI Center of Excellence or a dedicated AI team, and suddenly every AI decision routes through them. They’re the gatekeepers. The business waits. 

Why it fails: The people closest to the problem, the ops manager, the finance lead, the customer service director, can’t move fast. They hand requirements to the AI team, the AI team interprets them, requirements get misunderstood, timelines slip, and by the time something ships the business context has already shifted. 

What works instead: Push AI decisions closer to the business. You still need shared standards — how AI workflows get evaluated, how decisions get logged, how risk is governed — but the business unit lead, who owns the outcome, should decide when an AI workflow is ready to go live in their function. 

We made the same call inside our own delivery organization. Instead of standing up one central AI practice that every client team has to route through, we organized around small cross-functional pods, each aligned to a specific client, each deciding for itself how AI gets used in that engagement. A pod answers to shared standards, a hiring bar, a set of proficiencies, not to a gatekeeper reviewing its every move.  

Mistake 2: Treating Upskilling as Training, Not Proficiency Building 

The error: You run a one-week training program. Everyone learns to use Claude, Copilot, or ChatGPT. Then you expect productivity to jump. 

Why it fails: Training teaches how to use a tool. It doesn’t build organizational proficiency. The operations manager learns Claude syntax, goes back to their desk, and does the same job exactly the way they used to, just a little faster. Productivity gains are marginal, executives see no ROI, and everyone quietly concludes AI didn’t work. 

What works instead: Build proficiency through doing, not classrooms. 

Start by asking what this person stops doing, what new responsibilities they take on, and how their relationship to the work changes. Answer those honestly and you’ve effectively restructured how that function operates, at which point upskilling stops being a training event and becomes proficiency built through doing the work. 

A client we worked with had an immediate unlock the first time we had them use an orchestrated workflow we built for their forecasting process. The response was emphatic, “This will replace 90% of the meetings we have, I can simply ask AI questions about my forecast, and it knows my entire book.”  

Zero training involved, they got it immediately. That is powerful. This frees them up people to do what they do best, build relationships to close deals.  

Mistake 3: No Feedback Loop Between Operations and AI 

The error: The AI team builds an AI workflow, the business puts it to work, and six months later nobody can say whether it’s moving the outcomes that matter. 

Why it fails: Without real feedback you can’t improve: performance drifts, edge cases pile up, the business loses confidence, and the AI team never learns what’s needed. 

What works instead: Build operational feedback into the rollout from day one. Who’s watching how it’s performing against the outcomes you care about? Who surfaces problems? How fast can you respond? 

On another engagement, we skipped the weekly-sync approach entirely and went tighter. The day two account managers first tried the assistant live, on their own real data, their feedback went straight into a ranked list for engineering before the day was over. Four fixes made the build before the end of the same day the feedback was received. A handful of other requests got logged as legitimate but not urgent. A couple of ideas got an explicit “not this round,” with the reasoning written down so nobody had to relitigate it later.  

The Pattern Underneath 

These aren’t technology problems, they’re proficiency problems: companies think they’re buying an AI system when what they’re building is organizational capability. 

The fix comes down to three structural shifts, and they reinforce each other.  

Push AI decisions closer to the business, because feedback only flows fast when the people doing the work own the decision to change it.  

Redefine roles and workflows through doing instead of training, because software that keeps evolving forces people to build proficiency in real time, and that’s where the actual transformation happens.  

Close the feedback loop, then keep it tight, because iteration speed is the discipline: every cycle, the system improves, and the organization learns alongside it. 

When those three things hold, AI proficiency becomes the muscle of how the organization operates day to day, and the productivity gains stick instead of fading out after the pilot. None of it requires a heroic AI team. It requires distributed decision-making with clear guardrails around it. 

If your AI tools are live but proficiency, and the productivity gains that are supposed to come with it, still haven’t shown up, this is the first place to look. 

Questions to take back 

Up next in this series, Part 3: Foundations

Fixing the organization gets you further, but it does not answer the harder question underneath it. Once the model itself becomes a commodity, what should you actually own? In Part 3, we lay out the five-part foundation every company needs, whether it builds its own AI or simply buys it. Read Part 3: Own the foundation, rent the model.


About the Author

Brendan Flynn is SVP, Strategist at Robots & Pencils where he heads industry strategy within the Generative & Agentic AI Studio.


Key Takeaways

FAQs

Why do AI pilots that work so well often fail to scale?

Because the failure is usually organizational, not technical. If AI decisions route through one central team, if training substitutes for real proficiency, or if there is no feedback loop back to the business, the gains a pilot proved rarely carry into production.

Should a company centralize its AI decisions in one team?

No. Centralizing every AI decision in one gatekeeping team creates a queue the business waits behind. Shared standards should be centralized. The decision to put a specific AI workflow into production should sit with the business unit that owns the outcome.

What is the difference between AI training and AI proficiency?

Training teaches someone to use a tool. Proficiency changes how they do the job. A short training session on a chatbot rarely moves productivity. Asking what a role stops doing and what it takes on instead, then building that into daily work, does.

What happens without a feedback loop between the business and the AI team?

Performance drifts, edge cases pile up, and nobody can prove months later whether the AI workflow is helping. A tight feedback loop, where real users test the workflow on real data and issues go straight into a ranked list for the team building it, catches problems while they are still cheap to fix.

What three changes help AI initiatives scale past the pilot stage?

Push AI decisions closer to the business unit that owns the outcome, build proficiency through real work instead of classroom training, and close the feedback loop between operations and the team building the AI, then keep it tight.

Part 3: The AI Productivity Paradox – Own the Foundation, Rent the Model 

AI has sped up work, but few companies can point to organization-wide return on investment (ROI). Everyone is calling this a paradox. This three-part series names the three things buying the tools never fixes on its own, the people, the organization, and the foundation, and what to do about each. Read all three to find where your own gap is hiding.

Part 1: The People | Part 2: The Organization | Part 3: The Foundation

Count the AI tools running in your company right now. The ones actually in use. The Copilot licenses, Enterprise Claude accounts, Salesforce Agentforce. The pilot the finance team built with a contractor. The thing the marketing group pays for on a corporate card. The internal assistant somebody in operations put together over a long weekend. 

If you got past ten, you’re typical. If you can name who owns each one, what it costs, and whether it’s working, you’re rare. Atlassian’s 2026 research found that only 6% of executives can point to organization-wide AI ROI, and the reason isn’t that the tools don’t work. It’s that there is nothing to measure them with. Twelve tools, twelve logins, twelve vendors, no shared memory. Every pilot starts from zero. The company gets faster at individual tasks and no smarter as an organization. 

Why this matters more than it did a year ago 

Something shifted in the middle of 2026 that most executive teams haven’t fully absorbed: the frontier models became close to interchangeable. The gap between the leading providers narrowed to the point where, for most business tasks, which model you use matters far less than what you’ve built around it. The models are becoming commoditized. Prices fell. Switching got easier. The model has become something you rent. 

That changes what the durable asset is. When the model is a commodity, the thing you wrap around it, your business context, the guardrails, your way of knowing whether it’s working, is the only part that appreciates. 

The question for executive teams isn’t “which AI should we buy?” It’s “what should we own, regardless of what we buy?” Engineers call this the harness. We’ll call it the foundation. You rent the model. You own the foundation. 

What the foundation is, in plain terms 

Strip the architecture diagrams away and the foundation is five things. None of them is exotic. Most companies have a version of each for their financial systems and none for their AI. 

A shared definition of your business. What “a customer” means in your company. What “an order” is, what “a batch” is, what “on time” means, and the history of each, because most systems of record overwrite yesterday and remember nothing. Written down once, in a form every tool can use, so the finance team’s assistant and the operations team’s forecast are talking about the same thing. Without this, every AI tool learns your business from scratch, and each one learns it differently. 

One door. Every AI request in the company goes through a single point, so cost, usage and risk show up in one place. Without this, you cannot answer the CFO’s question about what AI is costing you, and you cannot swap vendors without rewriting everything that touches them. 

A register. A list of every AI tool running in your company, bought or built, each with a named owner. Without this, you don’t know what you’re governing. Most companies discover the size of their AI footprint the first time something goes wrong. 

A way to know if it’s working. Before anything goes live, and every week after. Not a vendor’s demo; your own test, on your own data, against what happens. Without this, “the pilot worked” is an opinion, and six months later nobody can say whether the thing in production still does. This is your evaluation framework. 

Approval in proportion to risk. Who signs off on what, at what level of consequence, with the same rules for the tools you bought as for the tools you built. Without this, governance either doesn’t exist or exists as a committee everything waits behind. 

That’s it. Five things. If you have them, you can add the eleventh tool in a week and know what it costs and whether it works by the second week. If you don’t, the eleventh tool is another island. 

A nervous system, not a headquarters 

Here is where executives get worried, and rightly. “Own the foundation” sounds like “centralize AI,” and centralizing AI is one of the fastest ways to fail. We wrote about that in the second article in this series: the AI Center of Excellence that becomes the place where the business goes to wait. 

The foundation is not that. Think of it as a nervous system, not a headquarters; it’s the core of what makes your business, yours. A nervous system doesn’t decide where the hand goes. It makes sure the hand can feel, that the signal gets back to the brain, and that the whole body knows what the hand just learned. The center owns the foundation, the shared definitions, the one door, the register, the tests, the rules. The business units own the decisions: what to build, what to buy, whether it goes live in their operation. Standards are shared. Decisions are local. 

Get this distinction wrong in either direction, and your AI initiatives won’t scale. Centralize all decision making and you have a bottleneck. Decentralize your foundation and you have twelve islands with twelve definitions of a customer. The companies getting results have done the unglamorous thing: they’ve been disciplined about what’s shared and explicit about what’s not. 

The tools you already bought count 

Most organizations are not in the business of building an agent-building program. You’ve bought licenses. That doesn’t exempt you from defining the foundation; it’s the strongest argument for it. 

Governance that only covers what you build misses most of what you run. The Copilot seats, the vendor’s embedded AI, the SaaS tool that quietly added a model last quarter: all of it consumes your data, produces outputs your people act on, and costs your organization money, and almost none of it shows up on the same budget line item as the internal pilot.  

The register is how it gets there. The one door is how you see what it costs, the tokenomics. The test is your evaluation framework to find out whether the expensive bundle you renewed in January is moving you closer to your north star. 

This is the accountability answer for a company that has bought AI and can’t see the return. You don’t need to have built anything to need a foundation. You need one because you bought things. 

What it looks like when it’s done right 

One company we worked with, a manufacturer with operations across several regions, had systems of record that kept no history. Each month overwrote the last. That’s common, and it’s fatal for AI, because a model that can’t see yesterday can’t learn anything about tomorrow. 

The first thing the foundation did was remember. Before any forecast, before any agent, the team built a place where the business’s own history accumulated: what was ordered, what shipped, what the plan said versus what happened. Alongside that history came a connector into the main system of record, a way to test outputs against reality, a handful of reusable patterns for how AI intakes data and asks a human for approval, and a written record of every architectural decision and why it was made. 

None of those was the deliverable. The deliverable was a way for their users to interact with the data that was locked behind unavailable systems to the business unit. When the second use case came along, completely unrelated to this specific function, it needed almost none of that built again. When the business wanted to expand into another region, the only thing that changed was the connector. Each use case shipped faster than the last. That compounding of information is what the foundation is for, and it’s the same story we told in the second article about pilots that leave something behind. This is what “behind” looks like. 

Governance that doesn’t mean slow 

One more thing the foundation does, and it’s the one that makes the rest survivable: it lets you put the controls where the consequences are, instead of everywhere. 

Not every AI decision needs a human gate. An assistant that drafts an internal summary needs a basic check and nothing more. A model that changes a price, approves a stage in your workflow or touches a customer, needs an independent second opinion, ideally from a different system than the one that produced the answer, and a named person who signs off. The gates go at the high-consequence moments, not spread evenly across every step so that everything moves at the speed of the slowest approval. 

That’s what most AI governance gets wrong. It treats every use the same, which means either everything is slow or nothing is checked. Matching oversight to risk is the only approach that is sustainable, and you can only pull it off if the foundation exists. You need the register to know what’s running, the one door to see it and manage the costs, and the evaluation framework to judge its performance. 

The muscle to build 

If you intend to run many AI systems, whether you build them or buy them, the capability your organization needs to develop isn’t building more agents. Agents are getting easier to build. The capability you must develop to scale AI usage is the foundation: knowing what you’re running, knowing what it costs, knowing whether it works, and knowing who decides. Evaluation, governance, and the foundation they run on. 

That’s the muscle we’ve learned to prioritize before anything scales — it’s the difference between compounding every new AI effort and starting from zero each time. 

Questions to take back 

Request an AI Briefing

AI has already changed how your people work. Request an AI Briefing with Robots & Pencils to see exactly where your organization sits on the productivity paradox, and what to fix first, across the people, the organization, and the foundation.


About the Author

Brendan Flynn is SVP, Strategist at Robots & Pencils where he heads industry strategy within the Generative & Agentic AI Studio.


Key Takeaways

FAQs

What does it mean to own the foundation instead of the model?

AI models are becoming commodities as leading providers converge in capability, so switching between them is getting easier. What a company builds around the model, its business definitions, its governance, its way of testing outcomes, is the part that keeps its value no matter which model runs underneath it.

What are the five parts of an AI foundation?

A shared definition of core business terms, a single point every AI request goes through, a register of every AI tool with a named owner, a repeatable way to test whether a tool is working, and an approval process sized to the risk of what the tool touches.

Does a company need a foundation if it only buys AI tools and does not build any?

Yes. Governance that only covers tools a company builds misses most of what it actually runs, since most AI tools in a typical company are bought, not built. A foundation gives a company a way to see cost, usage, and performance across every tool, regardless of where it came from.

Does owning the foundation mean centralizing every AI decision?

No. The foundation centralizes standards, shared definitions, and the way tools are tested and tracked. Decisions about what to build, what to buy, and when it goes live in a specific business unit stay local to that unit.

What is the payoff of having a foundation in place?

A company with a foundation can add a new AI tool and know what it costs and whether it works within about two weeks. Without one, every new tool starts from zero and stays an island, disconnected from everything the company has already built.