Why Innovation Is Hard for Most Organizations
Imagining something that has never been imagined is one of humanity’s rarest talents.
Yet the environments required for that kind of thinking are surprisingly fragile.
Even the most thoughtfully designed organizations face a powerful operational reality: the business must be run. Customers must be served, products delivered, systems maintained, and commitments honored. These responsibilities create a constant whirlwind of activity that exerts a relentless claim on the attention of leaders and teams alike.
Left unmanaged, that whirlwind gradually encroaches upon the space required for creative exploration.
Over time, most organizations become a kind of institutional palimpsest, layered with processes, priorities, and reporting rhythms that slowly crowd out the conditions required for discovery.
History offers a glimpse of how great innovators instinctively protect that space.
In the late nineteenth century, Thomas Edison built the world’s first film production studio—the Black Maria—next to his laboratories in West Orange, New Jersey. The structure itself was an extraordinary invention: a dark, tar-paper building with a retractable roof, mounted on a rotating platform so it could follow the sun throughout the day. In an era when motion pictures had not yet been imagined, Edison had already designed a studio to produce them.
Inside this unusual structure, Edison and his team conducted the experiments that eventually produced some of the earliest motion pictures, including the famous 1894 short Boxing Cats.
The architectural ingenuity of the Black Maria is fascinating. But its deeper significance lies in the space it created—a protected environment where experimentation could occur without the constant interruption of everyday demands.
Modern organizations face the same challenge.
Innovation rarely fails because people lack imagination. It fails because the conditions required for discovery are overwhelmed by the daily pressures of running the business.
What Makes an Innovation Factory Different from Other Factories
Protecting the conditions for discovery is only the first step. Organizations must also build a system that converts promising ideas into value.
That system is what I call the Innovation Factory.
At first glance, the name sounds paradoxical. Factories are usually associated with control, efficiency, and repeatable processes. Innovation, by contrast, is messy and unpredictable.
Yet the purpose of the Innovation Factory is not to constrain creativity within rigid procedural workflows. Its purpose is to create a structured environment in which ideas can evolve into commercially viable offerings.
The process unfolds through five stages:
- Generate Ideas
- Uncover Unmet Needs and Wants
- Discover Deeper Insights
- Develop Multiple Solutions
- Commercialize Innovation
Each stage moves an idea closer to becoming something customers genuinely value.
The system is designed around what I call the Principle of Unrestricted Progress. Rather than tightly managing every step, individuals and small autonomous teams are free to pursue ideas wherever they emerge within the system. The process defines objectives and guidelines but avoids prescribing exactly how teams must achieve them.
Ideas move forward not because they are pushed through bureaucracy, but because people are motivated to develop them.
This motivation is created through Reward Power, aligning individual curiosity with organizational success. And for the most strategically significant opportunities, organizations may deploy small specialized teams—what I call Delta Force innovation teams—to accelerate development and ensure that the most promising ideas reach the market.
The result is a structure that balances two forces that are usually in tension: the freedom required for creativity and the discipline required for commercial success.
The Problem with “Intelligent Failure”
Innovation requires experimentation. When organizations explore new ideas, not every attempt will succeed. This insight is often discussed through the concept of “intelligent failure,” popularized by Harvard Business School professor Amy Edmondson.
Edmondson’s work makes an important point: in uncertain environments, some experiments will not produce the desired result. Rather than punishing those outcomes, organizations should treat them as opportunities to learn.
The concept is sound.
The language, however, can be conceptually misleading.
When leaders repeatedly speak about embracing failure—even “intelligent” failure—they subtly center failure in the cultural narrative. The conversation begins to revolve disproportionately around what went wrong rather than what is being discovered.
This may seem like a semantic nuance, but language shapes culture, and culture shapes behavior.
Innovators are not pursuing failure. They are pursuing discovery.
Experiments sometimes produce results that do not validate the original hypothesis. But these outcomes still generate information that moves the organization closer to understanding what will work.
The objective of experimentation is not failure—it is progress.
Organizations that keep this distinction clear create a healthier environment for innovation: one where experimentation is encouraged, learning is valued, and the ultimate goal remains firmly focused on success.
Beyond Innovation: Turning Ideas into Commercial Success
Innovation is often romanticized as the moment of insight—the sudden breakthrough that produces a brilliant idea.
Reaching that moment is no small feat. Discovering something that has never been imagined requires creativity, curiosity, and perseverance.
But insight alone is not enough.
Ideas must be refined, tested, developed, and ultimately translated into offerings that customers value.
I once worked with a technology executive who understood this distinction clearly. The digital teams under his control were constantly uncovering valuable technological insights, but too many of them dissipated before reaching the market. To address this, the leadership team deliberately established an Innovation and Commercialization function responsible for ensuring that promising discoveries were translated into tangible strategic value.
Without that final step, innovation remains little more than imagination.
In some organizations, innovation quietly devolves into a kind of corporate sinecure—a collection of workshops, brainstorming sessions, and exploratory projects that generate enthusiasm but little strategic impact.
The difference between imagination and innovation is commercialization.
Organizations that master this transition gain a powerful competitive advantage. Those that do not are left with something far less valuable: a collection of interesting ideas that never change the market.
How Much Innovation Is the “Right” Amount?
A question I often hear from leaders is:
“How much should innovation cost?”
At first glance, this appears to be a perfectly reasonable question.
But it often reveals a more fundamental misunderstanding.
Cost is an input. Innovation is an outcome.
Organizations do not innovate for the sake of innovation. They innovate to create strategic advantage—to develop products, services, and experiences that competitors cannot easily replicate.
When innovation is viewed primarily through the lens of cost control, leaders risk constraining the very capability that could drive future growth.
A more coherent way to think about innovation is as a portfolio of value-based investments.
Within an Innovation Factory, ideas exist at many different stages of maturity. Some will fail. Some will produce modest returns. And occasionally, one will generate extraordinary value.
The true worth of the innovation capability lies in the collective probability of success across the entire portfolio of ideas.
Seen in this light, the real leadership question is not:
How much should innovation cost?
It is:
What level of investment is required to produce the future we want to create?
Keeping the Innovation Machine Running When Nobody Wants to Innovate
Innovation is easy to champion when times are good.
But the real test of an organization’s commitment to innovation arrives during more difficult moments.
When quarterly targets are under pressure, operational challenges begin to mount, or leaders become preoccupied with short-term execution, innovation is often the first capability to be quietly marginalized.
Exploration gives way to execution. Experiments are postponed. Resources are redirected to immediate priorities.
Over time, the innovation capability gradually atrophies. Exploration becomes sporadic, experimentation grows desultory, and the organization slowly loses the disciplined curiosity that once fueled its progress.
This is not because organizations suddenly lose their imagination. It is because the whirlwind of day-to-day operations gradually overwhelms the fragile conditions that allow innovation to flourish.
Sustaining innovation therefore requires deliberate leadership.
Leaders must protect the cultural and structural environment that enables discovery. They must maintain the incentives that motivate experimentation and continue investing in the systems that move ideas toward commercialization.
They must keep the Innovation Factory running—even when the organization is tempted to shut it down.
Organizations that master this discipline do more than produce ideas.
They design systems where discovery, development, and motivation flow together—continuously converting human ingenuity into competitive advantage.
0 Comments