Key Takeaways: Enterprise AI: Stop Piloting, Start Producing
Executive Summary
Enterprises are moving from AI pilots to production, but I see three consistent blockers: getting reliable access to diverse, legacy data, rethinking use cases for an agentic world instead of automating old workflows, and driving adoption so people trust and use AI in daily decisions. The discussion emphasizes that production success depends on a unified data foundation—secure ingestion (including streaming), open storage formats such as Apache Iceberg on Amazon S3, a strong semantic layer and data products that add business context, and end-to-end governance for access control, lineage, auditing, sovereignty, and quality. With that foundation, teams can reduce cost and improve performance by serving agents only the right data, choosing fit-for-purpose models, and avoiding excessive token usage—Qlik cited a 92% token reduction, fewer LLM calls, lower latency, and higher accuracy after improving data readiness. Finally, as humans are less “in the loop,” organizations need built-in failure handling, deterministic guardrails, confidence signals like data quality scores, and automated remediation workflows where agents can detect issues, trace root causes, and propose fixes under controlled governance.
Key Takeaways
1. Fix Data Access: I see 65–80% of enterprises exploring AI, but the fastest path from pilot to production is to fix data access first by making legacy systems, diverse data types, and permissions reliably available to AI.
2. Reimagine Agentic Processes: You’ll get better outcomes when you reimagine processes for an agentic world—rather than automating yesterday’s workflows—by testing, learning from failures, and iterating on use cases that change how work gets done.
3. Unified Data Foundation: I’d prioritize a unified data foundation—ingestion (streaming and batch), open storage (for example, Iceberg tables on Amazon S3), a semantic layer, and governance—so agents can use the right data with the right business context.
4. Open Distributed Catalogs: Open standards and a distributed catalog approach reduce lock-in and heavy replication, letting you mix engines and partners while keeping data fresh, interoperable, and ready for real-time and historical decisioning.
5. Governed Efficient Agents: When we connected Qlik to internal agents, we cut token consumption by 92% and halved LLM calls, showing that strong data products, semantics, and governance directly improve cost, latency, and accuracy while enabling automated guardrails, auditing, and remediation.
Key Quote
“Governance isn't a check box. It's it's actually completely an enabling part of the infrastructure.”
Blog: Three Barriers to Production AI—and How to Clear Them
Moving AI from pilots into day-to-day operations usually breaks down in three places: getting the right data to the right teams, designing use cases that hold up in production, and earning adoption inside the workflows that run the business. It’s easy to stand up a proof of concept with today’s models and tooling. It’s harder to make AI repeatable, governed, and accountable to business outcomes.
That challenge is getting sharper as more organizations shift from batch analytics to real-time decisioning. Streaming data is now practical fuel for production AI, which means you can act on events, transactions, and operational telemetry as they happen—not after the next refresh cycle. The goal isn’t to “add AI” or “stream everything.” It’s to make AI reliably useful where revenue, cost, risk, and customer experience decisions actually get made.
Three Barriers to Production AI: Data, Workflow, and Adoption
The first blocker is foundational: getting the right data into the right AI experience, with the right controls. Most organizations run a mix of legacy systems, systems of record, warehouses, lakes, and unstructured content, layered with years of complexity across catalogs, pipelines, and access policies. It’s easy to point a large language model (LLM) at that environment and expect quick value, then hit inconsistent definitions, missing context, and security constraints. In production, security stays job one. You need role-based and row-level access that still holds when an agent dynamically retrieves information. You also need a semantic layer that converts raw fields into business meaning, so models can reason in the same language your business uses for customers, products, orders, risk, and performance.
The second blocker is strategic: teams often automate yesterday’s process instead of redesigning it for an agentic world. AI can speed up existing tasks, yet the bigger gains show up when you rebuild workflows around what agents do well—finding relevant context, summarizing, proposing actions, and escalating exceptions—while keeping people in the loop for judgment, approvals, and accountability. That redesign takes experimentation, and experimentation needs permission to learn. Organizations that treat pilots as disposable prototypes tend to stall. Organizations that run pilots as structured learning loops—hypothesis, test, measure, refine—move faster into production. I anchor every use case to a business outcome, then work backward to define the data, controls, and user experience required to deliver it.
The third blocker is operational: adoption and economics. Even strong AI capabilities won’t land if people don’t trust them, understand them, or see how they fit into daily work. Production success depends on change management, clear guardrails, and an experience that feels like a superpower, not another tool to babysit. Cost and performance shape adoption, too. If an agent keeps pulling massive context into prompts, token usage spikes, latency climbs, and accuracy can drop. Strong data products and semantics cut unnecessary LLM calls, reduce token consumption, and improve response quality—often by orders of magnitude, not single-digit percentages. That’s also where model selection becomes practical: you can pair lighter-weight, faster models with well-curated data products instead of defaulting to the most expensive frontier model for every task.
Modern Data Foundation and Governance for AI
To keep this scalable, I build a modern, distributed data posture on open standards and a unified foundation that supports structured and unstructured data. Open table formats like Apache Iceberg separate compute from storage, reduce lock-in, and make interoperability practical across engines and platforms in a multi-cloud environment. That flexibility matters because production AI rarely lives in one place: you may ingest batch and streaming data, store it in open tables, enrich it into governed data products, and expose it through a semantic layer and catalog that agents can use.
I design the foundation for both flexibility and control. I start with ingestion and storage that handle diverse data types and keep portability across tools and clouds. I add a semantic layer so people and systems interpret metrics consistently, even when sources differ. I treat governance as a first-class capability from day one: identity and access management, auditing, lineage, data quality, anonymization, and data sovereignty. When these capabilities work as one connected system, you stop re-solving the same problems in every dashboard, app, or workflow, and you deliver trusted data products teams can reuse.
Governance is where AI initiatives either accelerate or stall, so I align it to your strategic goals—speed without losing control, autonomy without risk, and scale without chaos. I make access policies travel with the data instead of living inside a single tool. I capture lineage automatically so you can explain where a number came from, how it changed, and who interacted with it. I surface quality scoring at the point of use so consumers understand confidence, freshness, and known limitations. Done well, this enables safe self-service for people and safe autonomy for AI, and it keeps the blast radius low enough for agents to operate broadly.
I also plan for the operational shift that happens when humans are not consistently in the loop. In the dashboard era, an analyst could spot issues, question results, and raise a ticket. In an agent-driven world, systems need to anticipate failure conditions and unknown unknowns. I design agents to detect stale inputs, broken pipelines, and low-confidence outputs, then respond predictably—trigger human review, route to a remediation agent, or fall back to a deterministic method. I add guardrails that reduce randomness where it matters: deterministic checks, programmatic validation, and reasoning paths that test whether an answer is plausible given the data and the rules. I also require audit trails and logs that make every decision explainable, reviewable, and improvable.
Production AI is less about the model and more about the system around it—data, semantics, governance, economics, and people. When you align these pieces, you move from impressive pilots to durable capabilities that drive faster decisions, reduce operational friction, and increase confidence in outcomes.
I’d treat the next step as a production-readiness plan: strengthen the data foundation, formalize data products and semantics, design agent-ready workflows with humans in the loop, and build multidisciplinary teams that bring together AI, data, security, and business expertise.
As AI scales, data operations should run like modern software operations: diagnose, isolate, remediate, and learn. Agents can help by reading logs, tracing lineage, comparing changes over time, and pinpointing where a transformation, key, schema, or upstream feed introduced an issue. With open standards and time-travel-friendly storage patterns, you can reproduce historical states, sandbox fixes, validate outcomes, and promote changes with confidence. This creates a reinforcing loop where strong governance enables broader use, broader use surfaces edge cases, and those edge cases drive continuous improvements in both data products and the agents that rely on them—turning AI into a dependable part of how you run the business.