Key Takeaways: Enterprise AI: Stop Piloting, Start Producing

Executive Summary

Enterprises are moving from AI pilots to production, but I see three consistent blockers: getting reliable access to diverse, legacy data, rethinking use cases for an agentic world instead of automating old workflows, and driving adoption so people trust and use AI in daily decisions. The discussion emphasizes that production success depends on a unified data foundation—secure ingestion (including streaming), open storage formats such as Apache Iceberg on Amazon S3, a strong semantic layer and data products that add business context, and end-to-end governance for access control, lineage, auditing, sovereignty, and quality. With that foundation, teams can reduce cost and improve performance by serving agents only the right data, choosing fit-for-purpose models, and avoiding excessive token usage—Qlik cited a 92% token reduction, fewer LLM calls, lower latency, and higher accuracy after improving data readiness. Finally, as humans are less “in the loop,” organizations need built-in failure handling, deterministic guardrails, confidence signals like data quality scores, and automated remediation workflows where agents can detect issues, trace root causes, and propose fixes under controlled governance.

Key Takeaways

1. Fix Data Access: I see 65–80% of enterprises exploring AI, but the fastest path from pilot to production is to fix data access first by making legacy systems, diverse data types, and permissions reliably available to AI.

2. Reimagine Agentic Processes: You’ll get better outcomes when you reimagine processes for an agentic world—rather than automating yesterday’s workflows—by testing, learning from failures, and iterating on use cases that change how work gets done.

3. Unified Data Foundation: I’d prioritize a unified data foundation—ingestion (streaming and batch), open storage (for example, Iceberg tables on Amazon S3), a semantic layer, and governance—so agents can use the right data with the right business context.

4. Open Distributed Catalogs: Open standards and a distributed catalog approach reduce lock-in and heavy replication, letting you mix engines and partners while keeping data fresh, interoperable, and ready for real-time and historical decisioning.

5. Governed Efficient Agents: When we connected Qlik to internal agents, we cut token consumption by 92% and halved LLM calls, showing that strong data products, semantics, and governance directly improve cost, latency, and accuracy while enabling automated guardrails, auditing, and remediation.

Key Quote

“Governance isn't a check box. It's it's actually completely an enabling part of the infrastructure.”

FAQs: Enterprise AI: Stop Piloting, Start Producing

Frequently Asked Questions

Enterprise AI: Stop Piloting, Start Producing

Moving AI from pilot to production

FAQ

What’s stopping most organizations from moving AI from pilots into production?

I see three blockers come up again and again: (1) data access and readiness—teams rush into AI tools, then realize their legacy systems, systems of record, and diverse data types aren’t easy to reach or use safely; (2) use-case redesign—many teams try to bolt AI onto old workflows instead of reimagining processes for an agentic world; and (3) adoption—AI only drives productivity when people trust it, use it, and know how it fits into their day-to-day decisions.

FAQ

Why do AI pilots often look successful, but production rollouts struggle?

In pilots, people watch everything closely, fix issues manually, and fill gaps with human judgment. In production, you hit “unknown unknowns,” like broken pipelines, stale data, or low-confidence outputs. To succeed, I design for failure conditions up front—clear guardrails, monitoring, auditability, and defined escalation paths to a human review or another agent when confidence drops.

FAQ

What does it mean to be “embracing AI” but not yet “AI-driven” as a business?

It means AI is present in projects and conversations, but it isn’t reliably embedded into core business processes with the right data access, governance, and adoption. I see many enterprises exploring AI (often cited in the 65–80% range), yet they haven’t built the foundation that lets AI consistently drive decisions, workflows, and measurable outcomes.

Data foundation: the prerequisite for production AI

FAQ

Why is data access still the first major hurdle for production AI?

Because enterprise data is spread across older warehouses, catalogs, and multiple engines, often built 5–10+ years ago. Even if it sounds simple to “point an LLM at the data,” I still need secure, governed, and reliable access across structured and unstructured sources. Without that, AI systems either can’t reach the right data or they reach it in ways that aren’t safe or scalable.

FAQ

What capabilities should a production-ready data foundation provide for AI agents?

I look for four essentials: (1) strong security and access control (including role-level and row-level controls); (2) a semantic layer that adds business context so models can reason accurately; (3) a catalog that’s accessible to agents, not just humans; and (4) interoperability via open standards so data can move across engines and tools without getting locked in.

FAQ

Why does a semantic layer matter so much for AI accuracy and efficiency?

Models perform best when they get data plus business meaning. I use a semantic layer to translate raw fields into business concepts, definitions, and relationships. That reduces ambiguity, improves answer quality, and avoids wasting tokens on irrelevant context.

FAQ

How do data products help make AI more reliable and cost-effective?

I use data products to serve “the exact right data” for a specific purpose, with governance and context built in. Instead of dumping huge volumes into a model context window, I expose curated, relevant slices that are easier to secure, easier to audit, and cheaper to use. Action item: start by defining 1–2 high-value data products (for example, revenue and pipeline), then standardize ownership, quality checks, and access policies.

Open standards and distributed architectures

FAQ

Why are open standards becoming central to AI and analytics strategies?

Open standards help data “escape” proprietary formats and reduce lock-in to a single engine. I get more portability across structured and unstructured data, better separation of compute and storage, and easier interoperability across tools. That flexibility becomes a practical requirement when multiple AI agents and analytics experiences need governed access to the same data.

FAQ

Are organizations still aiming for a single, monolithic data catalog approach?

Less and less. I’m seeing a shift from the older, monolithic catalog model to a more distributed approach that’s richer and more interoperable. The goal is to make data discoverable and usable across engines and platforms, while keeping governance consistent.

FAQ

How does a distributed approach reduce data replication and freshness issues?

When data formats and access patterns are interoperable, I don’t need to create massive copies just to serve different tools. That reduces duplication, lowers cost, and helps keep answers consistent because agents and analytics can query governed data closer to where it lives.

Cost, performance, and model strategy

FAQ

How can improving the data layer reduce AI costs and latency?

When I serve agents curated, relevant data (with context), I reduce unnecessary token usage and repeated calls to the model. In the webinar, Qlik shared an internal example where connecting the right data layer led to a 92% reduction in token consumption, about half as many LLM calls, lower latency, and higher accuracy. The takeaway is simple: better data packaging drives step-function improvements, not just incremental gains.

FAQ

How should teams think about choosing models for different AI tasks?

I match the model to the job and the data. With a strong data foundation, I can often use lighter-weight, faster, less expensive models for many agent workflows instead of defaulting to the largest frontier model. Action item: define a model selection policy that considers cost, latency, and accuracy, then test it against your highest-volume agent tasks.

FAQ

What trade-offs do teams face between retrieval-augmented generation (RAG) and fine-tuning?

I see teams balancing maintainability and performance. RAG can be powerful for search and grounding, but indexing and embeddings can be harder to maintain over time. Fine-tuning can improve inherent understanding, but it depends on having clean, well-governed data and clear objectives. The key point from the discussion is that you can’t make good trade-offs without a solid data foundation.

Streaming data and keeping AI aligned with the business

FAQ

Why is streaming data becoming more relevant for AI agents now?

Earlier AI patterns didn’t always mesh well with streaming modalities, but models have become more capable. Now I can combine streaming and non-streaming data to give agents a more up-to-date view of the business—useful in areas like ad tech, manufacturing, and IoT. The practical goal is to plug agents into the pulse of the business, not yesterday’s snapshot.

FAQ

What’s the recommended approach to ingestion and storage for AI-ready data?

The webinar framed it as a “four-layer cake”: ingestion (streaming and non-streaming), storage (in open, interoperable formats), a semantic layer (business meaning), and a governance layer (controls and auditability). Action item: map your current architecture to these four layers, then identify the weakest layer that’s blocking production AI.

Governance, security, and trust

FAQ

Why is governance an enabler for AI autonomy, not a constraint?

Because no enterprise will let agents operate at scale without confidence that access is controlled, actions are auditable, and sensitive data is protected. I treat governance as the mechanism that makes autonomy possible—policies that move with the data, lineage, quality scoring, audit trails, and sandboxing where needed.

FAQ

What governance capabilities matter most when agents access enterprise data?

I focus on identity and access management, auditing and logs, data quality signals, anonymization, and data sovereignty. I also want policies that aren’t trapped inside one tool, so access rules and controls remain consistent across dashboards, users, and agents.

FAQ

How do you handle data quality when humans aren’t always in the loop?

I build explicit failure handling into the agent workflow. If data is stale, broken, or low-confidence, the agent should trigger a human review or route to another agent designed to remediate. I also surface data quality scores as context so users and systems can judge trustworthiness. Action item: define thresholds (for example, “below X quality score requires review”) and bake them into agent decision logic.

FAQ

How do you prevent confusion when agents return different answers at different times?

I make time and freshness explicit. Two answers can both be correct if the underlying data changed between runs. In the past, a human would explain that a batch ran at 09:00. In production AI, I want agents to understand and communicate that context, and I want deterministic checks where possible to validate outputs.

Operating model: teams, adoption, and continuous improvement

FAQ

What kind of team structure works best for building production AI agents?

I don’t see this succeeding in silos anymore. The effective pattern is a multidisciplinary team: AI practitioners (including prompt and context engineering), data and analytics experts, security and governance experts, and business domain experts. That mix helps you build agents that are useful, safe, and aligned to real business workflows.

FAQ

How do organizations create a feedback loop to improve agents and data products over time?

I treat production as a learning system. I log and audit agent behavior, capture failure states, and feed those insights back into both the agent development lifecycle and the data product roadmap. Over time, that creates a virtuous cycle where governance, quality, and reliability compound.

FAQ

How can AI help remediate data issues instead of just reporting them?

I can use agents to diagnose issues by reading logs, tracing changes, and explaining what broke and why. The webinar discussed a path toward auto-remediation where an agent can propose a fix, or even create a pull request for a data engineer to review. Action item: start with “assistive remediation” (diagnose and propose), then graduate to controlled automation once governance and testing are mature.

Blog: Three Barriers to Production AI—and How to Clear Them

Moving AI from pilots into day-to-day operations usually breaks down in three places: getting the right data to the right teams, designing use cases that hold up in production, and earning adoption inside the workflows that run the business. It’s easy to stand up a proof of concept with today’s models and tooling. It’s harder to make AI repeatable, governed, and accountable to business outcomes.

That challenge is getting sharper as more organizations shift from batch analytics to real-time decisioning. Streaming data is now practical fuel for production AI, which means you can act on events, transactions, and operational telemetry as they happen—not after the next refresh cycle. The goal isn’t to “add AI” or “stream everything.” It’s to make AI reliably useful where revenue, cost, risk, and customer experience decisions actually get made.

Three Barriers to Production AI: Data, Workflow, and Adoption

The first blocker is foundational: getting the right data into the right AI experience, with the right controls. Most organizations run a mix of legacy systems, systems of record, warehouses, lakes, and unstructured content, layered with years of complexity across catalogs, pipelines, and access policies. It’s easy to point a large language model (LLM) at that environment and expect quick value, then hit inconsistent definitions, missing context, and security constraints. In production, security stays job one. You need role-based and row-level access that still holds when an agent dynamically retrieves information. You also need a semantic layer that converts raw fields into business meaning, so models can reason in the same language your business uses for customers, products, orders, risk, and performance.

The second blocker is strategic: teams often automate yesterday’s process instead of redesigning it for an agentic world. AI can speed up existing tasks, yet the bigger gains show up when you rebuild workflows around what agents do well—finding relevant context, summarizing, proposing actions, and escalating exceptions—while keeping people in the loop for judgment, approvals, and accountability. That redesign takes experimentation, and experimentation needs permission to learn. Organizations that treat pilots as disposable prototypes tend to stall. Organizations that run pilots as structured learning loops—hypothesis, test, measure, refine—move faster into production. I anchor every use case to a business outcome, then work backward to define the data, controls, and user experience required to deliver it.

The third blocker is operational: adoption and economics. Even strong AI capabilities won’t land if people don’t trust them, understand them, or see how they fit into daily work. Production success depends on change management, clear guardrails, and an experience that feels like a superpower, not another tool to babysit. Cost and performance shape adoption, too. If an agent keeps pulling massive context into prompts, token usage spikes, latency climbs, and accuracy can drop. Strong data products and semantics cut unnecessary LLM calls, reduce token consumption, and improve response quality—often by orders of magnitude, not single-digit percentages. That’s also where model selection becomes practical: you can pair lighter-weight, faster models with well-curated data products instead of defaulting to the most expensive frontier model for every task.

Modern Data Foundation and Governance for AI

To keep this scalable, I build a modern, distributed data posture on open standards and a unified foundation that supports structured and unstructured data. Open table formats like Apache Iceberg separate compute from storage, reduce lock-in, and make interoperability practical across engines and platforms in a multi-cloud environment. That flexibility matters because production AI rarely lives in one place: you may ingest batch and streaming data, store it in open tables, enrich it into governed data products, and expose it through a semantic layer and catalog that agents can use.

I design the foundation for both flexibility and control. I start with ingestion and storage that handle diverse data types and keep portability across tools and clouds. I add a semantic layer so people and systems interpret metrics consistently, even when sources differ. I treat governance as a first-class capability from day one: identity and access management, auditing, lineage, data quality, anonymization, and data sovereignty. When these capabilities work as one connected system, you stop re-solving the same problems in every dashboard, app, or workflow, and you deliver trusted data products teams can reuse.

Governance is where AI initiatives either accelerate or stall, so I align it to your strategic goals—speed without losing control, autonomy without risk, and scale without chaos. I make access policies travel with the data instead of living inside a single tool. I capture lineage automatically so you can explain where a number came from, how it changed, and who interacted with it. I surface quality scoring at the point of use so consumers understand confidence, freshness, and known limitations. Done well, this enables safe self-service for people and safe autonomy for AI, and it keeps the blast radius low enough for agents to operate broadly.

I also plan for the operational shift that happens when humans are not consistently in the loop. In the dashboard era, an analyst could spot issues, question results, and raise a ticket. In an agent-driven world, systems need to anticipate failure conditions and unknown unknowns. I design agents to detect stale inputs, broken pipelines, and low-confidence outputs, then respond predictably—trigger human review, route to a remediation agent, or fall back to a deterministic method. I add guardrails that reduce randomness where it matters: deterministic checks, programmatic validation, and reasoning paths that test whether an answer is plausible given the data and the rules. I also require audit trails and logs that make every decision explainable, reviewable, and improvable.

Production AI is less about the model and more about the system around it—data, semantics, governance, economics, and people. When you align these pieces, you move from impressive pilots to durable capabilities that drive faster decisions, reduce operational friction, and increase confidence in outcomes.

I’d treat the next step as a production-readiness plan: strengthen the data foundation, formalize data products and semantics, design agent-ready workflows with humans in the loop, and build multidisciplinary teams that bring together AI, data, security, and business expertise.

As AI scales, data operations should run like modern software operations: diagnose, isolate, remediate, and learn. Agents can help by reading logs, tracing lineage, comparing changes over time, and pinpointing where a transformation, key, schema, or upstream feed introduced an issue. With open standards and time-travel-friendly storage patterns, you can reproduce historical states, sandbox fixes, validate outcomes, and promote changes with confidence. This creates a reinforcing loop where strong governance enables broader use, broader use surfaces edge cases, and those edge cases drive continuous improvements in both data products and the agents that rely on them—turning AI into a dependable part of how you run the business.