HeadlinesBriefing favicon HeadlinesBriefing.com

Building Enterprise Agentic AI Environments

MIT Technology Review •
×

For the enterprise, agentic AI promises software agents that execute business tasks end-to-end across people, workflows, data, and systems—not merely better chatbots. Intel performed thousands of agentic AI workload experiments, revealing five practical lessons: agentic AI is a larger systems problem, not just inference; existing harnesses are limited; capacity planning uses agents per v CPU density; monitor task latency, not average CPU utilization; and default to scale-out for agent-hosting systems.

Enterprise agents are goal-driven automated workflow processes that plan, call tools, read results, and retry on failure. Platform teams need six metrics: task success rate, cost per task, time per task, throughput, agent density (agents per v CPU), and latency. To measure these, Intel extended Terminal-Bench with profiling, telemetry, and deterministic record-replay of LLM responses across diverse tasks including compilation, database operations, and machine learning training.

Deploying agentic AI requires three phases. First, plan by agent density—normalize agent count by compute; 10 agents on 8 v CPUs behaves like 20 on 16 v CPUs. Second, adopt new observability: average CPU utilization is weak; P95 latency better signals workflow queues. Third, scale out by default—adding systems increases capacity while preserving density ratios; scale up only for heavier per-agent compute or architectural constraints.

Organizations achieving production results wrap automation around codified workflows: code creation, regression testing, ticket triaging, market analysis, and security review. Success depends on reliable environments where agents support business workflows, improve productivity, enforce governance, and scale confidently from pilots to production.