Developersummit
  • HOME
  • SPEAKERS
  • SESSIONS
  • SCHEDULE
  • FAQ
  • BUY TICKETS
  • ONDEMAND
  • CONTACT
saltmarch

GIDS news media, articles, insights and virtual events educate and illuminate its audiences so they can be fully prepared to deal with the new realities at work and in their professions.

Saltmarch On-Demand
Media

Our Experts

Videos On Demand

Insights

Call for Papers

Connect

About Us

Privacy Policy

Terms & Conditions

Contact Us

Subscribe to Developersummit

Get the latest event updates, and insights from today's leading voices.

© 2026-2027 Saltmarch. All rights reserved.

The Hidden Cost of AI Agents: Designing for Predictable Spend at Scale
RegisterTwitterLinkedInFacebook

< session />

The Hidden Cost of AI Agents: Designing for Predictable Spend at Scale

Tue, April 21 at 12:10 PM - 12:40 PM GMT+5:30DeepTech OpsTech Architecture

AI agents do not fail because they cannot reason. They fail because the cost of their behaviour is not designed upfront. What begins as a simple agentic workflow with a planner, tools, and retrieval quickly grows into a system of chained calls, recursive loops, repeated memory access, and cascading model invocations. Each step may appear inexpensive, but at scale the combined cost becomes significant. For enterprise systems, this unpredictability is a critical risk.

This session examines the unit economics of agentic AI systems in production. Drawing from real deployments, it identifies where costs accumulate, including orchestration overhead from uncontrolled reasoning loops, excessive tool calls due to poorly defined boundaries, context window growth from unmanaged memory, and escalation from multi-agent coordination. The session also presents practical approaches to address these challenges, including agent loop budgeting, tiered model routing for sub-tasks, caching strategies for tool outputs, and observability patterns that make spend predictable.

What You Will Learn

  • Where cost accumulates in agentic AI systems, including loops, tool calls, and memory usage
  • How to design agent workflows with budgeting, routing, and caching to control spend
  • How to apply observability patterns to make AI agent costs predictable at scale

Who Should Attend

  • Software developers building AI agent systems
  • AI and machine learning engineers
  • Platform and infrastructure engineers
  • Software architects
  • Engineering and technology leaders responsible for cost and scalability

< speaker_info />

About the speaker

Anannya Roy Chowdhury

Anannya Roy Chowdhury

Gen AI Developer Advocate & Architect, AWS

Anannya Roy is a Generative AI Architect and Developer Advocate at Amazon Web Services, where she builds production-grade LLM and agentic AI systems for enterprise use. With 8+ years of experience across software engineering, data science, and AI, she specializes in multi-agent architectures, RAG pipelines, and scalable AI systems.

She previously led award-winning GenAI platforms at Capgemini, delivering measurable impact across industries. Anannya is an active speaker and workshop leader, helping developers move from experimentation to production, with a strong focus on reliability, observability, and responsible AI.

Related Talks

Power and Perils of Vibe Coding

Tue, April 21

Power and Perils of Vibe Coding

Venkat Subramaniam
Enterprise Vibe Coding: Building Secure, AI-Powered Apps in 30 Minutes

Wed, April 22

Enterprise Vibe Coding: Building Secure, AI-Powered Apps in 30 Minutes

Parth Sharma
GraphRAG and Explainable AI: Building Trustworthy LLM Outputs

Thu, April 23

GraphRAG and Explainable AI: Building Trustworthy LLM Outputs

Rohit Bhardwaj

On-Demand Talks

Open Source, XPlat ML framework for .NET Developers

Open Source, XPlat ML framework for .NET Developers

Lohith GN
AI Powered Root Cause Analysis for Production Alerts

AI Powered Root Cause Analysis for Production Alerts

Deepa Elumalai
Leading Tech-powered Experiences at Walmart with GenAI

Leading Tech-powered Experiences at Walmart with GenAI

Rekha Joshi
From Reactive to Proactive: How AI is Redefining Resilience in Modern Networks

From Reactive to Proactive: How AI is Redefining Resilience in Modern Networks

Krishna Mohan Choudhary
Democratizing Access to GPUs for Faster ML/AI Innovation with Generative AI

Democratizing Access to GPUs for Faster ML/AI Innovation with Generative AI

Duncan Ng
Give Your LLMs a Left Brain

Give Your LLMs a Left Brain

Stephen Chin
All On-Demand »