The real economics of production AI, from metal to token
23
9:00 AM - 9:30 AM
After the honeymoon comes the hangover… and for enterprise AI, the cold light of day is hitting particularly hard.
If you’re a CIO sweating to balance the budget for AI initiatives across your business, this webinar is for you. We’ll share the real-world, no-nonsense insight that will help you turn red to green across your projects, covering:
- How to sweat your idle GPUs and free yourself from lead-time stress. We’ll cover multi-tenancy serving patterns and how to go from shelfware to live faster than ever.
- The fast path to freedom from frontier token costs. Local inference, open models and smart model routing can slash your frontier spend without compromising user experience (human or agent).
- The impact that tuning can have on token throughput on today’s best open models. We’ll share tips that delivered jaw-dropping improvements in time-to-first-token, throughput and concurrency on real-world infrastructure.
Scott Rosenberg (lead architect, CTO office, TeraSky) and Pedro Oliveira (principal AI architect, Spectro Cloud) have earned more than their share of AI infra war stories: Scott taking enterprise projects from proof of concept to production SLA through TeraSky's Applied AI Center, Pedro working hands-on with deployments ranging from the largest AI factories to single-node appliances.
Speakers
Pedro Oliveira
Principal AI Architect, Spectro Cloud
Scott Rosenberg
Lead Architect, CTO Office, TeraSky
23
9:00 AM - 9:30 AM