SPECTRO CLOUD
Powered by
The real economics of production AI, from metal to token

The real economics of production AI, from metal to token

SEP

23

Wednesday, September 23

9:00 AM - 9:30 AM

Register

After the honeymoon comes the hangover… and for enterprise AI, the cold light of day is hitting particularly hard.

If you’re a CIO sweating to balance the budget for AI initiatives across your business, this webinar is for you. We’ll share the real-world, no-nonsense insight that will help you turn red to green across your projects, covering:

  • How to sweat your idle GPUs and free yourself from lead-time stress. We’ll cover multi-tenancy serving patterns and how to go from shelfware to live faster than ever.
  • The fast path to freedom from frontier token costs. Local inference, open models and smart model routing can slash your frontier spend without compromising user experience (human or agent).
  • The impact that tuning can have on token throughput on today’s best open models. We’ll share tips that delivered jaw-dropping improvements in time-to-first-token, throughput and concurrency on real-world infrastructure.

Scott Rosenberg (lead architect, CTO office, TeraSky) and Pedro Oliveira (principal AI architect, Spectro Cloud) have earned more than their share of AI infra war stories: Scott taking enterprise projects from proof of concept to production SLA through TeraSky's Applied AI Center, Pedro working hands-on with deployments ranging from the largest AI factories to single-node appliances.

Speakers

Pedro Oliveira

Pedro Oliveira

Principal AI Architect, Spectro Cloud

Scott Rosenberg

Scott Rosenberg

Lead Architect, CTO Office, TeraSky

SEP

23

Wednesday, September 23

9:00 AM - 9:30 AM

Register