How Modelbit Runs a Two Tiered LLM System in Production

Harry Glaser, Co-Founder and CEO at modelbit, presents lessons from using closed-source APIs and self-hosted LLMs in a two-tiered system for best cost and best performance. This talk was originally delivered at Arize:Observe 2024 at Shack 15 in San Francisco on July 11, 2024. Sign up for Paper Readings: https://arize.com/resource/community-papers-reading/ Check out Upcoming Arize AI Events: https://arize.com/events/

Harry Glaser

Modelbit

Harry is the co-founder and CEO of Modelbit, the scalable platform for ML Engineering teams. Previously he was co-founder and CEO of Periscope Data, which was acquired by Sisense in 2019. He has a BS in Computer Science from the University of Rochester.

Subscribe to our resources and blogs

Subscribe