Lou Kratz is Principal Research Engineer at BazaarVoice and Chaoyu Yang is Founder and CEO of BentoML.
This talk was originally delivered at “From Toy To Production: Building LLM-Powered Systems that Work in the Real World,” an event in New York City dedicated to scaling LLM-powered systems from experimental stages to real-world production environments.
